Workload Utilization Metrics

Draft

Motivation

Tenants/ users of Akash expect to be able to see what amount of allocated resources are being used by their workloads so that they can better manage peak load and also optimize cost/ spend

Summary

This AEP will likely require building the necessary contructs (metrics server/ agent) for collecting utilization metrics from the tenant containers and reporting them through an API that can be quried and graphed for display in clients like Console. The metrics collected initially will likely be GPU (VRAM), CPU, Memeory and Storage.

Estimated completion: 6/30/2025

Created: 12/1/2024

Last Updated: 1/11/2024

Category: Interface

Status: Draft

Experience the Supercloud.