Periodically capture resource metrics for every sandbox

[0div]

Description

Periodically call a envd's /metrics endpoint from orchestrator to get basic resource usage metrics. Calls it on start, on 5s interval and on end of Sandbox lifecycle

• add logging methods for CPU percentage and Memory MB
• bump envd version and check that version is gte this version to call this new endpoint
• replace time.After in check loop with time.Ticker to avoid allocating a new time on every iteration

Test

Let's test this manually for now

✨

Description by Callstackai

This PR introduces a new feature to periodically capture resource metrics for every sandbox by calling the /metrics endpoint of envd. It includes new types for metrics, updates to the API, and logging enhancements.

Diagrams of code changes

sequenceDiagram
    participant Client
    participant API
    participant Sandbox
    participant Loki
    participant EnvD

    Client->>API: GET /sandboxes/{sandboxID}/metrics
    
    API->>Loki: Query metrics for sandboxID
    Loki-->>API: Return metrics data
    
    alt Metrics Found
        API->>API: Parse metrics data
        API->>API: Transform to SandboxMetric objects
        API-->>Client: Return SandboxMetrics response
    else No Metrics
        API-->>Client: Return 404 error
    end

    loop Every 5 seconds
        Sandbox->>EnvD: GET /metrics
        EnvD-->>Sandbox: Return CPU & Memory metrics
        Sandbox->>Loki: Log metrics data
    end

Loading

Files Changed

File	Summary
packages/api/internal/api/api.gen.go	Added a new API endpoint for fetching sandbox metrics.
packages/api/internal/api/spec.gen.go	Updated Swagger specification to include the new metrics endpoint.
packages/api/internal/api/types.gen.go	Defined new types for sandbox metrics.
packages/api/internal/handlers/sanbox_metrics.go	Implemented the handler for fetching sandbox metrics from Loki.
packages/docker-reverse-proxy/main.tf	Specified the platform for the Docker image.
packages/envd/internal/host/metrics.go	Updated metrics structure to include memory in MiB.
packages/envd/main.go	Bumped the version of envd.
packages/orchestrator/internal/sandbox/checks.go	Replaced time.After with time.Ticker for periodic metric logging.
packages/orchestrator/internal/sandbox/metrics.go	Defined the structure for sandbox metrics.
packages/orchestrator/internal/sandbox/sandbox.go	Updated sandbox initialization to check envd version.
packages/orchestrator/internal/server/sandboxes.go	Added logging of metrics before stopping the sandbox.
packages/shared/pkg/logs/logger.go	Updated logger to handle new metrics logging.
spec/openapi.yml	Updated OpenAPI specification to include new metrics schema.

This PR includes files in programming languages that we currently do not support. We have not reviewed files with the extensions .go, .tf, .yml. See list of supported languages.

[linear]

E2B-1024 Periodically capture resource metrics for every sandbox

[callstackai]

Key Issues

Reducing the HTTP client timeout to 1 second may lead to frequent timeouts in network-dependent functions, potentially affecting reliability under network latency or high load conditions.

[jakubno]

Can we also remove the old method for getting metrics (stats)?

[0div]

Can we also remove the old method for getting metrics (stats)?

Ok, i was thinking maybe we could compare side by side but if you're confident that it won't be useful, ill remove it.

[jakubno]

Can we also remove the old method for getting metrics (stats)?

Ok, i was thinking maybe we could compare side by side but if you're confident that it won't be useful, ill remove it.

It should be basically the same and the new ones are shinny and better

[callstackai]

Key Issues

The internal variable memoryMB still uses the old name and potentially wrong unit, which can lead to incorrect calculations when compared with l.memoryMiBMax due to the difference between MiB and MB units.

[jakubno]

as discussed in RPC, add total CPU 🙏🏻

[jakubno]

I changed the base branch to dev we want to merge to this branch, could you please solve merge conflicts 🙏