Skip to content

Enable Non-TEE GPU Inference #12

@jcabrero

Description

@jcabrero

This task aims to create an environment within AWS / GCP where we have access to a GPU other than an H100 while giving CPU TEE security guarantees. This aims to prove that such an extended environment is not required for reduced inference times.

Metadata

Metadata

Assignees

Labels

No labels
No labels

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions