Skip to content

Conversation

@zyzniewski-reef
Copy link
Contributor

Description of the Change

Looks like FastAPIThreadedServer.start is launching 2 threads to start FastAPI/uvicorn server with no real reason.

Quantitative Performance Benefits

No performance tests were run - it's a simple design change.

Possible Drawbacks

None?

Verification Process

Created unittest. Ran Axon and checked FastAPI is listening in accepting requests.

Release Notes

  • Improve Axon's resource management

@zyzniewski-reef zyzniewski-reef force-pushed the perf/creating_fastapi_server branch 2 times, most recently from 4727724 to bc49250 Compare January 21, 2025 13:07
Copy link
Contributor

@thewhaleking thewhaleking left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a great catch!

@thewhaleking thewhaleking merged commit 1b6c0e8 into opentensor:staging Jan 21, 2025
28 checks passed
This was referenced Feb 12, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants