[Demo] Sample for official OpenAI library integration (via custom transport) #360
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
This PR is a non-exhaustive demonstration of using a custom pipeline transport (concept from
System.ClientModel) to facilitate with the official OpenAI library from https://github.com/openai/openai-dotnet. It's not intended to merge as-is, but rather provide a reference for official client integration options and approaches.Only non-streaming is initially implemented -- but streaming shouldn't be too different, especially with impl sources available.
Program.csis an adaptedHelloFoundryLocalSdk, but uses the includedFoundryLocalChatClientfor use of theOpenAI.Note
Integrated into Foundry Local, client retrieval wouldn't require the new public type, as something like the following would "just work" to provide a client:
The guts of the derived client lie in the
FoundryLocalPipelineTransportand its nested classes. This transport replaces standard HTTP traffic behavior with use of Foundry Local CoreInterop, instead, stubbing substantial portions of functionality that aren't applicable to the scenario.As not all CoreInterop capabilities have external visibility, this use relies on Reflection via an encapsulated
FoundryLocaInteropWrappertype at the end of the custom transport's nested classes.