Is it possible to run foundy in Docker? For example in CI?

[chaliy]

Is there any plans to enable foundy in Docker? Probably need to support ubunta base docker images.

[3GDXC]

adding support for docker would be great; and IMHO would not only provide isolation from the host os for developers but also as a side would allow .NET ASPIRE support and thus reduce fricsion for distributed applications.

[samuel100]

Thanks @chaliy and @3GDXC - we have some internal builds of Linux but it needs to go through validation and testing. I'll update you when we have these released.

[The3G]

@samuel100 I'm wondering if any progress has been made in this area? I'd love to help out with regards to testing the image configuration; especally given my current work which includes using ollama and qdrant to enrich and search pdf documents.

[3GDXC]

@samuel100 thanks for the information; I'm at present looking into creating Aspire.Hosting.FoundryClient that has a extension of .UseLocal( ) just thinking aloud and playing with the concepts; but feel that Aspire support for Azure AI Foundry and Foundry Local would add great value.

[natke]

@chaliy @3GDXC Can you describe your scenario in a little more detail? We do have some initial support in Aspire and will share more details. Are you primarily looking for support in docker so that you can do O/S independent development? Or are you looking to deploy applications using docker containers? Or both

[3GDXC]

The idea is that docker container support would allow not only local development plus local ASPIRE support and O/S independent isolation features; but also allow the ASPIRE PublishingDeployment story to ASPIRE supported hosting platforms with minimal effort/changes; like SqlServer, Redis or RabbitMQ for example.

[agoncal]

CI is one scenario, but testing is also an interesting one. In Java we heavily use TestContainers to automatically download and start a container before doing some tests. Ollama has its own Testcontainer module making it a great fit for doing AI related tests. If Foundry Local had a Docker image, we could easily create a Testcontainer module to ease AI testing in Java

[joshua-mo-143]

Hi, I'm also interested in Linux support. Or at the very least, Docker support.

I am the maintainer of rig which is the currently leading AI Agent framework in Rust. We're trying to add foundry-local as an integration but I can't merge the PR because I can't actually test it to see that it works, and the person who submitted the PR has an extremely weak laptop so they are also unable to test it.

[justinyoo]

In addition to that, if we use DevContainer environment like GitHub Codespaces, running Foundry Local in a container or at least Linux environment would be great.