MongoDB Atlas Support

[ranfysvalle02]

MongoDB support for LinkStorage also opens up more possibilities since MongoDB Atlas now supports $vectorSearch!

MongoDB Atlas has native vector storage and search capabilities embedded in an operational database. Combine vector search with other query capabilities available in MongoDB for defining advanced filters on vector queries. It provides the functional capabilities and the scalability, reliability, and security features in a multi-cloud platform to address the needs of GenAI-powered applications - like big-AGI.

[vercel]

The latest updates on your projects. Learn more about Vercel for Git ↗︎

Name	Status	Preview	Updated (UTC)
big-agi	✅ Ready (Inspect)	Visit Preview	Feb 5, 2024 3:43pm

[enricoros]

Thank you, this is pretty good. From a first review one issue seems to be that Mongo replaces Postgres inside the prisma.schema.
This will invalidate all the existing installations with a DB. Any solutions for that?

[ranfysvalle02]

prisma.schema can stay postgres; this can be an optional solution for anyone just doing MongoDB. Perhaps we move the changes from prisma.schema to the readme and leave prisma.schema as is? What do you think?

[ranfysvalle02]

@enricoros - I updated the repo/pull-request.... Let me know what you think, happy to change whatever needs changing... I think MongoDB Atlas will open up a whole new world of possibilities (optional of course) for big-AGI :)

[enricoros]

Looks great to me! @ranfysvalle02
Would you be open to create a docs/config-database.md with the same simple instructions, and then have the environment me linking to it?

Of course you can use big-AGI and just drag an example md file, the current env file, and ask to generate a short config-database.md with the instructions for mongo :)

I'll merge even more happily, also because I got contacted from Prisma and I'm in the trial for the edge version (will be faster and better and more docs may come around DBs :)

[ranfysvalle02]

Will get those changes in today 👌

[ranfysvalle02]

Updated the docs -- also included why I highly recommend MongoDB Atlas versus Postgres. There are some really cool 'data platform' capabilities that can enable big-AGI in some interesting ways! HTTPS endpoints, Triggers, vector search, data federation (which let's you query non-MongoDB data sources through the MongoDB query API!) and much more! Let me know what you think -- happy to make any modifications needed.

[enricoros]

Stunning job, this is really good and needed. Big-AGI has a very large amount of custom deployments and docs are important to them.

Great quality submission - merging right away!