vault backup: 2024-11-19 - 1 files

Affected files:
Monthly Notes/Nov 2024 notes.md

Monthly Notes/Nov 2024 notes.md

@@ -0,0 +1,18 @@
+
+
+## releases
+
+- [voyage-multimodal-3: all-in-one embedding model for interleaved text, images, and screenshots](https://blog.voyageai.com/2024/11/12/voyage-multimodal-3/)
+	- API-only model. No thanks but congrats anyway. 
+
+## discussions
+
+- hitting a wall
+	- https://www.bloomberg.com/news/articles/2024-11-13/openai-google-and-anthropic-are-struggling-to-build-more-advanced-ai
+		- https://archive.ph/2024.11.13-100709/https://www.bloomberg.com/news/articles/2024-11-13/openai-google-and-anthropic-are-struggling-to-build-more-advanced-ai#selection-1659.235-1663.17
+		- Orion fell short when trying to answer coding questions that it hadn’t been trained on, the people said. Overall, Orion is so far not considered to be as big a step up from OpenAI’s existing models as GPT-4 was from GPT-3.5
+		- The companies are facing several challenges. It’s become increasingly difficult to find new, untapped sources of high-quality, human-made training data that can be used to build more advanced AI systems. Orion’s unsatisfactory coding performance was due in part to the lack of sufficient coding data to train on, two people said. At the same time, even modest improvements may not be enough to justify the tremendous costs associated with building and operating new models, or to live up to the expectations that come with branding a product as a major upgrade.
+	- Amodei has said companies will spend $100 million to train a bleeding-edge model this year and that amount will [hit $100 billion](https://archive.ph/o/kYe5n/https://www.bloomberg.com/news/articles/2024-05-09/openai-rival-anthropic-defends-partnerships-with-amazon-google) in the coming years.
+- Google Is Working on Reasoning AI, Chasing OpenAI’s Efforts
+	- https://archive.ph/Y3OVO#selection-1405.0-1405.59
+	- In recent months, multiple teams at [Alphabet Inc.](https://archive.ph/o/Y3OVO/https://www.bloomberg.com/quote/goog:undefined)’s Google have been making progress on AI reasoning software, according to people with knowledge of the matter,