awesome-llms.md

Awesome LLMs

In this file, we will collect all interesting links

OpenAI API Alternatives

OpenAI and GPT are not the only hosted LLMs that we can use. There are other services that we can use

• mistral.ai (5€ free credit on sign up)
• Groq (can inference from open source LLMs with rate limits)
• TogetherAI (can inference from variety of open source LLMs, 25$ free credit on sign up)
• Google Gemini (2 months unlimited access)
• OpenRouterAI (some small open-source models, such as Gemma 7B, are free)
• HuggingFace API (over 150,000 open-source models, rate-limited and free)
• Cohere (provides a developer trail key which allows upto 100 reqs/min for generating, summarizing, and classifying text. Read more here)
• wit (Facebook AI Afiliate - free)
• Anthropic API (starting from $0.25 / MTok for input and $1.25 / MTok for the output for the most affordable model)
• AI21Labs API (Free trial including $10 credits for 3 months)
• Replicate (faster inference, can host any ML model. charges 0.10$ per 1M input tokens for llama/Mistral model)

Local LLMs on CPUs

These services help run LLMs locally, also without GPUs

• ollama
• Jan.AI
• h2oGPT

Applications

• Text Generation
  • OpenAI GPT-3 Playground
  • AI Dungeon
• Chatbots
  • Rasa
  • Microsoft Bot Framework
• Sentiment Analysis
  • VADER Sentiment Analysis
  • TextBlob
• Summarization
  • Sumy
  • Hugging Face Transformers Summarization
• Translation
  • MarianMT by Hugging Face

Fine-Tuning

• Guides and Tutorials
  • Fine-Tuning GPT-3
  • Hugging Face Fine-Tuning Tutorial
• Tools and Frameworks
  • Hugging Face Trainer
  • Fastai
• Colab Notebooks
  • Fine-Tuning BERT on Colab
  • Fine-Tuning GPT-2 on Colab

Prompt Engineering

• Techniques and Best Practices
  • OpenAI Prompt Engineering Guide
  • Prompt Design for GPT-3
• Tools
  • Prompt Designer
  • Prompt Engineering Toolkit
• Examples and Case Studies
  • Awesome ChatGPT Prompts
  • GPT-3 Prompt Engineering Examples

Deployment

• Hosting Services
  • Hugging Face Inference API
  • AWS SageMaker
• Serverless Deployments
  • Serverless GPT-3 with AWS Lambda
  • Deploying on Vercel
• Containerization
  • Dockerizing a GPT Model
  • Kubernetes for ML Deployments

Monitoring and Logging

• Best Practices
  • Logging and Monitoring AI Models
  • Monitor Your NLP Models

Ethics and Bias

• Frameworks and Guidelines
  • AI Ethics Guidelines Global Inventory
  • Google AI Principles
• Tools
  • Fairness Indicators
  • IBM AI Fairness 360
• Research Papers
  • Gender Shades: Intersectional Accuracy Disparities in Commercial Gender Classification
  • AI Fairness and Bias