Skip to content

StudioPlatforms/aistupidmeter-web

Repository files navigation

AI Stupid Meter - Web Frontend

πŸš€ The World's First AI Intelligence Degradation Detection System

A Next.js-based web application that provides real-time monitoring and analysis of AI model performance, featuring advanced degradation detection, intelligent routing, and comprehensive analytics.

🌟 Live Demo

πŸš€ Key Features

πŸ”¬ Intelligence Monitoring

  • Real-time AI model performance tracking across 25+ models
  • 7-axis scoring methodology (Correctness, Spec Compliance, Code Quality, Efficiency, Stability, Refusal Rate, Recovery)
  • Dual-benchmark system: Speed tests (hourly) + Deep reasoning (daily)
  • Statistical degradation detection using CUSUM algorithms and Mann-Whitney U tests
  • Confidence intervals and reliability badges for performance consistency

🧠 Model Intelligence Center

  • Advanced analytics engine with 29 warning categories across 5 detection types
  • Smart recommendations for best coding models, most reliable, and fastest response
  • Proactive alerts for performance degradation and cost-efficiency issues
  • Provider trust scores tracking reliability across all AI providers
  • Drift incident monitoring with real-time notifications

πŸ”§ Revolutionary Tool Calling Evaluation

  • World-first tool calling benchmarks testing real system command execution
  • Multi-step workflow evaluation in secure sandbox environments
  • 171+ successful tool calling sessions demonstrating practical AI capabilities
  • Real-world task completion beyond simple text generation

🎯 AI Router Pro

  • Intelligent model routing based on real-time performance data
  • Cost optimization with automatic provider switching
  • Degradation protection preventing use of poorly performing models
  • One unified API for accessing multiple AI providers
  • Enterprise-grade reliability with 99.9% uptime SLA

πŸ“Š Advanced Analytics

  • Historical performance tracking with 24h, 7d, and 1m views
  • Interactive charts with confidence intervals and error bars
  • Performance matrix with reliability scoring
  • Trend analysis and change point detection
  • Real-time ticker tape with live performance updates

πŸ” Authentication & Subscriptions

  • NextAuth.js integration with OAuth providers
  • Stripe subscription management with Pro features
  • User dashboard with personalized settings
  • API key testing for transparency and verification

πŸ“‹ Prerequisites

πŸ› οΈ Installation

  1. Clone the repository:
git clone https://github.com/StudioPlatforms/aistupidmeter-web.git
cd aistupidmeter-web
  1. Install dependencies:
npm install
  1. Set up environment variables:
cp .env.local.template .env.local
# Edit .env.local with your configuration

Required environment variables:

NEXTAUTH_URL=http://localhost:3000
NEXTAUTH_SECRET=your-secret-here
GITHUB_CLIENT_ID=your-github-client-id
GITHUB_CLIENT_SECRET=your-github-client-secret
GOOGLE_CLIENT_ID=your-google-client-id
GOOGLE_CLIENT_SECRET=your-google-client-secret
STRIPE_PUBLISHABLE_KEY=your-stripe-publishable-key
STRIPE_SECRET_KEY=your-stripe-secret-key
STRIPE_WEBHOOK_SECRET=your-stripe-webhook-secret
DATABASE_URL=your-database-url
API_BASE_URL=http://localhost:4000
  1. Run the development server:
npm run dev

Open http://localhost:3000 in your browser to see the application.

πŸ“¦ Available Scripts

  • npm run dev - Start the development server
  • npm run build - Build the production application
  • npm run start - Start the production server
  • npm run lint - Run ESLint
  • npm run type-check - Run TypeScript type checking

πŸ—οΈ Tech Stack

Core Framework

  • Next.js 14 with App Router
  • React 18 with Server Components
  • TypeScript for type safety
  • Tailwind CSS for styling

Authentication & Payments

  • NextAuth.js for authentication
  • Stripe for subscription management
  • OAuth providers (GitHub, Google)

Data & State Management

  • React Query for server state
  • Zustand for client state
  • PostgreSQL with Drizzle ORM

UI & Visualization

  • Recharts for interactive charts
  • Framer Motion for animations
  • Vintage CRT aesthetic with custom CSS
  • Responsive design for mobile/desktop

Performance & Monitoring

  • Redis caching for optimized performance
  • Real-time updates with Server-Sent Events
  • Error tracking and performance monitoring
  • SEO optimization with metadata

🎨 Design Philosophy

The application features a unique vintage terminal aesthetic inspired by 1980s computer terminals:

  • Phosphor green color scheme
  • CRT monitor styling with scan lines
  • Monospace fonts for technical authenticity
  • Retro animations and loading states
  • Terminal-style interfaces for advanced users

πŸ”Œ API Integration

The frontend integrates with multiple backend services:

Main API Endpoints

  • /dashboard/cached - Cached dashboard data for instant loading
  • /dashboard/scores - Real-time model scores
  • /analytics/* - Advanced analytics and recommendations
  • /models/* - Individual model details and history

Router API

  • /router/* - AI Router Pro functionality
  • /router/analytics - Router performance metrics
  • /router/keys - API key management

Authentication API

  • /api/auth/* - NextAuth.js endpoints
  • /api/subscription/* - Stripe subscription management

πŸ“± Mobile Optimization

  • Responsive design that works on all screen sizes
  • Touch-friendly interfaces for mobile users
  • Optimized performance for slower connections
  • Progressive Web App features
  • Mobile-specific navigation and layouts

πŸ”— Related Repositories

🌍 Community

  • Reddit: r/AIStupidLevel - Community discussions
  • X/Twitter: @AIStupidlevel - Latest updates
  • GitHub Discussions - Technical discussions and feature requests

πŸ“ License

MIT License - see LICENSE file for details

🀝 Contributing

Contributions are welcome! Please feel free to submit a Pull Request.

Development Workflow

  1. Fork the repository
  2. Create your feature branch (git checkout -b feature/AmazingFeature)
  3. Make your changes and test thoroughly
  4. Commit your changes (git commit -m 'Add some AmazingFeature')
  5. Push to the branch (git push origin feature/AmazingFeature)
  6. Open a Pull Request

Code Standards

  • Follow TypeScript best practices
  • Use ESLint and Prettier for code formatting
  • Write meaningful commit messages
  • Add tests for new features
  • Update documentation as needed

πŸ“§ Contact

Built by: Laurent @ StudioPlatforms

πŸ™ Acknowledgments

  • OpenAI, Anthropic, Google, xAI for providing AI model APIs
  • Vercel for hosting and deployment
  • Stripe for payment processing
  • Community contributors for feedback and improvements

Project Links:

Last Updated: October 2025

About

AI Stupid Meter - Web Frontend

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Contributors 2

  •  
  •