π The World's First AI Intelligence Degradation Detection System
A Next.js-based web application that provides real-time monitoring and analysis of AI model performance, featuring advanced degradation detection, intelligent routing, and comprehensive analytics.
- Website: https://aistupidlevel.info
- Hugging Face Space: https://huggingface.co/spaces/AIStupidLevel/
- Community: r/AIStupidLevel
- Real-time AI model performance tracking across 25+ models
- 7-axis scoring methodology (Correctness, Spec Compliance, Code Quality, Efficiency, Stability, Refusal Rate, Recovery)
- Dual-benchmark system: Speed tests (hourly) + Deep reasoning (daily)
- Statistical degradation detection using CUSUM algorithms and Mann-Whitney U tests
- Confidence intervals and reliability badges for performance consistency
- Advanced analytics engine with 29 warning categories across 5 detection types
- Smart recommendations for best coding models, most reliable, and fastest response
- Proactive alerts for performance degradation and cost-efficiency issues
- Provider trust scores tracking reliability across all AI providers
- Drift incident monitoring with real-time notifications
- World-first tool calling benchmarks testing real system command execution
- Multi-step workflow evaluation in secure sandbox environments
- 171+ successful tool calling sessions demonstrating practical AI capabilities
- Real-world task completion beyond simple text generation
- Intelligent model routing based on real-time performance data
- Cost optimization with automatic provider switching
- Degradation protection preventing use of poorly performing models
- One unified API for accessing multiple AI providers
- Enterprise-grade reliability with 99.9% uptime SLA
- Historical performance tracking with 24h, 7d, and 1m views
- Interactive charts with confidence intervals and error bars
- Performance matrix with reliability scoring
- Trend analysis and change point detection
- Real-time ticker tape with live performance updates
- NextAuth.js integration with OAuth providers
- Stripe subscription management with Pro features
- User dashboard with personalized settings
- API key testing for transparency and verification
- Node.js 18+
- npm or yarn
- Backend API running (see aistupidmeter-api)
- Clone the repository:
git clone https://github.com/StudioPlatforms/aistupidmeter-web.git
cd aistupidmeter-web- Install dependencies:
npm install- Set up environment variables:
cp .env.local.template .env.local
# Edit .env.local with your configurationRequired environment variables:
NEXTAUTH_URL=http://localhost:3000
NEXTAUTH_SECRET=your-secret-here
GITHUB_CLIENT_ID=your-github-client-id
GITHUB_CLIENT_SECRET=your-github-client-secret
GOOGLE_CLIENT_ID=your-google-client-id
GOOGLE_CLIENT_SECRET=your-google-client-secret
STRIPE_PUBLISHABLE_KEY=your-stripe-publishable-key
STRIPE_SECRET_KEY=your-stripe-secret-key
STRIPE_WEBHOOK_SECRET=your-stripe-webhook-secret
DATABASE_URL=your-database-url
API_BASE_URL=http://localhost:4000- Run the development server:
npm run devOpen http://localhost:3000 in your browser to see the application.
npm run dev- Start the development servernpm run build- Build the production applicationnpm run start- Start the production servernpm run lint- Run ESLintnpm run type-check- Run TypeScript type checking
- Next.js 14 with App Router
- React 18 with Server Components
- TypeScript for type safety
- Tailwind CSS for styling
- NextAuth.js for authentication
- Stripe for subscription management
- OAuth providers (GitHub, Google)
- React Query for server state
- Zustand for client state
- PostgreSQL with Drizzle ORM
- Recharts for interactive charts
- Framer Motion for animations
- Vintage CRT aesthetic with custom CSS
- Responsive design for mobile/desktop
- Redis caching for optimized performance
- Real-time updates with Server-Sent Events
- Error tracking and performance monitoring
- SEO optimization with metadata
The application features a unique vintage terminal aesthetic inspired by 1980s computer terminals:
- Phosphor green color scheme
- CRT monitor styling with scan lines
- Monospace fonts for technical authenticity
- Retro animations and loading states
- Terminal-style interfaces for advanced users
The frontend integrates with multiple backend services:
/dashboard/cached- Cached dashboard data for instant loading/dashboard/scores- Real-time model scores/analytics/*- Advanced analytics and recommendations/models/*- Individual model details and history
/router/*- AI Router Pro functionality/router/analytics- Router performance metrics/router/keys- API key management
/api/auth/*- NextAuth.js endpoints/api/subscription/*- Stripe subscription management
- Responsive design that works on all screen sizes
- Touch-friendly interfaces for mobile users
- Optimized performance for slower connections
- Progressive Web App features
- Mobile-specific navigation and layouts
- AI Stupid Meter API - Backend API server
- Hugging Face Space - Interactive demo
- Reddit: r/AIStupidLevel - Community discussions
- X/Twitter: @AIStupidlevel - Latest updates
- GitHub Discussions - Technical discussions and feature requests
MIT License - see LICENSE file for details
Contributions are welcome! Please feel free to submit a Pull Request.
- Fork the repository
- Create your feature branch (
git checkout -b feature/AmazingFeature) - Make your changes and test thoroughly
- Commit your changes (
git commit -m 'Add some AmazingFeature') - Push to the branch (
git push origin feature/AmazingFeature) - Open a Pull Request
- Follow TypeScript best practices
- Use ESLint and Prettier for code formatting
- Write meaningful commit messages
- Add tests for new features
- Update documentation as needed
Built by: Laurent @ StudioPlatforms
- X/Twitter: @goatgamedev
- Email: laurent@studio-blockchain.com
- GitHub: StudioPlatforms
- Website: https://studioplatforms.eu
- OpenAI, Anthropic, Google, xAI for providing AI model APIs
- Vercel for hosting and deployment
- Stripe for payment processing
- Community contributors for feedback and improvements
Project Links:
- Repository: https://github.com/StudioPlatforms/aistupidmeter-web
- Live Site: https://aistupidlevel.info
- Demo: https://huggingface.co/spaces/AIStupidLevel/
Last Updated: October 2025