diff --git a/.gitignore b/.gitignore index c32d9fa..3ae9680 100644 --- a/.gitignore +++ b/.gitignore @@ -4,6 +4,7 @@ release dist .env .env.* +myenv/ **/.DS_Store **/.vscode **/.idea diff --git a/FLOATING_WINDOW_README.md b/FLOATING_WINDOW_README.md new file mode 100644 index 0000000..001822e --- /dev/null +++ b/FLOATING_WINDOW_README.md @@ -0,0 +1,70 @@ +# Conversational Co-Pilot - Floating Window + +This project has been transformed from a screenshot-based Jiminy – The Second Conscience to a clean floating conversational co-pilot application. + +## What We've Done + +### ✅ Completed Changes + +1. **Hidden Screenshot Functionality** + - Screenshot queues are now hidden but kept functional in the background + - Screenshot commands and UI elements are hidden from view + - All backend screenshot functionality remains intact + +2. **Added Floating Navigation Dock** + - Beautiful animated floating dock with relevant co-pilot controls + - Icons for Voice Input, Mute, AI Assistant, Conversations, Reset, and Settings + - Smooth animations and hover effects + - Positioned at the bottom center of the window + +3. **Redesigned UI for Conversational Co-Pilot** + - Clean, modern interface with glass-morphism design + - Placeholder areas for: + - MY SPEECH (voice input detection) + - OTHER SPEECH (voice detection from others) + - AI SUGGESTIONS (AI-generated suggestions) + - AI RESPONSE AREA (where AI responses will appear) + +4. **Updated Window Styling** + - Added gradient background + - Improved spacing and layout + - Made the interface more suitable for a floating window + +### 🎛️ Controls + +- **Ctrl+B** (Windows) or **Cmd+B** (Mac): Toggle window visibility +- **Floating Dock**: Navigation and controls (currently placeholders) + +### 🏗️ Next Steps (As per TASKS.md) + +The foundation is now ready for implementing the actual conversational co-pilot features: + +1. **Audio Capture Implementation** + - Microphone audio capture + - System audio loopback capture + - Integration with Silero VAD for voice activity detection + +2. **WebSocket Integration** + - Connect to FastAPI backend + - Real-time audio streaming + - Bi-directional communication for transcripts and AI responses + +3. **AI Integration** + - Faster-Whisper for speech-to-text + - DeepSeek LLM for AI responses + - ChromaDB for RAG (Retrieval-Augmented Generation) + +4. **Real-time Features** + - Live speech transcription + - Question detection + - Contextual AI suggestions + - Streaming AI responses + +### 🎨 Design Features + +- **Glass-morphism UI**: Semi-transparent panels with backdrop blur +- **Floating Dock**: Animated navigation with smooth hover effects +- **Responsive Layout**: Adapts to different window sizes +- **Dark Theme**: Modern dark interface suitable for a floating window + +The application now provides a clean, professional floating window interface ready for conversational AI features while keeping all existing functionality intact in the background. diff --git a/README.md b/README.md index 2b1a4e3..f4fe68d 100644 --- a/README.md +++ b/README.md @@ -1,69 +1,259 @@ -# Interview Coder +# 🤖 Jiminy – The Second Conscience -Interview Coder is a desktop application designed to help users with technical coding interviews. It allows users to take screenshots of coding problems, process them using AI, and get solutions. +
Made with ❤️ for developers, by developers
+Star ⭐ this repository if you find it helpful!
+- Loading solutions... -
-+ Loading solutions... +
++ Loading debug analysis... +
+- Extracting problem statement... -
-- Loading solutions... -
-- Calculating complexity... -
- ) : ( -- Generating solutions... -
-+ Extracting problem statement... +
++ Loading solutions... +
++ Loading complexity analysis... +
++ Extracting problem statement... +
++ Loading solutions... +
++ Loading complexity analysis... +
++ Your conversational AI assistant is ready to help with coding interviews, + algorithm discussions, and technical problem-solving. +
+{transcript}
+{interimTranscript}
+Recording text and visualization...
++ {recommendation.description} +
++ I can help you with general questions, creative tasks, or anything you'd like to discuss. What's on your mind? +
++ How do I improve my productivity when working from home? +
++ Welcome to Code Analysis Mode! 🚀 I can help you analyze code screenshots, debug issues, optimize performance, and explain complex algorithms. Simply capture some code using Ctrl+H and describe what you'd like me to help with. +
++ Hey! I need help optimizing this algorithm. Let me capture the code first... +
++ {message.content} +
+ {message.screenshots && ( +
+ {JSON.stringify(message.solutionData, null, 2)}
+
+ + I've analyzed your code screenshots! Here's what I found and how to solve it: +
+ + {/* Problem Information */} + {message.solutionData["Problem Information"] && ( +🎯 Problem Identified:
++ {message.solutionData["Problem Information"]} +
++ Here's the optimized solution in {selectedLanguage}: +
+💡 How it works:
++ {message.solutionData.Explanation} +
+⚡ Performance Analysis:
++ Time: {message.solutionData["Time Complexity"]} +
+ )} + {message.solutionData["Space Complexity"] && ( ++ Space: {message.solutionData["Space Complexity"]} +
+ )} +Detailed Analysis:
++ {message.solutionData.complexity_explanation} +
++ I've processed your request, but there seems to be an issue with the response format. Let me know if you'd like me to try again! +
+ )} ++ Welcome to your intelligent coding interview companion! I'm here to help you analyze code, + debug issues, optimize algorithms, and prepare for technical interviews. +
++ Capture code screenshots and get instant analysis, optimization suggestions, and explanations. +
++ Get immediate assistance during coding sessions with intelligent suggestions and debugging. +
+Begin a new coding session
+Get intelligent assistance
+View performance stats
+Configure preferences
+Code analysis completed
+2 minutes ago
+Algorithm optimization suggested
+5 minutes ago
+Debug session started
+10 minutes ago
++ {conversation.lastMessage} +
+ {conversation.unread && ( +• Press Ctrl+H to capture code screenshots
+• Screenshots will appear in the queue above
+• Select your programming language and click "Generate Solution" to analyze
+• Use the delete button to remove unwanted screenshots
++ {timeComplexityExplanation} +
+ )} ++ {spaceComplexityExplanation} +
+ )} ++ Capture some code screenshots and generate a solution to see AI-powered analysis and optimization suggestions here. +
+