FEATURE REQUEST: Efficient chunking strategy to create User Profile

[smokeyScraper]

Is your feature request related to a problem?

• Yes, it is related to a problem

Describe the feature you'd like

🌟 Feature Description

Implement an intelligent user profile chunking system that leverages GitHub API to create comprehensive developer profiles by analyzing their repositories, contributions, and coding patterns. This system will extract and structure user expertise data for storage in our hybrid Supabase-Weaviate database, enabling accurate mentor matching and contributor recommendations.

🔍 Problem Statement

Currently, we lack a systematic way to:

• Assess a developer's expertise beyond self-reported skills
• Understand the depth of experience in specific languages and frameworks
• Match contributors with appropriate mentors or issues
• Create meaningful embeddings that capture a developer's actual capabilities

Simply storing a GitHub bio or listing languages isn't sufficient for intelligent contributor matching or mentorship assignment.

🎯 Expected Outcome

A comprehensive user profiling system that:

1. Extracts Multi-dimensional Data: Pull data from GitHub profile, repositories and contributions
2. Analyzes Expertise Levels: Calculate proficiency scores based on actual code contributions
3. Creates Semantic Chunks: Generate meaningful, searchable chunks of user expertise
4. Enables Smart Matching: Support queries like "Find Python developers experienced in machine learning"
5. Updates Dynamically: Refresh profiles based on new contributions

Record

• I agree to follow this project's Code of Conduct
• I want to work on implementing this feature

[smokeyScraper]

Refer Gist: GitHubUserProfiling.py

Sample Response with codes attached