Skip to content

Update metrics-collector and agent-performance-analyzer to new repo-memory path format #8030

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
pelikhan merged 3 commits into from
Dec 29, 2025
Merged

Update metrics-collector and agent-performance-analyzer to new repo-memory path format #8030

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
3 commits
Select commit Hold shift + click to select a range
b271036
Initial plan
Copilot Dec 29, 2025
f621972
Fix metrics-collector storage path to use meta-orchestrators subdirec…
Copilot Dec 29, 2025
a031c3d
Update repo-memory paths to new format: /tmp/gh-aw/repo-memory/{id}/
Copilot Dec 29, 2025
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
14 changes: 7 additions & 7 deletions .github/workflows/agent-performance-analyzer.lock.yml
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

10 changes: 5 additions & 5 deletions .github/workflows/agent-performance-analyzer.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -166,20 +166,20 @@ Execute these phases each run:

## Shared Memory Integration

**Access shared repo memory at `/tmp/gh-aw/repo-memory-default/memory/meta-orchestrators/`**
**Access shared repo memory at `/tmp/gh-aw/repo-memory/default/`**

This workflow shares memory with other meta-orchestrators (Campaign Manager and Workflow Health Manager) to coordinate insights and avoid duplicate work.

**Shared Metrics Infrastructure:**

The Metrics Collector workflow runs daily and stores performance metrics in a structured JSON format:

1. **Latest Metrics**: `/tmp/gh-aw/repo-memory-default/memory/meta-orchestrators/metrics/latest.json`
1. **Latest Metrics**: `/tmp/gh-aw/repo-memory/default/metrics/latest.json`
- Most recent daily metrics snapshot
- Quick access without date calculations
- Contains all workflow metrics, engagement data, and quality indicators

2. **Historical Metrics**: `/tmp/gh-aw/repo-memory-default/memory/meta-orchestrators/metrics/daily/YYYY-MM-DD.json`
2. **Historical Metrics**: `/tmp/gh-aw/repo-memory/default/metrics/daily/YYYY-MM-DD.json`
- Daily metrics for the last 30 days
- Enables trend analysis and historical comparisons
- Calculate week-over-week and month-over-month changes
Expand Down Expand Up @@ -228,8 +228,8 @@ The Metrics Collector workflow runs daily and stores performance metrics in a st
### Phase 1: Data Collection (10 minutes)

1. **Load historical metrics from shared storage:**
- Read latest metrics from: `/tmp/gh-aw/repo-memory-default/memory/meta-orchestrators/metrics/latest.json`
- Load daily metrics for trend analysis from: `/tmp/gh-aw/repo-memory-default/memory/meta-orchestrators/metrics/daily/`
- Read latest metrics from: `/tmp/gh-aw/repo-memory/default/metrics/latest.json`
- Load daily metrics for trend analysis from: `/tmp/gh-aw/repo-memory/default/metrics/daily/`
- Extract per-workflow metrics:
- Safe output counts (issues, PRs, comments, discussions)
- Workflow run statistics (total, successful, failed, success_rate)
Expand Down
12 changes: 6 additions & 6 deletions .github/workflows/metrics-collector.lock.yml
View file
Open in desktop

Some generated files are not rendered by default. Learn more about how customized files appear on GitHub.

12 changes: 6 additions & 6 deletions .github/workflows/metrics-collector.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -38,7 +38,7 @@ As an infrastructure agent, you collect and persist performance data that enable
- **Repository**: ${{ github.repository }}
- **Collection Date**: $(date +%Y-%m-%d)
- **Collection Time**: $(date +%H:%M:%S) UTC
- **Storage Path**: `/tmp/gh-aw/repo-memory-default/memory/default/metrics/`
- **Storage Path**: `/tmp/gh-aw/repo-memory/default/metrics/`

## Metrics Collection Process

Expand Down Expand Up @@ -131,15 +131,15 @@ Create a JSON object following this schema:
### 3. Store Metrics in Repo Memory

**Daily Storage**:
- Write metrics to: `/tmp/gh-aw/repo-memory-default/memory/default/metrics/daily/YYYY-MM-DD.json`
- Write metrics to: `/tmp/gh-aw/repo-memory/default/metrics/daily/YYYY-MM-DD.json`
- Use today's date for the filename (e.g., `2024-12-24.json`)

**Latest Snapshot**:
- Copy current metrics to: `/tmp/gh-aw/repo-memory-default/memory/default/metrics/latest.json`
- Copy current metrics to: `/tmp/gh-aw/repo-memory/default/metrics/latest.json`
- This provides quick access to most recent data without date calculations

**Create Directory Structure**:
- Ensure the directory exists: `mkdir -p /tmp/gh-aw/repo-memory-default/memory/default/metrics/daily/`
- Ensure the directory exists: `mkdir -p /tmp/gh-aw/repo-memory/default/metrics/daily/`

### 4. Cleanup Old Data

Expand All @@ -150,7 +150,7 @@ Create a JSON object following this schema:

**Cleanup Command**:
```bash
find /tmp/gh-aw/repo-memory-default/memory/default/metrics/daily/ -name "*.json" -mtime +30 -delete
find /tmp/gh-aw/repo-memory/default/metrics/daily/ -name "*.json" -mtime +30 -delete
```

### 5. Calculate Ecosystem Aggregates
Expand Down Expand Up @@ -222,7 +222,7 @@ At the end of collection:
- Active workflows: 85
- Total safe outputs: 45
- Overall success rate: 89.2%
- Storage: /tmp/gh-aw/repo-memory-default/memory/default/metrics/daily/2024-12-24.json
- Storage: /tmp/gh-aw/repo-memory/default/metrics/daily/2024-12-24.json

⏱️ Collection took: 45 seconds
```
Expand Down