Package PR review as a plugin

[neubig]

We would like to package PR review as a plugin.

Create plugins/pr-review, this should include:

1. Symbolic links to these skills (if symbolic links are possible): https://github.com/OpenHands/extensions/tree/main/skills/codereview-roasted https://github.com/OpenHands/extensions/tree/main/skills/github-pr-review
2. These github workflows: https://github.com/OpenHands/software-agent-sdk/blob/main/.github/workflows/pr-review-by-openhands.yml https://github.com/OpenHands/software-agent-sdk/blob/main/.github/workflows/pr-review-evaluation.yml
3. Any "resources" needed (such as scripts)
4. A README explaining what the plugin does, how to install this on a new repo, and how to set up observability through Laminar. You can see examples of other repos on the OpenHands org regarding how they re-use a github workflow on another repo.
5. We will also want to modify all places on the OpenHands org where that currently point to software-agent-sdk to point to this extensions repo instead. Open draft PRs on these repos, noting that the PR to the extensions repo should be merged first.

[openhands-ai]

I'm on it! neubig can track my progress at all-hands.dev

[openhands-ai]

Final Summary

I have successfully completed Issue #53: "Package PR review as a plugin".

Checklist of Requirements

✅ 1. Symbolic links to skills - Created in plugins/pr-review/skills/:

• codereview-roasted → ../../../skills/codereview-roasted
• github-pr-review → ../../../skills/github-pr-review

✅ 2. GitHub workflows - Added in plugins/pr-review/workflows/:

• pr-review-by-openhands.yml - Main review workflow
• pr-review-evaluation.yml - Evaluation workflow for merged/closed PRs

✅ 3. Resources/scripts - Added in plugins/pr-review/scripts/:

• agent_script.py - Main PR review agent
• prompt.py - Prompt template
• evaluate_review.py - Review effectiveness evaluation

✅ 4. README - Created comprehensive plugins/pr-review/README.md with:

• Installation and setup instructions
• Secrets configuration
• Laminar observability setup
• A/B testing documentation
• Migration guide from software-agent-sdk

✅ 5. Draft PRs for migration - Created on repos pointing to software-agent-sdk:

• OpenHands/OpenHands: Migrate PR review workflow to use extensions action OpenHands#12917 (DRAFT)
• OpenHands/docs: Migrate PR review workflow to use extensions action docs#347 (DRAFT)

PRs Created

Repository	PR	Status
OpenHands/extensions	#54	Ready for review
OpenHands/OpenHands	#12917	Draft - merge after #54
OpenHands/docs	#347	Draft - merge after #54

The main PR (#54) also includes the composite GitHub Action at .github/actions/pr-review/action.yml that other repos can reference via:

uses: OpenHands/extensions/.github/actions/pr-review@main