Skip to content

Exploring different UI wrappers for experimenting with zero-shot prompting

Notifications You must be signed in to change notification settings

mayagao/prompt-comparison

Repository files navigation

A set of tools I'm experimenting with to help myself learn to write better zero-shot prompts. Warning: code is horrible and messy. 😳

CleanShot 2025-01-31 at 13 03 29@2x

What's this good for

I find this tool most useful after the early rapid iteration stage when I'm ready to test a few different prompt strategies. Once I’ve selected the final set of candidates, I can also use it to compare their performance across different scenarios.

How to use

  1. Tweak the prompts and the variables directly in prompts/prompts.json
  2. Run the dev server
  3. Enter OpenAI Key on top
  4. Enter variables for each set of scenarios
  5. Click Run to test the different prompts variations across different scnearios!

Variables used across different prompt variations will be detected and shared, so you only need to enter them once—just ensure they have the same name like patch_url.

Run the dev server

npm run dev
# or
yarn dev
# or
pnpm dev
# or
bun dev

Open http://localhost:3000 to see the result.

About

Exploring different UI wrappers for experimenting with zero-shot prompting

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published