mshumer/gpt-prompt-engineer - GitHub vs Ava

mshumer/gpt-prompt-engineer is an open source prompt engineering toolkit that generates, tests, and ranks candidate prompts for a task you define. You describe the use case, supply test cases, and the notebooks create multiple prompt variants, run them against every test case, and sort results with an ELO rating system starting at 1200. It ships as Jupyter notebooks you can run in Google Colab or locally.

Most prompt tools help you write one prompt at a time. gpt-prompt-engineer treats prompt selection like a tournament: dozens of candidates compete on your test cases, and the highest ELO scores surface the winners. Separate notebooks cover classification tasks, Claude 3 Opus with auto-generated test cases, and Opus-to-Haiku conversion for cheaper inference. Optional Weights & Biases and Portkey logging trace each run.

ML engineers, prompt engineers, and AI developers use it when they need reproducible prompt tuning instead of manual trial and error. The repo has 9.7k GitHub stars and runs on your own OpenAI or Anthropic API keys. It is free under the MIT license.

Ava turns spoken conversations into live captions on your phone, computer, or browser. Deaf and hard-of-hearing users get real-time text for video calls, lectures, doctor visits, and in-person chats. The service mixes automatic speech recognition with optional human Scribes when a meeting needs ADA-grade accuracy.

Most caption apps stop at whatever accuracy the speech model gives you. Ava lets you stay on free or low-cost AI captions for everyday use, then add a professional Scribe for 99% accuracy when the stakes are higher. Ava Connect drops captions into Zoom, Google Meet, or Teams without rebuilding your meeting workflow around a single platform.

Students, employers, clinics, and event hosts use Ava to caption classes, standups, telehealth sessions, and venue talks. Individual plans start free with 40-minute sessions; organizations can add custom dictionaries, SSO, and scheduled Scribe time.