27 launches
130 total tracked · momentum -12.9%
ai & agents · testing & qa · updated 2026-11-21
Prompt regression testing, LLM trace inspection, token cost tracking, and model benchmarking suites.
Niche Snapshot (Updated 2026-11-21)
LLM Evals & Prompt Observability currently has 27 launches in the past 28 days (130 total tracked across 18,410 launches on ShowBuild), earning 1.15x average launch attention. Historical launches perform best on GitHub around Sunday at 01:00 UTC.
27 launches
130 total tracked · momentum -12.9%
1.15x average
avg 476.61 upvotes · median 2 upvotes
Sunday 01:00 UTC
top platform: GitHub · 63.08% AI-native
27 launches in last 28d · 1.15x average attention ratio
Color-coded by launch platform · see the upvote ceiling in this niche
| source | launch | upvotes | date |
|---|---|---|---|
| GitHub | MemPalace/mempalace The best-benchmarked open-source AI memory system. And it's free. |
60647 | 2026-04-05 |
| Show HN | Gemini 4 Argon plays StarCraft I've refreshed StarSkirmish Bench, a benchmark where LLMs play StarCraft BW by writing code, with results from the flagship models of… |
254 | 2026-10-16 |
| Show HN | JevBench, a reproducible benchmark for typed decision models Hi HN! I built JevBench because Jev kicks ass, and the world deserves to know how the serious open source and fake lookalike projects… |
154 | 2026-09-22 |
| Show HN | Nari Qwen3-TTS and Qwen3-ASR – High accuracy, low latency and cost Hey HN, Toby from Nari Labs here. We've been working on making OSS speech models super-fast. Last year, we built Dia, the first OSS… |
92 | 2026-09-14 |
| Show HN | Jevman – AI decision models play Pac-Man Openai just launched their decisions endpoint, cloudflare launched clef the other week, and many more jev alternatives are out there. We… |
82 | 2026-10-08 |
| Show HN | Pac-Bench – How well can models one-shot a Pac-Man game? Benchmarks how well Harness+models can create a Pac-Man game from a single prompt: “Create a Pac-Man game in a single HTML page” Each… |
80 | 2026-09-28 |
| Show HN | Parsimony – an open-source benchmark for how much code AI models add Existing benchmarks measure solve rate and token output/cost, but don't punish excess code, which makes a codebase harder to work with in… |
77 | 2026-10-13 |
“I (not GP) have no issues with CSS part of the design (just as I am fine with bootstrap websites). But if you can't be arsed to write 4 lines of text describing it in human language instead of the claude vomit, you probably didn't put much effort to begin with.”
“Is this really something people want? Honestly you can properly lower the pricing at least by 50%+. Getting something conversationally better has been done, the tool calling will likely be worse though. The infrastructure for real time is really annoying though.”
Run 50 golden test cases on every PR and fail on JSON schema or accuracy drops.
target: AI product engineersSee which SaaS users are burning your API margin before the monthly bill hits.
target: Bootstrapped AI SaaS foundersbuilding in llm evals & prompt observability?