Products/AI Tools/ProgramBenchQuietVC Report ↗

ProgramBench

ProgramBench is a research benchmark for assessing whether language models can generate complete, functional programs from scratch

AI Tools·Launched May 2026·0 upvotes·programbench.com

▲Upvote0 Visit Website↗

ALIVEverified Jul 13, 2026 · HTTP 200

CohortClass of 2026

What it is

ProgramBench is a research benchmark for assessing whether language models can generate complete, functional programs from scratch. It provides a comprehensive evaluation framework built in Python to test LLM capabilities in code generation and program synthesis tasks.

HTTP liveness

12 probes since May 23

May 23Jul 13

AliveHard-dead (404/5xx/parked)RedirectedUnverified (timeout/DNS/block)

Observed events

probes · press · GitHub

Jul 4, 2026
+59 stars
825 total
Jun 17, 2026
+47 stars
766 total
Jun 16, 2026
Back online
Alive · 200 OK
Jun 12, 2026
Probe inconclusive
Timeout
Jun 5, 2026
+15 stars
719 total
Jun 4, 2026
+14 stars
704 total
May 30, 2026
+19 stars
681 total
May 24, 2026
+18 stars
643 total
May 23, 2026
First probe — live
Alive · 200 OK

Moat

Data moat

moderate

Provides a comprehensive evaluation framework built in Python to test LLM capabilities in code generation and program synthesis tasks.

moderate · 0.80 confidence

Text classification · Jun 2026

Discussion 0 comments

No comments yet. Be the first!

VitalsQuiet

Upvotes

—

Press

—