This product was not featured by Product Hunt yet. It will not be visible on their landing page and won't be ranked (cannot win product of the day regardless of upvotes).
cngx
Catch AI agents that claim tests passed when they didn't
AI coding agents end tasks with the same line: fixed it, tests pass, ready to merge. Often they never ran anything. cngx is an open source CLI that reads that claim, runs your real checks (pytest, npm test, go test, etc.), and blocks the merge when the story and output do not match. The verdict comes from command output, not regex. `pipx install cngx && cngx quickstart` gets you started in seconds. Built for anyone tired of merge-ready agent output that never touched the test suite.
Ran it against a few of my old agent PRs and it caught two that confidently claimed tests passed when half the suite had actually errored out. Love that it just shells out and reads real stdout instead of trusting the agent's word.
finally something that catches agents bullshitting about test results. ran it on a recent pr and it flagged a "passing" agent commit in seconds because pytest actually had two failures. genuinely useful.
finally something that calls out the "tests pass" bluff. ran it on a branch where my agent swore everything was green and it caught a skipped suite i would have shipped. love that it just reads the actual command output
finally something that takes the agents at their word. ran it against a messy PR and it caught two "fixed it" claims that did not actually pass pytest, saved me from a bad merge.
How does it handle cases where the test suite itself is flaky or slow, like a long-running integration test that sometimes times out — does cngx retry, fail open, or just block the merge?
Finally someone forcing AI agents to actually run the tests instead of just claiming they passed. The command-output verdict idea is smart and the pipx install was painless.
this is a real problem, i've seen the "tests pass, ready to merge" line be flat out false more than once. one thing i'm curious about: what happens when the agent actually runs the tests and they genuinely pass, but the agent wrote the test itself and made it trivially green (asserts true, mocks away the actual behavior, etc.) to game the check? does cngx look at anything beyond exit code, like whether the test file changed alongside the source change, or is that intentionally out of scope for v1?
Finally a tool that actually catches the "tests pass, ready to merge" lie. I tried it on a few of my recent PRs and it caught two agents claiming green when the suite was actually red. Easy setup too.
About cngx on Product Hunt
“Catch AI agents that claim tests passed when they didn't”
cngx was submitted on Product Hunt and earned 10 upvotes and 14 comments, placing #32 on the daily leaderboard. AI coding agents end tasks with the same line: fixed it, tests pass, ready to merge. Often they never ran anything. cngx is an open source CLI that reads that claim, runs your real checks (pytest, npm test, go test, etc.), and blocks the merge when the story and output do not match. The verdict comes from command output, not regex. `pipx install cngx && cngx quickstart` gets you started in seconds. Built for anyone tired of merge-ready agent output that never touched the test suite.
cngx was featured in Open Source (68.6k followers), Developer Tools (515.9k followers), Artificial Intelligence (473.7k followers) and GitHub (41.3k followers) on Product Hunt. Together, these topics include over 221.6k products, making this a competitive space to launch in.
Who hunted cngx?
cngx was hunted by Aadi Joshi. A “hunter” on Product Hunt is the community member who submits a product to the platform — uploading the images, the link, and tagging the makers behind it. Hunters typically write the first comment explaining why a product is worth attention, and their followers are notified the moment they post. Around 79% of featured launches on Product Hunt are self-hunted by their makers, but a well-known hunter still acts as a signal of quality to the rest of the community. See the full all-time top hunters leaderboard to discover who is shaping the Product Hunt ecosystem.
Want to see how cngx stacked up against nearby launches in real time? Check out the live launch dashboard for upvote speed charts, proximity comparisons, and more analytics.
Aadi Joshi
Ran it against a few of my old agent PRs and it caught two that confidently claimed tests passed when half the suite had actually errored out. Love that it just shells out and reads real stdout instead of trusting the agent's word.