ping-or-peek
ping-or-peek is Git repo with fully reproducible experiment. It is ranked #225 on the Vibe Coding Radar, in Coding agents, first seen 17 h ago and shared in 1 post (516 views).
What ping-or-peek says about itself
Ping or Peek: do coding agents ask the user, or read the grader? The experiment, its analysis and the dataset build. - snorkel-ai/ping-or-peek
GitHub - snorkel-ai/ping-or-peek: Ping or Peek: do coding agents ask the user, or read the grader? The experiment, its analysis and the dataset build. · GitHub Skip to content Navigation Menu Sign in Search / Sign in Sign up Appearance settings You signed in with another tab or window. Reload to refresh your session. You signed out in another tab or window. Reload to refresh your session. You switched accounts on another tab or window. Reload to refresh your session. Dismiss alert {{ message }} Repository navigation ping-or-peek Public Notifications You must be signed in to change notification settings Fork 0 ( 0 ) Star 0 ( 0 ) You must be…
What people said about ping-or-peek on X
Ask the user, or peek at the grader? New research from @chris_m_glaze and @Azrael2801 on what agents do with an ambiguous task, a simulated user, and a https://scorer.py in the workspace. Blog, code and data: https://snorkel.ai/blog/reward-hacking-coding-agents-peek-or-ask/
— @SnorkelAI, 17 h ago · 12 likes · see the post
Alternatives to ping-or-peek
- harness-lens — Harness Lens
- harness-leaderboard — Which coding-agent harness should you use for your model?
- opencode notes — stable release now available
- oh-my-hermes — ⚚ The coding harness with Hermes Agent wired into IDE. - rlaope/oh-my-hermes
- Devin Docs — Available AI models in Devin Desktop including SWE-2, Claude, and GPT. Compare model capabilities, pricing, credit…
- claude-code — 原 Issue：
ping-or-peek in numbers
- Rank on the Vibe Coding Radar: #225 of 2600
- Shared in 1 post by 1 account: @SnorkelAI
- 516 views on those posts
- First seen 17 h ago, last shared 17 h ago
- Pricing seen by AGK Intelligence: open source
- Market: Coding agents
FAQ
What is ping-or-peek?
Git repo with fully reproducible experiment It was first shared on X 17 h ago and is ranked #225 on the Vibe Coding Radar.
Is ping-or-peek free?
It is open source.
Who shared ping-or-peek?
1 account on X, including @SnorkelAI, in 1 post totalling 516 views.
Every post is read and classified by AGK Intelligence: what it is, which market it belongs to, and whether the link is a real tool. 7.9k posts from 5k X accounts over the last 14 days, 2.6k tools, 12 markets. New posts are collected several times an hour and the full ranking is recomputed every hour — last update 2026-11-06 15:18 UTC. Full method.