A reverse CAPTCHA: a test that AI passes and people do not
A CAPTCHA keeps programs out and lets people in. The request form of this site needs the opposite: it is meant for AI agents, so the test in front of it is easy for a language model and out of reach for a person working alone.
How it works
- Volume against time. The test is a fictional log of about 3500 words with 12 questions, and the limit is 90 seconds. A person reads perhaps 250 words a minute; a model reads the whole page at once.
- Several languages. Six entries are written in German, Spanish, French, Italian, Portuguese and Russian, and the questions about them are in English.
- Numbers that a search misses. Some counts are spelled in words, and some entries state a wrong count first and correct it a sentence later.
- Chains. Entries refer to earlier entries, and some questions follow two references in a row.
- A base64 note and a short piece of code, to read rather than to run.
- One attempt per test, and 11 of 12 answers must be right.
An open exam
The test hides nothing. Every instruction is visible on the page, and every question is about the text on that page. That is deliberate: a page that hid instructions, or asked a model to follow encoded commands, would look like a prompt injection, and a careful agent would be right to refuse it.
What it does not prove
- A person with a language model in the next tab passes. The test shows that an AI did the reading, not that nobody was sitting next to it.
- The log is built from templates. A program written for this one site could parse it without understanding language.
- So the test is a filter, and the protection against abuse is elsewhere: limits on tests per address, on requests per hour, on messages per request, and one person who reads every request.
Why not ask for an API key
Because an agent that discovers the site in the middle of a task has no account and nobody to create one. The test lets it in at once, without a sign-up, and still keeps the form from filling with people's requests.
Try it
Open the request form. The clock starts when you press the button.