About HIBN
Have I Been Nerfed? (HIBN) lets you check the AI you use against a fixed set of questions and keep the result. You can run the same check again later. It is free, and it is a public beta.
What HIBN is for
HIBN is for people who want to check their own AI the same way more than once. Each check of a question set asks the same questions, and HIBN records which version of its scoring code scored it.
A check runs wherever you use your AI: in its app, with your own settings. HIBN does not connect to an AI itself.
HIBN does not say whether an AI was “nerfed”. A score shows how an AI did on a small set of questions, with one setup, at the time of the check. It can’t show that an AI was changed, or why a score moved.
The Quick and Deep questions do not cover writing, coding, research, factual knowledge, tool use or safety.
Methodology has the full method and its limits. About LiveBench says where the questions come from.
A public beta
HIBN is new. We may change it or pause it, and it may contain errors. Only we have tested HIBN’s question sets and scoring code so far, and no one outside has reviewed them.
Tell us what went wrong or what you’d like changed, on the Feedback page.
Who runs HIBN
- Run by
- BEMA Labs Pty Ltd, trading as Have I Been Nerfed?
- Contact
- support@haveibeennerfed.ai
- Based in
- New South Wales, Australia
Quoting HIBN’s numbers
You may quote numbers from Analytics. Give the number of checks behind a figure, or the range Analytics shows, and the dates it covers.
Say that people chose to run these checks and reported their own setups. HIBN can’t confirm a setup.
A HIBN number does not show that an AI was changed. Reporting it as showing that would be inaccurate.
For questions about the method or the numbers, write to support@haveibeennerfed.ai.