Here is the question, that I was reviewing:
10 GB of RAM unaccounted for by top10 GB of RAM unaccounted for by top
It appeared as a new one, so I flagged it as a duplicate of How to interpret output from Linux 'top' command?How to interpret output from Linux 'top' command? (actually there are hundreds of the same "why my free
command displays wrong memory" questions out there).
Then got this:
STOP! Look and Listen.
This was an audit, designed to see if you were paying attention.
You didn't pass. Your review was inappropriate.
This was a high quality post and you should have considered leaving it
as-is or even upvoting.
You know, I'm getting a feeling I'm the only one doing reviews for several weeks, since the "unreviewed" posts count only goes down when I'm doing it. Getting a test failure on such troll questions doesn't help my motivation in doing reviews at all.
I might just have a simple technical solution, that will once & for all eliminate this problem:
- When flagging question as a duplicate, we already got "Similar questions frequently linked or suggested as originals" search field.
- Exclude questions that have possible duplicates from the "review audit" questions pool.
- Problem solved!
I'll explain a bit:
Look at the top rated questionstop rated questions, choose a random onechoose a random one, press "flag -> Duplicate" and check whether it has any suggested duplicates. If it doesn't, than it's a good test question. Here is an example of a good test questionan example of a good test question.
But if it does have a long list of possible duplicates like this onethis one - exclude it from the pool, so it never shows as a test question.
I'm not saying this is anywhere near important, but it would be nice if this is implemented someday.