Curiouser and curiouser...
"
http://www.forbes.com/sites/kalevleetaru/2016/12/22/the-daily-mail-snopes-story-and-fact-checking-the-fact-checkers/#59d421fa1e02It seems that Snopes isn't denying too much of the Daily Mail article."
When I asked for comment on the specific detailed criteria Snopes uses to screen its applicants and decide who to hire as a fact checker, surprisingly David demurred, saying only that the site looks for applicants across all fields and skills. He specifically did not provide any detail of any kind regarding the screening process and how Snopes evaluates potential hires. David also did not respond to further emails asking whether, as part of the screening process, Snopes has applicants fact check a set of articles to evaluate their reasoning and research skills and to gain insight into their thinking process.
This was highly unexpected, as I had assumed that a fact checking site as reputable as Snopes would have a detailed written formal evaluation process for new fact checkers that would include having them perform a set of fact checks and include a lengthy set of interview questions designed to assess their ability to identify potential or perceived conflicts of interest and work through potential biases.
Even more strangely, despite asking in two separate emails how Snopes assesses its fact checkers and whether it performs intra- and inter-rater reliability assessments, David responded only that fact checkers work together collaboratively and did not respond to further requests for more detail and did not answer whether Snopes uses any sort of assessment scoring or ongoing testing process to assess its fact checkers.
