Google recently a video on how its search quality raters initially check out changes it wants to incorporate to uderstand whether the change will be for the larger good or not.
The video talks of Google running hundreds of thousands of tests to see if a change it was considering to search would actually make it better for the people who will use it.
One of the essential ways, says Google, to test is by turning to real people, called, “Search Quality Raters”. Google reveals there are over 10,000 of them around the globe.
These chaps have the Search Quality Evaluators Guidelines to fall back on. This is a public manual every reader studies & is tested on before providing ratings.
Interesting. For more, check out the above video.
Source: Google
