General Guidlines

General Guidelines Version 4.2

June 7, 2013

General Guidelines Overview .................................................................................. 4 Part 1: Utility Rating Guidelines ............................................................................. 5

1.0 Introduction to Utility Rating ............................................................................................................................. 5 1.1 1.2 1.3 1.4 1.5 1.6 2.0 Important Rating Definitions and Ideas .................................................................................................. 5 The Purpose of Search Quality Rating .................................................................................................... 6 Raters Must Represent the User .............................................................................................................. 6 Browser Requirements ............................................................................................................................. 6 Ad Blocking Extensions ........................................................................................................................... 6 Internet Safety Information....................................................................................................................... 6

Understanding the Query .................................................................................................................................. 7 2.1 Understanding User Intent ........................................................................................................................ 7 2.2 Task Language and Task Location (Locale) ............................................................................................ 8 2.3 Queries with Multiple Meanings................................................................................................................ 8 2.4 Query Meanings Can Change Over Time...