AI Content Analyst
This work requires first understanding the user’s intent—for example, determining whether they were researching a topic or searching for their own document—and forming an opinion on what would be the most helpful or accurate result for that specific query.
Other related tasks include evaluating the quality of assistant answers, considering aspects such as accuracy, completeness, clarity, and whether the system appropriately acknowledges when it cannot provide an answer. Evaluating correctness may involve performing light research to understand terminology and confirm information.
Responsibilities
-
Review query–document pairs and any context provided (e.g., when and by whom the query was issued).
-
Research topics to better understand user intent.
-
Use internal tools (such as search indexes or conversational assistants) to simulate user behavior and test query results.
-
Rate documents, images, videos, or assistant answers according to the relevance rubric.
Requirements
-
Strong understanding of English.
-
Ability to formulate effective search or conversational queries.
Preferred Qualifications
-
No engineering background is required, but basic scripting in Python can be helpful.
