Google reportedly instructed GlobalLogic, an outsourcing firm whose contractors evaluate AI-generated output, not to have reviewers skip prompts outside of their expertise. Previously, contractors could choose to skip any prompt that fell far out of their expertise — such as asking a doctor about laws.Google accused of using novices to fact-check Gemini’s AI answers. Hopefully no computer science majors were asked to review medical questions. One contractor aptly responded to the changes stating, “I thought the point of skipping was to increase accuracy by giving it to someone better?” What is yoir take on output evaluation for Gemini ?
