Google has been accused of using novices to test Gemini's AI responses

It cannot be argued that AI still has a few inaccuracies, but one could at least hope that its assessments are correct. But last week, it was alleged that Google issued instructions to contract workers Appreciates Gemini not to miss any instructions regardless of experience, TechCrunch reports it is based on the internal management it looks at. Google shared a preview Gemini 2.0 earlier this month.

Google contractors are said to have instructed GlobalLogic, an outsourced firm that evaluates AI-generated products, to ensure that reviewers do not miss out on pointers outside of their own experience. In the past, contractors could choose to refuse any instruction that strayed too far from their expertise, such as asking a doctor about the law. The instructions stated, "Please skip this task if you do not have critical experience (eg, coding, math) to evaluate this command."

Contractors are now instructed to "not miss instructions that require domain-specific knowledge" and to "evaluate the parts of the notice that you understand," adding a note that this is not their area of ​​expertise. It appears that the only time Agreements can now be bypassed is when there is a substantial lack of information or harmful content that requires special consent forms for assessment.

One of the contractors correctly responded to the changes: "I thought the purpose of skipping was to improve accuracy by giving it to someone better?"

Google did not respond to a request for comment.



Source link

Leave a Reply

Your email address will not be published. Required fields are marked *