Human Feedback Collection Quiz

5 questions • Pass: 70% • +25 pts

Quiz covering GenAI Evaluation

Human Feedback Collection Quiz

5 questions | Pass: 70% | Earn 25 points

Questions in this quiz

A preview of the 5 questions covered. Start the quiz above to answer them, check your score, and read the explanations.

  1. 1

    What is the primary purpose of collecting human feedback in GenAI evaluation?

  2. 2

    When designing a Likert scale for human evaluators, what is a best practice to minimize bias?

  3. 3

    Which of the following scenarios is best suited for a 'Pairwise Comparison' evaluation method?

  4. 4

    Why is 'Inter-Annotator Agreement' (IAA) a critical metric in human evaluation programs?

  5. 5

    In a Reinforcement Learning from Human Feedback (RLHF) pipeline, how does 'reward hacking' manifest during the human feedback collection phase?