Regression Testing for FMs Quiz

Quiz covering Testing Strategies

Questions in this quiz

A preview of the 5 questions covered. Start the quiz above to answer them, check your score, and read the explanations.

1. 1

   What is the primary objective of regression testing in the context of Foundation Models (FMs)?

2. 2

   When building an automated regression suite for an LLM, which of the following is considered a 'gold standard' practice for assessing output consistency?

3. 3

   You have fine-tuned an existing FM for a specific classification task. During regression testing, you notice the model is performing significantly better on the new task but worse on its original general-purpose reasoning tasks. What is this phenomenon called?

4. 4

   In the context of testing LLMs, why is it often difficult to use simple exact-match (string comparison) assertions for regression testing?

5. 5

   When implementing a 'Model-based Evaluation' (LLM-as-a-Judge) for regression testing, what is the most significant risk to the validity of your test results?