Primary Metric Quiz

5 questions Pass: 70% +25 pts

Quiz covering Hyperparameter Tuning

Primary Metric Quiz

5 questions | Pass: 70% | Earn 25 points

Questions in this quiz

A preview of the 5 questions covered. Start the quiz above to answer them, check your score, and read the explanations.

  1. 1

    What is the primary purpose of defining a 'primary metric' when running hyperparameter tuning experiments?

  2. 2

    If you are training a binary classification model on a highly imbalanced dataset where the positive class is rare, which primary metric would be most appropriate to track?

  3. 3

    When configuring an experiment to minimize prediction error in a regression task, which metric should you set as the primary objective?

  4. 4

    A data scientist is tuning a model and sets the primary metric to 'Accuracy' with a goal of 'Maximize'. What happens if the hyperparameter tuning service finds a configuration that results in an accuracy of 0.95 and another with 0.92?

  5. 5

    You are performing hyperparameter tuning using a Bayesian optimization strategy. If you change your primary metric from 'Precision' to 'F1-Score' mid-experiment, what is the most significant consequence?