CloudWatch ML Metrics Quiz

Quiz covering Model Monitoring

Questions in this quiz

A preview of the 5 questions covered. Start the quiz above to answer them, check your score, and read the explanations.

1. 1

   Which AWS service is primarily used to collect and store model performance metrics such as latency and invocation counts?

2. 2

   When monitoring an Amazon SageMaker endpoint, which metric is most useful for identifying if your model is struggling to keep up with incoming request volume?

3. 3

   You have configured a CloudWatch Alarm to trigger when the 99th percentile of model latency exceeds 200ms. Why is it better to use P99 rather than Average latency for this alarm?

4. 4

   Which feature allows you to visualize multiple model performance metrics, such as Invocations and ModelLatency, on a single screen in the AWS Console?

5. 5

   You notice that your SageMaker endpoint is triggering an 'Invocation4XXErrors' alarm. What is the most likely cause you should investigate first?