Manual Prompt Evaluation Quiz
Quiz covering Prompt Engineering and Prompt Flow
Manual Prompt Evaluation Quiz
5 questions | Pass: 70% | Earn 25 points
Questions in this quiz
A preview of the 5 questions covered. Start the quiz above to answer them, check your score, and read the explanations.
- 1
When manually evaluating a prompt's output, what is the primary purpose of using a 'ground truth' reference?
- 2
You are evaluating a prompt for a customer support bot. The bot correctly answers the user's question but uses a tone that is too casual for your brand guidelines. Which evaluation metric should you prioritize?
- 3
When performing manual evaluation of prompt outputs, what is the 'Chain of Thought' (CoT) technique intended to reveal?
- 4
Which of the following is a common pitfall when manually evaluating prompts using a small, non-diverse dataset?
- 5
During a manual evaluation, you notice the model exhibits 'hallucination' on a specific prompt variation. Which strategy is most effective to resolve this during the iterative prompt engineering cycle?
- Automated Machine Learning for Tabular Data
- AutoML Tabular Data Quiz5q
- Automated Machine Learning for Computer Vision
- AutoML Computer Vision Quiz5q
- Automated Machine Learning for NLP
- AutoML NLP Quiz5q
- Training Options Preprocessing and Algorithms
- Training Options Quiz5q
- Evaluating AutoML Runs with Responsible AI
- AutoML Responsible AI Quiz5q
- Configuring a Compute Instance Terminal
- Compute Instance Terminal Quiz5q
- Accessing and Wrangling Data in Notebooks
- Data Wrangling in Notebooks Quiz5q
- Using Synapse Spark Pools and Serverless Spark
- Spark Pools Quiz5q
- Retrieving Features from a Feature Store
- Feature Store Quiz5q
- Tracking Model Training with MLflow
- MLflow Tracking Quiz5q
- Evaluating Models with Responsible AI Guidelines
- Responsible AI Model Evaluation Quiz5q
- Consuming Data in a Job
- Consuming Data in Jobs Quiz5q
- Configuring Compute for a Job Run
- Job Compute Configuration Quiz5q
- Configuring an Environment for a Job Run
- Job Environment Configuration Quiz5q
- Tracking Model Training with MLflow in Jobs
- MLflow in Jobs Quiz5q
- Defining Parameters for a Job
- Job Parameters Quiz5q
- Running a Script as a Job
- Running Scripts as Jobs Quiz5q
- Using Logs to Troubleshoot Job Errors
- Job Troubleshooting Quiz5q
- Configuring Settings for Online Deployment
- Online Deployment Settings Quiz5q
- Deploying a Model to an Online Endpoint
- Online Endpoint Deployment Quiz5q
- Testing an Online Deployed Service
- Testing Online Services Quiz5q
- Configuring Compute for Batch Deployment
- Batch Compute Configuration Quiz5q
- Deploying a Model to a Batch Endpoint
- Batch Endpoint Deployment Quiz5q
- Invoking Batch Endpoint for Scoring Jobs
- Batch Scoring Jobs Quiz5q
- Preparing Data for Fine-Tuning
- Fine-Tuning Data Preparation Quiz5q
- Selecting an Appropriate Base Model
- Base Model Selection Quiz5q
- Running a Fine-Tuning Job
- Fine-Tuning Jobs Quiz5q
- Evaluating Your Fine-Tuned Model
- Fine-Tuned Model Evaluation Quiz5q
- Deploying Fine-Tuned Models
- Deploying Fine-Tuned Models Quiz5q
- Understanding AI Model Evaluation Metrics
- AI Model Evaluation Metrics Quiz5q
- Implementing Content Safety Filters
- Content Safety Filters Quiz5q
- Managing Model Bias and Fairness
- Model Bias and Fairness Quiz5q
- Model Interpretability and Explainability
- Model Interpretability Quiz5q
- Monitoring Model Performance in Production
- Model Performance Monitoring Quiz5q
- Data Drift Detection and Handling
- Data Drift Detection Quiz5q
- Azure AI Content Safety Integration
- Azure AI Content Safety Quiz5q
- Model Versioning and Lineage Tracking
- Model Versioning Quiz5q
- A/B Testing for Model Deployment
- A/B Testing Quiz5q
- Cost Optimization for ML Workloads
- Cost Optimization Quiz5q
- Security Best Practices for ML Models
- Security Best Practices Quiz5q
Enjoying the courses?
Everything stays free. Pro shows fewer ads, doubles the points you earn on every lesson and quiz so you progress twice as fast, unlocks half of every practice exam — plus full case studies — with the Learn & Exam study modes, and lets you read each lesson on one page.
- ✓ Fewer advertisements
- ✓ 2× points per lesson & quiz
- ✓ 50% of every exam unlocked
- ✓ Learn & Exam modes
- ✓ Distraction-free lessons