StackedML
Practice
Labs
Questions
Models
Pricing
Sign in
Questions
/
Model Evaluation & Experimentation
/
Experimentation
/
Offline vs online evaluation
← Previous
Next →
727.
Shadow Mode Evaluation
medium
Shadow mode deployment is used to evaluate a new model before full rollout. What does it involve?
A
Testing the new model on synthetic users generated from the production data distribution
B
Deploying the new model to a small random sample of users while the rest continue seeing the production model
C
Running the new model in parallel with the production model — its predictions are logged but not served to users
D
Evaluating the new model on live traffic using offline metrics computed in real time without user exposure
Sign in to verify your answer
← Back to Questions