domino logo
Latest (5.4)
  • Tech Ecosystem
  • Deployment-wide Search
  • Get Started
  • Security and Credentials
  • Collaborate
  • Organizations
  • Projects
  • Domino Datasets
  • External Data
  • Workspaces
  • Environments
  • Executions
  • Model APIs
  • Publish
  • Model Monitoring and Remediation
  • Notifications
  • Download the Audit Log
  • Domino Command Line Interface (CLI)
  • Troubleshooting
  • Get Help
domino logo
About Domino
Domino Data LabKnowledge BaseData Science BlogTraining
User Guide
>
Model Monitoring and Remediation
>
Set Up Model Monitor

Set Up Model Monitor

Use the Model Monitor to configure monitoring for models that aren’t deployed on Model APIs or for those models deployed outside Domino.

The following topics explain the steps:

  1. Connect a Data Source. Connect to external data sources to access your training, prediction, and ground truth data.

  2. Register a Model. Register external models so that Domino can capture information about them through their Monitoring Config JSON files.

  3. Set up Drift Detection. Add data that was trained on historical data to your model’s code to start ingesting and storing prediction data for monitoring.

    • Optional: Configure notifications or change the scheduled checks.

  4. Analyze data drift. See the divergence value for features and experiment with test types, thresholds, and other conditions.

    • Optional: Configure notifications or change the scheduled checks.

  5. Set up Model Quality Monitoring. Ingest ground truth data to monitor the quality of the model’s predictions.

    • Optional: Configure notifications or change the scheduled checks.

  6. Set up Cohort Analysis. Get insights into model quality so you can find underperforming data hotspots for model remediation.

Domino Data LabKnowledge BaseData Science BlogTraining
Copyright © 2022 Domino Data Lab. All rights reserved.