MLflow tracking and registry
**MLflow Tracking** logs parameters, code versions, metrics, and artifacts for each experiment run, with a UI to compare results. The **Model Registry** then manages lifecycle: versions, aliases, tags, lineage, and deployment pointers. T...
What it is
MLflow Tracking logs parameters, code versions, metrics, and artifacts for each experiment run, with a UI to compare results. The Model Registry then manages lifecycle: versions, aliases, tags, lineage, and deployment pointers. Together they answer: what did we try, what won, and what’s in prod?
<!-- IMAGE: experiment → runs → registered model@champion -->
Visual Spec & Architecture Diagram
MLflow conceptual UI: Experiment runs table (params, metrics); Model Registry versions with stage tags. Fake run IDs. Caption 'tracking + registry'.
Why it matters
Without tracking, “best model” is folklore. Without a registry, rollback is archaeology. Production MLOps (Google Cloud level 2) explicitly includes experiment/metadata stores and a model registry.
How it works (plain)
- Start a run inside an experiment.
- Log params, metrics, and artifacts (including models).
- Compare runs in the UI or API.
- Register the chosen model; assign aliases like
champion. - Deploy/load via
models:/Name@champion; reassign alias to roll forward/back.
Everyday example
A lab notebook with dated pages (tracking) plus a locked cabinet labeled “current reagent” (registry).
Try it
Log three toy runs that differ by one parameter. Pick a winner by a metric. Write the registry alias you would point production to.
Myths
- ⚠️ Myth: Local
mlruns/folders are enough for a team. - ✓ Reality: Fine for solo; teams need a tracking server + shared artifact store.
- ⚠️ Myth: Registry stages replace eval gates.
- ✓ Reality: Stages/aliases are pointers—your tests still decide promotion.
Sources
- MLflow Tracking: https://mlflow.org/docs/latest/ml/tracking/ ↗
- MLflow Model Registry: https://mlflow.org/docs/latest/ml/model-registry/ ↗
- Google Cloud MLOps (metadata + registry): https://docs.cloud.google.com/architecture/mlops-continuous-delivery-and-automation-pipelines-in-machine-learning ↗
