My Rendezvous with Experiment Tracking & Model Management at the DataTalksClub's MLOps Zoomcamp
I recently finished Module 2 of the MLOps Zoomcamp (hands-on with experiment tracking and model management). The homework was intense – a real grind – but very educational. Rather than sifting through disorganized files for metrics and models, we used MLflow to automatically log and organize all experiment runs. Hyperopt handled our search space, and the best model got neatly registered. Below I share how each step helped turn chaotic experimentation into a clear, reproducible process. Experiment Tracking with MLflow Experiment tracking is about systematically recording every training run so you can reproduce and compare results. MLflow makes this easy. In practice we wrapped our training code (in train.py ) with MLflow’s run API and enabled MLflow’s autologging ( mlflow.sklearn.autolog() ). This meant every model parameter, metric, and artifact was captured automatically. For example, once MLflow autologging was on, we track all hyperparameters and metrics without manual logging . Wit...