MLflow Project Joins the Linux Foundation
Databricks created MLflow (https://mlflow.org/) in 2018 as an open source platform for the management of machine learning lifecycles. The platform was created in response to the complicated process of machine learning model development. Unlike traditional software development, machine learning models must not only track code versions, but versions of data sets, model parameters, and algorithms. Because of this, the variables that must be tracked and managed can grow exponentially.
MLflow prevents the process from overwhelming scientists, educators, developers, and other users by providing a platform to fully manage end-to-end machine learning development lifecycles, which includes data prep, deployment, experiment tracking, creating reproducible runs, model sharing, and collaboration.
Matei Zaharia, the original creator of Apache Spark and creator of MLflow, said of his platform, “MLflow…