MLflow 2.9.0 includes several major features and improvements.
MLflow AI Gateway deprecation (#10420, @harupy)
The feature previously known as MLflow AI Gateway has been moved to utilize the MLflow deployments API. For guidance on migrating from the AI Gateway to the new deployments API, please see the [MLflow AI Gateway Migration Guide](https://mlflow.org/docs/latest/llms/gateway/migration.html.
MLflow Tracking docs overhaul (#10471, @B-Step62)
The MLflow tracking docs have been overhauled. We'd like your feedback on the new tracking docs!
Security fixes
Three security patches have been filed with this release and CVE's have been issued with the details involved in the security patch and potential attack vectors. Please review and update your tracking server deployments if your tracking server is not securely deployed and has open access to the internet.
- Sanitize
path
inHttpArtifactRepository.list_artifacts
(#10585, @harupy) - Sanitize
filename
inContent-Disposition
header forHTTPDatasetSource
(#10584, @harupy). - Validate
Content-Type
header to prevent POST XSS (#10526, @B-Step62)
Features
- [Tracking] Use
backoff_jitter
when making HTTP requests (#10486, @ajinkyavbhandare) - [Tracking] Add default
aggregate_results
if the score type is numeric inmake_metric
API (#10490, @sunishsheth2009) - [Tracking] Add string type of score types for metric value for genai (#10307, @sunishsheth2009)
- [Artifacts] Support multipart upload for for proxy artifact access (#9521, @harupy)
- [Models] Support saving
torch_dtype
for transformers models (#10586, @serena-ruan) - [Models] Add built-in metric
ndcg_at_k
to retriever evaluation (#10284, @liangz1) - [Model Registry] Implement universal
copy_model_version
(#10308, @jerrylian-db) - [Models] Support saving/loading
RunnableSequence
,RunnableParallel
, andRunnableBranch
(#10521, #10611, @serena-ruan)
Bug fixes
- [Tracking] Resume system metrics logging when resuming an existing run (#10312, @chenmoneygithub)
- [UI] Fix incorrect sorting order in line chart (#10553, @B-Step62)
- [UI] Remove extra whitespace in git URLs (#10506, @mrplants)
- [Models] Make spark_udf use NFS to broadcast model to spark executor on databricks runtime and spark connect mode (#10463, @WeichenXu123)
- [Models] Fix promptlab pyfunc models not working for chat routes (#10346, @daniellok-db)
Documentation updates
- [Docs] Add a quickstart guide for Tensorflow (#10398, @chenmoneygithub)
- [Docs] Improve the parameter tuning guide (#10344, @chenmoneygithub)
- [Docs] Add a guide for system metrics logging (#10429, @chenmoneygithub)
- [Docs] Add instructions on how to configure credentials for Azure OpenAI (#10560, @BenWilson2)
- [Docs] Add docs and tutorials for Sentence Transformers flavor (#10476, @BenWilson2)
- [Docs] Add tutorials, examples, and guides for Transformers Flavor (#10360, @BenWilson2)
For a comprehensive list of changes, see the release change log, and check out the latest documentation on mlflow.org.