Fix java model server compatibility with models containing databricks_runtime conf by dbczumar · Pull Request #6337 · mlflow/mlflow

dbczumar · 2022-07-26T22:54:32Z

Signed-off-by: dbczumar [email protected]

Related Issues/PRs

Fixes #6307

What changes are proposed in this pull request?

Fix java model server compatibility with models containing databricks_runtime conf

How is this patch tested?

Added tests

Does this PR change the documentation?

No. You can skip the rest of this section.
Yes. Make sure the changed pages / sections render correctly by following the steps below.

Check the status of the ci/circleci: build_doc check. If it's successful, proceed to the
next step, otherwise fix it.
Click Details on the right to open the job page of CircleCI.
Click the Artifacts tab.
Click docs/build/html/index.html.
Find the changed pages / sections and make sure they render correctly.

Release Notes

Fix java model server compatibility with models containing databricks_runtime conf

Is this a user-facing change?

No. You can skip the rest of this section.
Yes. Give a description of this change to be included in the release notes for MLflow users.

What component(s), interfaces, languages, and integrations does this PR affect?

Components

Interface

area/uiux: Front-end, user experience, plotting, JavaScript, JavaScript dev server
area/docker: Docker use across MLflow's components, such as MLflow Projects and MLflow Models
area/sqlalchemy: Use of SQLAlchemy in the Tracking Service or Model Registry
area/windows: Windows support

Language

language/r: R APIs and clients
language/java: Java APIs and clients
language/new: Proposals for new client languages

Integrations

integrations/azure: Azure and Azure ML integrations
integrations/sagemaker: SageMaker integrations
integrations/databricks: Databricks integrations

How should the PR be classified in the release notes? Choose one:

rn/breaking-change - The PR will be mentioned in the "Breaking Changes" section
rn/none - No description will be included. The PR will be mentioned only by the PR number in the "Small Bugfixes and Documentation Updates" section
rn/feature - A new user-facing feature worth mentioning in the release notes
rn/bug-fix - A user-facing bug fix worth mentioning in the release notes
rn/documentation - A user-facing documentation change worth mentioning in the release notes

Signed-off-by: dbczumar <[email protected]>

harupy

LGTM!

WeichenXu123

LGTM

* Fix java model server compatibility with models containing databricks_runtime conf (#6337) * Javafix Signed-off-by: dbczumar <[email protected]> * Resource fix Signed-off-by: dbczumar <[email protected]> * Add run / model links to MLP train step card (#6294) * One commit Signed-off-by: dbczumar <[email protected]> * Submodule revert Signed-off-by: dbczumar <[email protected]> * Fix client tests Signed-off-by: dbczumar <[email protected]> * fix ci Signed-off-by: dbczumar <[email protected]> * Remove unused / invalid import Signed-off-by: dbczumar <[email protected]> * Put run summary back to end, fix tests Signed-off-by: dbczumar <[email protected]> * Use mocks instead Signed-off-by: dbczumar <[email protected]> * Fix inefficient relative time computation for metric plot (#6341) * compute minTimestamp only once Signed-off-by: harupy <[email protected]> * fix method name Signed-off-by: harupy <[email protected]> * fix lint Signed-off-by: harupy <[email protected]> * return empty array Signed-off-by: harupy <[email protected]> * fix test Signed-off-by: harupy <[email protected]> * Add `MLFLOW_SQLALCHEMYSTORE_POOL_RECYCLE` flag (#6344) * Add pool_recycle option to SQLAlchemy create_engine Signed-off-by: Michal Karzynski <[email protected]> * Add new option to unit test Signed-off-by: Michal Karzynski <[email protected]> * Add note in documentation Signed-off-by: Michal Karzynski <[email protected]> * Add box plot in compare-runs page (#6308) * Added BoxPlot Signed-off-by: changyonglik <[email protected]> * Fixed key error Signed-off-by: changyonglik <[email protected]> * Added default state Signed-off-by: changyonglik <[email protected]> * Fixed props passing Signed-off-by: changyonglik <[email protected]> * Fixed react hooks state Signed-off-by: changyonglik <[email protected]> * Added unit test Signed-off-by: changyonglik <[email protected]> * Added boxplot to CompareModelVersion Signed-off-by: changyonglik <[email protected]> * Changed keys numbering to reflect tab name Signed-off-by: changyonglik <[email protected]> * Made the ordering of tabs consistent accross CompareRunView and CompareModelVersion Signed-off-by: changyonglik <[email protected]> * Linted Signed-off-by: changyonglik <[email protected]> * Fixed FormattedMessage Signed-off-by: changyonglik <[email protected]> * refactoring Signed-off-by: harupy <[email protected]> * fix lint errors Signed-off-by: harupy <[email protected]> * i18n Signed-off-by: harupy <[email protected]> * minor comment fix Signed-off-by: harupy <[email protected]> Co-authored-by: harupy <[email protected]> * Add script and workflow to update requirements.yaml specifications (#6287) * add script to update requirements.yaml Signed-off-by: harupy <[email protected]> * update both skinny and core requirements Signed-off-by: harupy <[email protected]> * remove base Signed-off-by: harupy <[email protected]> * clean up Signed-off-by: harupy <[email protected]> * add MLFLOW_CONDA_HOME Signed-off-by: harupy <[email protected]> * create create-pr job Signed-off-by: harupy <[email protected]> * fix syntax Signed-off-by: harupy <[email protected]> * remove redundant if Signed-off-by: harupy <[email protected]> * clean up Signed-off-by: harupy <[email protected]> * doc Signed-off-by: harupy <[email protected]> * dynamically determine python version Signed-off-by: harupy <[email protected]> * remove python version mock Signed-off-by: harupy <[email protected]> * use setup-ssh.sh in master.yml Signed-off-by: harupy <[email protected]> * simplify Signed-off-by: harupy <[email protected]> * update both core and skinny requirements Signed-off-by: harupy <[email protected]> * use env Signed-off-by: harupy <[email protected]> * remove action version Signed-off-by: harupy <[email protected]> * fix pandas dtypes issue Signed-off-by: harupy <[email protected]> * check if PR already exists Signed-off-by: harupy <[email protected]> * add semicolons Signed-off-by: harupy <[email protected]> * test PR creation Signed-off-by: harupy <[email protected]> * set base Signed-off-by: harupy <[email protected]> * use run_number Signed-off-by: harupy <[email protected]> * set result-encoding Signed-off-by: harupy <[email protected]> * revert changes for test Signed-off-by: harupy <[email protected]> * fix more tests Signed-off-by: harupy <[email protected]> * fix run URL Signed-off-by: harupy <[email protected]> * add dot Signed-off-by: harupy <[email protected]> * remove minimum_version Signed-off-by: harupy <[email protected]> * remove create-pr job Signed-off-by: harupy <[email protected]> * rename workflow Signed-off-by: harupy <[email protected]> * mutate dict approach Signed-off-by: harupy <[email protected]> * use ruamel Signed-off-by: harupy <[email protected]> * remove PYTHON_VERSION patch Signed-off-by: harupy <[email protected]> * add ruamel.yaml to requirements Signed-off-by: harupy <[email protected]> * skip update-requirements on PR Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * print new version Signed-off-by: harupy <[email protected]> * preserve quotes Signed-off-by: harupy <[email protected]> * fix badge Signed-off-by: harupy <[email protected]> * fix README Signed-off-by: harupy <[email protected]> * run ci Signed-off-by: harupy <[email protected]> * remove validate-requirements.yml Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * fix test_dataframe_from_json Signed-off-by: harupy <[email protected]> * Make `model_uri` optional for `mlflow models build-docker` (#6302) * Make model_uri optional for mlflow models build-docker Signed-off-by: harupy <[email protected]> * fix doc Signed-off-by: harupy <[email protected]> * Add generic Signed-off-by: harupy <[email protected]> * Add pythou_function flavor Signed-off-by: harupy <[email protected]> * fix doc Signed-off-by: harupy <[email protected]> * quotes Signed-off-by: harupy <[email protected]> * use longer options Signed-off-by: harupy <[email protected]> * add index (#6347) Signed-off-by: harupy <[email protected]> * fix badge link (#6349) Signed-off-by: harupy <[email protected]> * Enable consider-using-dict-items rule for pylint (#6351) * Enable consider-using-dict-items Signed-off-by: harupy <[email protected]> * fix lint errors Signed-off-by: harupy <[email protected]> * Enable consider-merging-isinstance (#6350) Signed-off-by: harupy <[email protected]> * Enable consider-using-from-import rule for pylint (#6352) * Enable consider-using-from-import Signed-off-by: harupy <[email protected]> * fix Signed-off-by: harupy <[email protected]> * fix datasets import Signed-off-by: harupy <[email protected]> * fix failed tests Signed-off-by: harupy <[email protected]> * Run model registry sqlalchemy tests in database job (#6353) Signed-off-by: harupy <[email protected]> * update to run profiles on the first 100 dataframe columns (#6297) * update to run profiles on the first 100 dataframe columns Signed-off-by: Sunish Sheth <[email protected]> * Adding replace=True so we can sample rows twice Signed-off-by: Sunish Sheth <[email protected]> * Removing replace=true and fixing how the max_rows are calculated Signed-off-by: Sunish Sheth <[email protected]> * Fix sklearn autologging input example & signature mutation for models containing transformers (#6230) * Fix with test case Signed-off-by: dbczumar <[email protected]> * Test fix Signed-off-by: dbczumar <[email protected]> * Fix and simplification Signed-off-by: dbczumar <[email protected]> * more fixes & better test coveragE Signed-off-by: dbczumar <[email protected]> * test Signed-off-by: dbczumar <[email protected]> * LGBM test Signed-off-by: dbczumar <[email protected]> * Format Signed-off-by: dbczumar <[email protected]> * Address comments Signed-off-by: dbczumar <[email protected]> * Fixes Signed-off-by: dbczumar <[email protected]> * Use py37-compatible call args syntax Signed-off-by: dbczumar <[email protected]> * use list (#6363) Signed-off-by: harupy <[email protected]> * Log runtime pipeline config to MLflow (#6359) * Log runtime pipeline config to MLflow Signed-off-by: Jin Zhang <[email protected]> * Fixed lint Signed-off-by: Jin Zhang <[email protected]> * Add status badge for stale action (#6372) Signed-off-by: harupy <[email protected]> * Add stack trace section to bug report template (#6374) Signed-off-by: harupy <[email protected]> * Skipping the transform step by using Functional transformer (#6362) Signed-off-by: Sunish Sheth <[email protected]> * Series schema (#6361) * Added in name for ColSpec of pandas datatype infer panda series name for ColSpec Signed-off-by: Ryan Fogle <[email protected]> * Added test for Series name inference added one more pytest condition in test_schema:test_schema_inference_on_pandas_series Signed-off-by: Ryan Fogle <[email protected]> * Update test_schema.py Added in one more assertion to test schema inference. Signed-off-by: Ryan Fogle <[email protected]> * ran black Signed-off-by: Ryan Fogle <[email protected]> * added in requested changes in issue #6361 Signed-off-by: Ryan Fogle <[email protected]> * fix typo. changed hasattr to getattr Signed-off-by: Ryan Fogle <[email protected]> * integrate mlflowdbfs (#6282) Signed-off-by: Brian Barnes <[email protected]> * Fix step card display breakage in Jupyter notebooks (#6378) * remove Signed-off-by: apurva-koti <[email protected]> * fix Signed-off-by: apurva-koti <[email protected]> * Avoid using flask 2.2.0 (#6380) Signed-off-by: harupy <[email protected]> * Migrate GCS environment variables to `mlflow.environment_variables` module (#6375) * Migrate GCS environment variables to mlflow.environment_variables Signed-off-by: harupy <[email protected]> * add default Signed-off-by: harupy <[email protected]> * improve comments Signed-off-by: harupy <[email protected]> * Avoid logging model signatures in pyspark ML autologging if model input/output dataframe contains unsupported data types (#6365) * Avoid logging signatures Signed-off-by: harupy <[email protected]> * test Signed-off-by: harupy <[email protected]> * fix indent Signed-off-by: harupy <[email protected]> * check model output Signed-off-by: harupy <[email protected]> * fix warning message Signed-off-by: harupy <[email protected]> * todo Signed-off-by: harupy <[email protected]> * update test and doc Signed-off-by: harupy <[email protected]> * fix docstring Signed-off-by: harupy <[email protected]> * fix failed tests Signed-off-by: harupy <[email protected]> * improve _assert_autolog_infers_model_signature_correctly Signed-off-by: harupy <[email protected]> * Refactor `set_matrix.py` (#6373) * refacor set_matrix.py Signed-off-by: harupy <[email protected]> * fix Signed-off-by: harupy <[email protected]> * fix tests Signed-off-by: harupy <[email protected]> * tset for --no-dev Signed-off-by: harupy <[email protected]> * install pytest and pytest-cov Signed-off-by: harupy <[email protected]> * test for --changed-files Signed-off-by: harupy <[email protected]> * add pyyaml to requirements Signed-off-by: harupy <[email protected]> * fix is_matrix_empty Signed-off-by: harupy <[email protected]> * use raw string and re.match Signed-off-by: harupy <[email protected]> * Fix is_matrix_empty (#6385) Signed-off-by: harupy <[email protected]> * Allow mlflow-skinny's autolog() to succeed when no scipy is installed (#5897) * allow mlflow-skinny's autolog() to succeed when no scipy is installed Signed-off-by: Hannes Schulz <[email protected]> * optional pyfunc scipy dependency Signed-off-by: Hannes Schulz <[email protected]> * fix linter-discovered issues Signed-off-by: Hannes Schulz <[email protected]> * add test case, autolog() should pass w/o scipy installed Signed-off-by: Hannes Schulz <[email protected]> * minor cleanup Signed-off-by: Hannes Schulz <[email protected]> * test creating _Example with / without scipy present Signed-off-by: Hannes Schulz <[email protected]> * docs: do not warn about sparse matrix classes Signed-off-by: Hannes Schulz <[email protected]> * linting Signed-off-by: Hannes Schulz <[email protected]> * address review comment Signed-off-by: Hannes Schulz <[email protected]> * run black Signed-off-by: Hannes Schulz <[email protected]> * allow mlflow-skinny's autolog() to succeed when no scipy is installed Signed-off-by: Hannes Schulz <[email protected]> * optional pyfunc scipy dependency Signed-off-by: Hannes Schulz <[email protected]> * fix linter-discovered issues Signed-off-by: Hannes Schulz <[email protected]> * add test case, autolog() should pass w/o scipy installed Signed-off-by: Hannes Schulz <[email protected]> * minor cleanup Signed-off-by: Hannes Schulz <[email protected]> * test creating _Example with / without scipy present Signed-off-by: Hannes Schulz <[email protected]> * docs: do not warn about sparse matrix classes Signed-off-by: Hannes Schulz <[email protected]> * linting Signed-off-by: Hannes Schulz <[email protected]> * address review comment Signed-off-by: Hannes Schulz <[email protected]> * run black Signed-off-by: Hannes Schulz <[email protected]> * remove redundant None check after import Signed-off-by: Hannes Schulz <[email protected]> * delete comment Signed-off-by: Hannes Schulz <[email protected]> * Revert "remove redundant None check after import" This reverts commit f2e198c. Signed-off-by: Hannes Schulz <[email protected]> * review comments Signed-off-by: Hannes Schulz <[email protected]> * remove redundant test Signed-off-by: Hannes Schulz <[email protected]> * Apply suggestions from code review Co-authored-by: Harutaka Kawamura <[email protected]> Signed-off-by: Hannes Schulz <[email protected]> * Autoformat: https://github.com/mlflow/mlflow/actions/runs/2779791161 Signed-off-by: mlflow-automation <[email protected]> Co-authored-by: Harutaka Kawamura <[email protected]> Co-authored-by: dbczumar <[email protected]> Co-authored-by: mlflow-automation <[email protected]> * Fix extraneous warning about pyspark evaluation truncation (#6389) * Revert #6380 (#6386) * revert Signed-off-by: harupy <[email protected]> * workaround for test_prometheus_exporter Signed-off-by: harupy <[email protected]> * nit Signed-off-by: harupy <[email protected]> * Validate metric value in `FileStore.log_metric` (#6381) * add failing test Signed-off-by: harupy <[email protected]> * use _validate_metric Signed-off-by: harupy <[email protected]> * fix invalid metric timestamp Signed-off-by: harupy <[email protected]> * fix docstring Signed-off-by: harupy <[email protected]> * fix java test Signed-off-by: harupy <[email protected]> * Make search experiment by tag key comparison case sensitive in MYSQL (#6333) * init Signed-off-by: Weichen Xu <[email protected]> * add test Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * fix BINARY conditions in MySQL Signed-off-by: harupy <[email protected]> * fix attr error Signed-off-by: harupy <[email protected]> Co-authored-by: harupy <[email protected]> * Run Model Registry SQLAlchemy tests in PostgreSQL, MySQL, and MSSQL (#6390) * Run Model Registry SQLAlchemy tests in postgres, mysql, and mssql Signed-off-by: harupy <[email protected]> * fix failed tests Signed-off-by: harupy <[email protected]> * remove uuid Signed-off-by: harupy <[email protected]> * clean up Signed-off-by: harupy <[email protected]> * do not drop tables Signed-off-by: harupy <[email protected]> * Fix filestore data loss on failed write & mitigate read / write race condition (#6388) * Fix Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * Format Signed-off-by: dbczumar <[email protected]> * Added a custom filter from_json to render_and_merge_yaml (#6368) * Added a custom filter from_json to render_and_merge_yaml Signed-off-by: Jin Zhang <[email protected]> * Fixed test Signed-off-by: Jin Zhang <[email protected]> * Update tests/utils/test_file_utils.py Co-authored-by: Siddharth Murching <[email protected]> * Update tests/utils/test_file_utils.py Co-authored-by: Siddharth Murching <[email protected]> * Fixed test Signed-off-by: Jin Zhang <[email protected]> * Fixed windows test attempt Signed-off-by: Jin Zhang <[email protected]> * Fixed windows test Signed-off-by: Jin Zhang <[email protected]> Co-authored-by: Siddharth Murching <[email protected]> * Fix `!=` operator for MySQL (#6397) * fix ne operator and improve tests Signed-off-by: harupy <[email protected]> * add () to other operators Signed-off-by: harupy <[email protected]> * Simplify the documentation section in the PR template (#6398) * Simplify the documentation section in the PR template Signed-off-by: harupy <[email protected]> * fix Signed-off-by: harupy <[email protected]> * Timebased gc (#6354) * Added delete_time field to runs table Signed-off-by: Jason Cheng <[email protected]> * Updated latest_schema.sql to pass tests/store/tracking/test_sqlalchemy_store_schema.py Signed-off-by: Jason Cheng <[email protected]> * Added delete_time column into mlflow/store/tracking/dbmodels/initial_models.py Signed-off-by: Jason Cheng <[email protected]> * Moved the docstring to the end of the declaration instead of the start Signed-off-by: Jason Cheng <[email protected]> * Regenerated protobuf for RunInfo new schema, and passed pytest Signed-off-by: Jason Cheng <[email protected]> * Added --older-than flag in mlflow gc command, and added tests for that cli command Signed-off-by: Jason Cheng <[email protected]> * Removed delete_time from RunInfo proto Signed-off-by: Jason Cheng <[email protected]> * Set default older-than flag to None Signed-off-by: Jason Cheng <[email protected]> * Remove delete_time from RunInfo, add optional parameter older_than to store.get_deleted_runs(), and write delete_time into yaml file for file storage instead of adding it to RunInfo Signed-off-by: Jason Cheng <[email protected]> * Remove commented delete_time in RunInfo constructor in models.py Signed-off-by: Jason Cheng <[email protected]> * added INVALID_PARAMETER_VALUE error code in mlflow gc Signed-off-by: Jason Cheng <[email protected]> * Resolve case of delete time not in meta.yaml file, edited overwrite_run_info and gc Signed-off-by: Jason Cheng <[email protected]> * Rename delete_time to deleted_time Signed-off-by: Jason Cheng <[email protected]> * Rename delete_time to deleted_time, match error message in cli tests, filter SqlRuns by deleted_time, indicate float values accepted for gc --older-than flag Signed-off-by: Jason Cheng <[email protected]> * Rename delete_time to deleted_time, fixed assert statement in test_mlflow_gc, and fixed deleted_time queries in test_file_store.py and test_sqlalchemy_store.py Signed-off-by: Jason Cheng <[email protected]> * Only check if is in meta after restoring run in test_delte_restore_run Signed-off-by: Jason Cheng <[email protected]> * Fixed lint errors Signed-off-by: Jason Cheng <[email protected]> * Install mlflow from repository root Signed-off-by: harupy <[email protected]> Co-authored-by: harupy <[email protected]> * Separate protos job (#6399) * Separate protos job Signed-off-by: harupy <[email protected]> * test Signed-off-by: harupy <[email protected]> * Add paths Signed-off-by: harupy <[email protected]> * Revert "test" This reverts commit 5d04b02. Signed-off-by: harupy <[email protected]> * Fix flaky `TestFileStore.test_get_deleted_runs` (#6402) * use gt operator Signed-off-by: harupy <[email protected]> * fix sqlalchemy store Signed-off-by: harupy <[email protected]> * Migrate environment variables for SQLAlchemy store (#6396) Signed-off-by: harupy <[email protected]> * Deduplicate MlflowClient in MLflow docs, move to mlflow.client module (#6405) * Dedupe MlflowClient Signed-off-by: dbczumar <[email protected]> * Improvements Signed-off-by: dbczumar <[email protected]> * Add client Signed-off-by: dbczumar <[email protected]> * Remove unused functions in `mlflow.data` module (#6408) * remove unused functions in data Signed-off-by: harupy <[email protected]> * Remove unused functions and variables Signed-off-by: harupy <[email protected]> * Tag based registered model search and model version search (#6320) * init Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update tests Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * clean Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * add test Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * de-dup tag based search result Signed-off-by: Weichen Xu <[email protected]> * add () to fix case_sensitive_mysql_ne Signed-off-by: Weichen Xu <[email protected]> * fix Signed-off-by: Weichen Xu <[email protected]> * lint Signed-off-by: Weichen Xu <[email protected]> * fix * fix test in TODO Signed-off-by: Weichen Xu <[email protected]> * support dup tag key filter Signed-off-by: Weichen Xu <[email protected]> * add mv order by Signed-off-by: Weichen Xu <[email protected]> * cmp res list in test Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * add doc Signed-off-by: Weichen Xu <[email protected]> * fix Signed-off-by: Weichen Xu <[email protected]> * fix lint Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * update doc Signed-off-by: Weichen Xu <[email protected]> * Increase maximum param value length to 500 (#6358) * increase validation of maximum param value length from 250 to 500 (squashed) Signed-off-by: Jan Sindlar <[email protected]> * 1. added test for exceeding max length. 2. lint. 3. validation logic addresses null Signed-off-by: Jan Sindlar <[email protected]> * file store should test already stringified params Signed-off-by: Jan Sindlar <[email protected]> * update alembic chain Signed-off-by: Jan Sindlar <[email protected]> * Autoformat: https://github.com/mlflow/mlflow/actions/runs/2800398158 Signed-off-by: mlflow-automation <[email protected]> * Update tests/store/tracking/test_file_store.py Co-authored-by: Harutaka Kawamura <[email protected]> Signed-off-by: Jan Sindlar <[email protected]> Co-authored-by: Jan Sindlar <[email protected]> Co-authored-by: mlflow-automation <[email protected]> Co-authored-by: Harutaka Kawamura <[email protected]> * Add workflow dispatch for requirements validation, remove duplicate file (#6418) * Workflow dispatch Signed-off-by: dbczumar <[email protected]> * Remove unused Signed-off-by: dbczumar <[email protected]> * Prevent `pytest.raises` context manager from containing multiple statements (#6409) * rename Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * Do not allow calling assert in pytest.raises Signed-off-by: harupy <[email protected]> * more strict rule Signed-off-by: harupy <[email protected]> * Improve error message Signed-off-by: harupy <[email protected]> * relax condition Signed-off-by: harupy <[email protected]> * fix lint errors Signed-off-by: harupy <[email protected]> * fix failed tests Signed-off-by: harupy <[email protected]> * clean up Signed-off-by: harupy <[email protected]> * rename _is_complex_pytest_raises Signed-off-by: harupy <[email protected]> * fix lint errors Signed-off-by: harupy <[email protected]> * fix failed tests Signed-off-by: harupy <[email protected]> * Fix regression in pandas type inference behavior for scoring server (#6417) * Fix impl Signed-off-by: dbczumar <[email protected]> * Remove unused pandas import Signed-off-by: dbczumar <[email protected]> * Adjust client to use SearchExperiments POST method (#6415) * POST Signed-off-by: dbczumar <[email protected]> * Generate protos Signed-off-by: dbczumar <[email protected]> * Fix test Signed-off-by: dbczumar <[email protected]> * update (#6420) Signed-off-by: Weichen Xu <[email protected]> * Check if artifacts are proxied in model_version_artifact_handler (#6355) * Check if artifacts are proxied in model_version_artifact_handler Signed-off-by: Mohammad Abbas <[email protected]> * Use file prefix for artifact dest on windows Signed-off-by: dbczumar <[email protected]> * Fix application of prefix Signed-off-by: dbczumar <[email protected]> * Fixes Signed-off-by: dbczumar <[email protected]> Co-authored-by: dbczumar <[email protected]> * Allow sql filter IN operator right-hand side values including whitespaces (#6413) * support in rhs whitespace Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * Fix IN operator related issues in sql filter parser (#6411) * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * clean Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * address comment Signed-off-by: Weichen Xu <[email protected]> * Remove unused method `SearchUtils._get_comparison_for_model_registry` (#6412) * init Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * Update MLflow UI (#6422) * Project import generated by Copybara. GitOrigin-RevId: 086b1200f4573559e37fcea6cb5472d52f166e42 Signed-off-by: dbczumar <[email protected]> * Reconcile changes from universe with OSS Signed-off-by: dbczumar <[email protected]> * Fix test fails Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * Apply model search fix Signed-off-by: dbczumar <[email protected]> * Remove errant test line Signed-off-by: dbczumar <[email protected]> Co-authored-by: Richard Zang <[email protected]> * remove near from deprecation msg (#6430) Signed-off-by: ninabacc-db <[email protected]> * Raise clear error message when pipeline path contains a space (#6426) * Add unsupported Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * Exc Signed-off-by: dbczumar <[email protected]> * Test Signed-off-by: dbczumar <[email protected]> * Format Signed-off-by: dbczumar <[email protected]> * Test fix Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * [ALL TESTS] Changelog for MLflow 1.28.0 (#6433) * Generating changelog for MLflow 1.27.1.dev0 Signed-off-by: Jenkins <[email protected]> * Changelog Signed-off-by: dbczumar <[email protected]> * Add missing PR Signed-off-by: dbczumar <[email protected]> * Some fixes Signed-off-by: dbczumar <[email protected]> * More small fixes Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> Signed-off-by: Jenkins <[email protected]> Signed-off-by: dbczumar <[email protected]> Co-authored-by: Jenkins <[email protected]> Co-authored-by: dbczumar <[email protected]> * Patch (#6440) Signed-off-by: dbczumar <[email protected]> Signed-off-by: dbczumar <[email protected]> * [ALL TESTS] Update (#6443) * python dev/update_ml_package_versions.py Signed-off-by: Jenkins <[email protected]> * pyspark max ver 3.4 Signed-off-by: Weichen Xu <[email protected]> Signed-off-by: Jenkins <[email protected]> Signed-off-by: Weichen Xu <[email protected]> Co-authored-by: Jenkins <[email protected]> Co-authored-by: Weichen Xu <[email protected]> * Update MLflow version to 1.28.1 (#6449) Signed-off-by: Jenkins <[email protected]> Signed-off-by: Jenkins <[email protected]> Co-authored-by: Jenkins <[email protected]> * Add data capture config to sagemaker (#6423) Signed-off-by: jonwiggins <[email protected]> Signed-off-by: jonwiggins <[email protected]> * Fix small search_runs docs issues (#6452) * Fix Signed-off-by: dbczumar <[email protected]> * Doc fix Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> Signed-off-by: dbczumar <[email protected]> * python dev/update_pypi_package_index.py (#6442) Signed-off-by: Jenkins <[email protected]> Signed-off-by: Jenkins <[email protected]> Co-authored-by: Jenkins <[email protected]> * use xgboost on pypi (#6461) Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> * Add environment variable for `echo` option in `create_engine` (#6460) * Add environment variable for echo Signed-off-by: harupy <[email protected]> * use _BooleanEnvironmentVariable Signed-off-by: harupy <[email protected]> * address comments Signed-off-by: harupy <[email protected]> * address comments and add tests Signed-off-by: harupy <[email protected]> * fix comment Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> Signed-off-by: dbczumar <[email protected]> Signed-off-by: harupy <[email protected]> Signed-off-by: Michal Karzynski <[email protected]> Signed-off-by: Sunish Sheth <[email protected]> Signed-off-by: Jin Zhang <[email protected]> Signed-off-by: Ryan Fogle <[email protected]> Signed-off-by: Brian Barnes <[email protected]> Signed-off-by: apurva-koti <[email protected]> Signed-off-by: Weichen Xu <[email protected]> Signed-off-by: ninabacc-db <[email protected]> Signed-off-by: Jenkins <[email protected]> Signed-off-by: jonwiggins <[email protected]> Co-authored-by: Corey Zumar <[email protected]> Co-authored-by: Michał Karzyński <[email protected]> Co-authored-by: Chang Yong Lik <[email protected]> Co-authored-by: Sunish Sheth <[email protected]> Co-authored-by: jinzhang21 <[email protected]> Co-authored-by: Ryan Fogle <[email protected]> Co-authored-by: bbarnes52 <[email protected]> Co-authored-by: apurva-koti <[email protected]> Co-authored-by: Hannes Schulz <[email protected]> Co-authored-by: dbczumar <[email protected]> Co-authored-by: mlflow-automation <[email protected]> Co-authored-by: WeichenXu <[email protected]> Co-authored-by: Siddharth Murching <[email protected]> Co-authored-by: Cheng Kuan Yong Jason <[email protected]> Co-authored-by: johnyNJ <[email protected]> Co-authored-by: Jan Sindlar <[email protected]> Co-authored-by: Mohammad Abbas <[email protected]> Co-authored-by: Richard Zang <[email protected]> Co-authored-by: Nina Baccam <[email protected]> Co-authored-by: mlflow-automation <[email protected]> Co-authored-by: Jenkins <[email protected]> Co-authored-by: Jon Wiggins <[email protected]>

* Fix java model server compatibility with models containing databricks_runtime conf (#6337) * Javafix Signed-off-by: dbczumar <[email protected]> * Resource fix Signed-off-by: dbczumar <[email protected]> * Add run / model links to MLP train step card (#6294) * One commit Signed-off-by: dbczumar <[email protected]> * Submodule revert Signed-off-by: dbczumar <[email protected]> * Fix client tests Signed-off-by: dbczumar <[email protected]> * fix ci Signed-off-by: dbczumar <[email protected]> * Remove unused / invalid import Signed-off-by: dbczumar <[email protected]> * Put run summary back to end, fix tests Signed-off-by: dbczumar <[email protected]> * Use mocks instead Signed-off-by: dbczumar <[email protected]> * Fix inefficient relative time computation for metric plot (#6341) * compute minTimestamp only once Signed-off-by: harupy <[email protected]> * fix method name Signed-off-by: harupy <[email protected]> * fix lint Signed-off-by: harupy <[email protected]> * return empty array Signed-off-by: harupy <[email protected]> * fix test Signed-off-by: harupy <[email protected]> * Add `MLFLOW_SQLALCHEMYSTORE_POOL_RECYCLE` flag (#6344) * Add pool_recycle option to SQLAlchemy create_engine Signed-off-by: Michal Karzynski <[email protected]> * Add new option to unit test Signed-off-by: Michal Karzynski <[email protected]> * Add note in documentation Signed-off-by: Michal Karzynski <[email protected]> * Add box plot in compare-runs page (#6308) * Added BoxPlot Signed-off-by: changyonglik <[email protected]> * Fixed key error Signed-off-by: changyonglik <[email protected]> * Added default state Signed-off-by: changyonglik <[email protected]> * Fixed props passing Signed-off-by: changyonglik <[email protected]> * Fixed react hooks state Signed-off-by: changyonglik <[email protected]> * Added unit test Signed-off-by: changyonglik <[email protected]> * Added boxplot to CompareModelVersion Signed-off-by: changyonglik <[email protected]> * Changed keys numbering to reflect tab name Signed-off-by: changyonglik <[email protected]> * Made the ordering of tabs consistent accross CompareRunView and CompareModelVersion Signed-off-by: changyonglik <[email protected]> * Linted Signed-off-by: changyonglik <[email protected]> * Fixed FormattedMessage Signed-off-by: changyonglik <[email protected]> * refactoring Signed-off-by: harupy <[email protected]> * fix lint errors Signed-off-by: harupy <[email protected]> * i18n Signed-off-by: harupy <[email protected]> * minor comment fix Signed-off-by: harupy <[email protected]> Co-authored-by: harupy <[email protected]> * Add script and workflow to update requirements.yaml specifications (#6287) * add script to update requirements.yaml Signed-off-by: harupy <[email protected]> * update both skinny and core requirements Signed-off-by: harupy <[email protected]> * remove base Signed-off-by: harupy <[email protected]> * clean up Signed-off-by: harupy <[email protected]> * add MLFLOW_CONDA_HOME Signed-off-by: harupy <[email protected]> * create create-pr job Signed-off-by: harupy <[email protected]> * fix syntax Signed-off-by: harupy <[email protected]> * remove redundant if Signed-off-by: harupy <[email protected]> * clean up Signed-off-by: harupy <[email protected]> * doc Signed-off-by: harupy <[email protected]> * dynamically determine python version Signed-off-by: harupy <[email protected]> * remove python version mock Signed-off-by: harupy <[email protected]> * use setup-ssh.sh in master.yml Signed-off-by: harupy <[email protected]> * simplify Signed-off-by: harupy <[email protected]> * update both core and skinny requirements Signed-off-by: harupy <[email protected]> * use env Signed-off-by: harupy <[email protected]> * remove action version Signed-off-by: harupy <[email protected]> * fix pandas dtypes issue Signed-off-by: harupy <[email protected]> * check if PR already exists Signed-off-by: harupy <[email protected]> * add semicolons Signed-off-by: harupy <[email protected]> * test PR creation Signed-off-by: harupy <[email protected]> * set base Signed-off-by: harupy <[email protected]> * use run_number Signed-off-by: harupy <[email protected]> * set result-encoding Signed-off-by: harupy <[email protected]> * revert changes for test Signed-off-by: harupy <[email protected]> * fix more tests Signed-off-by: harupy <[email protected]> * fix run URL Signed-off-by: harupy <[email protected]> * add dot Signed-off-by: harupy <[email protected]> * remove minimum_version Signed-off-by: harupy <[email protected]> * remove create-pr job Signed-off-by: harupy <[email protected]> * rename workflow Signed-off-by: harupy <[email protected]> * mutate dict approach Signed-off-by: harupy <[email protected]> * use ruamel Signed-off-by: harupy <[email protected]> * remove PYTHON_VERSION patch Signed-off-by: harupy <[email protected]> * add ruamel.yaml to requirements Signed-off-by: harupy <[email protected]> * skip update-requirements on PR Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * print new version Signed-off-by: harupy <[email protected]> * preserve quotes Signed-off-by: harupy <[email protected]> * fix badge Signed-off-by: harupy <[email protected]> * fix README Signed-off-by: harupy <[email protected]> * run ci Signed-off-by: harupy <[email protected]> * remove validate-requirements.yml Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * fix test_dataframe_from_json Signed-off-by: harupy <[email protected]> * Make `model_uri` optional for `mlflow models build-docker` (#6302) * Make model_uri optional for mlflow models build-docker Signed-off-by: harupy <[email protected]> * fix doc Signed-off-by: harupy <[email protected]> * Add generic Signed-off-by: harupy <[email protected]> * Add pythou_function flavor Signed-off-by: harupy <[email protected]> * fix doc Signed-off-by: harupy <[email protected]> * quotes Signed-off-by: harupy <[email protected]> * use longer options Signed-off-by: harupy <[email protected]> * add index (#6347) Signed-off-by: harupy <[email protected]> * fix badge link (#6349) Signed-off-by: harupy <[email protected]> * Enable consider-using-dict-items rule for pylint (#6351) * Enable consider-using-dict-items Signed-off-by: harupy <[email protected]> * fix lint errors Signed-off-by: harupy <[email protected]> * Enable consider-merging-isinstance (#6350) Signed-off-by: harupy <[email protected]> * Enable consider-using-from-import rule for pylint (#6352) * Enable consider-using-from-import Signed-off-by: harupy <[email protected]> * fix Signed-off-by: harupy <[email protected]> * fix datasets import Signed-off-by: harupy <[email protected]> * fix failed tests Signed-off-by: harupy <[email protected]> * Run model registry sqlalchemy tests in database job (#6353) Signed-off-by: harupy <[email protected]> * update to run profiles on the first 100 dataframe columns (#6297) * update to run profiles on the first 100 dataframe columns Signed-off-by: Sunish Sheth <[email protected]> * Adding replace=True so we can sample rows twice Signed-off-by: Sunish Sheth <[email protected]> * Removing replace=true and fixing how the max_rows are calculated Signed-off-by: Sunish Sheth <[email protected]> * Fix sklearn autologging input example & signature mutation for models containing transformers (#6230) * Fix with test case Signed-off-by: dbczumar <[email protected]> * Test fix Signed-off-by: dbczumar <[email protected]> * Fix and simplification Signed-off-by: dbczumar <[email protected]> * more fixes & better test coveragE Signed-off-by: dbczumar <[email protected]> * test Signed-off-by: dbczumar <[email protected]> * LGBM test Signed-off-by: dbczumar <[email protected]> * Format Signed-off-by: dbczumar <[email protected]> * Address comments Signed-off-by: dbczumar <[email protected]> * Fixes Signed-off-by: dbczumar <[email protected]> * Use py37-compatible call args syntax Signed-off-by: dbczumar <[email protected]> * use list (#6363) Signed-off-by: harupy <[email protected]> * Log runtime pipeline config to MLflow (#6359) * Log runtime pipeline config to MLflow Signed-off-by: Jin Zhang <[email protected]> * Fixed lint Signed-off-by: Jin Zhang <[email protected]> * Add status badge for stale action (#6372) Signed-off-by: harupy <[email protected]> * Add stack trace section to bug report template (#6374) Signed-off-by: harupy <[email protected]> * Skipping the transform step by using Functional transformer (#6362) Signed-off-by: Sunish Sheth <[email protected]> * Series schema (#6361) * Added in name for ColSpec of pandas datatype infer panda series name for ColSpec Signed-off-by: Ryan Fogle <[email protected]> * Added test for Series name inference added one more pytest condition in test_schema:test_schema_inference_on_pandas_series Signed-off-by: Ryan Fogle <[email protected]> * Update test_schema.py Added in one more assertion to test schema inference. Signed-off-by: Ryan Fogle <[email protected]> * ran black Signed-off-by: Ryan Fogle <[email protected]> * added in requested changes in issue #6361 Signed-off-by: Ryan Fogle <[email protected]> * fix typo. changed hasattr to getattr Signed-off-by: Ryan Fogle <[email protected]> * integrate mlflowdbfs (#6282) Signed-off-by: Brian Barnes <[email protected]> * Fix step card display breakage in Jupyter notebooks (#6378) * remove Signed-off-by: apurva-koti <[email protected]> * fix Signed-off-by: apurva-koti <[email protected]> * Avoid using flask 2.2.0 (#6380) Signed-off-by: harupy <[email protected]> * Migrate GCS environment variables to `mlflow.environment_variables` module (#6375) * Migrate GCS environment variables to mlflow.environment_variables Signed-off-by: harupy <[email protected]> * add default Signed-off-by: harupy <[email protected]> * improve comments Signed-off-by: harupy <[email protected]> * Avoid logging model signatures in pyspark ML autologging if model input/output dataframe contains unsupported data types (#6365) * Avoid logging signatures Signed-off-by: harupy <[email protected]> * test Signed-off-by: harupy <[email protected]> * fix indent Signed-off-by: harupy <[email protected]> * check model output Signed-off-by: harupy <[email protected]> * fix warning message Signed-off-by: harupy <[email protected]> * todo Signed-off-by: harupy <[email protected]> * update test and doc Signed-off-by: harupy <[email protected]> * fix docstring Signed-off-by: harupy <[email protected]> * fix failed tests Signed-off-by: harupy <[email protected]> * improve _assert_autolog_infers_model_signature_correctly Signed-off-by: harupy <[email protected]> * Refactor `set_matrix.py` (#6373) * refacor set_matrix.py Signed-off-by: harupy <[email protected]> * fix Signed-off-by: harupy <[email protected]> * fix tests Signed-off-by: harupy <[email protected]> * tset for --no-dev Signed-off-by: harupy <[email protected]> * install pytest and pytest-cov Signed-off-by: harupy <[email protected]> * test for --changed-files Signed-off-by: harupy <[email protected]> * add pyyaml to requirements Signed-off-by: harupy <[email protected]> * fix is_matrix_empty Signed-off-by: harupy <[email protected]> * use raw string and re.match Signed-off-by: harupy <[email protected]> * Fix is_matrix_empty (#6385) Signed-off-by: harupy <[email protected]> * Allow mlflow-skinny's autolog() to succeed when no scipy is installed (#5897) * allow mlflow-skinny's autolog() to succeed when no scipy is installed Signed-off-by: Hannes Schulz <[email protected]> * optional pyfunc scipy dependency Signed-off-by: Hannes Schulz <[email protected]> * fix linter-discovered issues Signed-off-by: Hannes Schulz <[email protected]> * add test case, autolog() should pass w/o scipy installed Signed-off-by: Hannes Schulz <[email protected]> * minor cleanup Signed-off-by: Hannes Schulz <[email protected]> * test creating _Example with / without scipy present Signed-off-by: Hannes Schulz <[email protected]> * docs: do not warn about sparse matrix classes Signed-off-by: Hannes Schulz <[email protected]> * linting Signed-off-by: Hannes Schulz <[email protected]> * address review comment Signed-off-by: Hannes Schulz <[email protected]> * run black Signed-off-by: Hannes Schulz <[email protected]> * allow mlflow-skinny's autolog() to succeed when no scipy is installed Signed-off-by: Hannes Schulz <[email protected]> * optional pyfunc scipy dependency Signed-off-by: Hannes Schulz <[email protected]> * fix linter-discovered issues Signed-off-by: Hannes Schulz <[email protected]> * add test case, autolog() should pass w/o scipy installed Signed-off-by: Hannes Schulz <[email protected]> * minor cleanup Signed-off-by: Hannes Schulz <[email protected]> * test creating _Example with / without scipy present Signed-off-by: Hannes Schulz <[email protected]> * docs: do not warn about sparse matrix classes Signed-off-by: Hannes Schulz <[email protected]> * linting Signed-off-by: Hannes Schulz <[email protected]> * address review comment Signed-off-by: Hannes Schulz <[email protected]> * run black Signed-off-by: Hannes Schulz <[email protected]> * remove redundant None check after import Signed-off-by: Hannes Schulz <[email protected]> * delete comment Signed-off-by: Hannes Schulz <[email protected]> * Revert "remove redundant None check after import" This reverts commit f2e198c. Signed-off-by: Hannes Schulz <[email protected]> * review comments Signed-off-by: Hannes Schulz <[email protected]> * remove redundant test Signed-off-by: Hannes Schulz <[email protected]> * Apply suggestions from code review Co-authored-by: Harutaka Kawamura <[email protected]> Signed-off-by: Hannes Schulz <[email protected]> * Autoformat: https://github.com/mlflow/mlflow/actions/runs/2779791161 Signed-off-by: mlflow-automation <[email protected]> Co-authored-by: Harutaka Kawamura <[email protected]> Co-authored-by: dbczumar <[email protected]> Co-authored-by: mlflow-automation <[email protected]> * Fix extraneous warning about pyspark evaluation truncation (#6389) * Revert #6380 (#6386) * revert Signed-off-by: harupy <[email protected]> * workaround for test_prometheus_exporter Signed-off-by: harupy <[email protected]> * nit Signed-off-by: harupy <[email protected]> * Validate metric value in `FileStore.log_metric` (#6381) * add failing test Signed-off-by: harupy <[email protected]> * use _validate_metric Signed-off-by: harupy <[email protected]> * fix invalid metric timestamp Signed-off-by: harupy <[email protected]> * fix docstring Signed-off-by: harupy <[email protected]> * fix java test Signed-off-by: harupy <[email protected]> * Make search experiment by tag key comparison case sensitive in MYSQL (#6333) * init Signed-off-by: Weichen Xu <[email protected]> * add test Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * fix BINARY conditions in MySQL Signed-off-by: harupy <[email protected]> * fix attr error Signed-off-by: harupy <[email protected]> Co-authored-by: harupy <[email protected]> * Run Model Registry SQLAlchemy tests in PostgreSQL, MySQL, and MSSQL (#6390) * Run Model Registry SQLAlchemy tests in postgres, mysql, and mssql Signed-off-by: harupy <[email protected]> * fix failed tests Signed-off-by: harupy <[email protected]> * remove uuid Signed-off-by: harupy <[email protected]> * clean up Signed-off-by: harupy <[email protected]> * do not drop tables Signed-off-by: harupy <[email protected]> * Fix filestore data loss on failed write & mitigate read / write race condition (#6388) * Fix Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * Format Signed-off-by: dbczumar <[email protected]> * Added a custom filter from_json to render_and_merge_yaml (#6368) * Added a custom filter from_json to render_and_merge_yaml Signed-off-by: Jin Zhang <[email protected]> * Fixed test Signed-off-by: Jin Zhang <[email protected]> * Update tests/utils/test_file_utils.py Co-authored-by: Siddharth Murching <[email protected]> * Update tests/utils/test_file_utils.py Co-authored-by: Siddharth Murching <[email protected]> * Fixed test Signed-off-by: Jin Zhang <[email protected]> * Fixed windows test attempt Signed-off-by: Jin Zhang <[email protected]> * Fixed windows test Signed-off-by: Jin Zhang <[email protected]> Co-authored-by: Siddharth Murching <[email protected]> * Fix `!=` operator for MySQL (#6397) * fix ne operator and improve tests Signed-off-by: harupy <[email protected]> * add () to other operators Signed-off-by: harupy <[email protected]> * Simplify the documentation section in the PR template (#6398) * Simplify the documentation section in the PR template Signed-off-by: harupy <[email protected]> * fix Signed-off-by: harupy <[email protected]> * Timebased gc (#6354) * Added delete_time field to runs table Signed-off-by: Jason Cheng <[email protected]> * Updated latest_schema.sql to pass tests/store/tracking/test_sqlalchemy_store_schema.py Signed-off-by: Jason Cheng <[email protected]> * Added delete_time column into mlflow/store/tracking/dbmodels/initial_models.py Signed-off-by: Jason Cheng <[email protected]> * Moved the docstring to the end of the declaration instead of the start Signed-off-by: Jason Cheng <[email protected]> * Regenerated protobuf for RunInfo new schema, and passed pytest Signed-off-by: Jason Cheng <[email protected]> * Added --older-than flag in mlflow gc command, and added tests for that cli command Signed-off-by: Jason Cheng <[email protected]> * Removed delete_time from RunInfo proto Signed-off-by: Jason Cheng <[email protected]> * Set default older-than flag to None Signed-off-by: Jason Cheng <[email protected]> * Remove delete_time from RunInfo, add optional parameter older_than to store.get_deleted_runs(), and write delete_time into yaml file for file storage instead of adding it to RunInfo Signed-off-by: Jason Cheng <[email protected]> * Remove commented delete_time in RunInfo constructor in models.py Signed-off-by: Jason Cheng <[email protected]> * added INVALID_PARAMETER_VALUE error code in mlflow gc Signed-off-by: Jason Cheng <[email protected]> * Resolve case of delete time not in meta.yaml file, edited overwrite_run_info and gc Signed-off-by: Jason Cheng <[email protected]> * Rename delete_time to deleted_time Signed-off-by: Jason Cheng <[email protected]> * Rename delete_time to deleted_time, match error message in cli tests, filter SqlRuns by deleted_time, indicate float values accepted for gc --older-than flag Signed-off-by: Jason Cheng <[email protected]> * Rename delete_time to deleted_time, fixed assert statement in test_mlflow_gc, and fixed deleted_time queries in test_file_store.py and test_sqlalchemy_store.py Signed-off-by: Jason Cheng <[email protected]> * Only check if is in meta after restoring run in test_delte_restore_run Signed-off-by: Jason Cheng <[email protected]> * Fixed lint errors Signed-off-by: Jason Cheng <[email protected]> * Install mlflow from repository root Signed-off-by: harupy <[email protected]> Co-authored-by: harupy <[email protected]> * Separate protos job (#6399) * Separate protos job Signed-off-by: harupy <[email protected]> * test Signed-off-by: harupy <[email protected]> * Add paths Signed-off-by: harupy <[email protected]> * Revert "test" This reverts commit 5d04b02. Signed-off-by: harupy <[email protected]> * Fix flaky `TestFileStore.test_get_deleted_runs` (#6402) * use gt operator Signed-off-by: harupy <[email protected]> * fix sqlalchemy store Signed-off-by: harupy <[email protected]> * Migrate environment variables for SQLAlchemy store (#6396) Signed-off-by: harupy <[email protected]> * Deduplicate MlflowClient in MLflow docs, move to mlflow.client module (#6405) * Dedupe MlflowClient Signed-off-by: dbczumar <[email protected]> * Improvements Signed-off-by: dbczumar <[email protected]> * Add client Signed-off-by: dbczumar <[email protected]> * Remove unused functions in `mlflow.data` module (#6408) * remove unused functions in data Signed-off-by: harupy <[email protected]> * Remove unused functions and variables Signed-off-by: harupy <[email protected]> * Tag based registered model search and model version search (#6320) * init Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update tests Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * clean Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * add test Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * de-dup tag based search result Signed-off-by: Weichen Xu <[email protected]> * add () to fix case_sensitive_mysql_ne Signed-off-by: Weichen Xu <[email protected]> * fix Signed-off-by: Weichen Xu <[email protected]> * lint Signed-off-by: Weichen Xu <[email protected]> * fix * fix test in TODO Signed-off-by: Weichen Xu <[email protected]> * support dup tag key filter Signed-off-by: Weichen Xu <[email protected]> * add mv order by Signed-off-by: Weichen Xu <[email protected]> * cmp res list in test Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * add doc Signed-off-by: Weichen Xu <[email protected]> * fix Signed-off-by: Weichen Xu <[email protected]> * fix lint Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * update doc Signed-off-by: Weichen Xu <[email protected]> * Increase maximum param value length to 500 (#6358) * increase validation of maximum param value length from 250 to 500 (squashed) Signed-off-by: Jan Sindlar <[email protected]> * 1. added test for exceeding max length. 2. lint. 3. validation logic addresses null Signed-off-by: Jan Sindlar <[email protected]> * file store should test already stringified params Signed-off-by: Jan Sindlar <[email protected]> * update alembic chain Signed-off-by: Jan Sindlar <[email protected]> * Autoformat: https://github.com/mlflow/mlflow/actions/runs/2800398158 Signed-off-by: mlflow-automation <[email protected]> * Update tests/store/tracking/test_file_store.py Co-authored-by: Harutaka Kawamura <[email protected]> Signed-off-by: Jan Sindlar <[email protected]> Co-authored-by: Jan Sindlar <[email protected]> Co-authored-by: mlflow-automation <[email protected]> Co-authored-by: Harutaka Kawamura <[email protected]> * Add workflow dispatch for requirements validation, remove duplicate file (#6418) * Workflow dispatch Signed-off-by: dbczumar <[email protected]> * Remove unused Signed-off-by: dbczumar <[email protected]> * Prevent `pytest.raises` context manager from containing multiple statements (#6409) * rename Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * Do not allow calling assert in pytest.raises Signed-off-by: harupy <[email protected]> * more strict rule Signed-off-by: harupy <[email protected]> * Improve error message Signed-off-by: harupy <[email protected]> * relax condition Signed-off-by: harupy <[email protected]> * fix lint errors Signed-off-by: harupy <[email protected]> * fix failed tests Signed-off-by: harupy <[email protected]> * clean up Signed-off-by: harupy <[email protected]> * rename _is_complex_pytest_raises Signed-off-by: harupy <[email protected]> * fix lint errors Signed-off-by: harupy <[email protected]> * fix failed tests Signed-off-by: harupy <[email protected]> * Fix regression in pandas type inference behavior for scoring server (#6417) * Fix impl Signed-off-by: dbczumar <[email protected]> * Remove unused pandas import Signed-off-by: dbczumar <[email protected]> * Adjust client to use SearchExperiments POST method (#6415) * POST Signed-off-by: dbczumar <[email protected]> * Generate protos Signed-off-by: dbczumar <[email protected]> * Fix test Signed-off-by: dbczumar <[email protected]> * update (#6420) Signed-off-by: Weichen Xu <[email protected]> * Check if artifacts are proxied in model_version_artifact_handler (#6355) * Check if artifacts are proxied in model_version_artifact_handler Signed-off-by: Mohammad Abbas <[email protected]> * Use file prefix for artifact dest on windows Signed-off-by: dbczumar <[email protected]> * Fix application of prefix Signed-off-by: dbczumar <[email protected]> * Fixes Signed-off-by: dbczumar <[email protected]> Co-authored-by: dbczumar <[email protected]> * Allow sql filter IN operator right-hand side values including whitespaces (#6413) * support in rhs whitespace Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * Fix IN operator related issues in sql filter parser (#6411) * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * clean Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * address comment Signed-off-by: Weichen Xu <[email protected]> * Remove unused method `SearchUtils._get_comparison_for_model_registry` (#6412) * init Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * Update MLflow UI (#6422) * Project import generated by Copybara. GitOrigin-RevId: 086b1200f4573559e37fcea6cb5472d52f166e42 Signed-off-by: dbczumar <[email protected]> * Reconcile changes from universe with OSS Signed-off-by: dbczumar <[email protected]> * Fix test fails Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * Apply model search fix Signed-off-by: dbczumar <[email protected]> * Remove errant test line Signed-off-by: dbczumar <[email protected]> Co-authored-by: Richard Zang <[email protected]> * remove near from deprecation msg (#6430) Signed-off-by: ninabacc-db <[email protected]> * Raise clear error message when pipeline path contains a space (#6426) * Add unsupported Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * Exc Signed-off-by: dbczumar <[email protected]> * Test Signed-off-by: dbczumar <[email protected]> * Format Signed-off-by: dbczumar <[email protected]> * Test fix Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * [ALL TESTS] Changelog for MLflow 1.28.0 (#6433) * Generating changelog for MLflow 1.27.1.dev0 Signed-off-by: Jenkins <[email protected]> * Changelog Signed-off-by: dbczumar <[email protected]> * Add missing PR Signed-off-by: dbczumar <[email protected]> * Some fixes Signed-off-by: dbczumar <[email protected]> * More small fixes Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> Signed-off-by: Jenkins <[email protected]> Signed-off-by: dbczumar <[email protected]> Co-authored-by: Jenkins <[email protected]> Co-authored-by: dbczumar <[email protected]> * Patch (#6440) Signed-off-by: dbczumar <[email protected]> Signed-off-by: dbczumar <[email protected]> * [ALL TESTS] Update (#6443) * python dev/update_ml_package_versions.py Signed-off-by: Jenkins <[email protected]> * pyspark max ver 3.4 Signed-off-by: Weichen Xu <[email protected]> Signed-off-by: Jenkins <[email protected]> Signed-off-by: Weichen Xu <[email protected]> Co-authored-by: Jenkins <[email protected]> Co-authored-by: Weichen Xu <[email protected]> * Update MLflow version to 1.28.1 (#6449) Signed-off-by: Jenkins <[email protected]> Signed-off-by: Jenkins <[email protected]> Co-authored-by: Jenkins <[email protected]> * Add data capture config to sagemaker (#6423) Signed-off-by: jonwiggins <[email protected]> Signed-off-by: jonwiggins <[email protected]> * Fix small search_runs docs issues (#6452) * Fix Signed-off-by: dbczumar <[email protected]> * Doc fix Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> Signed-off-by: dbczumar <[email protected]> * python dev/update_pypi_package_index.py (#6442) Signed-off-by: Jenkins <[email protected]> Signed-off-by: Jenkins <[email protected]> Co-authored-by: Jenkins <[email protected]> * use xgboost on pypi (#6461) Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> * Add environment variable for `echo` option in `create_engine` (#6460) * Add environment variable for echo Signed-off-by: harupy <[email protected]> * use _BooleanEnvironmentVariable Signed-off-by: harupy <[email protected]> * address comments Signed-off-by: harupy <[email protected]> * address comments and add tests Signed-off-by: harupy <[email protected]> * fix comment Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> * Add more file extensions to show content on frontend side (#3292) Signed-off-by: Мартынов Максим Сергеевич <[email protected]> Signed-off-by: Мартынов Максим Сергеевич <[email protected]> Signed-off-by: harupy <[email protected]> Co-authored-by: harupy <[email protected]> * Avoid using assertions at top level in `mlflow/models/docker_utils.py` (#6463) * do not construct maven proxy options at top level Signed-off-by: harupy <[email protected]> * fix validation for port Signed-off-by: harupy <[email protected]> * unpack Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> * Fix mlflowdbfs availability check (#6474) * Fix Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * Reverts Signed-off-by: dbczumar <[email protected]> * Better fix Signed-off-by: dbczumar <[email protected]> * Format Signed-off-by: dbczumar <[email protected]> * Format Signed-off-by: dbczumar <[email protected]> * Lint Signed-off-by: dbczumar <[email protected]> * Clean up Signed-off-by: dbczumar <[email protected]> Signed-off-by: dbczumar <[email protected]> * Replace `assertRaisesRegex` with `pytest.raises` (#6464) * replace assertRaisesRegex with pytest.raises Signed-off-by: harupy <[email protected]> * fix message Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> * CLI command suggestion after running the pipeline (#6376) * CLI command suggestion after running the pipeline Signed-off-by: Hubert Zub <[email protected]> * fix: added git commands to MLP CLI suggestion * chore: lint fixes Signed-off-by: Hubert Zub <[email protected]> * chore: test fixes Signed-off-by: Hubert Zub <[email protected]> Signed-off-by: Hubert Zub <[email protected]> * Remove redundant int conversion in create_sqlalchemy_engine (#6481) Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> * Improve code-to-reproduce section in the bug report template (#6478) * Improve code-to-reproduce section Signed-off-by: harupy <[email protected]> * fix Signed-off-by: harupy <[email protected]> * problem -> issue Signed-off-by: harupy <[email protected]> * fix Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> * Add Pipelines step option to skip step profiling (#6456) * changes Signed-off-by: apurva-koti <[email protected]> * changes Signed-off-by: apurva-koti <[email protected]> * partial-test Signed-off-by: apurva-koti <[email protected]> * lint Signed-off-by: apurva-koti <[email protected]> * missed Signed-off-by: apurva-koti <[email protected]> * review Signed-off-by: apurva-koti <[email protected]> Signed-off-by: apurva-koti <[email protected]> * Implement _download_file in hdfs_artifact_repo (#6482) * Implement _download_file in hdfs_artifact_repo Signed-off-by: bowen_who <[email protected]> * add ut on _download_file in test_hdfs_artifact_repo Signed-off-by: bowen_who <[email protected]> * rewrite _download_artifact, change back _download_file in hdfs_artifact_repo Signed-off-by: bowen_who <[email protected]> Signed-off-by: harupy <[email protected]> * rewrite test__download_file in test_hdfs_artifact_repo Signed-off-by: bowen_who <[email protected]> Signed-off-by: bowen_who <[email protected]> Signed-off-by: harupy <[email protected]> Co-authored-by: bowen_who <[email protected]> * [ML-19871] R documentation fix (#6484) * R bug fix * Documentation fix * Revert breaking change * Updated doc file * Doc fix * Testing a broken test * fix * Revert test * feat: return param value for mlflow.log_param (#6483) * feat: return param value for mlflow.log_param Signed-off-by: Xinyue Ruan <[email protected]> * update docstring and return value for MlflowClient Signed-off-by: Xinyue Ruan <[email protected]> Signed-off-by: Xinyue Ruan <[email protected]> * revert (#6490) Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> * Ignore empty environment variables in _get_maven_proxy (#6492) Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> * Migrate environment variables for S3 (#6438) * Migrated s3 Signed-off-by: changyonglik <[email protected]> * Migrated s3 for local.py Signed-off-by: changyonglik <[email protected]> * Changed default values Signed-off-by: changyonglik <[email protected]> * Added var imports Signed-off-by: changyonglik <[email protected]> * Added MLFLOW_S3_ENDPOINT_URL and MLFLOW_S3_IGNORE_TLS Signed-off-by: changyonglik <[email protected]> * Removed duplicated imports Signed-off-by: changyonglik <[email protected]> * Paraphrased specify to specifies Signed-off-by: changyonglik <[email protected]> * Changed _EnvironmentVariable to _BooleanEnvironmentVariable for MLFLOW_S3_IGNORE_TLS and defaults to False Signed-off-by: changyonglik <[email protected]> * Changed environment variables in hdfs_artifact_repo.py Signed-off-by: changyonglik <[email protected]> * Changed single to double quotes Signed-off-by: changyonglik <[email protected]> * Fixed comments Signed-off-by: changyonglik <[email protected]> * Small fixes Signed-off-by: dbczumar <[email protected]> * Format Signed-off-by: dbczumar <[email protected]> * Reset submodule Signed-off-by: dbczumar <[email protected]> Signed-off-by: changyonglik <[email protected]> Signed-off-by: dbczumar <[email protected]> Co-authored-by: dbczumar <[email protected]> * Always run CI check on PR (#6505) Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> Signed-off-by: dbczumar <[email protected]> Signed-off-by: harupy <[email protected]> Signed-off-by: Michal Karzynski <[email protected]> Signed-off-by: Sunish Sheth <[email protected]> Signed-off-by: Jin Zhang <[email protected]> Signed-off-by: Ryan Fogle <[email protected]> Signed-off-by: Brian Barnes <[email protected]> Signed-off-by: apurva-koti <[email protected]> Signed-off-by: Weichen Xu <[email protected]> Signed-off-by: ninabacc-db <[email protected]> Signed-off-by: Jenkins <[email protected]> Signed-off-by: jonwiggins <[email protected]> Signed-off-by: Мартынов Максим Сергеевич <[email protected]> Signed-off-by: Hubert Zub <[email protected]> Signed-off-by: bowen_who <[email protected]> Signed-off-by: Xinyue Ruan <[email protected]> Signed-off-by: changyonglik <[email protected]> Co-authored-by: Corey Zumar <[email protected]> Co-authored-by: Michał Karzyński <[email protected]> Co-authored-by: Chang Yong Lik <[email protected]> Co-authored-by: Sunish Sheth <[email protected]> Co-authored-by: jinzhang21 <[email protected]> Co-authored-by: Ryan Fogle <[email protected]> Co-authored-by: bbarnes52 <[email protected]> Co-authored-by: apurva-koti <[email protected]> Co-authored-by: Hannes Schulz <[email protected]> Co-authored-by: dbczumar <[email protected]> Co-authored-by: mlflow-automation <[email protected]> Co-authored-by: WeichenXu <[email protected]> Co-authored-by: Siddharth Murching <[email protected]> Co-authored-by: Cheng Kuan Yong Jason <[email protected]> Co-authored-by: johnyNJ <[email protected]> Co-authored-by: Jan Sindlar <[email protected]> Co-authored-by: Mohammad Abbas <[email protected]> Co-authored-by: Richard Zang <[email protected]> Co-authored-by: Nina Baccam <[email protected]> Co-authored-by: mlflow-automation <[email protected]> Co-authored-by: Jenkins <[email protected]> Co-authored-by: Jon Wiggins <[email protected]> Co-authored-by: Maxim Martynov <[email protected]> Co-authored-by: Hubert Zub <[email protected]> Co-authored-by: Bowen Hu <[email protected]> Co-authored-by: bowen_who <[email protected]> Co-authored-by: Kris Concepcion <[email protected]> Co-authored-by: Serena Ruan <[email protected]>

* Rebase `branch-2.0` on master (#6467) * Fix java model server compatibility with models containing databricks_runtime conf (#6337) * Javafix Signed-off-by: dbczumar <[email protected]> * Resource fix Signed-off-by: dbczumar <[email protected]> * Add run / model links to MLP train step card (#6294) * One commit Signed-off-by: dbczumar <[email protected]> * Submodule revert Signed-off-by: dbczumar <[email protected]> * Fix client tests Signed-off-by: dbczumar <[email protected]> * fix ci Signed-off-by: dbczumar <[email protected]> * Remove unused / invalid import Signed-off-by: dbczumar <[email protected]> * Put run summary back to end, fix tests Signed-off-by: dbczumar <[email protected]> * Use mocks instead Signed-off-by: dbczumar <[email protected]> * Fix inefficient relative time computation for metric plot (#6341) * compute minTimestamp only once Signed-off-by: harupy <[email protected]> * fix method name Signed-off-by: harupy <[email protected]> * fix lint Signed-off-by: harupy <[email protected]> * return empty array Signed-off-by: harupy <[email protected]> * fix test Signed-off-by: harupy <[email protected]> * Add `MLFLOW_SQLALCHEMYSTORE_POOL_RECYCLE` flag (#6344) * Add pool_recycle option to SQLAlchemy create_engine Signed-off-by: Michal Karzynski <[email protected]> * Add new option to unit test Signed-off-by: Michal Karzynski <[email protected]> * Add note in documentation Signed-off-by: Michal Karzynski <[email protected]> * Add box plot in compare-runs page (#6308) * Added BoxPlot Signed-off-by: changyonglik <[email protected]> * Fixed key error Signed-off-by: changyonglik <[email protected]> * Added default state Signed-off-by: changyonglik <[email protected]> * Fixed props passing Signed-off-by: changyonglik <[email protected]> * Fixed react hooks state Signed-off-by: changyonglik <[email protected]> * Added unit test Signed-off-by: changyonglik <[email protected]> * Added boxplot to CompareModelVersion Signed-off-by: changyonglik <[email protected]> * Changed keys numbering to reflect tab name Signed-off-by: changyonglik <[email protected]> * Made the ordering of tabs consistent accross CompareRunView and CompareModelVersion Signed-off-by: changyonglik <[email protected]> * Linted Signed-off-by: changyonglik <[email protected]> * Fixed FormattedMessage Signed-off-by: changyonglik <[email protected]> * refactoring Signed-off-by: harupy <[email protected]> * fix lint errors Signed-off-by: harupy <[email protected]> * i18n Signed-off-by: harupy <[email protected]> * minor comment fix Signed-off-by: harupy <[email protected]> Co-authored-by: harupy <[email protected]> * Add script and workflow to update requirements.yaml specifications (#6287) * add script to update requirements.yaml Signed-off-by: harupy <[email protected]> * update both skinny and core requirements Signed-off-by: harupy <[email protected]> * remove base Signed-off-by: harupy <[email protected]> * clean up Signed-off-by: harupy <[email protected]> * add MLFLOW_CONDA_HOME Signed-off-by: harupy <[email protected]> * create create-pr job Signed-off-by: harupy <[email protected]> * fix syntax Signed-off-by: harupy <[email protected]> * remove redundant if Signed-off-by: harupy <[email protected]> * clean up Signed-off-by: harupy <[email protected]> * doc Signed-off-by: harupy <[email protected]> * dynamically determine python version Signed-off-by: harupy <[email protected]> * remove python version mock Signed-off-by: harupy <[email protected]> * use setup-ssh.sh in master.yml Signed-off-by: harupy <[email protected]> * simplify Signed-off-by: harupy <[email protected]> * update both core and skinny requirements Signed-off-by: harupy <[email protected]> * use env Signed-off-by: harupy <[email protected]> * remove action version Signed-off-by: harupy <[email protected]> * fix pandas dtypes issue Signed-off-by: harupy <[email protected]> * check if PR already exists Signed-off-by: harupy <[email protected]> * add semicolons Signed-off-by: harupy <[email protected]> * test PR creation Signed-off-by: harupy <[email protected]> * set base Signed-off-by: harupy <[email protected]> * use run_number Signed-off-by: harupy <[email protected]> * set result-encoding Signed-off-by: harupy <[email protected]> * revert changes for test Signed-off-by: harupy <[email protected]> * fix more tests Signed-off-by: harupy <[email protected]> * fix run URL Signed-off-by: harupy <[email protected]> * add dot Signed-off-by: harupy <[email protected]> * remove minimum_version Signed-off-by: harupy <[email protected]> * remove create-pr job Signed-off-by: harupy <[email protected]> * rename workflow Signed-off-by: harupy <[email protected]> * mutate dict approach Signed-off-by: harupy <[email protected]> * use ruamel Signed-off-by: harupy <[email protected]> * remove PYTHON_VERSION patch Signed-off-by: harupy <[email protected]> * add ruamel.yaml to requirements Signed-off-by: harupy <[email protected]> * skip update-requirements on PR Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * print new version Signed-off-by: harupy <[email protected]> * preserve quotes Signed-off-by: harupy <[email protected]> * fix badge Signed-off-by: harupy <[email protected]> * fix README Signed-off-by: harupy <[email protected]> * run ci Signed-off-by: harupy <[email protected]> * remove validate-requirements.yml Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * fix test_dataframe_from_json Signed-off-by: harupy <[email protected]> * Make `model_uri` optional for `mlflow models build-docker` (#6302) * Make model_uri optional for mlflow models build-docker Signed-off-by: harupy <[email protected]> * fix doc Signed-off-by: harupy <[email protected]> * Add generic Signed-off-by: harupy <[email protected]> * Add pythou_function flavor Signed-off-by: harupy <[email protected]> * fix doc Signed-off-by: harupy <[email protected]> * quotes Signed-off-by: harupy <[email protected]> * use longer options Signed-off-by: harupy <[email protected]> * add index (#6347) Signed-off-by: harupy <[email protected]> * fix badge link (#6349) Signed-off-by: harupy <[email protected]> * Enable consider-using-dict-items rule for pylint (#6351) * Enable consider-using-dict-items Signed-off-by: harupy <[email protected]> * fix lint errors Signed-off-by: harupy <[email protected]> * Enable consider-merging-isinstance (#6350) Signed-off-by: harupy <[email protected]> * Enable consider-using-from-import rule for pylint (#6352) * Enable consider-using-from-import Signed-off-by: harupy <[email protected]> * fix Signed-off-by: harupy <[email protected]> * fix datasets import Signed-off-by: harupy <[email protected]> * fix failed tests Signed-off-by: harupy <[email protected]> * Run model registry sqlalchemy tests in database job (#6353) Signed-off-by: harupy <[email protected]> * update to run profiles on the first 100 dataframe columns (#6297) * update to run profiles on the first 100 dataframe columns Signed-off-by: Sunish Sheth <[email protected]> * Adding replace=True so we can sample rows twice Signed-off-by: Sunish Sheth <[email protected]> * Removing replace=true and fixing how the max_rows are calculated Signed-off-by: Sunish Sheth <[email protected]> * Fix sklearn autologging input example & signature mutation for models containing transformers (#6230) * Fix with test case Signed-off-by: dbczumar <[email protected]> * Test fix Signed-off-by: dbczumar <[email protected]> * Fix and simplification Signed-off-by: dbczumar <[email protected]> * more fixes & better test coveragE Signed-off-by: dbczumar <[email protected]> * test Signed-off-by: dbczumar <[email protected]> * LGBM test Signed-off-by: dbczumar <[email protected]> * Format Signed-off-by: dbczumar <[email protected]> * Address comments Signed-off-by: dbczumar <[email protected]> * Fixes Signed-off-by: dbczumar <[email protected]> * Use py37-compatible call args syntax Signed-off-by: dbczumar <[email protected]> * use list (#6363) Signed-off-by: harupy <[email protected]> * Log runtime pipeline config to MLflow (#6359) * Log runtime pipeline config to MLflow Signed-off-by: Jin Zhang <[email protected]> * Fixed lint Signed-off-by: Jin Zhang <[email protected]> * Add status badge for stale action (#6372) Signed-off-by: harupy <[email protected]> * Add stack trace section to bug report template (#6374) Signed-off-by: harupy <[email protected]> * Skipping the transform step by using Functional transformer (#6362) Signed-off-by: Sunish Sheth <[email protected]> * Series schema (#6361) * Added in name for ColSpec of pandas datatype infer panda series name for ColSpec Signed-off-by: Ryan Fogle <[email protected]> * Added test for Series name inference added one more pytest condition in test_schema:test_schema_inference_on_pandas_series Signed-off-by: Ryan Fogle <[email protected]> * Update test_schema.py Added in one more assertion to test schema inference. Signed-off-by: Ryan Fogle <[email protected]> * ran black Signed-off-by: Ryan Fogle <[email protected]> * added in requested changes in issue #6361 Signed-off-by: Ryan Fogle <[email protected]> * fix typo. changed hasattr to getattr Signed-off-by: Ryan Fogle <[email protected]> * integrate mlflowdbfs (#6282) Signed-off-by: Brian Barnes <[email protected]> * Fix step card display breakage in Jupyter notebooks (#6378) * remove Signed-off-by: apurva-koti <[email protected]> * fix Signed-off-by: apurva-koti <[email protected]> * Avoid using flask 2.2.0 (#6380) Signed-off-by: harupy <[email protected]> * Migrate GCS environment variables to `mlflow.environment_variables` module (#6375) * Migrate GCS environment variables to mlflow.environment_variables Signed-off-by: harupy <[email protected]> * add default Signed-off-by: harupy <[email protected]> * improve comments Signed-off-by: harupy <[email protected]> * Avoid logging model signatures in pyspark ML autologging if model input/output dataframe contains unsupported data types (#6365) * Avoid logging signatures Signed-off-by: harupy <[email protected]> * test Signed-off-by: harupy <[email protected]> * fix indent Signed-off-by: harupy <[email protected]> * check model output Signed-off-by: harupy <[email protected]> * fix warning message Signed-off-by: harupy <[email protected]> * todo Signed-off-by: harupy <[email protected]> * update test and doc Signed-off-by: harupy <[email protected]> * fix docstring Signed-off-by: harupy <[email protected]> * fix failed tests Signed-off-by: harupy <[email protected]> * improve _assert_autolog_infers_model_signature_correctly Signed-off-by: harupy <[email protected]> * Refactor `set_matrix.py` (#6373) * refacor set_matrix.py Signed-off-by: harupy <[email protected]> * fix Signed-off-by: harupy <[email protected]> * fix tests Signed-off-by: harupy <[email protected]> * tset for --no-dev Signed-off-by: harupy <[email protected]> * install pytest and pytest-cov Signed-off-by: harupy <[email protected]> * test for --changed-files Signed-off-by: harupy <[email protected]> * add pyyaml to requirements Signed-off-by: harupy <[email protected]> * fix is_matrix_empty Signed-off-by: harupy <[email protected]> * use raw string and re.match Signed-off-by: harupy <[email protected]> * Fix is_matrix_empty (#6385) Signed-off-by: harupy <[email protected]> * Allow mlflow-skinny's autolog() to succeed when no scipy is installed (#5897) * allow mlflow-skinny's autolog() to succeed when no scipy is installed Signed-off-by: Hannes Schulz <[email protected]> * optional pyfunc scipy dependency Signed-off-by: Hannes Schulz <[email protected]> * fix linter-discovered issues Signed-off-by: Hannes Schulz <[email protected]> * add test case, autolog() should pass w/o scipy installed Signed-off-by: Hannes Schulz <[email protected]> * minor cleanup Signed-off-by: Hannes Schulz <[email protected]> * test creating _Example with / without scipy present Signed-off-by: Hannes Schulz <[email protected]> * docs: do not warn about sparse matrix classes Signed-off-by: Hannes Schulz <[email protected]> * linting Signed-off-by: Hannes Schulz <[email protected]> * address review comment Signed-off-by: Hannes Schulz <[email protected]> * run black Signed-off-by: Hannes Schulz <[email protected]> * allow mlflow-skinny's autolog() to succeed when no scipy is installed Signed-off-by: Hannes Schulz <[email protected]> * optional pyfunc scipy dependency Signed-off-by: Hannes Schulz <[email protected]> * fix linter-discovered issues Signed-off-by: Hannes Schulz <[email protected]> * add test case, autolog() should pass w/o scipy installed Signed-off-by: Hannes Schulz <[email protected]> * minor cleanup Signed-off-by: Hannes Schulz <[email protected]> * test creating _Example with / without scipy present Signed-off-by: Hannes Schulz <[email protected]> * docs: do not warn about sparse matrix classes Signed-off-by: Hannes Schulz <[email protected]> * linting Signed-off-by: Hannes Schulz <[email protected]> * address review comment Signed-off-by: Hannes Schulz <[email protected]> * run black Signed-off-by: Hannes Schulz <[email protected]> * remove redundant None check after import Signed-off-by: Hannes Schulz <[email protected]> * delete comment Signed-off-by: Hannes Schulz <[email protected]> * Revert "remove redundant None check after import" This reverts commit f2e198c944f41d9a96c20ae471d71bff39431b48. Signed-off-by: Hannes Schulz <[email protected]> * review comments Signed-off-by: Hannes Schulz <[email protected]> * remove redundant test Signed-off-by: Hannes Schulz <[email protected]> * Apply suggestions from code review Co-authored-by: Harutaka Kawamura <[email protected]> Signed-off-by: Hannes Schulz <[email protected]> * Autoformat: https://github.com/mlflow/mlflow/actions/runs/2779791161 Signed-off-by: mlflow-automation <[email protected]> Co-authored-by: Harutaka Kawamura <[email protected]> Co-authored-by: dbczumar <[email protected]> Co-authored-by: mlflow-automation <[email protected]> * Fix extraneous warning about pyspark evaluation truncation (#6389) * Revert #6380 (#6386) * revert Signed-off-by: harupy <[email protected]> * workaround for test_prometheus_exporter Signed-off-by: harupy <[email protected]> * nit Signed-off-by: harupy <[email protected]> * Validate metric value in `FileStore.log_metric` (#6381) * add failing test Signed-off-by: harupy <[email protected]> * use _validate_metric Signed-off-by: harupy <[email protected]> * fix invalid metric timestamp Signed-off-by: harupy <[email protected]> * fix docstring Signed-off-by: harupy <[email protected]> * fix java test Signed-off-by: harupy <[email protected]> * Make search experiment by tag key comparison case sensitive in MYSQL (#6333) * init Signed-off-by: Weichen Xu <[email protected]> * add test Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * fix BINARY conditions in MySQL Signed-off-by: harupy <[email protected]> * fix attr error Signed-off-by: harupy <[email protected]> Co-authored-by: harupy <[email protected]> * Run Model Registry SQLAlchemy tests in PostgreSQL, MySQL, and MSSQL (#6390) * Run Model Registry SQLAlchemy tests in postgres, mysql, and mssql Signed-off-by: harupy <[email protected]> * fix failed tests Signed-off-by: harupy <[email protected]> * remove uuid Signed-off-by: harupy <[email protected]> * clean up Signed-off-by: harupy <[email protected]> * do not drop tables Signed-off-by: harupy <[email protected]> * Fix filestore data loss on failed write & mitigate read / write race condition (#6388) * Fix Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * Format Signed-off-by: dbczumar <[email protected]> * Added a custom filter from_json to render_and_merge_yaml (#6368) * Added a custom filter from_json to render_and_merge_yaml Signed-off-by: Jin Zhang <[email protected]> * Fixed test Signed-off-by: Jin Zhang <[email protected]> * Update tests/utils/test_file_utils.py Co-authored-by: Siddharth Murching <[email protected]> * Update tests/utils/test_file_utils.py Co-authored-by: Siddharth Murching <[email protected]> * Fixed test Signed-off-by: Jin Zhang <[email protected]> * Fixed windows test attempt Signed-off-by: Jin Zhang <[email protected]> * Fixed windows test Signed-off-by: Jin Zhang <[email protected]> Co-authored-by: Siddharth Murching <[email protected]> * Fix `!=` operator for MySQL (#6397) * fix ne operator and improve tests Signed-off-by: harupy <[email protected]> * add () to other operators Signed-off-by: harupy <[email protected]> * Simplify the documentation section in the PR template (#6398) * Simplify the documentation section in the PR template Signed-off-by: harupy <[email protected]> * fix Signed-off-by: harupy <[email protected]> * Timebased gc (#6354) * Added delete_time field to runs table Signed-off-by: Jason Cheng <[email protected]> * Updated latest_schema.sql to pass tests/store/tracking/test_sqlalchemy_store_schema.py Signed-off-by: Jason Cheng <[email protected]> * Added delete_time column into mlflow/store/tracking/dbmodels/initial_models.py Signed-off-by: Jason Cheng <[email protected]> * Moved the docstring to the end of the declaration instead of the start Signed-off-by: Jason Cheng <[email protected]> * Regenerated protobuf for RunInfo new schema, and passed pytest Signed-off-by: Jason Cheng <[email protected]> * Added --older-than flag in mlflow gc command, and added tests for that cli command Signed-off-by: Jason Cheng <[email protected]> * Removed delete_time from RunInfo proto Signed-off-by: Jason Cheng <[email protected]> * Set default older-than flag to None Signed-off-by: Jason Cheng <[email protected]> * Remove delete_time from RunInfo, add optional parameter older_than to store.get_deleted_runs(), and write delete_time into yaml file for file storage instead of adding it to RunInfo Signed-off-by: Jason Cheng <[email protected]> * Remove commented delete_time in RunInfo constructor in models.py Signed-off-by: Jason Cheng <[email protected]> * added INVALID_PARAMETER_VALUE error code in mlflow gc Signed-off-by: Jason Cheng <[email protected]> * Resolve case of delete time not in meta.yaml file, edited overwrite_run_info and gc Signed-off-by: Jason Cheng <[email protected]> * Rename delete_time to deleted_time Signed-off-by: Jason Cheng <[email protected]> * Rename delete_time to deleted_time, match error message in cli tests, filter SqlRuns by deleted_time, indicate float values accepted for gc --older-than flag Signed-off-by: Jason Cheng <[email protected]> * Rename delete_time to deleted_time, fixed assert statement in test_mlflow_gc, and fixed deleted_time queries in test_file_store.py and test_sqlalchemy_store.py Signed-off-by: Jason Cheng <[email protected]> * Only check if is in meta after restoring run in test_delte_restore_run Signed-off-by: Jason Cheng <[email protected]> * Fixed lint errors Signed-off-by: Jason Cheng <[email protected]> * Install mlflow from repository root Signed-off-by: harupy <[email protected]> Co-authored-by: harupy <[email protected]> * Separate protos job (#6399) * Separate protos job Signed-off-by: harupy <[email protected]> * test Signed-off-by: harupy <[email protected]> * Add paths Signed-off-by: harupy <[email protected]> * Revert "test" This reverts commit 5d04b02f55ec92e1e3ac18eb651ea989ca0d469a. Signed-off-by: harupy <[email protected]> * Fix flaky `TestFileStore.test_get_deleted_runs` (#6402) * use gt operator Signed-off-by: harupy <[email protected]> * fix sqlalchemy store Signed-off-by: harupy <[email protected]> * Migrate environment variables for SQLAlchemy store (#6396) Signed-off-by: harupy <[email protected]> * Deduplicate MlflowClient in MLflow docs, move to mlflow.client module (#6405) * Dedupe MlflowClient Signed-off-by: dbczumar <[email protected]> * Improvements Signed-off-by: dbczumar <[email protected]> * Add client Signed-off-by: dbczumar <[email protected]> * Remove unused functions in `mlflow.data` module (#6408) * remove unused functions in data Signed-off-by: harupy <[email protected]> * Remove unused functions and variables Signed-off-by: harupy <[email protected]> * Tag based registered model search and model version search (#6320) * init Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update tests Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * clean Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * add test Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * de-dup tag based search result Signed-off-by: Weichen Xu <[email protected]> * add () to fix case_sensitive_mysql_ne Signed-off-by: Weichen Xu <[email protected]> * fix Signed-off-by: Weichen Xu <[email protected]> * lint Signed-off-by: Weichen Xu <[email protected]> * fix * fix test in TODO Signed-off-by: Weichen Xu <[email protected]> * support dup tag key filter Signed-off-by: Weichen Xu <[email protected]> * add mv order by Signed-off-by: Weichen Xu <[email protected]> * cmp res list in test Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * add doc Signed-off-by: Weichen Xu <[email protected]> * fix Signed-off-by: Weichen Xu <[email protected]> * fix lint Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * update doc Signed-off-by: Weichen Xu <[email protected]> * Increase maximum param value length to 500 (#6358) * increase validation of maximum param value length from 250 to 500 (squashed) Signed-off-by: Jan Sindlar <[email protected]> * 1. added test for exceeding max length. 2. lint. 3. validation logic addresses null Signed-off-by: Jan Sindlar <[email protected]> * file store should test already stringified params Signed-off-by: Jan Sindlar <[email protected]> * update alembic chain Signed-off-by: Jan Sindlar <[email protected]> * Autoformat: https://github.com/mlflow/mlflow/actions/runs/2800398158 Signed-off-by: mlflow-automation <[email protected]> * Update tests/store/tracking/test_file_store.py Co-authored-by: Harutaka Kawamura <[email protected]> Signed-off-by: Jan Sindlar <[email protected]> Co-authored-by: Jan Sindlar <[email protected]> Co-authored-by: mlflow-automation <[email protected]> Co-authored-by: Harutaka Kawamura <[email protected]> * Add workflow dispatch for requirements validation, remove duplicate file (#6418) * Workflow dispatch Signed-off-by: dbczumar <[email protected]> * Remove unused Signed-off-by: dbczumar <[email protected]> * Prevent `pytest.raises` context manager from containing multiple statements (#6409) * rename Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * Do not allow calling assert in pytest.raises Signed-off-by: harupy <[email protected]> * more strict rule Signed-off-by: harupy <[email protected]> * Improve error message Signed-off-by: harupy <[email protected]> * relax condition Signed-off-by: harupy <[email protected]> * fix lint errors Signed-off-by: harupy <[email protected]> * fix failed tests Signed-off-by: harupy <[email protected]> * clean up Signed-off-by: harupy <[email protected]> * rename _is_complex_pytest_raises Signed-off-by: harupy <[email protected]> * fix lint errors Signed-off-by: harupy <[email protected]> * fix failed tests Signed-off-by: harupy <[email protected]> * Fix regression in pandas type inference behavior for scoring server (#6417) * Fix impl Signed-off-by: dbczumar <[email protected]> * Remove unused pandas import Signed-off-by: dbczumar <[email protected]> * Adjust client to use SearchExperiments POST method (#6415) * POST Signed-off-by: dbczumar <[email protected]> * Generate protos Signed-off-by: dbczumar <[email protected]> * Fix test Signed-off-by: dbczumar <[email protected]> * update (#6420) Signed-off-by: Weichen Xu <[email protected]> * Check if artifacts are proxied in model_version_artifact_handler (#6355) * Check if artifacts are proxied in model_version_artifact_handler Signed-off-by: Mohammad Abbas <[email protected]> * Use file prefix for artifact dest on windows Signed-off-by: dbczumar <[email protected]> * Fix application of prefix Signed-off-by: dbczumar <[email protected]> * Fixes Signed-off-by: dbczumar <[email protected]> Co-authored-by: dbczumar <[email protected]> * Allow sql filter IN operator right-hand side values including whitespaces (#6413) * support in rhs whitespace Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * Fix IN operator related issues in sql filter parser (#6411) * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * clean Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * address comment Signed-off-by: Weichen Xu <[email protected]> * Remove unused method `SearchUtils._get_comparison_for_model_registry` (#6412) * init Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * Update MLflow UI (#6422) * Project import generated by Copybara. GitOrigin-RevId: 086b1200f4573559e37fcea6cb5472d52f166e42 Signed-off-by: dbczumar <[email protected]> * Reconcile changes from universe with OSS Signed-off-by: dbczumar <[email protected]> * Fix test fails Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * Apply model search fix Signed-off-by: dbczumar <[email protected]> * Remove errant test line Signed-off-by: dbczumar <[email protected]> Co-authored-by: Richard Zang <[email protected]> * remove near from deprecation msg (#6430) Signed-off-by: ninabacc-db <[email protected]> * Raise clear error message when pipeline path contains a space (#6426) * Add unsupported Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * Exc Signed-off-by: dbczumar <[email protected]> * Test Signed-off-by: dbczumar <[email protected]> * Format Signed-off-by: dbczumar <[email protected]> * Test fix Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * [ALL TESTS] Changelog for MLflow 1.28.0 (#6433) * Generating changelog for MLflow 1.27.1.dev0 Signed-off-by: Jenkins <[email protected]> * Changelog Signed-off-by: dbczumar <[email protected]> * Add missing PR Signed-off-by: dbczumar <[email protected]> * Some fixes Signed-off-by: dbczumar <[email protected]> * More small fixes Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> Signed-off-by: Jenkins <[email protected]> Signed-off-by: dbczumar <[email protected]> Co-authored-by: Jenkins <[email protected]> Co-authored-by: dbczumar <[email protected]> * Patch (#6440) Signed-off-by: dbczumar <[email protected]> Signed-off-by: dbczumar <[email protected]> * [ALL TESTS] Update (#6443) * python dev/update_ml_package_versions.py Signed-off-by: Jenkins <[email protected]> * pyspark max ver 3.4 Signed-off-by: Weichen Xu <[email protected]> Signed-off-by: Jenkins <[email protected]> Signed-off-by: Weichen Xu <[email protected]> Co-authored-by: Jenkins <[email protected]> Co-authored-by: Weichen Xu <[email protected]> * Update MLflow version to 1.28.1 (#6449) Signed-off-by: Jenkins <[email protected]> Signed-off-by: Jenkins <[email protected]> Co-authored-by: Jenkins <[email protected]> * Add data capture config to sagemaker (#6423) Signed-off-by: jonwiggins <[email protected]> Signed-off-by: jonwiggins <[email protected]> * Fix small search_runs docs issues (#6452) * Fix Signed-off-by: dbczumar <[email protected]> * Doc fix Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> Signed-off-by: dbczumar <[email protected]> * python dev/update_pypi_package_index.py (#6442) Signed-off-by: Jenkins <[email protected]> Signed-off-by: Jenkins <[email protected]> Co-authored-by: Jenkins <[email protected]> * use xgboost on pypi (#6461) Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> * Add environment variable for `echo` option in `create_engine` (#6460) * Add environment variable for echo Signed-off-by: harupy <[email protected]> * use _BooleanEnvironmentVariable Signed-off-by: harupy <[email protected]> * address comments Signed-off-by: harupy <[email protected]> * address comments and add tests Signed-off-by: harupy <[email protected]> * fix comment Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> Signed-off-by: dbczumar <[email protected]> Signed-off-by: harupy <[email protected]> Signed-off-by: Michal Karzynski <[email protected]> Signed-off-by: Sunish Sheth <[email protected]> Signed-off-by: Jin Zhang <[email protected]> Signed-off-by: Ryan Fogle <[email protected]> Signed-off-by: Brian Barnes <[email protected]> Signed-off-by: apurva-koti <[email protected]> Signed-off-by: Weichen Xu <[email protected]> Signed-off-by: ninabacc-db <[email protected]> Signed-off-by: Jenkins <[email protected]> Signed-off-by: jonwiggins <[email protected]> Co-authored-by: Corey Zumar <[email protected]> Co-authored-by: Michał Karzyński <[email protected]> Co-authored-by: Chang Yong Lik <[email protected]> Co-authored-by: Sunish Sheth <[email protected]> Co-authored-by: jinzhang21 <[email protected]> Co-authored-by: Ryan Fogle <[email protected]> Co-authored-by: bbarnes52 <[email protected]> Co-authored-by: apurva-koti <[email protected]> Co-authored-by: Hannes Schulz <[email protected]> Co-authored-by: dbczumar <[email protected]> Co-authored-by: mlflow-automation <[email protected]> Co-authored-by: WeichenXu <[email protected]> Co-authored-by: Siddharth Murching <[email protected]> Co-authored-by: Cheng Kuan Yong Jason <[email protected]> Co-authored-by: johnyNJ <[email protected]> Co-authored-by: Jan Sindlar <[email protected]> Co-authored-by: Mohammad Abbas <[email protected]> Co-authored-by: Richard Zang <[email protected]> Co-authored-by: Nina Baccam <[email protected]> Co-authored-by: mlflow-automation <[email protected]> Co-authored-by: Jenkins <[email protected]> Co-authored-by: Jon Wiggins <[email protected]> * Use `virtualenv` by default when running an ML project (#6489) * Use virtualenv by default when running an ML project Signed-off-by: harupy <[email protected]> * use _PYTHON_ENV_FILE_NAME Signed-off-by: harupy <[email protected]> * fix doc Signed-off-by: harupy <[email protected]> * fix env type Signed-off-by: harupy <[email protected]> * fix env_type Signed-off-by: harupy <[email protected]> * swap conda and virtualenv Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> * Use `virtualenv` by default when restoring a model environment (#6459) * Use virtualenv by default when restoring a model environment Signed-off-by: harupy <[email protected]> * fix failed test Signed-off-by: harupy <[email protected]> * set up pyenv and virtualenv Signed-off-by: harupy <[email protected]> * get conda_env file path from MLmodel file Signed-off-by: harupy <[email protected]> * pyenv Signed-off-by: harupy <[email protected]> * use current python version Signed-off-by: harupy <[email protected]> * fix failed test Signed-off-by: harupy <[email protected]> * fix failed test Signed-off-by: harupy <[email protected]> * update default value of spark_udf Signed-off-by: harupy <[email protected]> * rename test Signed-off-by: harupy <[email protected]> * revert spark_udf change Signed-off-by: harupy <[email protected]> * revert Signed-off-by: harupy <[email protected]> * change default value to virtualenv Signed-off-by: harupy <[email protected]> * use local Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> * Remove `--no-conda` (#6501) * remove --no-conda Signed-off-by: harupy <[email protected]> * update R docs Signed-off-by: harupy <[email protected]> * remove tests for --no-conda Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> * Sync `branch-2.0` with master (#6510) * Fix java model server compatibility with models containing databricks_runtime conf (#6337) * Javafix Signed-off-by: dbczumar <[email protected]> * Resource fix Signed-off-by: dbczumar <[email protected]> * Add run / model links to MLP train step card (#6294) * One commit Signed-off-by: dbczumar <[email protected]> * Submodule revert Signed-off-by: dbczumar <[email protected]> * Fix client tests Signed-off-by: dbczumar <[email protected]> * fix ci Signed-off-by: dbczumar <[email protected]> * Remove unused / invalid import Signed-off-by: dbczumar <[email protected]> * Put run summary back to end, fix tests Signed-off-by: dbczumar <[email protected]> * Use mocks instead Signed-off-by: dbczumar <[email protected]> * Fix inefficient relative time computation for metric plot (#6341) * compute minTimestamp only once Signed-off-by: harupy <[email protected]> * fix method name Signed-off-by: harupy <[email protected]> * fix lint Signed-off-by: harupy <[email protected]> * return empty array Signed-off-by: harupy <[email protected]> * fix test Signed-off-by: harupy <[email protected]> * Add `MLFLOW_SQLALCHEMYSTORE_POOL_RECYCLE` flag (#6344) * Add pool_recycle option to SQLAlchemy create_engine Signed-off-by: Michal Karzynski <[email protected]> * Add new option to unit test Signed-off-by: Michal Karzynski <[email protected]> * Add note in documentation Signed-off-by: Michal Karzynski <[email protected]> * Add box plot in compare-runs page (#6308) * Added BoxPlot Signed-off-by: changyonglik <[email protected]> * Fixed key error Signed-off-by: changyonglik <[email protected]> * Added default state Signed-off-by: changyonglik <[email protected]> * Fixed props passing Signed-off-by: changyonglik <[email protected]> * Fixed react hooks state Signed-off-by: changyonglik <[email protected]> * Added unit test Signed-off-by: changyonglik <[email protected]> * Added boxplot to CompareModelVersion Signed-off-by: changyonglik <[email protected]> * Changed keys numbering to reflect tab name Signed-off-by: changyonglik <[email protected]> * Made the ordering of tabs consistent accross CompareRunView and CompareModelVersion Signed-off-by: changyonglik <[email protected]> * Linted Signed-off-by: changyonglik <[email protected]> * Fixed FormattedMessage Signed-off-by: changyonglik <[email protected]> * refactoring Signed-off-by: harupy <[email protected]> * fix lint errors Signed-off-by: harupy <[email protected]> * i18n Signed-off-by: harupy <[email protected]> * minor comment fix Signed-off-by: harupy <[email protected]> Co-authored-by: harupy <[email protected]> * Add script and workflow to update requirements.yaml specifications (#6287) * add script to update requirements.yaml Signed-off-by: harupy <[email protected]> * update both skinny and core requirements Signed-off-by: harupy <[email protected]> * remove base Signed-off-by: harupy <[email protected]> * clean up Signed-off-by: harupy <[email protected]> * add MLFLOW_CONDA_HOME Signed-off-by: harupy <[email protected]> * create create-pr job Signed-off-by: harupy <[email protected]> * fix syntax Signed-off-by: harupy <[email protected]> * remove redundant if Signed-off-by: harupy <[email protected]> * clean up Signed-off-by: harupy <[email protected]> * doc Signed-off-by: harupy <[email protected]> * dynamically determine python version Signed-off-by: harupy <[email protected]> * remove python version mock Signed-off-by: harupy <[email protected]> * use setup-ssh.sh in master.yml Signed-off-by: harupy <[email protected]> * simplify Signed-off-by: harupy <[email protected]> * update both core and skinny requirements Signed-off-by: harupy <[email protected]> * use env Signed-off-by: harupy <[email protected]> * remove action version Signed-off-by: harupy <[email protected]> * fix pandas dtypes issue Signed-off-by: harupy <[email protected]> * check if PR already exists Signed-off-by: harupy <[email protected]> * add semicolons Signed-off-by: harupy <[email protected]> * test PR creation Signed-off-by: harupy <[email protected]> * set base Signed-off-by: harupy <[email protected]> * use run_number Signed-off-by: harupy <[email protected]> * set result-encoding Signed-off-by: harupy <[email protected]> * revert changes for test Signed-off-by: harupy <[email protected]> * fix more tests Signed-off-by: harupy <[email protected]> * fix run URL Signed-off-by: harupy <[email protected]> * add dot Signed-off-by: harupy <[email protected]> * remove minimum_version Signed-off-by: harupy <[email protected]> * remove create-pr job Signed-off-by: harupy <[email protected]> * rename workflow Signed-off-by: harupy <[email protected]> * mutate dict approach Signed-off-by: harupy <[email protected]> * use ruamel Signed-off-by: harupy <[email protected]> * remove PYTHON_VERSION patch Signed-off-by: harupy <[email protected]> * add ruamel.yaml to requirements Signed-off-by: harupy <[email protected]> * skip update-requirements on PR Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * print new version Signed-off-by: harupy <[email protected]> * preserve quotes Signed-off-by: harupy <[email protected]> * fix badge Signed-off-by: harupy <[email protected]> * fix README Signed-off-by: harupy <[email protected]> * run ci Signed-off-by: harupy <[email protected]> * remove validate-requirements.yml Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * fix test_dataframe_from_json Signed-off-by: harupy <[email protected]> * Make `model_uri` optional for `mlflow models build-docker` (#6302) * Make model_uri optional for mlflow models build-docker Signed-off-by: harupy <[email protected]> * fix doc Signed-off-by: harupy <[email protected]> * Add generic Signed-off-by: harupy <[email protected]> * Add pythou_function flavor Signed-off-by: harupy <[email protected]> * fix doc Signed-off-by: harupy <[email protected]> * quotes Signed-off-by: harupy <[email protected]> * use longer options Signed-off-by: harupy <[email protected]> * add index (#6347) Signed-off-by: harupy <[email protected]> * fix badge link (#6349) Signed-off-by: harupy <[email protected]> * Enable consider-using-dict-items rule for pylint (#6351) * Enable consider-using-dict-items Signed-off-by: harupy <[email protected]> * fix lint errors Signed-off-by: harupy <[email protected]> * Enable consider-merging-isinstance (#6350) Signed-off-by: harupy <[email protected]> * Enable consider-using-from-import rule for pylint (#6352) * Enable consider-using-from-import Signed-off-by: harupy <[email protected]> * fix Signed-off-by: harupy <[email protected]> * fix datasets import Signed-off-by: harupy <[email protected]> * fix failed tests Signed-off-by: harupy <[email protected]> * Run model registry sqlalchemy tests in database job (#6353) Signed-off-by: harupy <[email protected]> * update to run profiles on the first 100 dataframe columns (#6297) * update to run profiles on the first 100 dataframe columns Signed-off-by: Sunish Sheth <[email protected]> * Adding replace=True so we can sample rows twice Signed-off-by: Sunish Sheth <[email protected]> * Removing replace=true and fixing how the max_rows are calculated Signed-off-by: Sunish Sheth <[email protected]> * Fix sklearn autologging input example & signature mutation for models containing transformers (#6230) * Fix with test case Signed-off-by: dbczumar <[email protected]> * Test fix Signed-off-by: dbczumar <[email protected]> * Fix and simplification Signed-off-by: dbczumar <[email protected]> * more fixes & better test coveragE Signed-off-by: dbczumar <[email protected]> * test Signed-off-by: dbczumar <[email protected]> * LGBM test Signed-off-by: dbczumar <[email protected]> * Format Signed-off-by: dbczumar <[email protected]> * Address comments Signed-off-by: dbczumar <[email protected]> * Fixes Signed-off-by: dbczumar <[email protected]> * Use py37-compatible call args syntax Signed-off-by: dbczumar <[email protected]> * use list (#6363) Signed-off-by: harupy <[email protected]> * Log runtime pipeline config to MLflow (#6359) * Log runtime pipeline config to MLflow Signed-off-by: Jin Zhang <[email protected]> * Fixed lint Signed-off-by: Jin Zhang <[email protected]> * Add status badge for stale action (#6372) Signed-off-by: harupy <[email protected]> * Add stack trace section to bug report template (#6374) Signed-off-by: harupy <[email protected]> * Skipping the transform step by using Functional transformer (#6362) Signed-off-by: Sunish Sheth <[email protected]> * Series schema (#6361) * Added in name for ColSpec of pandas datatype infer panda series name for ColSpec Signed-off-by: Ryan Fogle <[email protected]> * Added test for Series name inference added one more pytest condition in test_schema:test_schema_inference_on_pandas_series Signed-off-by: Ryan Fogle <[email protected]> * Update test_schema.py Added in one more assertion to test schema inference. Signed-off-by: Ryan Fogle <[email protected]> * ran black Signed-off-by: Ryan Fogle <[email protected]> * added in requested changes in issue #6361 Signed-off-by: Ryan Fogle <[email protected]> * fix typo. changed hasattr to getattr Signed-off-by: Ryan Fogle <[email protected]> * integrate mlflowdbfs (#6282) Signed-off-by: Brian Barnes <[email protected]> * Fix step card display breakage in Jupyter notebooks (#6378) * remove Signed-off-by: apurva-koti <[email protected]> * fix Signed-off-by: apurva-koti <[email protected]> * Avoid using flask 2.2.0 (#6380) Signed-off-by: harupy <[email protected]> * Migrate GCS environment variables to `mlflow.environment_variables` module (#6375) * Migrate GCS environment variables to mlflow.environment_variables Signed-off-by: harupy <[email protected]> * add default Signed-off-by: harupy <[email protected]> * improve comments Signed-off-by: harupy <[email protected]> * Avoid logging model signatures in pyspark ML autologging if model input/output dataframe contains unsupported data types (#6365) * Avoid logging signatures Signed-off-by: harupy <[email protected]> * test Signed-off-by: harupy <[email protected]> * fix indent Signed-off-by: harupy <[email protected]> * check model output Signed-off-by: harupy <[email protected]> * fix warning message Signed-off-by: harupy <[email protected]> * todo Signed-off-by: harupy <[email protected]> * update test and doc Signed-off-by: harupy <[email protected]> * fix docstring Signed-off-by: harupy <[email protected]> * fix failed tests Signed-off-by: harupy <[email protected]> * improve _assert_autolog_infers_model_signature_correctly Signed-off-by: harupy <[email protected]> * Refactor `set_matrix.py` (#6373) * refacor set_matrix.py Signed-off-by: harupy <[email protected]> * fix Signed-off-by: harupy <[email protected]> * fix tests Signed-off-by: harupy <[email protected]> * tset for --no-dev Signed-off-by: harupy <[email protected]> * install pytest and pytest-cov Signed-off-by: harupy <[email protected]> * test for --changed-files Signed-off-by: harupy <[email protected]> * add pyyaml to requirements Signed-off-by: harupy <[email protected]> * fix is_matrix_empty Signed-off-by: harupy <[email protected]> * use raw string and re.match Signed-off-by: harupy <[email protected]> * Fix is_matrix_empty (#6385) Signed-off-by: harupy <[email protected]> * Allow mlflow-skinny's autolog() to succeed when no scipy is installed (#5897) * allow mlflow-skinny's autolog() to succeed when no scipy is installed Signed-off-by: Hannes Schulz <[email protected]> * optional pyfunc scipy dependency Signed-off-by: Hannes Schulz <[email protected]> * fix linter-discovered issues Signed-off-by: Hannes Schulz <[email protected]> * add test case, autolog() should pass w/o scipy installed Signed-off-by: Hannes Schulz <[email protected]> * minor cleanup Signed-off-by: Hannes Schulz <[email protected]> * test creating _Example with / without scipy present Signed-off-by: Hannes Schulz <[email protected]> * docs: do not warn about sparse matrix classes Signed-off-by: Hannes Schulz <[email protected]> * linting Signed-off-by: Hannes Schulz <[email protected]> * address review comment Signed-off-by: Hannes Schulz <[email protected]> * run black Signed-off-by: Hannes Schulz <[email protected]> * allow mlflow-skinny's autolog() to succeed when no scipy is installed Signed-off-by: Hannes Schulz <[email protected]> * optional pyfunc scipy dependency Signed-off-by: Hannes Schulz <[email protected]> * fix linter-discovered issues Signed-off-by: Hannes Schulz <[email protected]> * add test case, autolog() should pass w/o scipy installed Signed-off-by: Hannes Schulz <[email protected]> * minor cleanup Signed-off-by: Hannes Schulz <[email protected]> * test creating _Example with / without scipy present Signed-off-by: Hannes Schulz <[email protected]> * docs: do not warn about sparse matrix classes Signed-off-by: Hannes Schulz <[email protected]> * linting Signed-off-by: Hannes Schulz <[email protected]> * address review comment Signed-off-by: Hannes Schulz <[email protected]> * run black Signed-off-by: Hannes Schulz <[email protected]> * remove redundant None check after import Signed-off-by: Hannes Schulz <[email protected]> * delete comment Signed-off-by: Hannes Schulz <[email protected]> * Revert "remove redundant None check after import" This reverts commit f2e198c944f41d9a96c20ae471d71bff39431b48. Signed-off-by: Hannes Schulz <[email protected]> * review comments Signed-off-by: Hannes Schulz <[email protected]> * remove redundant test Signed-off-by: Hannes Schulz <[email protected]> * Apply suggestions from code review Co-authored-by: Harutaka Kawamura <[email protected]> Signed-off-by: Hannes Schulz <[email protected]> * Autoformat: https://github.com/mlflow/mlflow/actions/runs/2779791161 Signed-off-by: mlflow-automation <[email protected]> Co-authored-by: Harutaka Kawamura <[email protected]> Co-authored-by: dbczumar <[email protected]> Co-authored-by: mlflow-automation <[email protected]> * Fix extraneous warning about pyspark evaluation truncation (#6389) * Revert #6380 (#6386) * revert Signed-off-by: harupy <[email protected]> * workaround for test_prometheus_exporter Signed-off-by: harupy <[email protected]> * nit Signed-off-by: harupy <[email protected]> * Validate metric value in `FileStore.log_metric` (#6381) * add failing test Signed-off-by: harupy <[email protected]> * use _validate_metric Signed-off-by: harupy <[email protected]> * fix invalid metric timestamp Signed-off-by: harupy <[email protected]> * fix docstring Signed-off-by: harupy <[email protected]> * fix java test Signed-off-by: harupy <[email protected]> * Make search experiment by tag key comparison case sensitive in MYSQL (#6333) * init Signed-off-by: Weichen Xu <[email protected]> * add test Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * fix BINARY conditions in MySQL Signed-off-by: harupy <[email protected]> * fix attr error Signed-off-by: harupy <[email protected]> Co-authored-by: harupy <[email protected]> * Run Model Registry SQLAlchemy tests in PostgreSQL, MySQL, and MSSQL (#6390) * Run Model Registry SQLAlchemy tests in postgres, mysql, and mssql Signed-off-by: harupy <[email protected]> * fix failed tests Signed-off-by: harupy <[email protected]> * remove uuid Signed-off-by: harupy <[email protected]> * clean up Signed-off-by: harupy <[email protected]> * do not drop tables Signed-off-by: harupy <[email protected]> * Fix filestore data loss on failed write & mitigate read / write race condition (#6388) * Fix Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * Format Signed-off-by: dbczumar <[email protected]> * Added a custom filter from_json to render_and_merge_yaml (#6368) * Added a custom filter from_json to render_and_merge_yaml Signed-off-by: Jin Zhang <[email protected]> * Fixed test Signed-off-by: Jin Zhang <[email protected]> * Update tests/utils/test_file_utils.py Co-authored-by: Siddharth Murching <[email protected]> * Update tests/utils/test_file_utils.py Co-authored-by: Siddharth Murching <[email protected]> * Fixed test Signed-off-by: Jin Zhang <[email protected]> * Fixed windows test attempt Signed-off-by: Jin Zhang <[email protected]> * Fixed windows test Signed-off-by: Jin Zhang <[email protected]> Co-authored-by: Siddharth Murching <[email protected]> * Fix `!=` operator for MySQL (#6397) * fix ne operator and improve tests Signed-off-by: harupy <[email protected]> * add () to other operators Signed-off-by: harupy <[email protected]> * Simplify the documentation section in the PR template (#6398) * Simplify the documentation section in the PR template Signed-off-by: harupy <[email protected]> * fix Signed-off-by: harupy <[email protected]> * Timebased gc (#6354) * Added delete_time field to runs table Signed-off-by: Jason Cheng <[email protected]> * Updated latest_schema.sql to pass tests/store/tracking/test_sqlalchemy_store_schema.py Signed-off-by: Jason Cheng <[email protected]> * Added delete_time column into mlflow/store/tracking/dbmodels/initial_models.py Signed-off-by: Jason Cheng <[email protected]> * Moved the docstring to the end of the declaration instead of the start Signed-off-by: Jason Cheng <[email protected]> * Regenerated protobuf for RunInfo new schema, and passed pytest Signed-off-by: Jason Cheng <[email protected]> * Added --older-than flag in mlflow gc command, and added tests for that cli command Signed-off-by: Jason Cheng <[email protected]> * Removed delete_time from RunInfo proto Signed-off-by: Jason Cheng <[email protected]> * Set default older-than flag to None Signed-off-by: Jason Cheng <[email protected]> * Remove delete_time from RunInfo, add optional parameter older_than to store.get_deleted_runs(), and write delete_time into yaml file for file storage instead of adding it to RunInfo Signed-off-by: Jason Cheng <[email protected]> * Remove commented delete_time in RunInfo constructor in models.py Signed-off-by: Jason Cheng <[email protected]> * added INVALID_PARAMETER_VALUE error code in mlflow gc Signed-off-by: Jason Cheng <[email protected]> * Resolve case of delete time not in meta.yaml file, edited overwrite_run_info and gc Signed-off-by: Jason Cheng <[email protected]> * Rename delete_time to deleted_time Signed-off-by: Jason Cheng <[email protected]> * Rename delete_time to deleted_time, match error message in cli tests, filter SqlRuns by deleted_time, indicate float values accepted for gc --older-than flag Signed-off-by: Jason Cheng <[email protected]> * Rename delete_time to deleted_time, fixed assert statement in test_mlflow_gc, and fixed deleted_time queries in test_file_store.py and test_sqlalchemy_store.py Signed-off-by: Jason Cheng <[email protected]> * Only check if is in meta after restoring run in test_delte_restore_run Signed-off-by: Jason Cheng <[email protected]> * Fixed lint errors Signed-off-by: Jason Cheng <[email protected]> * Install mlflow from repository root Signed-off-by: harupy <[email protected]> Co-authored-by: harupy <[email protected]> * Separate protos job (#6399) * Separate protos job Signed-off-by: harupy <[email protected]> * test Signed-off-by: harupy <[email protected]> * Add paths Signed-off-by: harupy <[email protected]> * Revert "test" This reverts commit 5d04b02f55ec92e1e3ac18eb651ea989ca0d469a. Signed-off-by: harupy <[email protected]> * Fix flaky `TestFileStore.test_get_deleted_runs` (#6402) * use gt operator Signed-off-by: harupy <[email protected]> * fix sqlalchemy store Signed-off-by: harupy <[email protected]> * Migrate environment variables for SQLAlchemy store (#6396) Signed-off-by: harupy <[email protected]> * Deduplicate MlflowClient in MLflow docs, move to mlflow.client module (#6405) * Dedupe MlflowClient Signed-off-by: dbczumar <[email protected]> * Improvements Signed-off-by: dbczumar <[email protected]> * Add client Signed-off-by: dbczumar <[email protected]> * Remove unused functions in `mlflow.data` module (#6408) * remove unused functions in data Signed-off-by: harupy <[email protected]> * Remove unused functions and variables Signed-off-by: harupy <[email protected]> * Tag based registered model search and model version search (#6320) * init Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update tests Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * clean Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * add test Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * de-dup tag based search result Signed-off-by: Weichen Xu <[email protected]> * add () to fix case_sensitive_mysql_ne Signed-off-by: Weichen Xu <[email protected]> * fix Signed-off-by: Weichen Xu <[email protected]> * lint Signed-off-by: Weichen Xu <[email protected]> * fix * fix test in TODO Signed-off-by: Weichen Xu <[email protected]> * support dup tag key filter Signed-off-by: Weichen Xu <[email protected]> * add mv order by Signed-off-by: Weichen Xu <[email protected]> * cmp res list in test Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * add doc Signed-off-by: Weichen Xu <[email protected]> * fix Signed-off-by: Weichen Xu <[email protected]> * fix lint Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * update doc Signed-off-by: Weichen Xu <[email protected]> * Increase maximum param value length to 500 (#6358) * increase validation of maximum param value length from 250 to 500 (squashed) Signed-off-by: Jan Sindlar <[email protected]> * 1. added test for exceed…

Javafix

88c00ec

Signed-off-by: dbczumar <[email protected]>

dbczumar requested a review from WeichenXu123 July 26, 2022 22:56

github-actions bot added area/scoring MLflow Model server, model deployment tools, Spark UDFs rn/bug-fix Mention under Bug Fixes in Changelogs. labels Jul 26, 2022

Resource fix

d142efd

Signed-off-by: dbczumar <[email protected]>

harupy approved these changes Jul 27, 2022

View reviewed changes

WeichenXu123 approved these changes Jul 27, 2022

View reviewed changes

dbczumar merged commit e6014d5 into mlflow:master Jul 27, 2022

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

Fix java model server compatibility with models containing databricks_runtime conf#6337

Fix java model server compatibility with models containing databricks_runtime conf#6337
dbczumar merged 2 commits intomlflow:masterfrom
dbczumar:java_dbr_fix

dbczumar commented Jul 26, 2022

Uh oh!

harupy left a comment

Uh oh!

WeichenXu123 left a comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants

Conversation

dbczumar commented Jul 26, 2022

Related Issues/PRs

What changes are proposed in this pull request?

How is this patch tested?

Does this PR change the documentation?

Release Notes

Is this a user-facing change?

What component(s), interfaces, languages, and integrations does this PR affect?

How should the PR be classified in the release notes? Choose one:

Uh oh!

harupy left a comment

Choose a reason for hiding this comment

Uh oh!

WeichenXu123 left a comment

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

3 participants