2.0 merge by BenWilson2 · Pull Request #7171 · mlflow/mlflow

BenWilson2 · 2022-10-26T14:18:30Z

Related Issues/PRs

#xxx

What changes are proposed in this pull request?

Merge 2.0 breaking changes into master branch

How is this patch tested?

I have written tests (not required for typo or doc fix) and confirmed the proposed feature/bug-fix/change works.

Does this PR change the documentation?

No. You can skip the rest of this section.
Yes. Make sure the changed pages / sections render correctly in the documentation preview.

Release Notes

Is this a user-facing change?

No. You can skip the rest of this section.
Yes. Give a description of this change to be included in the release notes for MLflow users.

Apply 2.0 breaking changes to master branch. For a full list of changes, see the 2.0 release notes.

What component(s), interfaces, languages, and integrations does this PR affect?

Components

Interface

area/uiux: Front-end, user experience, plotting, JavaScript, JavaScript dev server
area/docker: Docker use across MLflow's components, such as MLflow Projects and MLflow Models
area/sqlalchemy: Use of SQLAlchemy in the Tracking Service or Model Registry
area/windows: Windows support

Language

language/r: R APIs and clients
language/java: Java APIs and clients
language/new: Proposals for new client languages

Integrations

integrations/azure: Azure and Azure ML integrations
integrations/sagemaker: SageMaker integrations
integrations/databricks: Databricks integrations

How should the PR be classified in the release notes? Choose one:

rn/breaking-change - The PR will be mentioned in the "Breaking Changes" section
rn/none - No description will be included. The PR will be mentioned only by the PR number in the "Small Bugfixes and Documentation Updates" section
rn/feature - A new user-facing feature worth mentioning in the release notes
rn/bug-fix - A user-facing bug fix worth mentioning in the release notes
rn/documentation - A user-facing documentation change worth mentioning in the release notes

* Fix java model server compatibility with models containing databricks_runtime conf (#6337) * Javafix Signed-off-by: dbczumar <[email protected]> * Resource fix Signed-off-by: dbczumar <[email protected]> * Add run / model links to MLP train step card (#6294) * One commit Signed-off-by: dbczumar <[email protected]> * Submodule revert Signed-off-by: dbczumar <[email protected]> * Fix client tests Signed-off-by: dbczumar <[email protected]> * fix ci Signed-off-by: dbczumar <[email protected]> * Remove unused / invalid import Signed-off-by: dbczumar <[email protected]> * Put run summary back to end, fix tests Signed-off-by: dbczumar <[email protected]> * Use mocks instead Signed-off-by: dbczumar <[email protected]> * Fix inefficient relative time computation for metric plot (#6341) * compute minTimestamp only once Signed-off-by: harupy <[email protected]> * fix method name Signed-off-by: harupy <[email protected]> * fix lint Signed-off-by: harupy <[email protected]> * return empty array Signed-off-by: harupy <[email protected]> * fix test Signed-off-by: harupy <[email protected]> * Add `MLFLOW_SQLALCHEMYSTORE_POOL_RECYCLE` flag (#6344) * Add pool_recycle option to SQLAlchemy create_engine Signed-off-by: Michal Karzynski <[email protected]> * Add new option to unit test Signed-off-by: Michal Karzynski <[email protected]> * Add note in documentation Signed-off-by: Michal Karzynski <[email protected]> * Add box plot in compare-runs page (#6308) * Added BoxPlot Signed-off-by: changyonglik <[email protected]> * Fixed key error Signed-off-by: changyonglik <[email protected]> * Added default state Signed-off-by: changyonglik <[email protected]> * Fixed props passing Signed-off-by: changyonglik <[email protected]> * Fixed react hooks state Signed-off-by: changyonglik <[email protected]> * Added unit test Signed-off-by: changyonglik <[email protected]> * Added boxplot to CompareModelVersion Signed-off-by: changyonglik <[email protected]> * Changed keys numbering to reflect tab name Signed-off-by: changyonglik <[email protected]> * Made the ordering of tabs consistent accross CompareRunView and CompareModelVersion Signed-off-by: changyonglik <[email protected]> * Linted Signed-off-by: changyonglik <[email protected]> * Fixed FormattedMessage Signed-off-by: changyonglik <[email protected]> * refactoring Signed-off-by: harupy <[email protected]> * fix lint errors Signed-off-by: harupy <[email protected]> * i18n Signed-off-by: harupy <[email protected]> * minor comment fix Signed-off-by: harupy <[email protected]> Co-authored-by: harupy <[email protected]> * Add script and workflow to update requirements.yaml specifications (#6287) * add script to update requirements.yaml Signed-off-by: harupy <[email protected]> * update both skinny and core requirements Signed-off-by: harupy <[email protected]> * remove base Signed-off-by: harupy <[email protected]> * clean up Signed-off-by: harupy <[email protected]> * add MLFLOW_CONDA_HOME Signed-off-by: harupy <[email protected]> * create create-pr job Signed-off-by: harupy <[email protected]> * fix syntax Signed-off-by: harupy <[email protected]> * remove redundant if Signed-off-by: harupy <[email protected]> * clean up Signed-off-by: harupy <[email protected]> * doc Signed-off-by: harupy <[email protected]> * dynamically determine python version Signed-off-by: harupy <[email protected]> * remove python version mock Signed-off-by: harupy <[email protected]> * use setup-ssh.sh in master.yml Signed-off-by: harupy <[email protected]> * simplify Signed-off-by: harupy <[email protected]> * update both core and skinny requirements Signed-off-by: harupy <[email protected]> * use env Signed-off-by: harupy <[email protected]> * remove action version Signed-off-by: harupy <[email protected]> * fix pandas dtypes issue Signed-off-by: harupy <[email protected]> * check if PR already exists Signed-off-by: harupy <[email protected]> * add semicolons Signed-off-by: harupy <[email protected]> * test PR creation Signed-off-by: harupy <[email protected]> * set base Signed-off-by: harupy <[email protected]> * use run_number Signed-off-by: harupy <[email protected]> * set result-encoding Signed-off-by: harupy <[email protected]> * revert changes for test Signed-off-by: harupy <[email protected]> * fix more tests Signed-off-by: harupy <[email protected]> * fix run URL Signed-off-by: harupy <[email protected]> * add dot Signed-off-by: harupy <[email protected]> * remove minimum_version Signed-off-by: harupy <[email protected]> * remove create-pr job Signed-off-by: harupy <[email protected]> * rename workflow Signed-off-by: harupy <[email protected]> * mutate dict approach Signed-off-by: harupy <[email protected]> * use ruamel Signed-off-by: harupy <[email protected]> * remove PYTHON_VERSION patch Signed-off-by: harupy <[email protected]> * add ruamel.yaml to requirements Signed-off-by: harupy <[email protected]> * skip update-requirements on PR Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * print new version Signed-off-by: harupy <[email protected]> * preserve quotes Signed-off-by: harupy <[email protected]> * fix badge Signed-off-by: harupy <[email protected]> * fix README Signed-off-by: harupy <[email protected]> * run ci Signed-off-by: harupy <[email protected]> * remove validate-requirements.yml Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * fix test_dataframe_from_json Signed-off-by: harupy <[email protected]> * Make `model_uri` optional for `mlflow models build-docker` (#6302) * Make model_uri optional for mlflow models build-docker Signed-off-by: harupy <[email protected]> * fix doc Signed-off-by: harupy <[email protected]> * Add generic Signed-off-by: harupy <[email protected]> * Add pythou_function flavor Signed-off-by: harupy <[email protected]> * fix doc Signed-off-by: harupy <[email protected]> * quotes Signed-off-by: harupy <[email protected]> * use longer options Signed-off-by: harupy <[email protected]> * add index (#6347) Signed-off-by: harupy <[email protected]> * fix badge link (#6349) Signed-off-by: harupy <[email protected]> * Enable consider-using-dict-items rule for pylint (#6351) * Enable consider-using-dict-items Signed-off-by: harupy <[email protected]> * fix lint errors Signed-off-by: harupy <[email protected]> * Enable consider-merging-isinstance (#6350) Signed-off-by: harupy <[email protected]> * Enable consider-using-from-import rule for pylint (#6352) * Enable consider-using-from-import Signed-off-by: harupy <[email protected]> * fix Signed-off-by: harupy <[email protected]> * fix datasets import Signed-off-by: harupy <[email protected]> * fix failed tests Signed-off-by: harupy <[email protected]> * Run model registry sqlalchemy tests in database job (#6353) Signed-off-by: harupy <[email protected]> * update to run profiles on the first 100 dataframe columns (#6297) * update to run profiles on the first 100 dataframe columns Signed-off-by: Sunish Sheth <[email protected]> * Adding replace=True so we can sample rows twice Signed-off-by: Sunish Sheth <[email protected]> * Removing replace=true and fixing how the max_rows are calculated Signed-off-by: Sunish Sheth <[email protected]> * Fix sklearn autologging input example & signature mutation for models containing transformers (#6230) * Fix with test case Signed-off-by: dbczumar <[email protected]> * Test fix Signed-off-by: dbczumar <[email protected]> * Fix and simplification Signed-off-by: dbczumar <[email protected]> * more fixes & better test coveragE Signed-off-by: dbczumar <[email protected]> * test Signed-off-by: dbczumar <[email protected]> * LGBM test Signed-off-by: dbczumar <[email protected]> * Format Signed-off-by: dbczumar <[email protected]> * Address comments Signed-off-by: dbczumar <[email protected]> * Fixes Signed-off-by: dbczumar <[email protected]> * Use py37-compatible call args syntax Signed-off-by: dbczumar <[email protected]> * use list (#6363) Signed-off-by: harupy <[email protected]> * Log runtime pipeline config to MLflow (#6359) * Log runtime pipeline config to MLflow Signed-off-by: Jin Zhang <[email protected]> * Fixed lint Signed-off-by: Jin Zhang <[email protected]> * Add status badge for stale action (#6372) Signed-off-by: harupy <[email protected]> * Add stack trace section to bug report template (#6374) Signed-off-by: harupy <[email protected]> * Skipping the transform step by using Functional transformer (#6362) Signed-off-by: Sunish Sheth <[email protected]> * Series schema (#6361) * Added in name for ColSpec of pandas datatype infer panda series name for ColSpec Signed-off-by: Ryan Fogle <[email protected]> * Added test for Series name inference added one more pytest condition in test_schema:test_schema_inference_on_pandas_series Signed-off-by: Ryan Fogle <[email protected]> * Update test_schema.py Added in one more assertion to test schema inference. Signed-off-by: Ryan Fogle <[email protected]> * ran black Signed-off-by: Ryan Fogle <[email protected]> * added in requested changes in issue #6361 Signed-off-by: Ryan Fogle <[email protected]> * fix typo. changed hasattr to getattr Signed-off-by: Ryan Fogle <[email protected]> * integrate mlflowdbfs (#6282) Signed-off-by: Brian Barnes <[email protected]> * Fix step card display breakage in Jupyter notebooks (#6378) * remove Signed-off-by: apurva-koti <[email protected]> * fix Signed-off-by: apurva-koti <[email protected]> * Avoid using flask 2.2.0 (#6380) Signed-off-by: harupy <[email protected]> * Migrate GCS environment variables to `mlflow.environment_variables` module (#6375) * Migrate GCS environment variables to mlflow.environment_variables Signed-off-by: harupy <[email protected]> * add default Signed-off-by: harupy <[email protected]> * improve comments Signed-off-by: harupy <[email protected]> * Avoid logging model signatures in pyspark ML autologging if model input/output dataframe contains unsupported data types (#6365) * Avoid logging signatures Signed-off-by: harupy <[email protected]> * test Signed-off-by: harupy <[email protected]> * fix indent Signed-off-by: harupy <[email protected]> * check model output Signed-off-by: harupy <[email protected]> * fix warning message Signed-off-by: harupy <[email protected]> * todo Signed-off-by: harupy <[email protected]> * update test and doc Signed-off-by: harupy <[email protected]> * fix docstring Signed-off-by: harupy <[email protected]> * fix failed tests Signed-off-by: harupy <[email protected]> * improve _assert_autolog_infers_model_signature_correctly Signed-off-by: harupy <[email protected]> * Refactor `set_matrix.py` (#6373) * refacor set_matrix.py Signed-off-by: harupy <[email protected]> * fix Signed-off-by: harupy <[email protected]> * fix tests Signed-off-by: harupy <[email protected]> * tset for --no-dev Signed-off-by: harupy <[email protected]> * install pytest and pytest-cov Signed-off-by: harupy <[email protected]> * test for --changed-files Signed-off-by: harupy <[email protected]> * add pyyaml to requirements Signed-off-by: harupy <[email protected]> * fix is_matrix_empty Signed-off-by: harupy <[email protected]> * use raw string and re.match Signed-off-by: harupy <[email protected]> * Fix is_matrix_empty (#6385) Signed-off-by: harupy <[email protected]> * Allow mlflow-skinny's autolog() to succeed when no scipy is installed (#5897) * allow mlflow-skinny's autolog() to succeed when no scipy is installed Signed-off-by: Hannes Schulz <[email protected]> * optional pyfunc scipy dependency Signed-off-by: Hannes Schulz <[email protected]> * fix linter-discovered issues Signed-off-by: Hannes Schulz <[email protected]> * add test case, autolog() should pass w/o scipy installed Signed-off-by: Hannes Schulz <[email protected]> * minor cleanup Signed-off-by: Hannes Schulz <[email protected]> * test creating _Example with / without scipy present Signed-off-by: Hannes Schulz <[email protected]> * docs: do not warn about sparse matrix classes Signed-off-by: Hannes Schulz <[email protected]> * linting Signed-off-by: Hannes Schulz <[email protected]> * address review comment Signed-off-by: Hannes Schulz <[email protected]> * run black Signed-off-by: Hannes Schulz <[email protected]> * allow mlflow-skinny's autolog() to succeed when no scipy is installed Signed-off-by: Hannes Schulz <[email protected]> * optional pyfunc scipy dependency Signed-off-by: Hannes Schulz <[email protected]> * fix linter-discovered issues Signed-off-by: Hannes Schulz <[email protected]> * add test case, autolog() should pass w/o scipy installed Signed-off-by: Hannes Schulz <[email protected]> * minor cleanup Signed-off-by: Hannes Schulz <[email protected]> * test creating _Example with / without scipy present Signed-off-by: Hannes Schulz <[email protected]> * docs: do not warn about sparse matrix classes Signed-off-by: Hannes Schulz <[email protected]> * linting Signed-off-by: Hannes Schulz <[email protected]> * address review comment Signed-off-by: Hannes Schulz <[email protected]> * run black Signed-off-by: Hannes Schulz <[email protected]> * remove redundant None check after import Signed-off-by: Hannes Schulz <[email protected]> * delete comment Signed-off-by: Hannes Schulz <[email protected]> * Revert "remove redundant None check after import" This reverts commit f2e198c. Signed-off-by: Hannes Schulz <[email protected]> * review comments Signed-off-by: Hannes Schulz <[email protected]> * remove redundant test Signed-off-by: Hannes Schulz <[email protected]> * Apply suggestions from code review Co-authored-by: Harutaka Kawamura <[email protected]> Signed-off-by: Hannes Schulz <[email protected]> * Autoformat: https://github.com/mlflow/mlflow/actions/runs/2779791161 Signed-off-by: mlflow-automation <[email protected]> Co-authored-by: Harutaka Kawamura <[email protected]> Co-authored-by: dbczumar <[email protected]> Co-authored-by: mlflow-automation <[email protected]> * Fix extraneous warning about pyspark evaluation truncation (#6389) * Revert #6380 (#6386) * revert Signed-off-by: harupy <[email protected]> * workaround for test_prometheus_exporter Signed-off-by: harupy <[email protected]> * nit Signed-off-by: harupy <[email protected]> * Validate metric value in `FileStore.log_metric` (#6381) * add failing test Signed-off-by: harupy <[email protected]> * use _validate_metric Signed-off-by: harupy <[email protected]> * fix invalid metric timestamp Signed-off-by: harupy <[email protected]> * fix docstring Signed-off-by: harupy <[email protected]> * fix java test Signed-off-by: harupy <[email protected]> * Make search experiment by tag key comparison case sensitive in MYSQL (#6333) * init Signed-off-by: Weichen Xu <[email protected]> * add test Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * fix BINARY conditions in MySQL Signed-off-by: harupy <[email protected]> * fix attr error Signed-off-by: harupy <[email protected]> Co-authored-by: harupy <[email protected]> * Run Model Registry SQLAlchemy tests in PostgreSQL, MySQL, and MSSQL (#6390) * Run Model Registry SQLAlchemy tests in postgres, mysql, and mssql Signed-off-by: harupy <[email protected]> * fix failed tests Signed-off-by: harupy <[email protected]> * remove uuid Signed-off-by: harupy <[email protected]> * clean up Signed-off-by: harupy <[email protected]> * do not drop tables Signed-off-by: harupy <[email protected]> * Fix filestore data loss on failed write & mitigate read / write race condition (#6388) * Fix Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * Format Signed-off-by: dbczumar <[email protected]> * Added a custom filter from_json to render_and_merge_yaml (#6368) * Added a custom filter from_json to render_and_merge_yaml Signed-off-by: Jin Zhang <[email protected]> * Fixed test Signed-off-by: Jin Zhang <[email protected]> * Update tests/utils/test_file_utils.py Co-authored-by: Siddharth Murching <[email protected]> * Update tests/utils/test_file_utils.py Co-authored-by: Siddharth Murching <[email protected]> * Fixed test Signed-off-by: Jin Zhang <[email protected]> * Fixed windows test attempt Signed-off-by: Jin Zhang <[email protected]> * Fixed windows test Signed-off-by: Jin Zhang <[email protected]> Co-authored-by: Siddharth Murching <[email protected]> * Fix `!=` operator for MySQL (#6397) * fix ne operator and improve tests Signed-off-by: harupy <[email protected]> * add () to other operators Signed-off-by: harupy <[email protected]> * Simplify the documentation section in the PR template (#6398) * Simplify the documentation section in the PR template Signed-off-by: harupy <[email protected]> * fix Signed-off-by: harupy <[email protected]> * Timebased gc (#6354) * Added delete_time field to runs table Signed-off-by: Jason Cheng <[email protected]> * Updated latest_schema.sql to pass tests/store/tracking/test_sqlalchemy_store_schema.py Signed-off-by: Jason Cheng <[email protected]> * Added delete_time column into mlflow/store/tracking/dbmodels/initial_models.py Signed-off-by: Jason Cheng <[email protected]> * Moved the docstring to the end of the declaration instead of the start Signed-off-by: Jason Cheng <[email protected]> * Regenerated protobuf for RunInfo new schema, and passed pytest Signed-off-by: Jason Cheng <[email protected]> * Added --older-than flag in mlflow gc command, and added tests for that cli command Signed-off-by: Jason Cheng <[email protected]> * Removed delete_time from RunInfo proto Signed-off-by: Jason Cheng <[email protected]> * Set default older-than flag to None Signed-off-by: Jason Cheng <[email protected]> * Remove delete_time from RunInfo, add optional parameter older_than to store.get_deleted_runs(), and write delete_time into yaml file for file storage instead of adding it to RunInfo Signed-off-by: Jason Cheng <[email protected]> * Remove commented delete_time in RunInfo constructor in models.py Signed-off-by: Jason Cheng <[email protected]> * added INVALID_PARAMETER_VALUE error code in mlflow gc Signed-off-by: Jason Cheng <[email protected]> * Resolve case of delete time not in meta.yaml file, edited overwrite_run_info and gc Signed-off-by: Jason Cheng <[email protected]> * Rename delete_time to deleted_time Signed-off-by: Jason Cheng <[email protected]> * Rename delete_time to deleted_time, match error message in cli tests, filter SqlRuns by deleted_time, indicate float values accepted for gc --older-than flag Signed-off-by: Jason Cheng <[email protected]> * Rename delete_time to deleted_time, fixed assert statement in test_mlflow_gc, and fixed deleted_time queries in test_file_store.py and test_sqlalchemy_store.py Signed-off-by: Jason Cheng <[email protected]> * Only check if is in meta after restoring run in test_delte_restore_run Signed-off-by: Jason Cheng <[email protected]> * Fixed lint errors Signed-off-by: Jason Cheng <[email protected]> * Install mlflow from repository root Signed-off-by: harupy <[email protected]> Co-authored-by: harupy <[email protected]> * Separate protos job (#6399) * Separate protos job Signed-off-by: harupy <[email protected]> * test Signed-off-by: harupy <[email protected]> * Add paths Signed-off-by: harupy <[email protected]> * Revert "test" This reverts commit 5d04b02. Signed-off-by: harupy <[email protected]> * Fix flaky `TestFileStore.test_get_deleted_runs` (#6402) * use gt operator Signed-off-by: harupy <[email protected]> * fix sqlalchemy store Signed-off-by: harupy <[email protected]> * Migrate environment variables for SQLAlchemy store (#6396) Signed-off-by: harupy <[email protected]> * Deduplicate MlflowClient in MLflow docs, move to mlflow.client module (#6405) * Dedupe MlflowClient Signed-off-by: dbczumar <[email protected]> * Improvements Signed-off-by: dbczumar <[email protected]> * Add client Signed-off-by: dbczumar <[email protected]> * Remove unused functions in `mlflow.data` module (#6408) * remove unused functions in data Signed-off-by: harupy <[email protected]> * Remove unused functions and variables Signed-off-by: harupy <[email protected]> * Tag based registered model search and model version search (#6320) * init Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update tests Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * clean Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * add test Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * de-dup tag based search result Signed-off-by: Weichen Xu <[email protected]> * add () to fix case_sensitive_mysql_ne Signed-off-by: Weichen Xu <[email protected]> * fix Signed-off-by: Weichen Xu <[email protected]> * lint Signed-off-by: Weichen Xu <[email protected]> * fix * fix test in TODO Signed-off-by: Weichen Xu <[email protected]> * support dup tag key filter Signed-off-by: Weichen Xu <[email protected]> * add mv order by Signed-off-by: Weichen Xu <[email protected]> * cmp res list in test Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * add doc Signed-off-by: Weichen Xu <[email protected]> * fix Signed-off-by: Weichen Xu <[email protected]> * fix lint Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * update doc Signed-off-by: Weichen Xu <[email protected]> * Increase maximum param value length to 500 (#6358) * increase validation of maximum param value length from 250 to 500 (squashed) Signed-off-by: Jan Sindlar <[email protected]> * 1. added test for exceeding max length. 2. lint. 3. validation logic addresses null Signed-off-by: Jan Sindlar <[email protected]> * file store should test already stringified params Signed-off-by: Jan Sindlar <[email protected]> * update alembic chain Signed-off-by: Jan Sindlar <[email protected]> * Autoformat: https://github.com/mlflow/mlflow/actions/runs/2800398158 Signed-off-by: mlflow-automation <[email protected]> * Update tests/store/tracking/test_file_store.py Co-authored-by: Harutaka Kawamura <[email protected]> Signed-off-by: Jan Sindlar <[email protected]> Co-authored-by: Jan Sindlar <[email protected]> Co-authored-by: mlflow-automation <[email protected]> Co-authored-by: Harutaka Kawamura <[email protected]> * Add workflow dispatch for requirements validation, remove duplicate file (#6418) * Workflow dispatch Signed-off-by: dbczumar <[email protected]> * Remove unused Signed-off-by: dbczumar <[email protected]> * Prevent `pytest.raises` context manager from containing multiple statements (#6409) * rename Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * Do not allow calling assert in pytest.raises Signed-off-by: harupy <[email protected]> * more strict rule Signed-off-by: harupy <[email protected]> * Improve error message Signed-off-by: harupy <[email protected]> * relax condition Signed-off-by: harupy <[email protected]> * fix lint errors Signed-off-by: harupy <[email protected]> * fix failed tests Signed-off-by: harupy <[email protected]> * clean up Signed-off-by: harupy <[email protected]> * rename _is_complex_pytest_raises Signed-off-by: harupy <[email protected]> * fix lint errors Signed-off-by: harupy <[email protected]> * fix failed tests Signed-off-by: harupy <[email protected]> * Fix regression in pandas type inference behavior for scoring server (#6417) * Fix impl Signed-off-by: dbczumar <[email protected]> * Remove unused pandas import Signed-off-by: dbczumar <[email protected]> * Adjust client to use SearchExperiments POST method (#6415) * POST Signed-off-by: dbczumar <[email protected]> * Generate protos Signed-off-by: dbczumar <[email protected]> * Fix test Signed-off-by: dbczumar <[email protected]> * update (#6420) Signed-off-by: Weichen Xu <[email protected]> * Check if artifacts are proxied in model_version_artifact_handler (#6355) * Check if artifacts are proxied in model_version_artifact_handler Signed-off-by: Mohammad Abbas <[email protected]> * Use file prefix for artifact dest on windows Signed-off-by: dbczumar <[email protected]> * Fix application of prefix Signed-off-by: dbczumar <[email protected]> * Fixes Signed-off-by: dbczumar <[email protected]> Co-authored-by: dbczumar <[email protected]> * Allow sql filter IN operator right-hand side values including whitespaces (#6413) * support in rhs whitespace Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * Fix IN operator related issues in sql filter parser (#6411) * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * clean Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * address comment Signed-off-by: Weichen Xu <[email protected]> * Remove unused method `SearchUtils._get_comparison_for_model_registry` (#6412) * init Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * Update MLflow UI (#6422) * Project import generated by Copybara. GitOrigin-RevId: 086b1200f4573559e37fcea6cb5472d52f166e42 Signed-off-by: dbczumar <[email protected]> * Reconcile changes from universe with OSS Signed-off-by: dbczumar <[email protected]> * Fix test fails Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * Apply model search fix Signed-off-by: dbczumar <[email protected]> * Remove errant test line Signed-off-by: dbczumar <[email protected]> Co-authored-by: Richard Zang <[email protected]> * remove near from deprecation msg (#6430) Signed-off-by: ninabacc-db <[email protected]> * Raise clear error message when pipeline path contains a space (#6426) * Add unsupported Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * Exc Signed-off-by: dbczumar <[email protected]> * Test Signed-off-by: dbczumar <[email protected]> * Format Signed-off-by: dbczumar <[email protected]> * Test fix Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * [ALL TESTS] Changelog for MLflow 1.28.0 (#6433) * Generating changelog for MLflow 1.27.1.dev0 Signed-off-by: Jenkins <[email protected]> * Changelog Signed-off-by: dbczumar <[email protected]> * Add missing PR Signed-off-by: dbczumar <[email protected]> * Some fixes Signed-off-by: dbczumar <[email protected]> * More small fixes Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> Signed-off-by: Jenkins <[email protected]> Signed-off-by: dbczumar <[email protected]> Co-authored-by: Jenkins <[email protected]> Co-authored-by: dbczumar <[email protected]> * Patch (#6440) Signed-off-by: dbczumar <[email protected]> Signed-off-by: dbczumar <[email protected]> * [ALL TESTS] Update (#6443) * python dev/update_ml_package_versions.py Signed-off-by: Jenkins <[email protected]> * pyspark max ver 3.4 Signed-off-by: Weichen Xu <[email protected]> Signed-off-by: Jenkins <[email protected]> Signed-off-by: Weichen Xu <[email protected]> Co-authored-by: Jenkins <[email protected]> Co-authored-by: Weichen Xu <[email protected]> * Update MLflow version to 1.28.1 (#6449) Signed-off-by: Jenkins <[email protected]> Signed-off-by: Jenkins <[email protected]> Co-authored-by: Jenkins <[email protected]> * Add data capture config to sagemaker (#6423) Signed-off-by: jonwiggins <[email protected]> Signed-off-by: jonwiggins <[email protected]> * Fix small search_runs docs issues (#6452) * Fix Signed-off-by: dbczumar <[email protected]> * Doc fix Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> Signed-off-by: dbczumar <[email protected]> * python dev/update_pypi_package_index.py (#6442) Signed-off-by: Jenkins <[email protected]> Signed-off-by: Jenkins <[email protected]> Co-authored-by: Jenkins <[email protected]> * use xgboost on pypi (#6461) Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> * Add environment variable for `echo` option in `create_engine` (#6460) * Add environment variable for echo Signed-off-by: harupy <[email protected]> * use _BooleanEnvironmentVariable Signed-off-by: harupy <[email protected]> * address comments Signed-off-by: harupy <[email protected]> * address comments and add tests Signed-off-by: harupy <[email protected]> * fix comment Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> Signed-off-by: dbczumar <[email protected]> Signed-off-by: harupy <[email protected]> Signed-off-by: Michal Karzynski <[email protected]> Signed-off-by: Sunish Sheth <[email protected]> Signed-off-by: Jin Zhang <[email protected]> Signed-off-by: Ryan Fogle <[email protected]> Signed-off-by: Brian Barnes <[email protected]> Signed-off-by: apurva-koti <[email protected]> Signed-off-by: Weichen Xu <[email protected]> Signed-off-by: ninabacc-db <[email protected]> Signed-off-by: Jenkins <[email protected]> Signed-off-by: jonwiggins <[email protected]> Co-authored-by: Corey Zumar <[email protected]> Co-authored-by: Michał Karzyński <[email protected]> Co-authored-by: Chang Yong Lik <[email protected]> Co-authored-by: Sunish Sheth <[email protected]> Co-authored-by: jinzhang21 <[email protected]> Co-authored-by: Ryan Fogle <[email protected]> Co-authored-by: bbarnes52 <[email protected]> Co-authored-by: apurva-koti <[email protected]> Co-authored-by: Hannes Schulz <[email protected]> Co-authored-by: dbczumar <[email protected]> Co-authored-by: mlflow-automation <[email protected]> Co-authored-by: WeichenXu <[email protected]> Co-authored-by: Siddharth Murching <[email protected]> Co-authored-by: Cheng Kuan Yong Jason <[email protected]> Co-authored-by: johnyNJ <[email protected]> Co-authored-by: Jan Sindlar <[email protected]> Co-authored-by: Mohammad Abbas <[email protected]> Co-authored-by: Richard Zang <[email protected]> Co-authored-by: Nina Baccam <[email protected]> Co-authored-by: mlflow-automation <[email protected]> Co-authored-by: Jenkins <[email protected]> Co-authored-by: Jon Wiggins <[email protected]>

* Use virtualenv by default when running an ML project Signed-off-by: harupy <[email protected]> * use _PYTHON_ENV_FILE_NAME Signed-off-by: harupy <[email protected]> * fix doc Signed-off-by: harupy <[email protected]> * fix env type Signed-off-by: harupy <[email protected]> * fix env_type Signed-off-by: harupy <[email protected]> * swap conda and virtualenv Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]>

* Use virtualenv by default when restoring a model environment Signed-off-by: harupy <[email protected]> * fix failed test Signed-off-by: harupy <[email protected]> * set up pyenv and virtualenv Signed-off-by: harupy <[email protected]> * get conda_env file path from MLmodel file Signed-off-by: harupy <[email protected]> * pyenv Signed-off-by: harupy <[email protected]> * use current python version Signed-off-by: harupy <[email protected]> * fix failed test Signed-off-by: harupy <[email protected]> * fix failed test Signed-off-by: harupy <[email protected]> * update default value of spark_udf Signed-off-by: harupy <[email protected]> * rename test Signed-off-by: harupy <[email protected]> * revert spark_udf change Signed-off-by: harupy <[email protected]> * revert Signed-off-by: harupy <[email protected]> * change default value to virtualenv Signed-off-by: harupy <[email protected]> * use local Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]>

* remove --no-conda Signed-off-by: harupy <[email protected]> * update R docs Signed-off-by: harupy <[email protected]> * remove tests for --no-conda Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]>

* Fix java model server compatibility with models containing databricks_runtime conf (#6337) * Javafix Signed-off-by: dbczumar <[email protected]> * Resource fix Signed-off-by: dbczumar <[email protected]> * Add run / model links to MLP train step card (#6294) * One commit Signed-off-by: dbczumar <[email protected]> * Submodule revert Signed-off-by: dbczumar <[email protected]> * Fix client tests Signed-off-by: dbczumar <[email protected]> * fix ci Signed-off-by: dbczumar <[email protected]> * Remove unused / invalid import Signed-off-by: dbczumar <[email protected]> * Put run summary back to end, fix tests Signed-off-by: dbczumar <[email protected]> * Use mocks instead Signed-off-by: dbczumar <[email protected]> * Fix inefficient relative time computation for metric plot (#6341) * compute minTimestamp only once Signed-off-by: harupy <[email protected]> * fix method name Signed-off-by: harupy <[email protected]> * fix lint Signed-off-by: harupy <[email protected]> * return empty array Signed-off-by: harupy <[email protected]> * fix test Signed-off-by: harupy <[email protected]> * Add `MLFLOW_SQLALCHEMYSTORE_POOL_RECYCLE` flag (#6344) * Add pool_recycle option to SQLAlchemy create_engine Signed-off-by: Michal Karzynski <[email protected]> * Add new option to unit test Signed-off-by: Michal Karzynski <[email protected]> * Add note in documentation Signed-off-by: Michal Karzynski <[email protected]> * Add box plot in compare-runs page (#6308) * Added BoxPlot Signed-off-by: changyonglik <[email protected]> * Fixed key error Signed-off-by: changyonglik <[email protected]> * Added default state Signed-off-by: changyonglik <[email protected]> * Fixed props passing Signed-off-by: changyonglik <[email protected]> * Fixed react hooks state Signed-off-by: changyonglik <[email protected]> * Added unit test Signed-off-by: changyonglik <[email protected]> * Added boxplot to CompareModelVersion Signed-off-by: changyonglik <[email protected]> * Changed keys numbering to reflect tab name Signed-off-by: changyonglik <[email protected]> * Made the ordering of tabs consistent accross CompareRunView and CompareModelVersion Signed-off-by: changyonglik <[email protected]> * Linted Signed-off-by: changyonglik <[email protected]> * Fixed FormattedMessage Signed-off-by: changyonglik <[email protected]> * refactoring Signed-off-by: harupy <[email protected]> * fix lint errors Signed-off-by: harupy <[email protected]> * i18n Signed-off-by: harupy <[email protected]> * minor comment fix Signed-off-by: harupy <[email protected]> Co-authored-by: harupy <[email protected]> * Add script and workflow to update requirements.yaml specifications (#6287) * add script to update requirements.yaml Signed-off-by: harupy <[email protected]> * update both skinny and core requirements Signed-off-by: harupy <[email protected]> * remove base Signed-off-by: harupy <[email protected]> * clean up Signed-off-by: harupy <[email protected]> * add MLFLOW_CONDA_HOME Signed-off-by: harupy <[email protected]> * create create-pr job Signed-off-by: harupy <[email protected]> * fix syntax Signed-off-by: harupy <[email protected]> * remove redundant if Signed-off-by: harupy <[email protected]> * clean up Signed-off-by: harupy <[email protected]> * doc Signed-off-by: harupy <[email protected]> * dynamically determine python version Signed-off-by: harupy <[email protected]> * remove python version mock Signed-off-by: harupy <[email protected]> * use setup-ssh.sh in master.yml Signed-off-by: harupy <[email protected]> * simplify Signed-off-by: harupy <[email protected]> * update both core and skinny requirements Signed-off-by: harupy <[email protected]> * use env Signed-off-by: harupy <[email protected]> * remove action version Signed-off-by: harupy <[email protected]> * fix pandas dtypes issue Signed-off-by: harupy <[email protected]> * check if PR already exists Signed-off-by: harupy <[email protected]> * add semicolons Signed-off-by: harupy <[email protected]> * test PR creation Signed-off-by: harupy <[email protected]> * set base Signed-off-by: harupy <[email protected]> * use run_number Signed-off-by: harupy <[email protected]> * set result-encoding Signed-off-by: harupy <[email protected]> * revert changes for test Signed-off-by: harupy <[email protected]> * fix more tests Signed-off-by: harupy <[email protected]> * fix run URL Signed-off-by: harupy <[email protected]> * add dot Signed-off-by: harupy <[email protected]> * remove minimum_version Signed-off-by: harupy <[email protected]> * remove create-pr job Signed-off-by: harupy <[email protected]> * rename workflow Signed-off-by: harupy <[email protected]> * mutate dict approach Signed-off-by: harupy <[email protected]> * use ruamel Signed-off-by: harupy <[email protected]> * remove PYTHON_VERSION patch Signed-off-by: harupy <[email protected]> * add ruamel.yaml to requirements Signed-off-by: harupy <[email protected]> * skip update-requirements on PR Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * print new version Signed-off-by: harupy <[email protected]> * preserve quotes Signed-off-by: harupy <[email protected]> * fix badge Signed-off-by: harupy <[email protected]> * fix README Signed-off-by: harupy <[email protected]> * run ci Signed-off-by: harupy <[email protected]> * remove validate-requirements.yml Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * fix test_dataframe_from_json Signed-off-by: harupy <[email protected]> * Make `model_uri` optional for `mlflow models build-docker` (#6302) * Make model_uri optional for mlflow models build-docker Signed-off-by: harupy <[email protected]> * fix doc Signed-off-by: harupy <[email protected]> * Add generic Signed-off-by: harupy <[email protected]> * Add pythou_function flavor Signed-off-by: harupy <[email protected]> * fix doc Signed-off-by: harupy <[email protected]> * quotes Signed-off-by: harupy <[email protected]> * use longer options Signed-off-by: harupy <[email protected]> * add index (#6347) Signed-off-by: harupy <[email protected]> * fix badge link (#6349) Signed-off-by: harupy <[email protected]> * Enable consider-using-dict-items rule for pylint (#6351) * Enable consider-using-dict-items Signed-off-by: harupy <[email protected]> * fix lint errors Signed-off-by: harupy <[email protected]> * Enable consider-merging-isinstance (#6350) Signed-off-by: harupy <[email protected]> * Enable consider-using-from-import rule for pylint (#6352) * Enable consider-using-from-import Signed-off-by: harupy <[email protected]> * fix Signed-off-by: harupy <[email protected]> * fix datasets import Signed-off-by: harupy <[email protected]> * fix failed tests Signed-off-by: harupy <[email protected]> * Run model registry sqlalchemy tests in database job (#6353) Signed-off-by: harupy <[email protected]> * update to run profiles on the first 100 dataframe columns (#6297) * update to run profiles on the first 100 dataframe columns Signed-off-by: Sunish Sheth <[email protected]> * Adding replace=True so we can sample rows twice Signed-off-by: Sunish Sheth <[email protected]> * Removing replace=true and fixing how the max_rows are calculated Signed-off-by: Sunish Sheth <[email protected]> * Fix sklearn autologging input example & signature mutation for models containing transformers (#6230) * Fix with test case Signed-off-by: dbczumar <[email protected]> * Test fix Signed-off-by: dbczumar <[email protected]> * Fix and simplification Signed-off-by: dbczumar <[email protected]> * more fixes & better test coveragE Signed-off-by: dbczumar <[email protected]> * test Signed-off-by: dbczumar <[email protected]> * LGBM test Signed-off-by: dbczumar <[email protected]> * Format Signed-off-by: dbczumar <[email protected]> * Address comments Signed-off-by: dbczumar <[email protected]> * Fixes Signed-off-by: dbczumar <[email protected]> * Use py37-compatible call args syntax Signed-off-by: dbczumar <[email protected]> * use list (#6363) Signed-off-by: harupy <[email protected]> * Log runtime pipeline config to MLflow (#6359) * Log runtime pipeline config to MLflow Signed-off-by: Jin Zhang <[email protected]> * Fixed lint Signed-off-by: Jin Zhang <[email protected]> * Add status badge for stale action (#6372) Signed-off-by: harupy <[email protected]> * Add stack trace section to bug report template (#6374) Signed-off-by: harupy <[email protected]> * Skipping the transform step by using Functional transformer (#6362) Signed-off-by: Sunish Sheth <[email protected]> * Series schema (#6361) * Added in name for ColSpec of pandas datatype infer panda series name for ColSpec Signed-off-by: Ryan Fogle <[email protected]> * Added test for Series name inference added one more pytest condition in test_schema:test_schema_inference_on_pandas_series Signed-off-by: Ryan Fogle <[email protected]> * Update test_schema.py Added in one more assertion to test schema inference. Signed-off-by: Ryan Fogle <[email protected]> * ran black Signed-off-by: Ryan Fogle <[email protected]> * added in requested changes in issue #6361 Signed-off-by: Ryan Fogle <[email protected]> * fix typo. changed hasattr to getattr Signed-off-by: Ryan Fogle <[email protected]> * integrate mlflowdbfs (#6282) Signed-off-by: Brian Barnes <[email protected]> * Fix step card display breakage in Jupyter notebooks (#6378) * remove Signed-off-by: apurva-koti <[email protected]> * fix Signed-off-by: apurva-koti <[email protected]> * Avoid using flask 2.2.0 (#6380) Signed-off-by: harupy <[email protected]> * Migrate GCS environment variables to `mlflow.environment_variables` module (#6375) * Migrate GCS environment variables to mlflow.environment_variables Signed-off-by: harupy <[email protected]> * add default Signed-off-by: harupy <[email protected]> * improve comments Signed-off-by: harupy <[email protected]> * Avoid logging model signatures in pyspark ML autologging if model input/output dataframe contains unsupported data types (#6365) * Avoid logging signatures Signed-off-by: harupy <[email protected]> * test Signed-off-by: harupy <[email protected]> * fix indent Signed-off-by: harupy <[email protected]> * check model output Signed-off-by: harupy <[email protected]> * fix warning message Signed-off-by: harupy <[email protected]> * todo Signed-off-by: harupy <[email protected]> * update test and doc Signed-off-by: harupy <[email protected]> * fix docstring Signed-off-by: harupy <[email protected]> * fix failed tests Signed-off-by: harupy <[email protected]> * improve _assert_autolog_infers_model_signature_correctly Signed-off-by: harupy <[email protected]> * Refactor `set_matrix.py` (#6373) * refacor set_matrix.py Signed-off-by: harupy <[email protected]> * fix Signed-off-by: harupy <[email protected]> * fix tests Signed-off-by: harupy <[email protected]> * tset for --no-dev Signed-off-by: harupy <[email protected]> * install pytest and pytest-cov Signed-off-by: harupy <[email protected]> * test for --changed-files Signed-off-by: harupy <[email protected]> * add pyyaml to requirements Signed-off-by: harupy <[email protected]> * fix is_matrix_empty Signed-off-by: harupy <[email protected]> * use raw string and re.match Signed-off-by: harupy <[email protected]> * Fix is_matrix_empty (#6385) Signed-off-by: harupy <[email protected]> * Allow mlflow-skinny's autolog() to succeed when no scipy is installed (#5897) * allow mlflow-skinny's autolog() to succeed when no scipy is installed Signed-off-by: Hannes Schulz <[email protected]> * optional pyfunc scipy dependency Signed-off-by: Hannes Schulz <[email protected]> * fix linter-discovered issues Signed-off-by: Hannes Schulz <[email protected]> * add test case, autolog() should pass w/o scipy installed Signed-off-by: Hannes Schulz <[email protected]> * minor cleanup Signed-off-by: Hannes Schulz <[email protected]> * test creating _Example with / without scipy present Signed-off-by: Hannes Schulz <[email protected]> * docs: do not warn about sparse matrix classes Signed-off-by: Hannes Schulz <[email protected]> * linting Signed-off-by: Hannes Schulz <[email protected]> * address review comment Signed-off-by: Hannes Schulz <[email protected]> * run black Signed-off-by: Hannes Schulz <[email protected]> * allow mlflow-skinny's autolog() to succeed when no scipy is installed Signed-off-by: Hannes Schulz <[email protected]> * optional pyfunc scipy dependency Signed-off-by: Hannes Schulz <[email protected]> * fix linter-discovered issues Signed-off-by: Hannes Schulz <[email protected]> * add test case, autolog() should pass w/o scipy installed Signed-off-by: Hannes Schulz <[email protected]> * minor cleanup Signed-off-by: Hannes Schulz <[email protected]> * test creating _Example with / without scipy present Signed-off-by: Hannes Schulz <[email protected]> * docs: do not warn about sparse matrix classes Signed-off-by: Hannes Schulz <[email protected]> * linting Signed-off-by: Hannes Schulz <[email protected]> * address review comment Signed-off-by: Hannes Schulz <[email protected]> * run black Signed-off-by: Hannes Schulz <[email protected]> * remove redundant None check after import Signed-off-by: Hannes Schulz <[email protected]> * delete comment Signed-off-by: Hannes Schulz <[email protected]> * Revert "remove redundant None check after import" This reverts commit f2e198c. Signed-off-by: Hannes Schulz <[email protected]> * review comments Signed-off-by: Hannes Schulz <[email protected]> * remove redundant test Signed-off-by: Hannes Schulz <[email protected]> * Apply suggestions from code review Co-authored-by: Harutaka Kawamura <[email protected]> Signed-off-by: Hannes Schulz <[email protected]> * Autoformat: https://github.com/mlflow/mlflow/actions/runs/2779791161 Signed-off-by: mlflow-automation <[email protected]> Co-authored-by: Harutaka Kawamura <[email protected]> Co-authored-by: dbczumar <[email protected]> Co-authored-by: mlflow-automation <[email protected]> * Fix extraneous warning about pyspark evaluation truncation (#6389) * Revert #6380 (#6386) * revert Signed-off-by: harupy <[email protected]> * workaround for test_prometheus_exporter Signed-off-by: harupy <[email protected]> * nit Signed-off-by: harupy <[email protected]> * Validate metric value in `FileStore.log_metric` (#6381) * add failing test Signed-off-by: harupy <[email protected]> * use _validate_metric Signed-off-by: harupy <[email protected]> * fix invalid metric timestamp Signed-off-by: harupy <[email protected]> * fix docstring Signed-off-by: harupy <[email protected]> * fix java test Signed-off-by: harupy <[email protected]> * Make search experiment by tag key comparison case sensitive in MYSQL (#6333) * init Signed-off-by: Weichen Xu <[email protected]> * add test Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * fix BINARY conditions in MySQL Signed-off-by: harupy <[email protected]> * fix attr error Signed-off-by: harupy <[email protected]> Co-authored-by: harupy <[email protected]> * Run Model Registry SQLAlchemy tests in PostgreSQL, MySQL, and MSSQL (#6390) * Run Model Registry SQLAlchemy tests in postgres, mysql, and mssql Signed-off-by: harupy <[email protected]> * fix failed tests Signed-off-by: harupy <[email protected]> * remove uuid Signed-off-by: harupy <[email protected]> * clean up Signed-off-by: harupy <[email protected]> * do not drop tables Signed-off-by: harupy <[email protected]> * Fix filestore data loss on failed write & mitigate read / write race condition (#6388) * Fix Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * Format Signed-off-by: dbczumar <[email protected]> * Added a custom filter from_json to render_and_merge_yaml (#6368) * Added a custom filter from_json to render_and_merge_yaml Signed-off-by: Jin Zhang <[email protected]> * Fixed test Signed-off-by: Jin Zhang <[email protected]> * Update tests/utils/test_file_utils.py Co-authored-by: Siddharth Murching <[email protected]> * Update tests/utils/test_file_utils.py Co-authored-by: Siddharth Murching <[email protected]> * Fixed test Signed-off-by: Jin Zhang <[email protected]> * Fixed windows test attempt Signed-off-by: Jin Zhang <[email protected]> * Fixed windows test Signed-off-by: Jin Zhang <[email protected]> Co-authored-by: Siddharth Murching <[email protected]> * Fix `!=` operator for MySQL (#6397) * fix ne operator and improve tests Signed-off-by: harupy <[email protected]> * add () to other operators Signed-off-by: harupy <[email protected]> * Simplify the documentation section in the PR template (#6398) * Simplify the documentation section in the PR template Signed-off-by: harupy <[email protected]> * fix Signed-off-by: harupy <[email protected]> * Timebased gc (#6354) * Added delete_time field to runs table Signed-off-by: Jason Cheng <[email protected]> * Updated latest_schema.sql to pass tests/store/tracking/test_sqlalchemy_store_schema.py Signed-off-by: Jason Cheng <[email protected]> * Added delete_time column into mlflow/store/tracking/dbmodels/initial_models.py Signed-off-by: Jason Cheng <[email protected]> * Moved the docstring to the end of the declaration instead of the start Signed-off-by: Jason Cheng <[email protected]> * Regenerated protobuf for RunInfo new schema, and passed pytest Signed-off-by: Jason Cheng <[email protected]> * Added --older-than flag in mlflow gc command, and added tests for that cli command Signed-off-by: Jason Cheng <[email protected]> * Removed delete_time from RunInfo proto Signed-off-by: Jason Cheng <[email protected]> * Set default older-than flag to None Signed-off-by: Jason Cheng <[email protected]> * Remove delete_time from RunInfo, add optional parameter older_than to store.get_deleted_runs(), and write delete_time into yaml file for file storage instead of adding it to RunInfo Signed-off-by: Jason Cheng <[email protected]> * Remove commented delete_time in RunInfo constructor in models.py Signed-off-by: Jason Cheng <[email protected]> * added INVALID_PARAMETER_VALUE error code in mlflow gc Signed-off-by: Jason Cheng <[email protected]> * Resolve case of delete time not in meta.yaml file, edited overwrite_run_info and gc Signed-off-by: Jason Cheng <[email protected]> * Rename delete_time to deleted_time Signed-off-by: Jason Cheng <[email protected]> * Rename delete_time to deleted_time, match error message in cli tests, filter SqlRuns by deleted_time, indicate float values accepted for gc --older-than flag Signed-off-by: Jason Cheng <[email protected]> * Rename delete_time to deleted_time, fixed assert statement in test_mlflow_gc, and fixed deleted_time queries in test_file_store.py and test_sqlalchemy_store.py Signed-off-by: Jason Cheng <[email protected]> * Only check if is in meta after restoring run in test_delte_restore_run Signed-off-by: Jason Cheng <[email protected]> * Fixed lint errors Signed-off-by: Jason Cheng <[email protected]> * Install mlflow from repository root Signed-off-by: harupy <[email protected]> Co-authored-by: harupy <[email protected]> * Separate protos job (#6399) * Separate protos job Signed-off-by: harupy <[email protected]> * test Signed-off-by: harupy <[email protected]> * Add paths Signed-off-by: harupy <[email protected]> * Revert "test" This reverts commit 5d04b02. Signed-off-by: harupy <[email protected]> * Fix flaky `TestFileStore.test_get_deleted_runs` (#6402) * use gt operator Signed-off-by: harupy <[email protected]> * fix sqlalchemy store Signed-off-by: harupy <[email protected]> * Migrate environment variables for SQLAlchemy store (#6396) Signed-off-by: harupy <[email protected]> * Deduplicate MlflowClient in MLflow docs, move to mlflow.client module (#6405) * Dedupe MlflowClient Signed-off-by: dbczumar <[email protected]> * Improvements Signed-off-by: dbczumar <[email protected]> * Add client Signed-off-by: dbczumar <[email protected]> * Remove unused functions in `mlflow.data` module (#6408) * remove unused functions in data Signed-off-by: harupy <[email protected]> * Remove unused functions and variables Signed-off-by: harupy <[email protected]> * Tag based registered model search and model version search (#6320) * init Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update tests Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * clean Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * add test Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * de-dup tag based search result Signed-off-by: Weichen Xu <[email protected]> * add () to fix case_sensitive_mysql_ne Signed-off-by: Weichen Xu <[email protected]> * fix Signed-off-by: Weichen Xu <[email protected]> * lint Signed-off-by: Weichen Xu <[email protected]> * fix * fix test in TODO Signed-off-by: Weichen Xu <[email protected]> * support dup tag key filter Signed-off-by: Weichen Xu <[email protected]> * add mv order by Signed-off-by: Weichen Xu <[email protected]> * cmp res list in test Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * add doc Signed-off-by: Weichen Xu <[email protected]> * fix Signed-off-by: Weichen Xu <[email protected]> * fix lint Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * address comments Signed-off-by: Weichen Xu <[email protected]> * update doc Signed-off-by: Weichen Xu <[email protected]> * Increase maximum param value length to 500 (#6358) * increase validation of maximum param value length from 250 to 500 (squashed) Signed-off-by: Jan Sindlar <[email protected]> * 1. added test for exceeding max length. 2. lint. 3. validation logic addresses null Signed-off-by: Jan Sindlar <[email protected]> * file store should test already stringified params Signed-off-by: Jan Sindlar <[email protected]> * update alembic chain Signed-off-by: Jan Sindlar <[email protected]> * Autoformat: https://github.com/mlflow/mlflow/actions/runs/2800398158 Signed-off-by: mlflow-automation <[email protected]> * Update tests/store/tracking/test_file_store.py Co-authored-by: Harutaka Kawamura <[email protected]> Signed-off-by: Jan Sindlar <[email protected]> Co-authored-by: Jan Sindlar <[email protected]> Co-authored-by: mlflow-automation <[email protected]> Co-authored-by: Harutaka Kawamura <[email protected]> * Add workflow dispatch for requirements validation, remove duplicate file (#6418) * Workflow dispatch Signed-off-by: dbczumar <[email protected]> * Remove unused Signed-off-by: dbczumar <[email protected]> * Prevent `pytest.raises` context manager from containing multiple statements (#6409) * rename Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * Do not allow calling assert in pytest.raises Signed-off-by: harupy <[email protected]> * more strict rule Signed-off-by: harupy <[email protected]> * Improve error message Signed-off-by: harupy <[email protected]> * relax condition Signed-off-by: harupy <[email protected]> * fix lint errors Signed-off-by: harupy <[email protected]> * fix failed tests Signed-off-by: harupy <[email protected]> * clean up Signed-off-by: harupy <[email protected]> * rename _is_complex_pytest_raises Signed-off-by: harupy <[email protected]> * fix lint errors Signed-off-by: harupy <[email protected]> * fix failed tests Signed-off-by: harupy <[email protected]> * Fix regression in pandas type inference behavior for scoring server (#6417) * Fix impl Signed-off-by: dbczumar <[email protected]> * Remove unused pandas import Signed-off-by: dbczumar <[email protected]> * Adjust client to use SearchExperiments POST method (#6415) * POST Signed-off-by: dbczumar <[email protected]> * Generate protos Signed-off-by: dbczumar <[email protected]> * Fix test Signed-off-by: dbczumar <[email protected]> * update (#6420) Signed-off-by: Weichen Xu <[email protected]> * Check if artifacts are proxied in model_version_artifact_handler (#6355) * Check if artifacts are proxied in model_version_artifact_handler Signed-off-by: Mohammad Abbas <[email protected]> * Use file prefix for artifact dest on windows Signed-off-by: dbczumar <[email protected]> * Fix application of prefix Signed-off-by: dbczumar <[email protected]> * Fixes Signed-off-by: dbczumar <[email protected]> Co-authored-by: dbczumar <[email protected]> * Allow sql filter IN operator right-hand side values including whitespaces (#6413) * support in rhs whitespace Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * Fix IN operator related issues in sql filter parser (#6411) * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * clean Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * address comment Signed-off-by: Weichen Xu <[email protected]> * Remove unused method `SearchUtils._get_comparison_for_model_registry` (#6412) * init Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * Update MLflow UI (#6422) * Project import generated by Copybara. GitOrigin-RevId: 086b1200f4573559e37fcea6cb5472d52f166e42 Signed-off-by: dbczumar <[email protected]> * Reconcile changes from universe with OSS Signed-off-by: dbczumar <[email protected]> * Fix test fails Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * Apply model search fix Signed-off-by: dbczumar <[email protected]> * Remove errant test line Signed-off-by: dbczumar <[email protected]> Co-authored-by: Richard Zang <[email protected]> * remove near from deprecation msg (#6430) Signed-off-by: ninabacc-db <[email protected]> * Raise clear error message when pipeline path contains a space (#6426) * Add unsupported Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * Exc Signed-off-by: dbczumar <[email protected]> * Test Signed-off-by: dbczumar <[email protected]> * Format Signed-off-by: dbczumar <[email protected]> * Test fix Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * [ALL TESTS] Changelog for MLflow 1.28.0 (#6433) * Generating changelog for MLflow 1.27.1.dev0 Signed-off-by: Jenkins <[email protected]> * Changelog Signed-off-by: dbczumar <[email protected]> * Add missing PR Signed-off-by: dbczumar <[email protected]> * Some fixes Signed-off-by: dbczumar <[email protected]> * More small fixes Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> Signed-off-by: Jenkins <[email protected]> Signed-off-by: dbczumar <[email protected]> Co-authored-by: Jenkins <[email protected]> Co-authored-by: dbczumar <[email protected]> * Patch (#6440) Signed-off-by: dbczumar <[email protected]> Signed-off-by: dbczumar <[email protected]> * [ALL TESTS] Update (#6443) * python dev/update_ml_package_versions.py Signed-off-by: Jenkins <[email protected]> * pyspark max ver 3.4 Signed-off-by: Weichen Xu <[email protected]> Signed-off-by: Jenkins <[email protected]> Signed-off-by: Weichen Xu <[email protected]> Co-authored-by: Jenkins <[email protected]> Co-authored-by: Weichen Xu <[email protected]> * Update MLflow version to 1.28.1 (#6449) Signed-off-by: Jenkins <[email protected]> Signed-off-by: Jenkins <[email protected]> Co-authored-by: Jenkins <[email protected]> * Add data capture config to sagemaker (#6423) Signed-off-by: jonwiggins <[email protected]> Signed-off-by: jonwiggins <[email protected]> * Fix small search_runs docs issues (#6452) * Fix Signed-off-by: dbczumar <[email protected]> * Doc fix Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> Signed-off-by: dbczumar <[email protected]> * python dev/update_pypi_package_index.py (#6442) Signed-off-by: Jenkins <[email protected]> Signed-off-by: Jenkins <[email protected]> Co-authored-by: Jenkins <[email protected]> * use xgboost on pypi (#6461) Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> * Add environment variable for `echo` option in `create_engine` (#6460) * Add environment variable for echo Signed-off-by: harupy <[email protected]> * use _BooleanEnvironmentVariable Signed-off-by: harupy <[email protected]> * address comments Signed-off-by: harupy <[email protected]> * address comments and add tests Signed-off-by: harupy <[email protected]> * fix comment Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> * Add more file extensions to show content on frontend side (#3292) Signed-off-by: Мартынов Максим Сергеевич <[email protected]> Signed-off-by: Мартынов Максим Сергеевич <[email protected]> Signed-off-by: harupy <[email protected]> Co-authored-by: harupy <[email protected]> * Avoid using assertions at top level in `mlflow/models/docker_utils.py` (#6463) * do not construct maven proxy options at top level Signed-off-by: harupy <[email protected]> * fix validation for port Signed-off-by: harupy <[email protected]> * unpack Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> * Fix mlflowdbfs availability check (#6474) * Fix Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * Reverts Signed-off-by: dbczumar <[email protected]> * Better fix Signed-off-by: dbczumar <[email protected]> * Format Signed-off-by: dbczumar <[email protected]> * Format Signed-off-by: dbczumar <[email protected]> * Lint Signed-off-by: dbczumar <[email protected]> * Clean up Signed-off-by: dbczumar <[email protected]> Signed-off-by: dbczumar <[email protected]> * Replace `assertRaisesRegex` with `pytest.raises` (#6464) * replace assertRaisesRegex with pytest.raises Signed-off-by: harupy <[email protected]> * fix message Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> * CLI command suggestion after running the pipeline (#6376) * CLI command suggestion after running the pipeline Signed-off-by: Hubert Zub <[email protected]> * fix: added git commands to MLP CLI suggestion * chore: lint fixes Signed-off-by: Hubert Zub <[email protected]> * chore: test fixes Signed-off-by: Hubert Zub <[email protected]> Signed-off-by: Hubert Zub <[email protected]> * Remove redundant int conversion in create_sqlalchemy_engine (#6481) Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> * Improve code-to-reproduce section in the bug report template (#6478) * Improve code-to-reproduce section Signed-off-by: harupy <[email protected]> * fix Signed-off-by: harupy <[email protected]> * problem -> issue Signed-off-by: harupy <[email protected]> * fix Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> * Add Pipelines step option to skip step profiling (#6456) * changes Signed-off-by: apurva-koti <[email protected]> * changes Signed-off-by: apurva-koti <[email protected]> * partial-test Signed-off-by: apurva-koti <[email protected]> * lint Signed-off-by: apurva-koti <[email protected]> * missed Signed-off-by: apurva-koti <[email protected]> * review Signed-off-by: apurva-koti <[email protected]> Signed-off-by: apurva-koti <[email protected]> * Implement _download_file in hdfs_artifact_repo (#6482) * Implement _download_file in hdfs_artifact_repo Signed-off-by: bowen_who <[email protected]> * add ut on _download_file in test_hdfs_artifact_repo Signed-off-by: bowen_who <[email protected]> * rewrite _download_artifact, change back _download_file in hdfs_artifact_repo Signed-off-by: bowen_who <[email protected]> Signed-off-by: harupy <[email protected]> * rewrite test__download_file in test_hdfs_artifact_repo Signed-off-by: bowen_who <[email protected]> Signed-off-by: bowen_who <[email protected]> Signed-off-by: harupy <[email protected]> Co-authored-by: bowen_who <[email protected]> * [ML-19871] R documentation fix (#6484) * R bug fix * Documentation fix * Revert breaking change * Updated doc file * Doc fix * Testing a broken test * fix * Revert test * feat: return param value for mlflow.log_param (#6483) * feat: return param value for mlflow.log_param Signed-off-by: Xinyue Ruan <[email protected]> * update docstring and return value for MlflowClient Signed-off-by: Xinyue Ruan <[email protected]> Signed-off-by: Xinyue Ruan <[email protected]> * revert (#6490) Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> * Ignore empty environment variables in _get_maven_proxy (#6492) Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> * Migrate environment variables for S3 (#6438) * Migrated s3 Signed-off-by: changyonglik <[email protected]> * Migrated s3 for local.py Signed-off-by: changyonglik <[email protected]> * Changed default values Signed-off-by: changyonglik <[email protected]> * Added var imports Signed-off-by: changyonglik <[email protected]> * Added MLFLOW_S3_ENDPOINT_URL and MLFLOW_S3_IGNORE_TLS Signed-off-by: changyonglik <[email protected]> * Removed duplicated imports Signed-off-by: changyonglik <[email protected]> * Paraphrased specify to specifies Signed-off-by: changyonglik <[email protected]> * Changed _EnvironmentVariable to _BooleanEnvironmentVariable for MLFLOW_S3_IGNORE_TLS and defaults to False Signed-off-by: changyonglik <[email protected]> * Changed environment variables in hdfs_artifact_repo.py Signed-off-by: changyonglik <[email protected]> * Changed single to double quotes Signed-off-by: changyonglik <[email protected]> * Fixed comments Signed-off-by: changyonglik <[email protected]> * Small fixes Signed-off-by: dbczumar <[email protected]> * Format Signed-off-by: dbczumar <[email protected]> * Reset submodule Signed-off-by: dbczumar <[email protected]> Signed-off-by: changyonglik <[email protected]> Signed-off-by: dbczumar <[email protected]> Co-authored-by: dbczumar <[email protected]> * Always run CI check on PR (#6505) Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> Signed-off-by: dbczumar <[email protected]> Signed-off-by: harupy <[email protected]> Signed-off-by: Michal Karzynski <[email protected]> Signed-off-by: Sunish Sheth <[email protected]> Signed-off-by: Jin Zhang <[email protected]> Signed-off-by: Ryan Fogle <[email protected]> Signed-off-by: Brian Barnes <[email protected]> Signed-off-by: apurva-koti <[email protected]> Signed-off-by: Weichen Xu <[email protected]> Signed-off-by: ninabacc-db <[email protected]> Signed-off-by: Jenkins <[email protected]> Signed-off-by: jonwiggins <[email protected]> Signed-off-by: Мартынов Максим Сергеевич <[email protected]> Signed-off-by: Hubert Zub <[email protected]> Signed-off-by: bowen_who <[email protected]> Signed-off-by: Xinyue Ruan <[email protected]> Signed-off-by: changyonglik <[email protected]> Co-authored-by: Corey Zumar <[email protected]> Co-authored-by: Michał Karzyński <[email protected]> Co-authored-by: Chang Yong Lik <[email protected]> Co-authored-by: Sunish Sheth <[email protected]> Co-authored-by: jinzhang21 <[email protected]> Co-authored-by: Ryan Fogle <[email protected]> Co-authored-by: bbarnes52 <[email protected]> Co-authored-by: apurva-koti <[email protected]> Co-authored-by: Hannes Schulz <[email protected]> Co-authored-by: dbczumar <[email protected]> Co-authored-by: mlflow-automation <[email protected]> Co-authored-by: WeichenXu <[email protected]> Co-authored-by: Siddharth Murching <[email protected]> Co-authored-by: Cheng Kuan Yong Jason <[email protected]> Co-authored-by: johnyNJ <[email protected]> Co-authored-by: Jan Sindlar <[email protected]> Co-authored-by: Mohammad Abbas <[email protected]> Co-authored-by: Richard Zang <[email protected]> Co-authored-by: Nina Baccam <[email protected]> Co-authored-by: mlflow-automation <[email protected]> Co-authored-by: Jenkins <[email protected]> Co-authored-by: Jon Wiggins <[email protected]> Co-authored-by: Maxim Martynov <[email protected]> Co-authored-by: Hubert Zub <[email protected]> Co-authored-by: Bowen Hu <[email protected]> Co-authored-by: bowen_who <[email protected]> Co-authored-by: Kris Concepcion <[email protected]> Co-authored-by: Serena Ruan <[email protected]>

Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]>

* Convert examples to using virtualenv instead of conda Signed-off-by: harupy <[email protected]> * remove conda.yaml Signed-off-by: harupy <[email protected]> * fix tests/examples/test_examples.py Signed-off-by: harupy <[email protected]> * fix pytest parameter name Signed-off-by: harupy <[email protected]> * revert examples/sklearn_elasticnet_wine/conda.yaml Signed-off-by: harupy <[email protected]> * fix Signed-off-by: harupy <[email protected]> * use string version Signed-off-by: harupy <[email protected]> * fix failed test cases Signed-off-by: harupy <[email protected]> * clean up environments Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]>

Signed-off-by: dbczumar <[email protected]> Signed-off-by: dbczumar <[email protected]>

* Discourage use of conda and recommend virtualenv Signed-off-by: harupy <[email protected]> * update projects.rst Signed-off-by: harupy <[email protected]> * remove discouraged Signed-off-by: harupy <[email protected]> * address comments Signed-off-by: harupy <[email protected]> * add warning for conda Signed-off-by: harupy <[email protected]> * test Signed-off-by: harupy <[email protected]> * remove record Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]>

* init Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * update Signed-off-by: Weichen Xu <[email protected]> * fix lint Signed-off-by: Weichen Xu <[email protected]> Signed-off-by: Weichen Xu <[email protected]>

* Enable --serve-artifacts by default Signed-off-by: harupy <[email protected]> * remove --serve-artifacts Signed-off-by: harupy <[email protected]> * more updates Signed-off-by: harupy <[email protected]> * fix failed tests Signed-off-by: harupy <[email protected]> * update default_artifact_root error message Signed-off-by: harupy <[email protected]> * add how to disable artifact serving Signed-off-by: harupy <[email protected]> * update docs Signed-off-by: harupy <[email protected]> * fix captions Signed-off-by: harupy <[email protected]> * add missing caption Signed-off-by: harupy <[email protected]> * crop images Signed-off-by: harupy <[email protected]> * crop again Signed-off-by: harupy <[email protected]> * add missing caption Signed-off-by: harupy <[email protected]> * address comments Signed-off-by: harupy <[email protected]> * adjust image width Signed-off-by: harupy <[email protected]> * crop images Signed-off-by: harupy <[email protected]> * adjust image width Signed-off-by: harupy <[email protected]> * add serve_artifacts Signed-off-by: harupy <[email protected]> * update R docs Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]>

…to be local (#6640) Signed-off-by: Weichen Xu <[email protected]> Signed-off-by: Weichen Xu <[email protected]>

Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]>

… CLIs (#6650) * Make internal Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * CLI & tests Signed-off-by: dbczumar <[email protected]> * Call internal Signed-off-by: dbczumar <[email protected]> * Build_docker add Signed-off-by: dbczumar <[email protected]> * Format Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * Image and port Signed-off-by: dbczumar <[email protected]> * Change image name Signed-off-by: dbczumar <[email protected]> * Test fix Signed-off-by: dbczumar <[email protected]> * Fixes Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * Address awesome review comments Signed-off-by: dbczumar <[email protected]> * Small fix Signed-off-by: dbczumar <[email protected]> Signed-off-by: dbczumar <[email protected]>

* Use virtualenv if no env file is present in project Signed-off-by: harupy <[email protected]> * docstring Signed-off-by: harupy <[email protected]> * fix tests Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]>

* remove conda environment Signed-off-by: harupy <[email protected]> * add Prerequisites Signed-off-by: harupy <[email protected]> * remove conda Signed-off-by: harupy <[email protected]> * remove test for conda Signed-off-by: harupy <[email protected]> * add single quote Signed-off-by: harupy <[email protected]> * define environment variables in test step Signed-off-by: harupy <[email protected]> * link Signed-off-by: harupy <[email protected]> * update document.R Signed-off-by: harupy <[email protected]> * do not create conda env Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * fix filename Signed-off-by: harupy <[email protected]> * remove install.R Signed-off-by: harupy <[email protected]> * fix mlflow/R/mlflow/NAMESPACE Signed-off-by: harupy <[email protected]> * update doc Signed-off-by: harupy <[email protected]> * update README Signed-off-by: harupy <[email protected]> * update doc again Signed-off-by: harupy <[email protected]> * reset examples/pipelines/sklearn_regression Signed-off-by: harupy <[email protected]> * remove reticulate Signed-off-by: harupy <[email protected]> * add reticulate in Suggests Signed-off-by: harupy <[email protected]> * quote Signed-off-by: harupy <[email protected]> * Remove reticulate::use_condaenv Signed-off-by: harupy <[email protected]> * find python and mlflow binaries automatically Signed-off-by: harupy <[email protected]> * remove MLFLOW_PYTHON_BIN and MLFLOW_BIN Signed-off-by: harupy <[email protected]> * fix doc Signed-off-by: harupy <[email protected]> * udpate doc Signed-off-by: harupy <[email protected]> * fix syntax error Signed-off-by: harupy <[email protected]> * fix rst_header Signed-off-by: harupy <[email protected]> * revert MLFLOW_CONDA_HOME Signed-off-by: harupy <[email protected]> * replace NULL with NA Signed-off-by: harupy <[email protected]> * Fix README Signed-off-by: harupy <[email protected]> * update R-api.rst Signed-off-by: harupy <[email protected]> * use git rev-parse Signed-off-by: harupy <[email protected]> * Address comments Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]>

* change logic for experiment env variables Signed-off-by: Ben Wilson <[email protected]> * create experiment from env name if not exists Signed-off-by: Ben Wilson <[email protected]> * better grammar for exception messages Signed-off-by: Ben Wilson <[email protected]> Signed-off-by: Ben Wilson <[email protected]>

Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]>

* Remove preview routes Signed-off-by: harupy <[email protected]> * fix tests Signed-off-by: harupy <[email protected]> * fix test_get_endpoints Signed-off-by: harupy <[email protected]> * remove preview Signed-off-by: harupy <[email protected]> * fix doc Signed-off-by: harupy <[email protected]> * fix doc Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]>

* Drop support for passing PyFuncModel to mlflow.evaluate Signed-off-by: harupy <[email protected]> * fix failed tests Signed-off-by: harupy <[email protected]> * fix broken tests Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]>

* rename deployments predict df arg Signed-off-by: Ben Wilson <[email protected]> * repush Signed-off-by: Ben Wilson <[email protected]> * change arg name to a higher canonical grammar level Signed-off-by: Ben Wilson <[email protected]> * pydoc improvements Signed-off-by: Ben Wilson <[email protected]> * rename abc predict method usage locations Signed-off-by: Ben Wilson <[email protected]> Signed-off-by: Ben Wilson <[email protected]>

* Merge master Signed-off-by: dbczumar <[email protected]> * Remove dupe arg Signed-off-by: dbczumar <[email protected]> * Remove redundant description Signed-off-by: dbczumar <[email protected]> * Address comments, fix tests Signed-off-by: dbczumar <[email protected]> * Fix tests Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> Signed-off-by: dbczumar <[email protected]>

* merge master Signed-off-by: harupy <[email protected]> * fix dataset hash Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]>

* remove azureml modules Signed-off-by: Ben Wilson <[email protected]> * remove doc ref and import try Signed-off-by: Ben Wilson <[email protected]> * remove ci runner entry Signed-off-by: Ben Wilson <[email protected]> * revert AzureML deployment notice Signed-off-by: Ben Wilson <[email protected]> Signed-off-by: Ben Wilson <[email protected]>

Signed-off-by: Ben Wilson <[email protected]> Signed-off-by: Ben Wilson <[email protected]>

harupy · 2022-10-26T23:44:40Z

tests/db/schemas/postgresql.sql

@@ -73,6 +73,7 @@ CREATE TABLE runs (
 	status VARCHAR(9),
 	start_time BIGINT,
 	end_time BIGINT,
+	deleted_time BIGINT,


This is a duplicate. We deleted_time BIGINT at line 81.

Signed-off-by: Ben Wilson <[email protected]>

harupy · 2022-10-27T00:19:28Z

tests/store/tracking/test_file_store.py

+            # sleep for windows file system current_time precision in Python to enforce
+            # deterministic ordering based on last_update_time (creation_time due to no
+            # mutation of experiment state)
+            time.sleep(0.01)


On windows, time.sleep(0.001) results in 15~16 ms sleep, so time.sleep(0.001) should work.

Sorry about that. I couldn't remember if it was 0.01 or 0.001 that you had put on that closed branch. This will be updated in the next commit :)

It was 0.001 :)

harupy · 2022-10-27T00:29:52Z

https://github.com/mlflow/mlflow/actions/runs/3332579104/jobs/5513622700#step:13:483

FAILED tests/pytorch/test_pytorch_model_export.py::test_pyfunc_serve_and_score_transformers - AssertionError: 
Arrays are not equal

(shapes (3, 5), (3, 5, 2) mismatch)
 x: array([[list([0.9999999403953552, -1.0]), list([-1.0, 1.0]),
        list([0.9999999403953552, -0.9999998807907104]),
        list([-1.0000001192092896, 1.0]), list([-1.0, 1.0])],...
 y: array([[[ 1., -1.],
        [-1.,  1.],
        [ 1., -1.],...

This failure seems related to #6575.

Did 82e1290 fix this? Looks like it did.

harupy · 2022-10-27T01:48:46Z

We can ignore the following conflicts for now:

mlflow/keras.py
tests/keras/test_keras_autolog.py

I can file a follow-up that cherry-picks the changes in #7123.

Signed-off-by: Ben Wilson <[email protected]>

BenWilson2 · 2022-10-27T02:03:52Z

Did 82e1290 fix this? Looks like it did.

I mistakenly left in the .values in the parsed return. I think that 6c59fff will address it :)

Signed-off-by: harupy <[email protected]>

Signed-off-by: Ben Wilson <[email protected]>

harupy · 2022-10-27T02:11:21Z

Strange, it didn't resolve conflicts.

BenWilson2 · 2022-10-27T02:12:40Z

Those files are stripped down as aliases in this branch... and they were just updated in master

Signed-off-by: harupy <[email protected]>

pytest.ini

Signed-off-by: harupy <[email protected]>

harupy · 2022-10-27T11:09:32Z

tests/tracking/test_rest_tracking.py

+    root_artifact_uri = root_artifact_uri = str(tmp_path)
    if request.param == "file":
        uri = path_to_local_file_uri(str(tmp_path.joinpath("file")))
+        FileStore(uri)


Initialize the store here to create the default experiment.

harupy · 2022-10-27T14:42:46Z

@BenWilson2 Let's merge this!

harupy and others added 30 commits August 16, 2022 13:47

Remove --no-conda (#6501)

7b179f3

* remove --no-conda Signed-off-by: harupy <[email protected]> * update R docs Signed-off-by: harupy <[email protected]> * remove tests for --no-conda Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]>

set up pyenv (#6538)

71ce5a2

Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]>

Drop it (#6541)

2928e5c

Signed-off-by: dbczumar <[email protected]> Signed-off-by: dbczumar <[email protected]>

Remove from proto (#6524)

1f05110

Signed-off-by: dbczumar <[email protected]> Signed-off-by: dbczumar <[email protected]>

[2.0] Add mlflow_search_experiments to R client (#6578)

b64eed7

Java files (#6579)

504b329

[branch-2.0] Set pyfunc.spark_udf env_manager argument default value …

e4b0864

…to be local (#6640) Signed-off-by: Weichen Xu <[email protected]> Signed-off-by: Weichen Xu <[email protected]>

Fix env_manager doc (#6655)

fdee784

Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]>

fix base ref (#6656)

9ebea33

Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]>

remove use_conda (#6654)

2e3d5f5

Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]>

remove experiment decorators (#6669)

bea679d

Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]>

Merge master branch into branch-2.0 (#6707)

c8f362a

* merge master Signed-off-by: harupy <[email protected]> * fix dataset hash Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]>

Remove experimental designators in docs (#6713)

8982604

Signed-off-by: Ben Wilson <[email protected]> Signed-off-by: Ben Wilson <[email protected]>

harupy reviewed Oct 26, 2022

View reviewed changes

fix db test schemas

31d094b

Signed-off-by: Ben Wilson <[email protected]>

harupy reviewed Oct 27, 2022

View reviewed changes

more fixes

6c59fff

Signed-off-by: Ben Wilson <[email protected]>

harupy and others added 2 commits October 27, 2022 11:06

Ignore keras conflicts

fad6a94

Signed-off-by: harupy <[email protected]>

fix R namespace

e087a9e

Signed-off-by: Ben Wilson <[email protected]>

Resolve conflicts

0d58b1d

Signed-off-by: harupy <[email protected]>

harupy approved these changes Oct 27, 2022

View reviewed changes

harupy added 2 commits October 27, 2022 11:53

fix

3ef0b3f

Signed-off-by: harupy <[email protected]>

add --exitfirst

e6e4f99

Signed-off-by: harupy <[email protected]>

harupy requested a review from dbczumar October 27, 2022 02:55

harupy reviewed Oct 27, 2022

View reviewed changes

pytest.ini Outdated Show resolved Hide resolved

harupy added 6 commits October 27, 2022 12:49

fix

e688933

Signed-off-by: harupy <[email protected]>

str

e522771

Signed-off-by: harupy <[email protected]>

Increase timeout_seconds

097ca47

Signed-off-by: harupy <[email protected]>

Fix flakiness

edf3b1e

Signed-off-by: harupy <[email protected]>

Fix port

8540c38

Signed-off-by: harupy <[email protected]>

Remove exitfirst

c000c8c

Signed-off-by: harupy <[email protected]>

harupy reviewed Oct 27, 2022

View reviewed changes

BenWilson2 merged commit 9972267 into master Oct 27, 2022

This was referenced Oct 28, 2022

Remove redundant activity_polling_timeout_seconds #7182

Merged

Allow saving keras model in HDF5 format in TF autologging #7183

Merged

harupy deleted the 2.0-merge branch November 11, 2024 03:22

WeichenXu123 mentioned this pull request Nov 10, 2025

Safe model serialization: Add serialization format skops, and deprecate pickle / cloud pickle format #18759

Merged

29 tasks

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

2.0 merge#7171

2.0 merge#7171
BenWilson2 merged 84 commits intomasterfrom
2.0-merge

BenWilson2 commented Oct 26, 2022

Uh oh!

harupy Oct 26, 2022

Uh oh!

harupy Oct 27, 2022

Uh oh!

BenWilson2 Oct 27, 2022

Uh oh!

harupy Oct 27, 2022

Uh oh!

harupy commented Oct 27, 2022 •

edited

Loading

Uh oh!

harupy commented Oct 27, 2022 •

edited

Loading

Uh oh!

BenWilson2 commented Oct 27, 2022

Uh oh!

harupy commented Oct 27, 2022

Uh oh!

BenWilson2 commented Oct 27, 2022 •

edited

Loading

Uh oh!

Uh oh!

harupy Oct 27, 2022

Uh oh!

harupy commented Oct 27, 2022

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

Conversation

BenWilson2 commented Oct 26, 2022

Related Issues/PRs

What changes are proposed in this pull request?

How is this patch tested?

Does this PR change the documentation?

Release Notes

Is this a user-facing change?

What component(s), interfaces, languages, and integrations does this PR affect?

How should the PR be classified in the release notes? Choose one:

Uh oh!

harupy Oct 26, 2022

Choose a reason for hiding this comment

Uh oh!

harupy Oct 27, 2022

Choose a reason for hiding this comment

Uh oh!

BenWilson2 Oct 27, 2022

Choose a reason for hiding this comment

Uh oh!

harupy Oct 27, 2022

Choose a reason for hiding this comment

Uh oh!

harupy commented Oct 27, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

harupy commented Oct 27, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

BenWilson2 commented Oct 27, 2022

Uh oh!

harupy commented Oct 27, 2022

Uh oh!

BenWilson2 commented Oct 27, 2022 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Uh oh!

harupy Oct 27, 2022

Choose a reason for hiding this comment

Uh oh!

harupy commented Oct 27, 2022

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

6 participants

harupy commented Oct 27, 2022 •

edited

Loading

harupy commented Oct 27, 2022 •

edited

Loading

BenWilson2 commented Oct 27, 2022 •

edited

Loading