[branch-2.0] Set pyfunc.spark_udf env_manager argument default value to be local#6640
Merged
WeichenXu123 merged 1 commit intomlflow:branch-2.0from Aug 30, 2022
Conversation
WeichenXu123
changed the title
pyfunc.spark_udf env_manager argument default value to be localpyfunc.spark_udf env_manager argument default value to be local
dbczumar
approved these changes
Aug 30, 2022
Collaborator
dbczumar
left a comment
dbczumar
left a comment
There was a problem hiding this comment.
LGTM! Thanks @WeichenXu123 !
Contributor
|
@WeichenXu123 Thanks for the contribution! The DCO check failed. Please sign off your commits by following the instructions here: https://github.com/mlflow/mlflow/runs/8084576871. See https://github.com/mlflow/mlflow/blob/master/CONTRIBUTING.rst#sign-your-work for more details. |
github-actions
bot
added
area/scoring
harupy
approved these changes
Aug 30, 2022
Signed-off-by: Weichen Xu <[email protected]>
WeichenXu123
force-pushed
the
set-spark-udf-default-env-manager-local
branch
from
4a0bf12 to
e977af8
Compare
tomasatdatabricks
pushed a commit
to tomasatdatabricks/mlflow
that referenced
this pull request
Sep 2, 2022
…to be local (mlflow#6640) Signed-off-by: Weichen Xu <[email protected]> Signed-off-by: Weichen Xu <[email protected]> Signed-off-by: tomasatdatabricks <[email protected]>
dbczumar
added a commit
that referenced
this pull request
Sep 27, 2022
* Update scoring api to wrap response in a dictionary with predictions field and nest dataframe inputs explicit fields Signed-off-by: tomasatdatabricks <[email protected]> * fix tests. Signed-off-by: tomasatdatabricks <[email protected]> * fix Signed-off-by: tomasatdatabricks <[email protected]> * fix azureml test Signed-off-by: tomasatdatabricks <[email protected]> * fix azureml test Signed-off-by: tomasatdatabricks <[email protected]> * fix tests Signed-off-by: tomasatdatabricks <[email protected]> * fix tests Signed-off-by: tomasatdatabricks <[email protected]> * fix rfunc Signed-off-by: tomasatdatabricks <[email protected]> * fixes Signed-off-by: tomasatdatabricks <[email protected]> * fixes Signed-off-by: tomasatdatabricks <[email protected]> * fixes Signed-off-by: tomasatdatabricks <[email protected]> * fixes Signed-off-by: tomasatdatabricks <[email protected]> * Update mlflow/utils/proto_json_utils.py Co-authored-by: Corey Zumar <[email protected]> Signed-off-by: tomasatdatabricks <[email protected]> * Update mlflow/utils/proto_json_utils.py Co-authored-by: Corey Zumar <[email protected]> Signed-off-by: tomasatdatabricks <[email protected]> * Update mlflow/utils/proto_json_utils.py Co-authored-by: Corey Zumar <[email protected]> Signed-off-by: tomasatdatabricks <[email protected]> * Update mlflow/utils/proto_json_utils.py Co-authored-by: Corey Zumar <[email protected]> Signed-off-by: tomasatdatabricks <[email protected]> * Fixes. Signed-off-by: tomasatdatabricks <[email protected]> * Fix Java scoring. Signed-off-by: tomasatdatabricks <[email protected]> * Fixes. Signed-off-by: tomasatdatabricks <[email protected]> * [2.0] Add mlflow_search_experiments to R client (#6578) Signed-off-by: tomasatdatabricks <[email protected]> * Java files (#6579) Signed-off-by: tomasatdatabricks <[email protected]> * [branch-2.0] Set pyfunc.spark_udf env_manager argument default value to be local (#6640) Signed-off-by: Weichen Xu <[email protected]> Signed-off-by: Weichen Xu <[email protected]> Signed-off-by: tomasatdatabricks <[email protected]> * Fix env_manager doc (#6655) Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> Signed-off-by: tomasatdatabricks <[email protected]> * fix base ref (#6656) Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> Signed-off-by: tomasatdatabricks <[email protected]> * remove use_conda (#6654) Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> Signed-off-by: tomasatdatabricks <[email protected]> * Merged with upstream. Signed-off-by: tomasatdatabricks <[email protected]> * Use virtualenv if no env file is present in project (#6658) * Use virtualenv if no env file is present in project Signed-off-by: harupy <[email protected]> * docstring Signed-off-by: harupy <[email protected]> * fix tests Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> Signed-off-by: tomasatdatabricks <[email protected]> * Remove conda from R client (#6638) * remove conda environment Signed-off-by: harupy <[email protected]> * add Prerequisites Signed-off-by: harupy <[email protected]> * remove conda Signed-off-by: harupy <[email protected]> * remove test for conda Signed-off-by: harupy <[email protected]> * add single quote Signed-off-by: harupy <[email protected]> * define environment variables in test step Signed-off-by: harupy <[email protected]> * link Signed-off-by: harupy <[email protected]> * update document.R Signed-off-by: harupy <[email protected]> * do not create conda env Signed-off-by: harupy <[email protected]> * rename Signed-off-by: harupy <[email protected]> * fix filename Signed-off-by: harupy <[email protected]> * remove install.R Signed-off-by: harupy <[email protected]> * fix mlflow/R/mlflow/NAMESPACE Signed-off-by: harupy <[email protected]> * update doc Signed-off-by: harupy <[email protected]> * update README Signed-off-by: harupy <[email protected]> * update doc again Signed-off-by: harupy <[email protected]> * reset examples/pipelines/sklearn_regression Signed-off-by: harupy <[email protected]> * remove reticulate Signed-off-by: harupy <[email protected]> * add reticulate in Suggests Signed-off-by: harupy <[email protected]> * quote Signed-off-by: harupy <[email protected]> * Remove reticulate::use_condaenv Signed-off-by: harupy <[email protected]> * find python and mlflow binaries automatically Signed-off-by: harupy <[email protected]> * remove MLFLOW_PYTHON_BIN and MLFLOW_BIN Signed-off-by: harupy <[email protected]> * fix doc Signed-off-by: harupy <[email protected]> * udpate doc Signed-off-by: harupy <[email protected]> * fix syntax error Signed-off-by: harupy <[email protected]> * fix rst_header Signed-off-by: harupy <[email protected]> * revert MLFLOW_CONDA_HOME Signed-off-by: harupy <[email protected]> * replace NULL with NA Signed-off-by: harupy <[email protected]> * Fix README Signed-off-by: harupy <[email protected]> * update R-api.rst Signed-off-by: harupy <[email protected]> * use git rev-parse Signed-off-by: harupy <[email protected]> * Address comments Signed-off-by: harupy <[email protected]> Signed-off-by: harupy <[email protected]> Signed-off-by: tomasatdatabricks <[email protected]> * Fixes Signed-off-by: tomasatdatabricks <[email protected]> * fix Signed-off-by: tomasatdatabricks <[email protected]> * Fix Signed-off-by: tomasatdatabricks <[email protected]> * fix Signed-off-by: tomasatdatabricks <[email protected]> * Add debug print Signed-off-by: tomasatdatabricks <[email protected]> * Fixes Signed-off-by: tomasatdatabricks <[email protected]> * Java fixes. Signed-off-by: tomasatdatabricks <[email protected]> * Python test fixes. Signed-off-by: tomasatdatabricks <[email protected]> * Fixed spark udf tests. Signed-off-by: tomasatdatabricks <[email protected]> * fix Signed-off-by: tomasatdatabricks <[email protected]> * fix java Signed-off-by: tomasatdatabricks <[email protected]> * fix Signed-off-by: tomasatdatabricks <[email protected]> * fixes Signed-off-by: tomasatdatabricks <[email protected]> * fixes Signed-off-by: tomasatdatabricks <[email protected]> * fixes Signed-off-by: tomasatdatabricks <[email protected]> * fixes Signed-off-by: tomasatdatabricks <[email protected]> * fix Signed-off-by: tomasatdatabricks <[email protected]> * fix Signed-off-by: tomasatdatabricks <[email protected]> * fix Signed-off-by: tomasatdatabricks <[email protected]> * fixes Signed-off-by: tomasatdatabricks <[email protected]> * fixes Signed-off-by: tomasatdatabricks <[email protected]> * fixes Signed-off-by: tomasatdatabricks <[email protected]> * Change output get predictions API, docs Signed-off-by: dbczumar <[email protected]> * Lint Signed-off-by: dbczumar <[email protected]> * Move imports, docs Signed-off-by: dbczumar <[email protected]> * Test coverage Signed-off-by: dbczumar <[email protected]> * Format Signed-off-by: dbczumar <[email protected]> * Rename Signed-off-by: dbczumar <[email protected]> * Rename Signed-off-by: dbczumar <[email protected]> * format Signed-off-by: dbczumar <[email protected]> * Tuck imports Signed-off-by: dbczumar <[email protected]> * Fix naming Signed-off-by: dbczumar <[email protected]> * fix docs Signed-off-by: dbczumar <[email protected]> * Fix some tests, naming Signed-off-by: dbczumar <[email protected]> * Import fixes Signed-off-by: dbczumar <[email protected]> * format Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * Test case fix Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * format Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * remove import Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * Test case fix Signed-off-by: dbczumar <[email protected]> * Fix error Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * Test fix Signed-off-by: dbczumar <[email protected]> * Fix TF tests Signed-off-by: dbczumar <[email protected]> * Keep deployments in skinny Signed-off-by: dbczumar <[email protected]> * PredResp partial Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * Fix imports Signed-off-by: dbczumar <[email protected]> * Fix docs Signed-off-by: dbczumar <[email protected]> * Fix examples Signed-off-by: dbczumar <[email protected]> * Fix err msg Signed-off-by: dbczumar <[email protected]> * Fix bad imports Signed-off-by: dbczumar <[email protected]> * Autoformat: https://github.com/mlflow/mlflow/actions/runs/3131614304 Signed-off-by: mlflow-automation <[email protected]> * debug Signed-off-by: dbczumar <[email protected]> * Fix Signed-off-by: dbczumar <[email protected]> * more tolerant Signed-off-by: dbczumar <[email protected]> Signed-off-by: tomasatdatabricks <[email protected]> Signed-off-by: Weichen Xu <[email protected]> Signed-off-by: harupy <[email protected]> Signed-off-by: dbczumar <[email protected]> Signed-off-by: mlflow-automation <[email protected]> Co-authored-by: Corey Zumar <[email protected]> Co-authored-by: WeichenXu <[email protected]> Co-authored-by: Harutaka Kawamura <[email protected]> Co-authored-by: dbczumar <[email protected]> Co-authored-by: mlflow-automation <[email protected]>
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Related Issues/PRs
#xxx
What changes are proposed in this pull request?
Set
pyfunc.spark_udfenv_managerargument default value to belocalHow is this patch tested?
Manually
Does this PR change the documentation?
Detailslink on thePreview docscheck.Release Notes
Is this a user-facing change?
Set
pyfunc.spark_udfenv_managerargument default value to belocalWhat component(s), interfaces, languages, and integrations does this PR affect?
Components
area/artifacts: Artifact stores and artifact loggingarea/build: Build and test infrastructure for MLflowarea/docs: MLflow documentation pagesarea/examples: Example codearea/model-registry: Model Registry service, APIs, and the fluent client calls for Model Registryarea/models: MLmodel format, model serialization/deserialization, flavorsarea/pipelines: Pipelines, Pipeline APIs, Pipeline configs, Pipeline Templatesarea/projects: MLproject format, project running backendsarea/scoring: MLflow Model server, model deployment tools, Spark UDFsarea/server-infra: MLflow Tracking server backendarea/tracking: Tracking Service, tracking client APIs, autologgingInterface
area/uiux: Front-end, user experience, plotting, JavaScript, JavaScript dev serverarea/docker: Docker use across MLflow's components, such as MLflow Projects and MLflow Modelsarea/sqlalchemy: Use of SQLAlchemy in the Tracking Service or Model Registryarea/windows: Windows supportLanguage
language/r: R APIs and clientslanguage/java: Java APIs and clientslanguage/new: Proposals for new client languagesIntegrations
integrations/azure: Azure and Azure ML integrationsintegrations/sagemaker: SageMaker integrationsintegrations/databricks: Databricks integrationsHow should the PR be classified in the release notes? Choose one:
rn/breaking-change- The PR will be mentioned in the "Breaking Changes" sectionrn/none- No description will be included. The PR will be mentioned only by the PR number in the "Small Bugfixes and Documentation Updates" sectionrn/feature- A new user-facing feature worth mentioning in the release notesrn/bug-fix- A user-facing bug fix worth mentioning in the release notesrn/documentation- A user-facing documentation change worth mentioning in the release notes