Skip to content

Conversation

@windoze
Copy link
Member

@windoze windoze commented Jun 9, 2022

#211 Fix, enable submitting Feathr JAR from Maven.

@xiaoyongzhu
Copy link
Member

Overall look good to me. Seems like the test failure is irrelevant.

@xiaoyongzhu xiaoyongzhu linked an issue Jun 9, 2022 that may be closed by this pull request
@xiaoyongzhu
Copy link
Member

Can we also add a bit test case to cover this?

@windoze windoze added the safe to test Tag to execute build pipeline for a PR from forked repo label Jun 10, 2022
@xiaoyongzhu
Copy link
Member

Pasting some background info for this PR:

Since Feathr is on Maven now (https://search.maven.org/artifact/com.linkedin.feathr/feathr_2.12), we should consider using Maven as the source to submit Spark jobs,rather than using the public wasb path, since it's a bit hard to maintain and doesn't distribute well (like don't have mirrors etc., and will be slow).

@jainr
Copy link
Collaborator

jainr commented Jun 13, 2022

+1 to adding tests to cover this. Looks good to me.

@windoze
Copy link
Member Author

windoze commented Jun 13, 2022

E2E test was added in the latest commit.

@windoze windoze merged commit 7f105d5 into main Jun 13, 2022
@windoze windoze deleted the windoze/211-maven-submission branch June 13, 2022 14:33
hangfei pushed a commit that referenced this pull request Jun 13, 2022
* #211 Enable using maven package

* #211 Enable using maven package

* Print Maven package artifact id when using it

* Add e2e test for Maven job submission
hangfei pushed a commit that referenced this pull request Jun 13, 2022
* #211 Enable using maven package

* #211 Enable using maven package

* Print Maven package artifact id when using it

* Add e2e test for Maven job submission
bozhonghu pushed a commit that referenced this pull request Jun 15, 2022
* main:
  Fixing purview test issues and improve performance (#350)
  [feathr] Add product_recommendation advanced sample (#348)
  obejectId query cmd update (#360)
  add license, release, docs, python api ref badges with shields img (#357)
  quick fix the 404 not found in read me link (#355)
  Python SQL Registry (#311)
  enable JWT token param in frontend API calls (#337)
  Optimize environment variable behavior (#333)
  Adding better warning message to let user know that config file is missing and they need to set env parameters. (#347)
  Feature Monitoring (#330)
  Windoze/211 maven submission (#334)
  Windoze/211 maven submission (#334)
  Windoze/211 maven submission (#334)
  Fix Synapse quickstart link (#346)
  Show feature details when click feature in lineage graph (#339)
  Update pull_request_push_test.yml
  Update UI README for how to create overrides for local development (#335)
  Update databricks quick start experience (#217)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

safe to test Tag to execute build pipeline for a PR from forked repo

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Consider using Maven based spark job submission

4 participants