Skip to content

TST: Allow remote data job to fail, cron org - #11036

Merged
pllim merged 6 commits into
astropy:masterfrom
pllim:actions-allowed-failure
Nov 13, 2020
Merged

pllim merged 6 commits into
astropy:masterfrom
pllim:actions-allowed-failure

Conversation

@pllim

@pllim pllim commented Nov 12, 2020 •

Copy link
Copy Markdown
Member
  • Allow remote data job to fail, while not letting it block the rest of the jobs that have "fail fast" on.
  • Split cron jobs into daily and weekly.
  • Downgrade Python dev to 3.9-dev. Also see TST: Bump Python for dev jobs #10875

Out of scope: Fixing failing cron and remote-data jobs. We can do that in separate PRs. The main goal for this PR is to allow the "fail fast" mode so we don't waste CPU cycles.

TODO:

  • Get approval.
  • Add doc to ask people not to panic at the ❌ for allowed failure.

This is a direct follow up of #10388 .

@pllim
pllim requested review from a team, astrofrog and saimn November 12, 2020 22:55
@pllim pllim added this to the v4.3 milestone Nov 12, 2020

@saimn saimn left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Splitting daily and weekly builds seems a very good idea !
Do we need to have py37-test-devdeps both on the daily, weekly and normal builds?

Comment thread .github/workflows/ci_cron.yml Resolved
Comment thread .github/workflows/ci_cron_weekly.yml Resolved
@pllim

pllim commented Nov 13, 2020

Copy link
Copy Markdown
Member Author

Do we need to have py37-test-devdeps both on the daily, weekly and normal builds?

Definitely not in both daily and weekly. I think daily and weekly should be mutually exclusive. With this patch, the devdeps runs for push (with remote data) and daily (without remote data). And the Python dev runs weekly.

@pllim pllim mentioned this pull request Nov 13, 2020
18 tasks done
@saimn

saimn commented Nov 13, 2020

Copy link
Copy Markdown
Contributor

Right, sorry for the confusion, it's not in the weekly build, but it is twice in the normal build. Once without remote data on macos, and once with remote data in the allowed failures.

@pllim

pllim commented Nov 13, 2020

Copy link
Copy Markdown
Member Author

Re: #11036 (comment) -- Good catch! I think it is a typo.

@astrofrog astrofrog left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good and I like the separation into daily and weekly, but just a note about the 3.10 job.

Comment thread .github/workflows/ci_cron_weekly.yml Outdated
# Test against Python dev in cron job.
- name: Python dev with basic dependencies
os: ubuntu-latest
python: 3.9-dev

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Since 3.9 is out what does this install? 3.10a1 is already out right so by the comment we should actually leave 3.10-dev?

I wonder if it would be more correct to set it to 3.10-dev and comment out and put a note to uncomment once Numpy supports Python 3.10?

(We should probably add a stable 3.9 job to the main matrix btw)

Actually I wonder whether it would work with 3.10-dev if we specified -devdeps in the tox env - Numpy may have fixed compatibility issues there.

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

3.10a1, in my understanding, is not yet to be used, though I would agree that changing this job to 3.10-dev would make sense, but then we better to comment it out until the dev cycle is a bit further along.

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Yes, we should comment this until the beta/rc versions are available.

This comment was marked as resolved.

pllim and others added 4 commits November 13, 2020 15:12
TST: Split cron jobs into daily and weekly.
TST: Downgrade Python dev to 3.9-dev.
[ci skip]
[ci skip]

Co-authored-by: Simon Conseil <[email protected]>
@pllim
pllim force-pushed the actions-allowed-failure branch from 7dbd314 to 4d0b7da Compare November 13, 2020 20:17
@pllim

pllim commented Nov 13, 2020

Copy link
Copy Markdown
Member Author

I addressed your comments about python dev job. Also updated the docs. If you are okay with this, please approve. Thanks!

@astrofrog astrofrog left a comment

Copy link
Copy Markdown
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me! Once this is merged I'll open a PR to add arm etc to the weekly cron

@pllim
pllim merged commit 77cfcd5 into astropy:master Nov 13, 2020
@pllim
pllim deleted the actions-allowed-failure branch November 13, 2020 22:13
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants