Skip to content

feat: Adds Python script and requirements to harvest the latest versions (acceptance tests)#926

Merged
lionel-nj merged 6 commits intomasterfrom
issue/734/acceptance-test-database-python-script
Jul 15, 2021
Merged

feat: Adds Python script and requirements to harvest the latest versions (acceptance tests)#926
lionel-nj merged 6 commits intomasterfrom
issue/734/acceptance-test-database-python-script

Conversation

@maximearmstrong
Copy link
Copy Markdown
Contributor

@maximearmstrong maximearmstrong commented Jul 13, 2021

Summary:

This PR adds the Python script and requirements to harvest the datasets latest versions URLs from the Mobility Database/archives. The file are under acceptance/tests/.

Expected behavior:

Same as before. This PR changes nothing to the behaviour of the canonical GTFS validator.

Please make sure these boxes are checked before submitting your pull request - thanks!

@maximearmstrong maximearmstrong marked this pull request as ready for review July 13, 2021 22:46
@maximearmstrong maximearmstrong self-assigned this Jul 13, 2021
@maximearmstrong maximearmstrong linked an issue Jul 13, 2021 that may be closed by this pull request
Copy link
Copy Markdown
Contributor

@lionel-nj lionel-nj left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks for working on that @maximearmstrong! I would suggest:

  • creating a Python package via IntelliJ named scripts (so that the Python interpreter is automatically configured when opening the project for IntelliJ IDE users)
    Capture d’écran, le 2021-07-14 à 10 00 59

  • placing these files inside a directory named mobility-database-harvester or mobility-database-harvest (it might increase clarity since acceptance/tests may suggest that the script you provided is a test suite).

  • passing the content of the credentials file used for the authentication to google storage services: locally the path to the said file is provided as an environment variable. However, in the CI process, we would be using the content of the said file instead of its path.

@lionel-nj
Copy link
Copy Markdown
Contributor

As discussed, I will provide some modifications in order to avoid passing the JSON credentials file as a Github secret.

Copy link
Copy Markdown
Contributor

@lionel-nj lionel-nj left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

@lionel-nj lionel-nj merged commit 81af939 into master Jul 15, 2021
@lionel-nj lionel-nj deleted the issue/734/acceptance-test-database-python-script branch July 15, 2021 13:35
@isabelle-dr isabelle-dr added this to the v3.0.0 milestone Aug 26, 2021
@lionel-nj lionel-nj mentioned this pull request Sep 3, 2021
4 tasks
@isabelle-dr isabelle-dr linked an issue Oct 28, 2021 that may be closed by this pull request
@isabelle-dr isabelle-dr mentioned this pull request Oct 28, 2021
4 tasks
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Automated tests to see if a PR will trigger new errors in datasets Write higher level acceptance tests

3 participants