Skip to content

fix: Corrected a problem where code was not multithread safe#1653

Merged
jcpitre merged 1 commit intomasterfrom
1647-feed-displaying-different-validation-reports-when-re-run
Jan 19, 2024
Merged

fix: Corrected a problem where code was not multithread safe#1653
jcpitre merged 1 commit intomasterfrom
1647-feed-displaying-different-validation-reports-when-re-run

Conversation

@jcpitre
Copy link
Copy Markdown
Contributor

@jcpitre jcpitre commented Jan 19, 2024

Summary:

Closes #1647

When running the validator with multiple datasets (like in the web validator) we sometimes have errors in the results because the noticeContainer is shared between threads.

Please make sure these boxes are checked before submitting your pull request - thanks!

@jcpitre jcpitre linked an issue Jan 19, 2024 that may be closed by this pull request
@github-actions
Copy link
Copy Markdown
Contributor

✅ Rule acceptance tests passed.
New Errors: 0 out of 1477 datasets (~0%) are invalid due to code change, which is less than the provided threshold of 1%.
Dropped Errors: 0 out of 1477 datasets (~0%) are invalid due to code change, which is less than the provided threshold of 1%.
New Warnings: 0 out of 1477 datasets (~0%) are invalid due to code change, which is less than the provided threshold of 1%.
Dropped Warnings: 0 out of 1477 datasets (~0%) are invalid due to code change, which is less than the provided threshold of 1%.
2 out of 1479 sources (~0 %) are corrupted.
Corrupted sources:
ci-abidjan-divers-operateurs-gtfs-913
de-unknown-verkehrsverbund-stuttgart-gtfs-1089
Commit: 0576629
Download the full acceptance test report here (report will disappear after 90 days).
✅ Rule acceptance tests passed.

Copy link
Copy Markdown
Member

@davidgamez davidgamez left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM!

@jcpitre jcpitre merged commit 18952e4 into master Jan 19, 2024
@jcpitre jcpitre deleted the 1647-feed-displaying-different-validation-reports-when-re-run branch January 19, 2024 14:20
@jcpitre
Copy link
Copy Markdown
Contributor Author

jcpitre commented Jan 19, 2024

The problem repaired in this in PR happened only if the validator is processing more than one dataset at the same time.
Normally this would warrant a maintenance release, since the web validator just did not work many times, but we can apply a stopgap measure instead. For the web validator we changed the configuration to allow only 1 simultaneous request per instance, meaning there is no risk of multithread problems between validation of different feeds.
We can go back with multiple requests after the next release is deployed.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

Feed displaying different validation reports when re-run

2 participants