Skip to content

Bug Report: Pull reports do not track PR branches #692

@jsiirola

Description

@jsiirola

Describe the bug
The Codecov "Pull" reports for our OSS project do not appear to track the branch HEAD. If I navigate to the specific commit hash, I can browse the coverage, but since it is a report for a specific commit and not the PR, we can not reliably see the PR patch coverage.

Environment (please complete the following information):
All (tested on Firefox, Chrome, and Edge)

  • OSS project, hosted on Github. Test reports uploaded from Jenkins and GitHub Actions

To Reproduce
Steps to reproduce the behavior:

  1. Go to https://app.codecov.io/gh/Pyomo/pyomo/pulls and note that almost all (but not all) PRs report no Patch coverage:

Image

  1. Navigate to an open PR and note
    • Codecov has identified that the PR HEAD is commit hash Pyomo/pyomo@fd98977
    • Codecov has identified that that commit failed CI (which it did)

Image

  1. Navigate to the PR and note that the current HEAD is several commits past the hash reported for the PR HEAD by Codecov:

Image

  1. Note that Codecov has reported "Success" for the checks on the most recent commit on the branch, but that the codecov/patch report is reporting the patch coverage for the most recent commit and not for the whole PR:

Image

  1. Follow the "Details" link for the Codecov status report for the most recent commit (at time of posting Pyomo/pyomo@5a821ae) and note that Codecov has the full report for the hash. As this is a commit report, the patch coverage is (correctly) for that commit and not for main...branch:

Image

Expected behavior
I would expect that Codecov's "Pulls" reports would track the branch for the PR.

Screenshots
Screenshots are included above.

Additional context
Note that Codecov has never posted a report as a comment to the PR (for the PRs where patch coverage is reported, Codecov has added the comment report). It almost appears like Codecov is still waiting for something from that old commit and is not moving on to new commits from the branch.

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    Status

    Waiting for: Product Owner

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions