Updated build ATS to 9.2.4 #7958

ntheanh201 · 2024-03-08T15:06:29Z

Upgrade tsb build ATS 9.2.4
Change docker-compose: build astats_over_http from the local source code instead of the cloned code

Which Traffic Control components are affected by this PR?

ATS

What is the best way to verify this PR?

Build ATS with pkg: ./pkg -o -b -v ats
The ATS version should be built with 9.2.4 instead of 8.0.x

If this is a bugfix, which Traffic Control versions contained the bug?

PR submission checklist

This PR has tests
This PR has documentation
This PR has a CHANGELOG.md entry
This PR DOES NOT FIX A SERIOUS SECURITY VULNERABILITY (see the Apache Software Foundation's security guidelines for details)

limited · 2024-03-08T18:15:44Z

Maybe this is a problem with building on OS X, but I run into an error following the test instructions

./pkg -o -b -v ats
Building ats.
[+] Building 45.9s (18/18) FINISHED                                                                                                                    docker:desktop-linux
 => [ats internal] load build definition from Dockerfile-tsb                                                                                                           0.0s
 => => transferring dockerfile: 2.63kB                                                                                                                                 0.0s
 => [ats internal] load .dockerignore                                                                                                                                  0.0s
 => => transferring context: 2B                                                                                                                                        0.0s
 => [ats internal] load metadata for docker.io/library/rockylinux:8                                                                                                    1.1s
 => [ats auth] library/rockylinux:pull token for registry-1.docker.io                                                                                                  0.0s
 => [ats internal] load build context                                                                                                                                  0.0s
 => => transferring context: 44B                                                                                                                                       0.0s
 => [ats tsb-build 1/6] FROM docker.io/library/rockylinux:8@sha256:c464612ef7e3d54d658c3eaa4778b5cdc990ec7a4d9ab63b0f00c9994c6ce980                                    4.8s
 => => resolve docker.io/library/rockylinux:8@sha256:c464612ef7e3d54d658c3eaa4778b5cdc990ec7a4d9ab63b0f00c9994c6ce980                                                  0.0s
 => => sha256:c464612ef7e3d54d658c3eaa4778b5cdc990ec7a4d9ab63b0f00c9994c6ce980 547B / 547B                                                                             0.0s
 => => sha256:be879ad24fd5387ed135b99ebf0622c323afab20ff7f1967d6f06e5dbf07ee31 529B / 529B                                                                             0.0s
 => => sha256:c49dbacab8723f9007f4cc25a5d701c40f2ba3597d8fce029830876326b6fbeb 1.49kB / 1.49kB                                                                         0.0s
 => => sha256:a49f4b3e1553c4468c366b42fd1cde2a27729bd7ab13162ad061af2bd1ef9268 72.15MB / 72.15MB                                                                       2.0s
 => => extracting sha256:a49f4b3e1553c4468c366b42fd1cde2a27729bd7ab13162ad061af2bd1ef9268                                                                              2.7s
 => [ats tsb-build 2/6] RUN yum clean all && yum -y install git &&  git config --global --add safe.directory '*'                                                      23.3s
 => [ats stage-1 2/7] RUN YUM -y install git sudo                                                                                                                     27.3s
 => [ats tsb-build 3/6] COPY GO_VERSION /                                                                                                                              0.0s
 => [ats tsb-build 4/6] RUN curl -L https://dl.google.com/go/go$(cat /GO_VERSION).linux-amd64.tar.gz | tar -C /usr/local -xz && ln -s /usr/local/go/bin/go /usr/bin/g  3.0s
 => [ats tsb-build 5/6] RUN mkdir -p /go/src/github.com/comcast/tsb && cd /go/src/github.com/comcast/tsb && git init && git remote add origin https://github.com/comc  0.8s
 => [ats tsb-build 6/6] RUN cd /go/src/github.com/comcast/tsb && CGOENABLED=0 go build -o /usr/bin/tsb                                                                12.0s
 => [ats stage-1 3/7] RUN ECHO -e "#!/usr/bin/env bash\necho docker-compose is not supported in this container and the build command will not work.\nexit 1" > /usr/b  0.2s
 => [ats stage-1 4/7] RUN CHMOD +x /usr/bin/docker-compose                                                                                                             0.3s
 => [ats stage-1 5/7] COPY --FROM=TSB-BUILD /usr/bin/tsb /usr/bin/tsb                                                                                                  0.0s
 => [ats stage-1 6/7] RUN GIT config --global user.email "[email protected]"                                                                               0.1s
 => [ats stage-1 7/7] RUN GIT config --global user.name "Apache Traffic Control"                                                                                       0.2s
 => [ats] exporting to image                                                                                                                                           0.4s
 => => exporting layers                                                                                                                                                0.4s
 => => writing image sha256:4ec40d3f4f2ac2e4648169feeae1ad8412840377d4cc9cb48aad6384ab2a5d9f                                                                           0.0s
 => => naming to docker.io/library/build-ats                                                                                                                           0.0s
realpath: illegal option -- e
usage: realpath [-q] [path ...]
realpath: illegal option -- e
usage: realpath [-q] [path ...]
unknown flag: --services
parsing /Users/eric.friedrich/Development/trafficcontrol/version: Top-level object must be a mapping
parsing /Users/eric.friedrich/Development/trafficcontrol/version: Top-level object must be a mapping
Results in 'dist':
total 0
Results in 'dist':
total 0

ntheanh201 · 2024-03-09T03:31:50Z

Maybe this is a problem with building on OS X, but I run into an error following the test instructions

./pkg -o -b -v ats
Building ats.
[+] Building 45.9s (18/18) FINISHED                                                                                                                    docker:desktop-linux
 => [ats internal] load build definition from Dockerfile-tsb                                                                                                           0.0s
 => => transferring dockerfile: 2.63kB                                                                                                                                 0.0s
 => [ats internal] load .dockerignore                                                                                                                                  0.0s
 => => transferring context: 2B                                                                                                                                        0.0s
 => [ats internal] load metadata for docker.io/library/rockylinux:8                                                                                                    1.1s
 => [ats auth] library/rockylinux:pull token for registry-1.docker.io                                                                                                  0.0s
 => [ats internal] load build context                                                                                                                                  0.0s
 => => transferring context: 44B                                                                                                                                       0.0s
 => [ats tsb-build 1/6] FROM docker.io/library/rockylinux:8@sha256:c464612ef7e3d54d658c3eaa4778b5cdc990ec7a4d9ab63b0f00c9994c6ce980                                    4.8s
 => => resolve docker.io/library/rockylinux:8@sha256:c464612ef7e3d54d658c3eaa4778b5cdc990ec7a4d9ab63b0f00c9994c6ce980                                                  0.0s
 => => sha256:c464612ef7e3d54d658c3eaa4778b5cdc990ec7a4d9ab63b0f00c9994c6ce980 547B / 547B                                                                             0.0s
 => => sha256:be879ad24fd5387ed135b99ebf0622c323afab20ff7f1967d6f06e5dbf07ee31 529B / 529B                                                                             0.0s
 => => sha256:c49dbacab8723f9007f4cc25a5d701c40f2ba3597d8fce029830876326b6fbeb 1.49kB / 1.49kB                                                                         0.0s
 => => sha256:a49f4b3e1553c4468c366b42fd1cde2a27729bd7ab13162ad061af2bd1ef9268 72.15MB / 72.15MB                                                                       2.0s
 => => extracting sha256:a49f4b3e1553c4468c366b42fd1cde2a27729bd7ab13162ad061af2bd1ef9268                                                                              2.7s
 => [ats tsb-build 2/6] RUN yum clean all && yum -y install git &&  git config --global --add safe.directory '*'                                                      23.3s
 => [ats stage-1 2/7] RUN YUM -y install git sudo                                                                                                                     27.3s
 => [ats tsb-build 3/6] COPY GO_VERSION /                                                                                                                              0.0s
 => [ats tsb-build 4/6] RUN curl -L https://dl.google.com/go/go$(cat /GO_VERSION).linux-amd64.tar.gz | tar -C /usr/local -xz && ln -s /usr/local/go/bin/go /usr/bin/g  3.0s
 => [ats tsb-build 5/6] RUN mkdir -p /go/src/github.com/comcast/tsb && cd /go/src/github.com/comcast/tsb && git init && git remote add origin https://github.com/comc  0.8s
 => [ats tsb-build 6/6] RUN cd /go/src/github.com/comcast/tsb && CGOENABLED=0 go build -o /usr/bin/tsb                                                                12.0s
 => [ats stage-1 3/7] RUN ECHO -e "#!/usr/bin/env bash\necho docker-compose is not supported in this container and the build command will not work.\nexit 1" > /usr/b  0.2s
 => [ats stage-1 4/7] RUN CHMOD +x /usr/bin/docker-compose                                                                                                             0.3s
 => [ats stage-1 5/7] COPY --FROM=TSB-BUILD /usr/bin/tsb /usr/bin/tsb                                                                                                  0.0s
 => [ats stage-1 6/7] RUN GIT config --global user.email "[email protected]"                                                                               0.1s
 => [ats stage-1 7/7] RUN GIT config --global user.name "Apache Traffic Control"                                                                                       0.2s
 => [ats] exporting to image                                                                                                                                           0.4s
 => => exporting layers                                                                                                                                                0.4s
 => => writing image sha256:4ec40d3f4f2ac2e4648169feeae1ad8412840377d4cc9cb48aad6384ab2a5d9f                                                                           0.0s
 => => naming to docker.io/library/build-ats                                                                                                                           0.0s
realpath: illegal option -- e
usage: realpath [-q] [path ...]
realpath: illegal option -- e
usage: realpath [-q] [path ...]
unknown flag: --services
parsing /Users/eric.friedrich/Development/trafficcontrol/version: Top-level object must be a mapping
parsing /Users/eric.friedrich/Development/trafficcontrol/version: Top-level object must be a mapping
Results in 'dist':
total 0
Results in 'dist':
total 0

Lemme try it with MacOS, with Linux (Ubuntu) it's working

mikeV02 · 2024-03-10T00:57:05Z

Maybe this is a problem with building on OS X, but I run into an error following the test instructions

./pkg -o -b -v ats
Building ats.
[+] Building 45.9s (18/18) FINISHED                                                                                                                    docker:desktop-linux
 => [ats internal] load build definition from Dockerfile-tsb                                                                                                           0.0s
 => => transferring dockerfile: 2.63kB                                                                                                                                 0.0s
 => [ats internal] load .dockerignore                                                                                                                                  0.0s
 => => transferring context: 2B                                                                                                                                        0.0s
 => [ats internal] load metadata for docker.io/library/rockylinux:8                                                                                                    1.1s
 => [ats auth] library/rockylinux:pull token for registry-1.docker.io                                                                                                  0.0s
 => [ats internal] load build context                                                                                                                                  0.0s
 => => transferring context: 44B                                                                                                                                       0.0s
 => [ats tsb-build 1/6] FROM docker.io/library/rockylinux:8@sha256:c464612ef7e3d54d658c3eaa4778b5cdc990ec7a4d9ab63b0f00c9994c6ce980                                    4.8s
 => => resolve docker.io/library/rockylinux:8@sha256:c464612ef7e3d54d658c3eaa4778b5cdc990ec7a4d9ab63b0f00c9994c6ce980                                                  0.0s
 => => sha256:c464612ef7e3d54d658c3eaa4778b5cdc990ec7a4d9ab63b0f00c9994c6ce980 547B / 547B                                                                             0.0s
 => => sha256:be879ad24fd5387ed135b99ebf0622c323afab20ff7f1967d6f06e5dbf07ee31 529B / 529B                                                                             0.0s
 => => sha256:c49dbacab8723f9007f4cc25a5d701c40f2ba3597d8fce029830876326b6fbeb 1.49kB / 1.49kB                                                                         0.0s
 => => sha256:a49f4b3e1553c4468c366b42fd1cde2a27729bd7ab13162ad061af2bd1ef9268 72.15MB / 72.15MB                                                                       2.0s
 => => extracting sha256:a49f4b3e1553c4468c366b42fd1cde2a27729bd7ab13162ad061af2bd1ef9268                                                                              2.7s
 => [ats tsb-build 2/6] RUN yum clean all && yum -y install git &&  git config --global --add safe.directory '*'                                                      23.3s
 => [ats stage-1 2/7] RUN YUM -y install git sudo                                                                                                                     27.3s
 => [ats tsb-build 3/6] COPY GO_VERSION /                                                                                                                              0.0s
 => [ats tsb-build 4/6] RUN curl -L https://dl.google.com/go/go$(cat /GO_VERSION).linux-amd64.tar.gz | tar -C /usr/local -xz && ln -s /usr/local/go/bin/go /usr/bin/g  3.0s
 => [ats tsb-build 5/6] RUN mkdir -p /go/src/github.com/comcast/tsb && cd /go/src/github.com/comcast/tsb && git init && git remote add origin https://github.com/comc  0.8s
 => [ats tsb-build 6/6] RUN cd /go/src/github.com/comcast/tsb && CGOENABLED=0 go build -o /usr/bin/tsb                                                                12.0s
 => [ats stage-1 3/7] RUN ECHO -e "#!/usr/bin/env bash\necho docker-compose is not supported in this container and the build command will not work.\nexit 1" > /usr/b  0.2s
 => [ats stage-1 4/7] RUN CHMOD +x /usr/bin/docker-compose                                                                                                             0.3s
 => [ats stage-1 5/7] COPY --FROM=TSB-BUILD /usr/bin/tsb /usr/bin/tsb                                                                                                  0.0s
 => [ats stage-1 6/7] RUN GIT config --global user.email "[email protected]"                                                                               0.1s
 => [ats stage-1 7/7] RUN GIT config --global user.name "Apache Traffic Control"                                                                                       0.2s
 => [ats] exporting to image                                                                                                                                           0.4s
 => => exporting layers                                                                                                                                                0.4s
 => => writing image sha256:4ec40d3f4f2ac2e4648169feeae1ad8412840377d4cc9cb48aad6384ab2a5d9f                                                                           0.0s
 => => naming to docker.io/library/build-ats                                                                                                                           0.0s
realpath: illegal option -- e
usage: realpath [-q] [path ...]
realpath: illegal option -- e
usage: realpath [-q] [path ...]
unknown flag: --services
parsing /Users/eric.friedrich/Development/trafficcontrol/version: Top-level object must be a mapping
parsing /Users/eric.friedrich/Development/trafficcontrol/version: Top-level object must be a mapping
Results in 'dist':
total 0
Results in 'dist':
total 0

Don't quote me here, but I believe the issue with "realpath" being different in MacOS (BSD) than GNU realpath in Linux. That command is used in some bash scripts, for example, the pkg.sh script, not related with the PR itself.

smalenfant · 2024-03-11T12:26:34Z

Was this build working prior to your change?

ntheanh201 · 2024-03-11T16:18:04Z

Was this build working prior to your change?

It has to be something with the OS, with Linux I see there's no problem

limited · 2024-03-12T16:00:13Z

I'll retry on non Mac and see how it goes. I am usually able to build pkg as part of my release verification

…

On Mon, Mar 11, 2024 at 12:18 PM The Anh Nguyen ***@***.***> wrote: Was this build working prior to your change? It has to be something with the OS, with Linux I see there's no problem — Reply to this email directly, view it on GitHub <#7958 (comment)>, or unsubscribe <https://github.com/notifications/unsubscribe-auth/AAGRNNBJP6EN3CATLPRID7TYXXKNHAVCNFSM6AAAAABEM62OSKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSOBYHAZTINZXG4> . You are receiving this because you commented.Message ID: ***@***.***>

ntheanh201 · 2024-03-14T12:59:40Z

I'll retry on non Mac and see how it goes. I am usually able to build pkg as part of my release verification
…
On Mon, Mar 11, 2024 at 12:18 PM The Anh Nguyen @.> wrote: Was this build working prior to your change? It has to be something with the OS, with Linux I see there's no problem — Reply to this email directly, view it on GitHub <#7958 (comment)>, or unsubscribe https://github.com/notifications/unsubscribe-auth/AAGRNNBJP6EN3CATLPRID7TYXXKNHAVCNFSM6AAAAABEM62OSKVHI2DSMVQWIX3LMV43OSLTON2WKQ3PNVWWK3TUHMYTSOBYHAZTINZXG4 . You are receiving this because you commented.Message ID: @.>

Did you take a look?

zrhoffman · 2024-04-03T19:11:13Z

@limited As noted by @mikeV02, ./pkg -o fails on macOS because macOS does not have realpath (although this problem is not caused by #7958).

I added realpath support on macOS to pkg in #7981, if anyone wants to review.

ntheanh201 · 2024-06-04T04:29:03Z

Can you review this PR after #7981 was merged? @zrhoffman

zrhoffman

This looks very close, Just a couple small nits :)

@limited The build issue should be fixed now that #7981 is merged, does #7958 build for you?

traffic_server/_tsb/run.sh

traffic_server/_tsb/repos.yml

traffic_server/_tsb/trafficserver.spec

zrhoffman

Looks good besides the tag pattern updates to update now that we have a proper release tag. Thanks!

traffic_server/_tsb/trafficserver.spec

ntheanh201 · 2024-07-10T02:28:30Z

@zrhoffman can you re-run the checks? I rebuild it and it works

zrhoffman

Looks good, thanks!

The CI is taking a long time for some reason, but I tested locally and it works.

As a note, the RPM still is built as 9.2.4-rc0, but that seems to be because ATS's version 9.2.4 was tagged incorrectly. So everything looks fine in #7958. :)

ntheanh201 · 2024-07-10T03:35:02Z

Looks good, thanks!

The CI is taking a long time for some reason, but I tested locally and it works.

As a note, the RPM still is built as 9.2.4-rc0, but that seems to be because ATS's version 9.2.4 was tagged incorrectly. So everything looks fine in #7958. :)

Actually, sometimes I see it will be like that, today I tried and the tag was 9.2.4 without rc0

zrhoffman · 2024-07-10T03:39:32Z

Actually, sometimes I see it will be like that, today I tried and the tag was 9.2.4 without rc0

Does this command print the 9.2.4 tag for you?

git describe --match=9.2.4 9.2.4

For me, it outputs

fatal: No annotated tags can describe '90fbf13db0858cef0e0a094f445d846b60a4c1ef'.
However, there were unannotated tags: try --tags.

. However,

git describe --match=9.2.4-rc0 9.2.4

and

git describe --match=9.2.3 9.2.3

work.

ntheanh201 · 2024-07-10T03:43:59Z

Actually, sometimes I see it will be like that, today I tried and the tag was 9.2.4 without rc0

Does this command print the 9.2.4 tag for you?
git describe --match=9.2.4 9.2.4
For me, it outputs
fatal: No annotated tags can describe '90fbf13db0858cef0e0a094f445d846b60a4c1ef'.
However, there were unannotated tags: try --tags.
. However,
git describe --match=9.2.4-rc0 9.2.4
and
git describe --match=9.2.3 9.2.3
work.

for me, it outputs:

git describe --long --tags --match='*[0-9.][0-9.][0-9.]'
9.2.4-0-g90fbf13db

But after I removed the ats folder and rebuild ats

zrhoffman · 2024-07-10T03:46:07Z

for me, it outputs:

git describe --long --tags --match='*[0-9.][0-9.][0-9.]'
9.2.4-0-g90fbf13db

But after I removed the ats folder and rebuild ats

When I run that command in a fresh clone of the ATS repo, I get

4.1.0-12031-g073fb7bea

zrhoffman · 2024-07-10T03:52:00Z

I opened apache/trafficserver#11529, hopefully the release manager can investigate.

ntheanh201 · 2024-07-10T07:01:44Z

for me, it outputs:

git describe --long --tags --match='*[0-9.][0-9.][0-9.]'
9.2.4-0-g90fbf13db

But after I removed the ats folder and rebuild ats

When I run that command in a fresh clone of the ATS repo, I get
4.1.0-12031-g073fb7bea

Did you checkout to this commit?: git checkout 90fbf13db0858cef0e0a094f445d846b60a4c1e

ntheanh201 · 2024-07-10T07:10:00Z

run this command and gets the result: git describe --long --tags --match=9.2.4 9.2.4
9.2.4-0-g90fbf13db

zrhoffman · 2024-07-10T08:26:08Z

You're right, I get that result, and git describe --tags --match=9.2.4 9.2.4 does return 9.2.4. But I still thing ATS tagged it wrong, because --match should not be necessary. See:

$ git describe --tags 9.2.3
9.2.3

even though 9.2.3 and 9.2.3-rc0 refer to the same commit.

ntheanh201 added 6 commits March 7, 2024 14:48

update branch, commit ats

223adee

update ats tsb patches, branch

2c8271a

fix: build astats_over_http plugin

0c065a4

revert: check TS_VERSION_MAJOR

df49687

Update astats_over_http.c

ad7cd0a

Update astats_over_http.c

470d3ae

ntheanh201 changed the title ~~Update build ATS 9.2.3~~ Updated build ATS to 9.2.3 Mar 8, 2024

chore: update CHANGELOG

66672c2

zrhoffman added Traffic Server related to Apache Traffic Server dependencies Pull requests that update a dependency file labels Mar 21, 2024

ntheanh201 mentioned this pull request Apr 3, 2024

Store Apache Traffic Server and grove logs in /var/log/trafficserver #7980

Merged

4 tasks

zrhoffman mentioned this pull request Apr 3, 2024

Add realpath support to pkg #7981

Merged

4 tasks

Merge branch 'master' into ats

3cd6460

zrhoffman suggested changes Jun 4, 2024

View reviewed changes

traffic_server/_tsb/run.sh Outdated Show resolved Hide resolved

traffic_server/_tsb/repos.yml Outdated Show resolved Hide resolved

ntheanh201 added 2 commits June 10, 2024 09:52

update build ats to 9.2.4

baf0cba

chore: update Changelog

7c01fd4

ntheanh201 changed the title ~~Updated build ATS to 9.2.3~~ Updated build ATS to 9.2.4 Jun 10, 2024

ntheanh201 commented Jun 10, 2024

View reviewed changes

traffic_server/_tsb/trafficserver.spec Outdated Show resolved Hide resolved

zrhoffman suggested changes Jun 12, 2024

View reviewed changes

traffic_server/_tsb/trafficserver.spec Outdated Show resolved Hide resolved

ntheanh201 force-pushed the ats branch from f575cd6 to 7c01fd4 Compare June 13, 2024 00:55

zrhoffman approved these changes Jul 10, 2024

View reviewed changes

zrhoffman merged commit b65e7a1 into apache:master Jul 10, 2024

Updated build ATS to 9.2.4 #7958

Updated build ATS to 9.2.4 #7958

Uh oh!

Conversation

ntheanh201 commented Mar 8, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Which Traffic Control components are affected by this PR?

What is the best way to verify this PR?

If this is a bugfix, which Traffic Control versions contained the bug?

PR submission checklist

Uh oh!

limited commented Mar 8, 2024

Uh oh!

ntheanh201 commented Mar 9, 2024

Uh oh!

mikeV02 commented Mar 10, 2024

Uh oh!

smalenfant commented Mar 11, 2024

Uh oh!

ntheanh201 commented Mar 11, 2024

Uh oh!

limited commented Mar 12, 2024 via email

Uh oh!

ntheanh201 commented Mar 14, 2024

Uh oh!

zrhoffman commented Apr 3, 2024

Uh oh!

ntheanh201 commented Jun 4, 2024

Uh oh!

zrhoffman left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

Uh oh!

Uh oh!

zrhoffman left a comment

Choose a reason for hiding this comment

Uh oh!

Uh oh!

ntheanh201 commented Jul 10, 2024

Uh oh!

zrhoffman left a comment

Choose a reason for hiding this comment

Uh oh!

ntheanh201 commented Jul 10, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

zrhoffman commented Jul 10, 2024

Uh oh!

ntheanh201 commented Jul 10, 2024 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

zrhoffman commented Jul 10, 2024

Uh oh!

zrhoffman commented Jul 10, 2024

Uh oh!

ntheanh201 commented Jul 10, 2024

Uh oh!

ntheanh201 commented Jul 10, 2024

Uh oh!

zrhoffman commented Jul 10, 2024

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

5 participants

ntheanh201 commented Mar 8, 2024 •

edited

Loading

ntheanh201 commented Jul 10, 2024 •

edited

Loading

ntheanh201 commented Jul 10, 2024 •

edited

Loading