Skip to content

NONJAVACLI-3460: update third party dependencies#4690

Closed
Jan Werner (janjwerner-confluent) wants to merge 9 commits intomasterfrom
janjwerner/dep-update
Closed

NONJAVACLI-3460: update third party dependencies#4690
Jan Werner (janjwerner-confluent) wants to merge 9 commits intomasterfrom
janjwerner/dep-update

Conversation

@janjwerner-confluent
Copy link
Copy Markdown
Member

No description provided.

@janjwerner-confluent Jan Werner (janjwerner-confluent) changed the title update third party dependencies NONJAVACLI-3460: update third party dependencies Apr 16, 2024
Copy link
Copy Markdown
Contributor

@milindl Milind L (milindl) left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Thanks a lot for the PR!

The windows versions also require an update. That can be done for zlib, curl, and zstd with updation of vcpkg.json.

Comment thread src/lz4.h Outdated
#define LZ4_VERSION_MAJOR 1 /* for breaking interface changes */
#define LZ4_VERSION_MINOR 9 /* for new (non-breaking) interface capabilities */
#define LZ4_VERSION_RELEASE 3 /* for tweaks, bug-fixes, or development */
#define LZ4_VERSION_RELEASE 4 /* for tweaks, bug-fixes, or development */
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

upgrading lz4 is trickier, as we have actually copied the entire code into our source tree. An update will look similar to https://github.com/confluentinc/librdkafka/pull/3148/files

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

I was under the impression that most of the update has already happened, it was just the version update missing:
#4232

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

oh, it was just the CVE fix,
maybe it would be worthwhile to update lz4 as there are some significant performance gains for ARM64 platform:
https://github.com/lz4/lz4/releases

local destdir=$2
local ver=7.86.0
local checksum="3dfdd39ba95e18847965cd3051ea6d22586609d9011d91df7bc5521288987a82"
local ver=8.7.1
Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Adding a note for the team here that curl 8 has no API or ABI changes

Copy link
Copy Markdown
Member Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Milind L (@milindl)
Thank you. Can you please see this commit through completion - this is as far as I can go with it.

@milindl
Copy link
Copy Markdown
Contributor

/sem-approve

@milindl
Copy link
Copy Markdown
Contributor

Running CI, and then I'll run try running OIDC tests locally to test out the libcurl update.

@janjwerner-confluent
Copy link
Copy Markdown
Member Author

Milind L (@milindl)
Can we bump openssl while we're here or should I create another ticket /pr ?

@milindl
Copy link
Copy Markdown
Contributor

I can bump it here, we're changing things anyway. However, openssl bumps are partial, linux only, because the latest versions of openssl 3.0.x are not available on vcpkg.

@milindl
Copy link
Copy Markdown
Contributor

Closing and reopening this to try and make sem-approve work.

@milindl
Copy link
Copy Markdown
Contributor

/sem-approve

@milindl
Copy link
Copy Markdown
Contributor

In the latest changes (which include openssl bump):

  1. I compiled with ./configure --install-deps --source-deps-only --disable-lz4-ext --enable-static --enable-strip --disable-gssapi
  2. Ran all integration tests with interactive-broker-version 3.7.0
  3. Ran the OIDC integration test (the test seems to be failing for an unrelated reason, but the curl request/response is working correctly, I added some log statements to check the response. The test fails after that, there's something wrong in the broker that trivup has set up).

@janjwerner-confluent
Copy link
Copy Markdown
Member Author

Jan Werner (janjwerner-confluent) commented Apr 24, 2024

resolves ( with downstream propagation)
#4653
#4664
confluentinc/confluent-kafka-dotnet#2203

@janjwerner-confluent
Copy link
Copy Markdown
Member Author

replacing the branch name to dev_janjwerner_deps_update per Milind L (@milindl) suggestion

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants