Was the breaking change announced in any way?

The change will be announced in the release notes. There is unfortunately no way to gradually introduce it (proposals to first make the superbuild off by default and then remove it were rejected), but at the same time the change is quite simple to migrate.

The change will be announced in the release notes. There is unfortunately no way to gradually introduce it (proposals to first make the superbuild off by default and then remove it were rejected), but at the same time the change is quite simple to migrate.

We probably need to announce removal and then actually do the removal in a couple releases. We cannot ship a release that will break dependencies and then expect them to fix it.

Undrafting, regardless of when we will take it, it is finished and ready for review.

Also just built successfully¹ libtiledbsoma with just the following change:

diff --git a/libtiledbsoma/cmake/Modules/FindTileDB_EP.cmake b/libtiledbsoma/cmake/Modules/FindTileDB_EP.cmake
index 910fc4e..62bd32a 100644
--- a/libtiledbsoma/cmake/Modules/FindTileDB_EP.cmake
+++ b/libtiledbsoma/cmake/Modules/FindTileDB_EP.cmake
@@ -113,8 +113,8 @@ else()
     else() # Build from source
         ExternalProject_Add(ep_tiledb
           PREFIX "externals"
-          URL "https://github.com/TileDB-Inc/TileDB/archive/2.23.0.zip"
-          URL_HASH SHA1=2acca37618f0a6192ca648930138231476422b96
+          GIT_REPOSITORY "https://github.com/TileDB-Inc/TileDB.git"
+          GIT_TAG teo/remove-superbuild
           DOWNLOAD_NAME "tiledb.zip"
           CMAKE_ARGS
             -DCMAKE_INSTALL_PREFIX=${EP_INSTALL_PREFIX}

Macports build (on macos-14 at least) on this commit succeeds, after removing an outdated patch for lz4.

@KiterLuc thanks for this work. Question: I want to point to external projects (with the dev branch) with CMake, however now it always defaults to pulling in vcpkg files, how can I instead point to my externally built projects? Meaning: with this dev branch, can I set something like -DTILEDB_VCPKG=OFF, and then set variables through CMake (such as ZLIB_INCLUDE_DIR) for zlib, lz4, zstd, webp, etc ?

thanks again.

(related to old ticket #4070 )

You can pass -DTILEDB_DISABLE_AUTO_VCPKG=ON to disable auto-downloading of vcpkg, making you responsible to provide the dependencies of TileDB from whatever sources you want.

ah, thanks @teo-tsirpanis !

@teo-tsirpanis I do see the option listed in BuildOptions.cmake, however even if I enable it, CMake still continues to download and build the vcpkg packages.

I wonder if it is because I do not set a CMAKE_TOOLCHAIN_FILE variable (I pass all of the includes manually by passing all of the _INCLUDE_DIR and _LIBRARY paths for libs through the cmake command). This works fine for my other 500+ libraries that I build. Hmm I wonder what is happening in the TileDB case...

I cannot reproduce locally. Do you perhaps have the VCPKG_ROOT environment variable set?

I do not set VCPKG_ROOT, or touch anything to do with VCPKG, all of the libs are compiled manually by myself (on MSVC 2022).

Even when I pass TILEDB_DISABLE_AUTO_VCPKG , CMake states -- Running vcpkg install...

Could it be that if CMake cannot find one dependency, instead of throwing an error, it begins a VCPKG install ?

Could it be that if CMake cannot find one dependency, instead of throwing an error, it begins a VCPKG install ?

Very unlikely, vcpkg inside the project() CMake command. If finding packages fails after that CMake itself will fake.

Can you share a repro for me to try?