Skip to content

Troubleshoot osx-arm64 libmagic error on 2.26.x branch#399

Closed
regro-cf-autotick-bot wants to merge 1 commit intoconda-forge:2.26.xfrom
regro-cf-autotick-bot:bot-pr_arm_osx_h8e0200
Closed

Troubleshoot osx-arm64 libmagic error on 2.26.x branch#399
regro-cf-autotick-bot wants to merge 1 commit intoconda-forge:2.26.xfrom
regro-cf-autotick-bot:bot-pr_arm_osx_h8e0200

Conversation

@regro-cf-autotick-bot
Copy link
Copy Markdown
Contributor

This feedstock is being rebuilt as part of the ARM OSX migration.

Feel free to merge the PR if CI is all green, but please don't close it
without reaching out the the ARM OSX team first at @conda-forge/help-osx-arm64.

If this PR was opened in error or needs to be updated please add the bot-rerun label to this PR. The bot will close this PR and schedule another one. If you do not have permissions to add this label, you can use the phrase @conda-forge-admin, please rerun bot in a PR comment to have the conda-forge-admin add it for you.

This PR was created by the regro-cf-autotick-bot. The regro-cf-autotick-bot is a service to automatically track the dependency graph, migrate packages, and propose package version updates for conda-forge. Feel free to drop us a line if there are any issues! This PR was generated by https://github.com/regro/cf-scripts/actions/runs/12372753219 - please use this URL for debugging.

@conda-forge-admin
Copy link
Copy Markdown
Contributor

Hi! This is the friendly automated conda-forge-linting service.

I just wanted to let you know that I linted all conda-recipes in your PR (recipe/meta.yaml) and found it was in an excellent condition.

Copy link
Copy Markdown
Member

@jdblischak jdblischak left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

This is a false positive. Do not merge. It was only opened because rerendering had an effect. Unclear why tiledb is pinned for the tiledb recipe. Seems unnecessary

@jdblischak
Copy link
Copy Markdown
Member

However, I am concerned that the osx-arm64 builds failed for all of these false positive migrator PRs. Nothing has changed, so it should be fine.

Looking at the build log, I think the problem was with installing libmagic via vcpkg:

Installing 5/19 libmagic:arm64-osx...
Building libmagic:arm64-osx...
-- [OVERLAY] Loading triplet configuration from: $SRC_DIR/triplets/arm64-osx.cmake
-- Installing port from location: $SRC_DIR/ports/libmagic
-- Downloading https://github.com/file/file/archive/FILE5_40.tar.gz -> file-file-FILE5_40.tar.gz...
-- Extracting source $SRC_DIR/build/_deps/vcpkg-src/downloads/file-file-FILE5_40.tar.gz
-- Applying patch 0001-Use-pcre2.patch
-- Using source at $SRC_DIR/build/_deps/vcpkg-src/buildtrees/libmagic/src/FILE5_40-ae3838cbe2.clean
CMake Warning (dev) at scripts/cmake/vcpkg_find_acquire_program.cmake:70 (cmake_parse_arguments):
  The INTERPRETER keyword was followed by an empty string or no value at all.
  Policy CMP0174 is not set, so cmake_parse_arguments() will unset the
  arg_INTERPRETER variable rather than setting it to an empty string.
Call Stack (most recent call first):
  scripts/cmake/vcpkg_find_acquire_program.cmake:139 (z_vcpkg_find_acquire_program_find_internal)
  $SRC_DIR/build/vcpkg_installed/x64-osx/share/vcpkg-cmake/vcpkg_cmake_configure.cmake:104 (vcpkg_find_acquire_program)
  $SRC_DIR/ports/libmagic/portfile.cmake:36 (vcpkg_cmake_configure)
  scripts/ports.cmake:170 (include)
This warning is for project developers.  Use -Wno-dev to suppress it.

-- Configuring arm64-osx
-- Building arm64-osx-rel
CMake Error at scripts/cmake/vcpkg_execute_build_process.cmake:134 (message):
    Command failed: $BUILD_PREFIX/bin/cmake --build . --config Release --target install -- -v -j5
    Working Directory: $SRC_DIR/build/_deps/vcpkg-src/buildtrees/libmagic/arm64-osx-rel
    See logs for more information:
      $SRC_DIR/build/_deps/vcpkg-src/buildtrees/libmagic/install-arm64-osx-rel-out.log

Call Stack (most recent call first):
  $SRC_DIR/build/vcpkg_installed/x64-osx/share/vcpkg-cmake/vcpkg_cmake_build.cmake:74 (vcpkg_execute_build_process)
  $SRC_DIR/build/vcpkg_installed/x64-osx/share/vcpkg-cmake/vcpkg_cmake_install.cmake:16 (vcpkg_cmake_build)
  $SRC_DIR/ports/libmagic/portfile.cmake:40 (vcpkg_cmake_install)
  scripts/ports.cmake:170 (include)


error: building libmagic:arm64-osx failed with: BUILD_FAILED
Elapsed time to handle libmagic:arm64-osx: 18 s

@xylar xylar mentioned this pull request Dec 17, 2024
@jdblischak jdblischak changed the title ARM OSX Migrator Troubleshoot osx-arm64 libmagic error on 2.26.x branch Dec 17, 2024
@teo-tsirpanis
Copy link
Copy Markdown
Member

file: could not find any valid magic files!

Is it being launched from the wrong directory? 🤔

@jdblischak
Copy link
Copy Markdown
Member

Looking at the 2.26.x branch, the last passing build was on Dec 10th from aa79484. Technically at that point it was still part of main

However, I hadn't realized this, but when I originally created 2.26.x (part of #395) two days later on Dec 12th, the osx-arm64 build had already started failing in 289db1f

@jdblischak
Copy link
Copy Markdown
Member

The nightly tiledb-feedstock builds are passing.

https://github.com/TileDB-Inc/tiledb-feedstock/tree/nightly-build
https://dev.azure.com/TileDB-Inc/CI/_build/results?buildId=41559&view=results

However, it also shows the message file: could not find any valid magic files!

Full log of libmagic installation for nightly osx-arm64 build
Installing 6/20 libmagic:[email protected]#1...
Building libmagic:[email protected]#1...
$SRC_DIR/triplets/x64-osx.cmake: info: loaded overlay triplet from here
$SRC_DIR/ports/libmagic: info: installing overlay port from here
-- Downloading https://github.com/file/file/archive/FILE5_45.tar.gz -> file-file-FILE5_45.tar.gz...
-- Extracting source $SRC_DIR/build/_deps/vcpkg-src/downloads/file-file-FILE5_45.tar.gz
-- Applying patch 0001-Use-pcre2.patch
-- Using source at $SRC_DIR/build/_deps/vcpkg-src/buildtrees/libmagic/src/FILE5_45-3941a70d66.clean
CMake Warning (dev) at scripts/cmake/vcpkg_find_acquire_program.cmake:70 (cmake_parse_arguments):
  The INTERPRETER keyword was followed by an empty string or no value at all.
  Policy CMP0174 is not set, so cmake_parse_arguments() will unset the
  arg_INTERPRETER variable rather than setting it to an empty string.
Call Stack (most recent call first):
  scripts/cmake/vcpkg_find_acquire_program.cmake:143 (z_vcpkg_find_acquire_program_find_internal)
  $SRC_DIR/build/vcpkg_installed/x64-osx/share/vcpkg-cmake/vcpkg_cmake_configure.cmake:116 (vcpkg_find_acquire_program)
  $SRC_DIR/ports/libmagic/portfile.cmake:40 (vcpkg_cmake_configure)
  scripts/ports.cmake:192 (include)
This warning is for project developers.  Use -Wno-dev to suppress it.

-- Configuring x64-osx
-- Building x64-osx-rel
CMake Warning (dev) at scripts/cmake/vcpkg_find_acquire_program.cmake:70 (cmake_parse_arguments):
  The INTERPRETER keyword was followed by an empty string or no value at all.
  Policy CMP0174 is not set, so cmake_parse_arguments() will unset the
  arg_INTERPRETER variable rather than setting it to an empty string.
Call Stack (most recent call first):
  scripts/cmake/vcpkg_find_acquire_program.cmake:143 (z_vcpkg_find_acquire_program_find_internal)
  scripts/cmake/vcpkg_fixup_pkgconfig.cmake:193 (vcpkg_find_acquire_program)
  $SRC_DIR/ports/libmagic/portfile.cmake:46 (vcpkg_fixup_pkgconfig)
  scripts/ports.cmake:192 (include)
This warning is for project developers.  Use -Wno-dev to suppress it.

CMake Warning (dev) at scripts/cmake/vcpkg_find_acquire_program.cmake:30 (cmake_parse_arguments):
  The INTERPRETER keyword was followed by an empty string or no value at all.
  Policy CMP0174 is not set, so cmake_parse_arguments() will unset the
  arg_INTERPRETER variable rather than setting it to an empty string.
Call Stack (most recent call first):
  scripts/cmake/vcpkg_find_acquire_program.cmake:149 (z_vcpkg_find_acquire_program_find_external)
  scripts/cmake/vcpkg_fixup_pkgconfig.cmake:193 (vcpkg_find_acquire_program)
  $SRC_DIR/ports/libmagic/portfile.cmake:46 (vcpkg_fixup_pkgconfig)
  scripts/ports.cmake:192 (include)
This warning is for project developers.  Use -Wno-dev to suppress it.

CMake Warning (dev) at scripts/cmake/vcpkg_find_acquire_program.cmake:30 (cmake_parse_arguments):
  The MIN_VERSION keyword was followed by an empty string or no value at all.
  Policy CMP0174 is not set, so cmake_parse_arguments() will unset the
  arg_MIN_VERSION variable rather than setting it to an empty string.
Call Stack (most recent call first):
  scripts/cmake/vcpkg_find_acquire_program.cmake:149 (z_vcpkg_find_acquire_program_find_external)
  scripts/cmake/vcpkg_fixup_pkgconfig.cmake:193 (vcpkg_find_acquire_program)
  $SRC_DIR/ports/libmagic/portfile.cmake:46 (vcpkg_fixup_pkgconfig)
  scripts/ports.cmake:192 (include)
This warning is for project developers.  Use -Wno-dev to suppress it.

-- Installing: $SRC_DIR/build/_deps/vcpkg-src/packages/libmagic_x64-osx/share/libmagic/copyright
-- Installing: $SRC_DIR/build/_deps/vcpkg-src/packages/libmagic_x64-osx/share/libmagic/usage
-- Remove RPATH from '$SRC_DIR/build/_deps/vcpkg-src/packages/libmagic_x64-osx/tools/libmagic/file' ('$PREFIX/lib')
-- Adjusted RPATH of '$SRC_DIR/build/_deps/vcpkg-src/packages/libmagic_x64-osx/tools/libmagic/file' (To '@loader_path/../../lib')
-- Performing post-build validation
Stored binaries in 1 destinations in 158 ms.
Elapsed time to handle libmagic:x64-osx: 14 s
libmagic:x64-osx package ABI: 8393e0015bd271de390513b00a5b634c26ff6b76ea838cbc659a0aec59e994a1
Installing 7/20 libmagic:[email protected]#1...
Building libmagic:[email protected]#1...
$SRC_DIR/triplets/arm64-osx.cmake: info: loaded overlay triplet from here
$SRC_DIR/ports/libmagic: info: installing overlay port from here
-- Using cached file-file-FILE5_45.tar.gz.
-- Cleaning sources at $SRC_DIR/build/_deps/vcpkg-src/buildtrees/libmagic/src/FILE5_45-3941a70d66.clean. Use --editable to skip cleaning for the packages you specify.
-- Extracting source $SRC_DIR/build/_deps/vcpkg-src/downloads/file-file-FILE5_45.tar.gz
-- Applying patch 0001-Use-pcre2.patch
-- Using source at $SRC_DIR/build/_deps/vcpkg-src/buildtrees/libmagic/src/FILE5_45-3941a70d66.clean
CMake Warning (dev) at scripts/cmake/vcpkg_find_acquire_program.cmake:70 (cmake_parse_arguments):
  The INTERPRETER keyword was followed by an empty string or no value at all.
  Policy CMP0174 is not set, so cmake_parse_arguments() will unset the
  arg_INTERPRETER variable rather than setting it to an empty string.
Call Stack (most recent call first):
  scripts/cmake/vcpkg_find_acquire_program.cmake:143 (z_vcpkg_find_acquire_program_find_internal)
  $SRC_DIR/build/vcpkg_installed/x64-osx/share/vcpkg-cmake/vcpkg_cmake_configure.cmake:116 (vcpkg_find_acquire_program)
  $SRC_DIR/ports/libmagic/portfile.cmake:40 (vcpkg_cmake_configure)
  scripts/ports.cmake:192 (include)
This warning is for project developers.  Use -Wno-dev to suppress it.

-- Configuring arm64-osx
-- Building arm64-osx-rel
CMake Warning (dev) at scripts/cmake/vcpkg_find_acquire_program.cmake:70 (cmake_parse_arguments):
  The INTERPRETER keyword was followed by an empty string or no value at all.
  Policy CMP0174 is not set, so cmake_parse_arguments() will unset the
  arg_INTERPRETER variable rather than setting it to an empty string.
Call Stack (most recent call first):
  scripts/cmake/vcpkg_find_acquire_program.cmake:143 (z_vcpkg_find_acquire_program_find_internal)
  scripts/cmake/vcpkg_fixup_pkgconfig.cmake:193 (vcpkg_find_acquire_program)
  $SRC_DIR/ports/libmagic/portfile.cmake:46 (vcpkg_fixup_pkgconfig)
  scripts/ports.cmake:192 (include)
This warning is for project developers.  Use -Wno-dev to suppress it.

CMake Warning (dev) at scripts/cmake/vcpkg_find_acquire_program.cmake:30 (cmake_parse_arguments):
  The INTERPRETER keyword was followed by an empty string or no value at all.
  Policy CMP0174 is not set, so cmake_parse_arguments() will unset the
  arg_INTERPRETER variable rather than setting it to an empty string.
Call Stack (most recent call first):
  scripts/cmake/vcpkg_find_acquire_program.cmake:149 (z_vcpkg_find_acquire_program_find_external)
  scripts/cmake/vcpkg_fixup_pkgconfig.cmake:193 (vcpkg_find_acquire_program)
  $SRC_DIR/ports/libmagic/portfile.cmake:46 (vcpkg_fixup_pkgconfig)
  scripts/ports.cmake:192 (include)
This warning is for project developers.  Use -Wno-dev to suppress it.

CMake Warning (dev) at scripts/cmake/vcpkg_find_acquire_program.cmake:30 (cmake_parse_arguments):
  The MIN_VERSION keyword was followed by an empty string or no value at all.
  Policy CMP0174 is not set, so cmake_parse_arguments() will unset the
  arg_MIN_VERSION variable rather than setting it to an empty string.
Call Stack (most recent call first):
  scripts/cmake/vcpkg_find_acquire_program.cmake:149 (z_vcpkg_find_acquire_program_find_external)
  scripts/cmake/vcpkg_fixup_pkgconfig.cmake:193 (vcpkg_find_acquire_program)
  $SRC_DIR/ports/libmagic/portfile.cmake:46 (vcpkg_fixup_pkgconfig)
  scripts/ports.cmake:192 (include)
This warning is for project developers.  Use -Wno-dev to suppress it.

-- Installing: $SRC_DIR/build/_deps/vcpkg-src/packages/libmagic_arm64-osx/share/libmagic/copyright
-- Installing: $SRC_DIR/build/_deps/vcpkg-src/packages/libmagic_arm64-osx/share/libmagic/usage
file: could not find any valid magic files! (No such file or directory)
file: could not find any valid magic files! (No such file or directory)
file: could not find any valid magic files! (No such file or directory)
file: could not find any valid magic files! (No such file or directory)
-- Performing post-build validation
Stored binaries in 1 destinations in 157 ms.
Elapsed time to handle libmagic:arm64-osx: 14 s
libmagic:arm64-osx package ABI: 3aeb8ff967464e6fb5aad1dace62e5ac24fc1e696e2a7305f8bc4b9fff331941

ihnorton added a commit to TileDB-Inc/TileDB that referenced this pull request Jan 7, 2025
Backport #5332 to release-2.26 to fix
conda-forge/tiledb-feedstock#399

---


[SC-56749](https://app.shortcut.com/tiledb-inc/story/56749/update-the-libmagic-vcpkg-port-overlay-to-version-5-45)

This PR updates our custom vcpkg port overlay for libmagic to version
5.45. Unlike the last time we attempted this (#4673), this PR does not
replace the port with the upstream autotools-based one, and is not
expected to be a build-breaking change.

---
TYPE: IMPROVEMENT
DESC: Updated libmagic to version 5.45.

(cherry picked from commit c44fb49)

<long description>

---
TYPE: NO_HISTORY | FEATURE | BUG | IMPROVEMENT | DEPRECATION | C_API |
CPP_API | BREAKING_BEHAVIOR | BREAKING_API | FORMAT
DESC: <short description>

---------

Co-authored-by: Theodore Tsirpanis <[email protected]>
@jdblischak jdblischak mentioned this pull request Jan 7, 2025
4 tasks
@jdblischak
Copy link
Copy Markdown
Member

Fixed by #404

@jdblischak jdblischak closed this Jan 8, 2025
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants