Describe the bug
When COLMAP tries to do the BA using CUDA (with --Mapper.ba_use_gpu option) it raises a ceres error on detect_structure.cc at line 111, indicating empty rows on the matrix.

To Reproduce
Steps to reproduce the behavior:

1. Execute the usual colmap pipeline: extract the features, do the matching.
2. At mapper step, use the option flag --Mapper.ba_use_gpu on

colmap mapper --Mapper.ba_use_gpu on --database_path ~/data/sfm/street_pole1/sparse/database.db --image_path ~/data/sfm/street_pole1/images --output_path ~/data/sfm/street_pole1/sparse

3. When the number of registered files reach 50 files, the retriangulation and Global BA happens.
4. The error triggers with message:

F0903 18:59:56.927320 76973 detect_structure.cc:111] Check failed: *row_block_size != 0 (0 vs. 0) No rows found

Expected behavior
It was expected to run without erros, given that the same dataset without GPU flags runs smooth.

Screenshots

Environment:

• OS: Ubuntu 22.04
• COLMAP Version: 4ccfeb5
• Capture Device: Samsung S23
• Ceres version: 2.2.0

Related issue: #2643
Related PR: #2717