Skip to content

Instantly share code, notes, and snippets.

@pitrou
Created July 3, 2023 14:13
Show Gist options
  • Select an option

  • Save pitrou/bde45f7a213bf4016cff454ad69a3653 to your computer and use it in GitHub Desktop.

Select an option

Save pitrou/bde45f7a213bf4016cff454ad69a3653 to your computer and use it in GitHub Desktop.
========================================================================= test session starts =========================================================================
platform linux -- Python 3.10.12, pytest-7.4.0, pluggy-1.2.0 -- /home/antoine/mambaforge/envs/pyarrow/bin/python
cachedir: .pytest_cache
hypothesis profile 'dev' -> max_examples=50, database=DirectoryBasedExampleDatabase('/home/antoine/arrow/dev/python/.hypothesis/examples')
rootdir: /home/antoine/arrow/dev/python
configfile: setup.cfg
plugins: lazy-fixture-0.6.3, hypothesis-6.79.3
collected 389 items / 388 deselected / 1 selected
pyarrow/tests/test_fs.py::test_s3_finalize Fatal error condition occurred in /home/conda/feedstock_root/build_artifacts/aws-c-common_1684218181827/work/source/allocator.c:209: allocator != ((void *)0)
Exiting Application
################################################################################
Stack trace:
################################################################################
/home/antoine/mambaforge/envs/pyarrow/lib/libaws-c-common.so.1(aws_backtrace_print+0x59) [0x7f5590e21839]
/home/antoine/mambaforge/envs/pyarrow/lib/libaws-c-common.so.1(aws_fatal_assert+0x46) [0x7f5590e0f646]
/home/antoine/mambaforge/envs/pyarrow/lib/libaws-c-common.so.1(+0x11847) [0x7f5590e0d847]
/home/antoine/mambaforge/envs/pyarrow/lib/libaws-c-common.so.1(+0x1c2c1) [0x7f5590e182c1]
/home/antoine/mambaforge/envs/pyarrow/lib/libaws-c-common.so.1(+0x1c2aa) [0x7f5590e182aa]
/home/antoine/mambaforge/envs/pyarrow/lib/libaws-c-sdkutils.so.1.0.0(+0xae33) [0x7f5590e51e33]
/home/antoine/mambaforge/envs/pyarrow/lib/libaws-c-common.so.1(aws_ref_count_release+0x1d) [0x7f5590e23acd]
/home/antoine/mambaforge/envs/pyarrow/lib/libaws-c-sdkutils.so.1.0.0(aws_endpoints_ruleset_release+0x13) [0x7f5590e54163]
/home/antoine/mambaforge/envs/pyarrow/lib/libaws-c-sdkutils.so.1.0.0(+0x8323) [0x7f5590e4f323]
/home/antoine/mambaforge/envs/pyarrow/lib/libaws-c-common.so.1(aws_ref_count_release+0x1d) [0x7f5590e23acd]
/home/antoine/mambaforge/envs/pyarrow/lib/libaws-c-sdkutils.so.1.0.0(aws_endpoints_rule_engine_release+0x13) [0x7f5590e50563]
/home/antoine/mambaforge/envs/pyarrow/lib/libaws-crt-cpp.so(_ZN3Aws3Crt9Endpoints10RuleEngineD1Ev+0xd) [0x7f559167d41d]
/home/antoine/mambaforge/envs/pyarrow/lib/libaws-cpp-sdk-s3.so(+0x99577) [0x7f55918b8577]
/home/antoine/mambaforge/envs/pyarrow/lib/libaws-cpp-sdk-s3.so(_ZN3Aws2S38S3ClientD1Ev+0x2c) [0x7f55918bac1c]
/home/antoine/mambaforge/envs/pyarrow/lib/libarrow.so.1300(+0x2b9bcc0) [0x7f55953a0cc0]
/home/antoine/mambaforge/envs/pyarrow/lib/libarrow.so.1300(+0x2b9ce87) [0x7f55953a1e87]
/home/antoine/mambaforge/envs/pyarrow/lib/libarrow.so.1300(+0x2b9c6fe) [0x7f55953a16fe]
/home/antoine/mambaforge/envs/pyarrow/lib/libarrow.so.1300(+0x13d34f9) [0x7f5593bd84f9]
/home/antoine/mambaforge/envs/pyarrow/lib/libarrow.so.1300(+0x13d70fd) [0x7f5593bdc0fd]
/home/antoine/mambaforge/envs/pyarrow/lib/libarrow.so.1300(+0x2b80488) [0x7f5595385488]
/home/antoine/mambaforge/envs/pyarrow/lib/libarrow.so.1300(+0x2b804a4) [0x7f55953854a4]
/home/antoine/mambaforge/envs/pyarrow/lib/libarrow.so.1300(_ZN5arrow2fs12S3FileSystem4ImplD1Ev+0x1e) [0x7f55953ddeee]
/home/antoine/mambaforge/envs/pyarrow/lib/libarrow.so.1300(_ZSt8_DestroyIN5arrow2fs12S3FileSystem4ImplEEvPT_+0x18) [0x7f55953ddf37]
/home/antoine/mambaforge/envs/pyarrow/lib/libarrow.so.1300(_ZNSt23_Sp_counted_ptr_inplaceIN5arrow2fs12S3FileSystem4ImplESaIvELN9__gnu_cxx12_Lock_policyE2EE10_M_disposeEv+0x40) [0x7f55953dc682]
/home/antoine/mambaforge/envs/pyarrow/lib/libarrow.so.1300(+0x13da1a7) [0x7f5593bdf1a7]
/home/antoine/mambaforge/envs/pyarrow/lib/libarrow.so.1300(+0x13d7002) [0x7f5593bdc002]
/home/antoine/mambaforge/envs/pyarrow/lib/libarrow.so.1300(+0x13d3595) [0x7f5593bd8595]
/home/antoine/mambaforge/envs/pyarrow/lib/libarrow.so.1300(+0x13d70fd) [0x7f5593bdc0fd]
/home/antoine/mambaforge/envs/pyarrow/lib/libarrow.so.1300(_ZNSt12__shared_ptrIN5arrow2fs12S3FileSystem4ImplELN9__gnu_cxx12_Lock_policyE2EED1Ev+0x1c) [0x7f55953ac926]
/home/antoine/mambaforge/envs/pyarrow/lib/libarrow.so.1300(_ZNSt10shared_ptrIN5arrow2fs12S3FileSystem4ImplEED1Ev+0x18) [0x7f55953ac942]
/home/antoine/mambaforge/envs/pyarrow/lib/libarrow.so.1300(_ZN5arrow2fs12S3FileSystemD1Ev+0x2e) [0x7f559538ef80]
/home/antoine/mambaforge/envs/pyarrow/lib/libarrow.so.1300(_ZN5arrow2fs12S3FileSystemD0Ev+0x18) [0x7f559538efa8]
/home/antoine/mambaforge/envs/pyarrow/lib/libarrow.so.1300(_ZNSt15_Sp_counted_ptrIPN5arrow2fs12S3FileSystemELN9__gnu_cxx12_Lock_policyE2EE10_M_disposeEv+0x28) [0x7f55953dc5ae]
/home/antoine/arrow/dev/python/pyarrow/_fs.cpython-310-x86_64-linux-gnu.so(_ZNSt16_Sp_counted_baseILN9__gnu_cxx12_Lock_policyE2EE19_M_release_last_useEv+0x23) [0x7f54c50b4bdf]
/home/antoine/arrow/dev/python/pyarrow/_fs.cpython-310-x86_64-linux-gnu.so(_ZNSt16_Sp_counted_baseILN9__gnu_cxx12_Lock_policyE2EE24_M_release_last_use_coldEv+0x18) [0x7f54c50b1906]
/home/antoine/arrow/dev/python/pyarrow/_fs.cpython-310-x86_64-linux-gnu.so(_ZNSt16_Sp_counted_baseILN9__gnu_cxx12_Lock_policyE2EE10_M_releaseEv+0x127) [0x7f54c50afdf1]
/home/antoine/arrow/dev/python/pyarrow/_fs.cpython-310-x86_64-linux-gnu.so(_ZNSt14__shared_countILN9__gnu_cxx12_Lock_policyE2EED1Ev+0x27) [0x7f54c50b196d]
/home/antoine/arrow/dev/python/pyarrow/_fs.cpython-310-x86_64-linux-gnu.so(_ZNSt12__shared_ptrIN5arrow2fs10FileSystemELN9__gnu_cxx12_Lock_policyE2EED1Ev+0x1c) [0x7f54c50b0772]
/home/antoine/arrow/dev/python/pyarrow/_fs.cpython-310-x86_64-linux-gnu.so(_ZNSt10shared_ptrIN5arrow2fs10FileSystemEED1Ev+0x18) [0x7f54c50b07b4]
/home/antoine/arrow/dev/python/pyarrow/_fs.cpython-310-x86_64-linux-gnu.so(_Z21__Pyx_call_destructorISt10shared_ptrIN5arrow2fs10FileSystemEEEvRT_+0x18) [0x7f54c50b4b6f]
/home/antoine/arrow/dev/python/pyarrow/_fs.cpython-310-x86_64-linux-gnu.so(+0x715e0) [0x7f54c50985e0]
/home/antoine/arrow/dev/python/pyarrow/_s3fs.cpython-310-x86_64-linux-gnu.so(+0x1b740) [0x7f54c4fd0740]
/home/antoine/mambaforge/envs/pyarrow/bin/python(+0x1310ef) [0x56034dcfd0ef]
/home/antoine/mambaforge/envs/pyarrow/bin/python(+0x209096) [0x56034ddd5096]
/home/antoine/mambaforge/envs/pyarrow/bin/python(+0x125c1f) [0x56034dcf1c1f]
/home/antoine/mambaforge/envs/pyarrow/bin/python(+0x208b7c) [0x56034ddd4b7c]
/home/antoine/mambaforge/envs/pyarrow/bin/python(Py_FinalizeEx+0x146) [0x56034ddd3c36]
/home/antoine/mambaforge/envs/pyarrow/bin/python(Py_RunMain+0x106) [0x56034ddc6826]
/home/antoine/mambaforge/envs/pyarrow/bin/python(Py_BytesMain+0x37) [0x56034dd97527]
/lib/x86_64-linux-gnu/libc.so.6(+0x29d90) [0x7f5598d2cd90]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0x80) [0x7f5598d2ce40]
/home/antoine/mambaforge/envs/pyarrow/bin/python(+0x1cb421) [0x56034dd97421]
FAILED
============================================================================== FAILURES ===============================================================================
__________________________________________________________________________ test_s3_finalize ___________________________________________________________________________
Traceback (most recent call last):
File "/home/antoine/mambaforge/envs/pyarrow/lib/python3.10/site-packages/_pytest/runner.py", line 341, in from_call
result: Optional[TResult] = func()
File "/home/antoine/mambaforge/envs/pyarrow/lib/python3.10/site-packages/_pytest/runner.py", line 262, in <lambda>
lambda: ihook(item=item, **kwds), when=when, reraise=reraise
File "/home/antoine/mambaforge/envs/pyarrow/lib/python3.10/site-packages/pluggy/_hooks.py", line 433, in __call__
return self._hookexec(self.name, self._hookimpls, kwargs, firstresult)
File "/home/antoine/mambaforge/envs/pyarrow/lib/python3.10/site-packages/pluggy/_manager.py", line 112, in _hookexec
return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
File "/home/antoine/mambaforge/envs/pyarrow/lib/python3.10/site-packages/pluggy/_callers.py", line 155, in _multicall
return outcome.get_result()
File "/home/antoine/mambaforge/envs/pyarrow/lib/python3.10/site-packages/pluggy/_result.py", line 108, in get_result
raise exc.with_traceback(exc.__traceback__)
File "/home/antoine/mambaforge/envs/pyarrow/lib/python3.10/site-packages/pluggy/_callers.py", line 80, in _multicall
res = hook_impl.function(*args)
File "/home/antoine/mambaforge/envs/pyarrow/lib/python3.10/site-packages/_pytest/runner.py", line 177, in pytest_runtest_call
raise e
File "/home/antoine/mambaforge/envs/pyarrow/lib/python3.10/site-packages/_pytest/runner.py", line 169, in pytest_runtest_call
item.runtest()
File "/home/antoine/mambaforge/envs/pyarrow/lib/python3.10/site-packages/_pytest/python.py", line 1788, in runtest
self.ihook.pytest_pyfunc_call(pyfuncitem=self)
File "/home/antoine/mambaforge/envs/pyarrow/lib/python3.10/site-packages/pluggy/_hooks.py", line 433, in __call__
return self._hookexec(self.name, self._hookimpls, kwargs, firstresult)
File "/home/antoine/mambaforge/envs/pyarrow/lib/python3.10/site-packages/pluggy/_manager.py", line 112, in _hookexec
return self._inner_hookexec(hook_name, methods, kwargs, firstresult)
File "/home/antoine/mambaforge/envs/pyarrow/lib/python3.10/site-packages/pluggy/_callers.py", line 116, in _multicall
raise exception.with_traceback(exception.__traceback__)
File "/home/antoine/mambaforge/envs/pyarrow/lib/python3.10/site-packages/pluggy/_callers.py", line 80, in _multicall
res = hook_impl.function(*args)
File "/home/antoine/mambaforge/envs/pyarrow/lib/python3.10/site-packages/_pytest/python.py", line 194, in pytest_pyfunc_call
result = testfunction(**testargs)
File "/home/antoine/arrow/dev/python/pyarrow/tests/test_fs.py", line 1841, in test_s3_finalize
subprocess.check_call([sys.executable, "-c", code])
File "/home/antoine/mambaforge/envs/pyarrow/lib/python3.10/subprocess.py", line 369, in check_call
raise CalledProcessError(retcode, cmd)
subprocess.CalledProcessError: Command '['/home/antoine/mambaforge/envs/pyarrow/bin/python', '-c', 'if 1:\n import pytest\n from pyarrow.fs import FileSystem, ensure_s3_initialized, finalize_s3\n\n fs, path = FileSystem.from_uri(\'s3://mf-nwp-models/README.txt\')\n assert fs.region == \'eu-west-1\'\n with fs.open_input_stream(path) as f:\n f.read(50)\n\n finalize_s3()\n\n with pytest.raises(ValueError, match="S3 subsystem is finalized"):\n fs.open_input_stream(path)\n ']' died with <Signals.SIGABRT: 6>.
======================================================================= short test summary info =======================================================================
FAILED pyarrow/tests/test_fs.py::test_s3_finalize - subprocess.CalledProcessError: Command '['/home/antoine/mambaforge/envs/pyarrow/bin/python', '-c', 'if 1:\n import pytest\n from pyarrow.fs import F...
================================================================== 1 failed, 388 deselected in 0.80s ==================================================================
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment