Skip to content

02125_lz4_compression_bug: Cannot parse input: expected '{' before: '2428739"} #51768

@vitlibar

Description

@vitlibar

Found in Stateless Tests (debug):

2023-07-02 21:41:46 [6872cba0114f] 2023.07.02 21:40:19.154764 [ 4673 ] {bd9da382-9409-412d-bbde-f692dd7d56e3} <Error> executeQuery: Code: 27. DB::ParsingException: Cannot parse input: expected '{' before: '2428739"}
{"x":"': While executing JSONEachRowRowInputFormat: While executing File: (in file/uri /var/lib/clickhouse/user_files/test_3sn7uu7s/data.JSONEachRow.lz4): (at row 2500000)
2023-07-02 21:41:46 . (CANNOT_PARSE_INPUT_ASSERTION_FAILED) (version 23.7.1.1) (from [::1]:37246) (comment: 02125_lz4_compression_bug.sh) (in query: SELECT max(x) FROM file), Stack trace (when copying this message, always include the lines below):
2023-07-02 21:41:46 
2023-07-02 21:41:46 0. /build/contrib/llvm-project/libcxx/include/exception:134: std::exception::capture() @ 0x000000001aeeab02 in /usr/bin/clickhouse
2023-07-02 21:41:46 1. /build/contrib/llvm-project/libcxx/include/exception:112: std::exception::exception[abi:v15000]() @ 0x000000001aeeaacd in /usr/bin/clickhouse
2023-07-02 21:41:46 2. /build/base/poco/Foundation/src/Exception.cpp:27: Poco::Exception::Exception(String const&, int) @ 0x000000003444b860 in /usr/bin/clickhouse
2023-07-02 21:41:46 3. /build/src/Common/Exception.cpp:92: DB::Exception::Exception(DB::Exception::MessageMasked&&, int, bool) @ 0x000000002448e94e in /usr/bin/clickhouse
2023-07-02 21:41:46 4. /build/src/Common/Exception.h:63: DB::Exception::Exception(String&&, int, bool) @ 0x000000001aedcd8a in /usr/bin/clickhouse
2023-07-02 21:41:46 5. /build/src/Common/Exception.h:186: DB::ParsingException::ParsingException<String&>(int, FormatStringHelperImpl<std::type_identity<String&>::type>, String&) @ 0x000000002452c753 in /usr/bin/clickhouse
2023-07-02 21:41:46 6. /build/src/IO/ReadHelpers.cpp:101: DB::throwAtAssertionFailed(char const*, DB::ReadBuffer&) @ 0x000000002451fbca in /usr/bin/clickhouse
2023-07-02 21:41:46 7. /build/src/IO/ReadHelpers.h:194: DB::assertChar(char, DB::ReadBuffer&) @ 0x000000001b31f7c0 in /usr/bin/clickhouse
2023-07-02 21:41:46 8. /build/src/Processors/Formats/Impl/JSONEachRowRowInputFormat.cpp:161: DB::JSONEachRowRowInputFormat::readJSONObject(std::vector<COW<DB::IColumn>::mutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::mutable_ptr<DB::IColumn>>>&) @ 0x000000002efd780f in /usr/bin/clickhouse
2023-07-02 21:41:46 9. /build/src/Processors/Formats/Impl/JSONEachRowRowInputFormat.cpp:219: DB::JSONEachRowRowInputFormat::readRow(std::vector<COW<DB::IColumn>::mutable_ptr<DB::IColumn>, std::allocator<COW<DB::IColumn>::mutable_ptr<DB::IColumn>>>&, DB::RowReadExtension&) @ 0x000000002efd7bf4 in /usr/bin/clickhouse
2023-07-02 21:41:46 10. /build/src/Processors/Formats/IRowInputFormat.cpp:112: DB::IRowInputFormat::generate() @ 0x000000002eecb5c4 in /usr/bin/clickhouse
2023-07-02 21:41:46 11. /build/src/Processors/ISource.cpp:125: DB::ISource::tryGenerate() @ 0x000000002edd8f70 in /usr/bin/clickhouse
2023-07-02 21:41:46 12. /build/src/Processors/ISource.cpp:94: DB::ISource::work() @ 0x000000002edd8c6b in /usr/bin/clickhouse
2023-07-02 21:41:46 13. /build/src/Processors/Executors/ExecutionThreadContext.cpp:47: DB::executeJob(DB::ExecutingGraph::Node*, DB::ReadProgressCallback*) @ 0x000000002ee10c83 in /usr/bin/clickhouse
2023-07-02 21:41:46 14. /build/src/Processors/Executors/ExecutionThreadContext.cpp:92: DB::ExecutionThreadContext::executeTask() @ 0x000000002ee109c0 in /usr/bin/clickhouse
2023-07-02 21:41:46 15. /build/src/Processors/Executors/PipelineExecutor.cpp:255: DB::PipelineExecutor::executeStepImpl(unsigned long, std::atomic<bool>*) @ 0x000000002edf5841 in /usr/bin/clickhouse
2023-07-02 21:41:46 16. /build/src/Processors/Executors/PipelineExecutor.cpp:151: DB::PipelineExecutor::executeStep(std::atomic<bool>*) @ 0x000000002edf53ae in /usr/bin/clickhouse
2023-07-02 21:41:46 17. /build/src/Processors/Executors/PullingPipelineExecutor.cpp:54: DB::PullingPipelineExecutor::pull(DB::Chunk&) @ 0x000000002ee1ae3e in /usr/bin/clickhouse
2023-07-02 21:41:46 18. /build/src/Storages/StorageFile.cpp:754: DB::StorageFileSource::generate() @ 0x000000002de9fe20 in /usr/bin/clickhouse

The test 02125_lz4_compression_bug generates a long file compressed by lz4

{"x":"0"}
{"x":"1"}
{"x":"2"}
{"x":"3"}
{"x":"4"}
...
{"x":"2499999"}

and then it reads the file. It's unclear whether the generating or reading is wrong.

There are more failures of this test
https://play.clickhouse.com/play?user=play#c2VsZWN0IAp0ZXN0X25hbWUsIGNoZWNrX3N0YXJ0X3RpbWUgQVMgZCwKcHVsbF9yZXF1ZXN0X251bWJlciwgcmVwb3J0X3VybApmcm9tIGNoZWNrcyB3aGVyZSAnMjAyMy0wNC0wMScgPD0gY2hlY2tfc3RhcnRfdGltZSBhbmQgdGVzdF9uYW1lIGxpa2UgJyUwMjEyNV9sejRfY29tcHJlc3Npb25fYnVnJScgYW5kIHRlc3Rfc3RhdHVzIGluICgnRkFJTCcsICdGTEFLWScpIG9yZGVyIGJ5IGQgZGVzYw==

Metadata

Metadata

Assignees

Labels

testingSpecial issue with list of bugs found by CI

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions