[pull] master from yandex:master by pull[bot] · Pull Request #2 · traceon/ClickHouse

pull · 2019-08-13T14:46:09Z

See Commits and Changes for more details.

Created by pull[bot]. Want to support this open source service? Please star it : )

* Fix shared build * Enable no-undefined check only in CI

Add space reservation for each new MargeTreeDataPart.

refresh_2

fix result type for avg aggregation

The failure goes like this: https://clickhouse-test-reports.s3.yandex.net/7946/1f69a7a015468099b7395ce3b96fb638b9830e0b/functional_stateless_tests_(memory)/stderr.log ``` ==199==WARNING: MemorySanitizer: use-of-uninitialized-value #0 0x2009fc34 in LZ4_count /build/obj-x86_64-linux-gnu/../contrib/lz4/lib/lz4.c:541:13 #1 0x2009fc34 in LZ4_compress_generic /build/obj-x86_64-linux-gnu/../contrib/lz4/lib/lz4.c:999 #2 0x2009fc34 in LZ4_compress_fast_extState /build/obj-x86_64-linux-gnu/../contrib/lz4/lib/lz4.c:1140 #3 0x200ac663 in LZ4_compress_fast /build/obj-x86_64-linux-gnu/../contrib/lz4/lib/lz4.c:1211:14 #4 0x200ac663 in LZ4_compress_default /build/obj-x86_64-linux-gnu/../contrib/lz4/lib/lz4.c:1222 #5 0x1b76d2e8 in DB::CompressionCodecLZ4::doCompressData(char const*, unsigned int, char*) const /build/obj-x86_64-linux-gnu/../dbms/src/Compression/CompressionCodecLZ4.cpp:45:12 ```

…ement-in-stateless-tests-2 Enable access management in stateless tests #2.

Update mergetree.md

…h nested interpreter Example of such queries are distributed queries, which creates local InterpreterSelectQuery, which will have it's own QueryPlan but returns Pipes that has that IQueryPlanStep attached. After EXPLAIN PIPELINE graph=1 tries to use them, and will get SIGSEGV. - TSAN: <details> ``` ==2782113==ERROR: AddressSanitizer: heap-use-after-free on address 0x6120000223c0 at pc 0x00002b8f3f3e bp 0x7fff18cfbff0 sp 0x7fff18cfbfe8 READ of size 8 at 0x6120000223c0 thread T22 (TCPHandler) #0 0x2b8f3f3d in DB::printPipelineCompact(std::__1::vector<std::__1::shared_ptr<DB::IProcessor>, std::__1::allocator<std::__1::shared_ptr<DB::IProcessor> > > const&, DB::WriteBuffer&, bool) /build/obj-x86_64-linux-gnu/../src/Processors/printPipeline.cpp:116:53 #1 0x29ee698c in DB::InterpreterExplainQuery::executeImpl() /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterExplainQuery.cpp:275:17 #2 0x29ee2e40 in DB::InterpreterExplainQuery::execute() /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterExplainQuery.cpp:73:14 #3 0x2a7b44a2 in DB::executeQueryImpl(char const*, char const*, DB::Context&, bool, DB::QueryProcessingStage::Enum, bool, DB::ReadBuffer*) /build/obj-x86_64-linux-gnu/../src/Interpreters/executeQuery.cpp:389:28 #4 0x2a7b1cb3 in DB::executeQuery(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, DB::Context&, bool, DB::QueryProcessingStage::Enum, bool) /build/obj-x86_64-linux-gnu/../src/Interpreters/executeQuery.cpp:675:30 #5 0x2b7993b2 in DB::TCPHandler::runImpl() /build/obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:253:24 #6 0x2b7b649a in DB::TCPHandler::run() /build/obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:1217:9 #7 0x31d9c57e in Poco::Net::TCPServerConnection::start() /build/obj-x86_64-linux-gnu/../contrib/poco/Net/src/TCPServerConnection.cpp:43:3 #8 0x31d9d281 in Poco::Net::TCPServerDispatcher::run() /build/obj-x86_64-linux-gnu/../contrib/poco/Net/src/TCPServerDispatcher.cpp:114:20 #9 0x3206b5d5 in Poco::PooledThread::run() /build/obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/ThreadPool.cpp:199:14 #10 0x320657ad in Poco::ThreadImpl::runnableEntry(void*) /build/obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/Thread_POSIX.cpp:345:27 #11 0x7ffff7f853e8 in start_thread (/usr/lib/libpthread.so.0+0x93e8) #12 0x7ffff7ea2292 in clone (/usr/lib/libc.so.6+0x100292) 0x6120000223c0 is located 0 bytes inside of 272-byte region [0x6120000223c0,0x6120000224d0) freed by thread T22 (TCPHandler) here: #0 0x122f3b62 in operator delete(void*, unsigned long) (/src/ch/tmp/master-20200831/clickhouse+0x122f3b62) #1 0x2bd9e9fa in std::__1::default_delete<DB::IQueryPlanStep>::operator()(DB::IQueryPlanStep*) const /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:2363:5 #2 0x2bd9e9fa in std::__1::unique_ptr<DB::IQueryPlanStep, std::__1::default_delete<DB::IQueryPlanStep> >::reset(DB::IQueryPlanStep*) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:2618:7 #3 0x2bd9e9fa in std::__1::unique_ptr<DB::IQueryPlanStep, std::__1::default_delete<DB::IQueryPlanStep> >::~unique_ptr() /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:2572:19 #4 0x2bd9e9fa in DB::QueryPlan::Node::~Node() /build/obj-x86_64-linux-gnu/../src/Processors/QueryPlan/QueryPlan.h:66:12 #5 0x2bd9e9fa in void std::__1::allocator_traits<std::__1::allocator<std::__1::__list_node<DB::QueryPlan::Node, void*> > >::__destroy<DB::QueryPlan::Node>(std::__1::integral_constant<bool, false>, std::__1::allocator<std::__1::__list_node<DB::QueryPlan::Node, void*> >&, DB::QueryPlan::Node*) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:1798:23 #6 0x2bd9e9fa in void std::__1::allocator_traits<std::__1::allocator<std::__1::__list_node<DB::QueryPlan::Node, void*> > >::destroy<DB::QueryPlan::Node>(std::__1::allocator<std::__1::__list_node<DB::QueryPlan::Node, void*> >&, DB::QueryPlan::Node*) /build/obj-x86_64-lin ux-gnu/../contrib/libcxx/include/memory:1630:14 #7 0x2bd9e9fa in std::__1::__list_imp<DB::QueryPlan::Node, std::__1::allocator<DB::QueryPlan::Node> >::clear() /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/list:762:13 #8 0x29fece08 in DB::InterpreterSelectQuery::execute() /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterSelectQuery.cpp:492:1 #9 0x2abf7484 in DB::ClusterProxy::(anonymous namespace)::createLocalStream(std::__1::shared_ptr<DB::IAST> const&, DB::Block const&, DB::Context const&, DB::QueryProcessingStage::Enum) /build/obj-x86_64-linux-gnu/../src/Interpreters/ClusterProxy/SelectStreamFactory.cpp: 78:33 #10 0x2abea85d in DB::ClusterProxy::SelectStreamFactory::createForShard(DB::Cluster::ShardInfo const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::shared_ptr<DB::IAST> const&, DB::Context const&, std::__1::shar ed_ptr<DB::Throttler> const&, DB::SelectQueryInfo const&, std::__1::vector<DB::Pipe, std::__1::allocator<DB::Pipe> >&)::$_0::operator()() const /build/obj-x86_64-linux-gnu/../src/Interpreters/ClusterProxy/SelectStreamFactory.cpp:133:51 #11 0x2abea85d in DB::ClusterProxy::SelectStreamFactory::createForShard(DB::Cluster::ShardInfo const&, std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, std::__1::shared_ptr<DB::IAST> const&, DB::Context const&, std::__1::shar ed_ptr<DB::Throttler> const&, DB::SelectQueryInfo const&, std::__1::vector<DB::Pipe, std::__1::allocator<DB::Pipe> >&) /build/obj-x86_64-linux-gnu/../src/Interpreters/ClusterProxy/SelectStreamFactory.cpp:189:13 #12 0x2abe6d99 in DB::ClusterProxy::executeQuery(DB::ClusterProxy::IStreamFactory&, std::__1::shared_ptr<DB::Cluster> const&, Poco::Logger*, std::__1::shared_ptr<DB::IAST> const&, DB::Context const&, DB::Settings const&, DB::SelectQueryInfo const&) /build/obj-x86_64-lin ux-gnu/../src/Interpreters/ClusterProxy/executeQuery.cpp:107:24 #13 0x2abc4b74 in DB::StorageDistributed::read(std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > > const&, s td::__1::shared_ptr<DB::StorageInMemoryMetadata const> const&, DB::SelectQueryInfo const&, DB::Context const&, DB::QueryProcessingStage::Enum, unsigned long, unsigned int) /build/obj-x86_64-linux-gnu/../src/Storages/StorageDistributed.cpp:514:12 #14 0x2bda1c5a in DB::ReadFromStorageStep::ReadFromStorageStep(std::__1::shared_ptr<DB::RWLockImpl::LockHolderImpl>, std::__1::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::SelectQueryOptions, std::__1::shared_ptr<DB::IStorage>, std::__1::vector<std::__1::basic_st ring<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > > const&, DB::SelectQueryInfo const&, std::__1::shared_ptr<DB::Context>, DB::QueryProcessingStage ::Enum, unsigned long, unsigned long) /build/obj-x86_64-linux-gnu/../src/Processors/QueryPlan/ReadFromStorageStep.cpp:39:26 #15 0x2a01ca70 in std::__1::__unique_if<DB::ReadFromStorageStep>::__unique_single std::__1::make_unique<DB::ReadFromStorageStep, std::__1::shared_ptr<DB::RWLockImpl::LockHolderImpl>&, std::__1::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::SelectQueryOptions&, std ::__1::shared_ptr<DB::IStorage>&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > >&, DB::SelectQueryInfo&, st d::__1::shared_ptr<DB::Context>&, DB::QueryProcessingStage::Enum&, unsigned long&, unsigned long&>(std::__1::shared_ptr<DB::RWLockImpl::LockHolderImpl>&, std::__1::shared_ptr<DB::StorageInMemoryMetadata const>&, DB::SelectQueryOptions&, std::__1::shared_ptr<DB::IStorage>&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std::__1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > >&, DB::SelectQueryInfo&, std::__1::shared_ptr<DB::Context>&, DB::QueryProcessingStage::Enum&, unsigned long&, unsigned long&) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/memory:3028:32 #16 0x29ff556a in DB::InterpreterSelectQuery::executeFetchColumns(DB::QueryProcessingStage::Enum, DB::QueryPlan&, std::__1::shared_ptr<DB::PrewhereInfo> const&, std::__1::vector<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> >, std:: __1::allocator<std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > > > const&) /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterSelectQuery.cpp:1383:26 #17 0x29fe6b83 in DB::InterpreterSelectQuery::executeImpl(DB::QueryPlan&, std::__1::shared_ptr<DB::IBlockInputStream> const&, std::__1::optional<DB::Pipe>) /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterSelectQuery.cpp:795:9 #18 0x29fe5771 in DB::InterpreterSelectQuery::buildQueryPlan(DB::QueryPlan&) /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterSelectQuery.cpp:473:5 #19 0x2a47d370 in DB::InterpreterSelectWithUnionQuery::buildQueryPlan(DB::QueryPlan&) /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterSelectWithUnionQuery.cpp:182:38 #20 0x29ee5bff in DB::InterpreterExplainQuery::executeImpl() /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterExplainQuery.cpp:265:21 #21 0x29ee2e40 in DB::InterpreterExplainQuery::execute() /build/obj-x86_64-linux-gnu/../src/Interpreters/InterpreterExplainQuery.cpp:73:14 #22 0x2a7b44a2 in DB::executeQueryImpl(char const*, char const*, DB::Context&, bool, DB::QueryProcessingStage::Enum, bool, DB::ReadBuffer*) /build/obj-x86_64-linux-gnu/../src/Interpreters/executeQuery.cpp:389:28 #23 0x2a7b1cb3 in DB::executeQuery(std::__1::basic_string<char, std::__1::char_traits<char>, std::__1::allocator<char> > const&, DB::Context&, bool, DB::QueryProcessingStage::Enum, bool) /build/obj-x86_64-linux-gnu/../src/Interpreters/executeQuery.cpp:675:30 #24 0x2b7993b2 in DB::TCPHandler::runImpl() /build/obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:253:24 #25 0x2b7b649a in DB::TCPHandler::run() /build/obj-x86_64-linux-gnu/../src/Server/TCPHandler.cpp:1217:9 #26 0x31d9c57e in Poco::Net::TCPServerConnection::start() /build/obj-x86_64-linux-gnu/../contrib/poco/Net/src/TCPServerConnection.cpp:43:3 #27 0x31d9d281 in Poco::Net::TCPServerDispatcher::run() /build/obj-x86_64-linux-gnu/../contrib/poco/Net/src/TCPServerDispatcher.cpp:114:20 #28 0x3206b5d5 in Poco::PooledThread::run() /build/obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/ThreadPool.cpp:199:14 #29 0x320657ad in Poco::ThreadImpl::runnableEntry(void*) /build/obj-x86_64-linux-gnu/../contrib/poco/Foundation/src/Thread_POSIX.cpp:345:27 #30 0x7ffff7f853e8 in start_thread (/usr/lib/libpthread.so.0+0x93e8) ``` </details>

Use join() instead of detach() for threads #2

Quorum inserts 2

update welch to master

Since onCancel() and generate() can be called from different threads TSAN reports: WARNING: ThreadSanitizer: data race (pid=253) Write of size 1 at 0x7b50008c25c2 by thread T144 (mutexes: write M643587328754916744): #0 DB::RemoteSource::onCancel() /build/obj-x86_64-linux-gnu/../src/Processors/Sources/RemoteSource.cpp:79:24 (clickhouse+0x11c2019d) #1 DB::IProcessor::cancel() /build/obj-x86_64-linux-gnu/../src/Processors/IProcessor.h:235:9 (clickhouse+0x11c21def) #2 DB::RemoteSource::onUpdatePorts() /build/obj-x86_64-linux-gnu/../src/Processors/Sources/RemoteSource.h:32:13 (clickhouse+0x11c21def) #3 DB::PipelineExecutor::tryAddProcessorToStackIfUpdated(DB::ExecutingGraph::Edge&, std::__1::queue<DB::ExecutingGraph::Node*, std::__1::deque<DB::ExecutingGraph::Node*, std::__1::allocator<DB::ExecutingGraph::Node*> > >&, unsigned long) /build/obj-x86_64-linux-gnu/../src/Processors/Executors/PipelineExecutor.cpp:190:43 (clickhouse+0x11aaf954) #4 DB::PipelineExecutor::prepareProcessor(unsigned long, unsigned long, std::__1::queue<DB::ExecutingGraph::Node*, std::__1::deque<DB::ExecutingGraph::Node*, std::__1::allocator<DB::ExecutingGraph::Node*> > >&, std::__1::unique_lock<std::__1::mutex>) /build/obj-x86_64-linux-gnu/../src/Processors/Executors/PipelineExecutor.cpp:296:18 (clickhouse+0x11ab0169) #5 DB::PipelineExecutor::tryAddProcessorToStackIfUpdated(DB::ExecutingGraph::Edge&, std::__1::queue<DB::ExecutingGraph::Node*, std::__1::deque<DB::ExecutingGraph::Node*, std::__1::allocator<DB::ExecutingGraph::Node*> > >&, unsigned long) /build/obj-x86_64-linux-gnu/../src/Processors/Executors/PipelineExecutor.cpp:187:16 (clickhouse+0x11aaf9c2) #6 DB::PipelineExecutor::prepareProcessor(unsigned long, unsigned long, std::__1::queue<DB::ExecutingGraph::Node*, std::__1::deque<DB::ExecutingGraph::Node*, std::__1::allocator<DB::ExecutingGraph::Node*> > >&, std::__1::unique_lock<std::__1::mutex>) /build/obj-x86_64-linux-gnu/../src/Processors/Executors/PipelineExecutor.cpp:296:18 (clickhouse+0x11ab0169) #7 DB::PipelineExecutor::executeStepImpl(unsigned long, unsigned long, std::__1::atomic<bool>*) /build/obj-x86_64-linux-gnu/../src/Processors/Executors/PipelineExecutor.cpp:589:26 (clickhouse+0x11ab2a3e) #8 DB::PipelineExecutor::executeSingleThread(unsigned long, unsigned long) /build/obj-x86_64-linux-gnu/../src/Processors/Executors/PipelineExecutor.cpp:477:5 (clickhouse+0x11ab538b) #9 DB::PipelineExecutor::executeImpl(unsigned long)::$_4::operator()() const /build/obj-x86_64-linux-gnu/../src/Processors/Executors/PipelineExecutor.cpp:736:21 (clickhouse+0x11ab538b) #10 decltype(std::__1::forward<DB::PipelineExecutor::executeImpl(unsigned long)::$_4&>(fp)()) std::__1::__invoke_constexpr<DB::PipelineExecutor::executeImpl(unsigned long)::$_4&>(DB::PipelineExecutor::executeImpl(unsigned long)::$_4&) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/type_traits:3525:1 (clickhouse+0x11ab538b) #11 decltype(auto) std::__1::__apply_tuple_impl<DB::PipelineExecutor::executeImpl(unsigned long)::$_4&, std::__1::tuple<>&>(DB::PipelineExecutor::executeImpl(unsigned long)::$_4&, std::__1::tuple<>&, std::__1::__tuple_indices<>) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/tuple:1415:1 (clickhouse+0x11ab538b) #12 decltype(auto) std::__1::apply<DB::PipelineExecutor::executeImpl(unsigned long)::$_4&, std::__1::tuple<>&>(DB::PipelineExecutor::executeImpl(unsigned long)::$_4&, std::__1::tuple<>&) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/tuple:1424:1 (clickhouse+0x11ab538b) #13 ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long)::$_4>(DB::PipelineExecutor::executeImpl(unsigned long)::$_4&&)::'lambda'()::operator()() /build/obj-x86_64-linux-gnu/../src/Common/ThreadPool.h:178:13 (clickhouse+0x11ab538b) #14 decltype(std::__1::forward<DB::PipelineExecutor::executeImpl(unsigned long)::$_4>(fp)()) std::__1::__invoke<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long)::$_4>(DB::PipelineExecutor::executeImpl(unsigned long)::$_4&&)::'lambda'()&>(DB::PipelineExecutor::executeImpl(unsigned long)::$_4&&) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/type_traits:3519:1 (clickhouse+0x11ab538b) #15 void std::__1::__invoke_void_return_wrapper<void>::__call<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long)::$_4>(DB::PipelineExecutor::executeImpl(unsigned long)::$_4&&)::'lambda'()&>(DB::PipelineExecutor::executeImpl(unsigned long)::$_4&&...) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/__functional_base:348:9 (clickhouse+0x11ab538b) #16 std::__1::__function::__alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long)::$_4>(DB::PipelineExecutor::executeImpl(unsigned long)::$_4&&)::'lambda'(), std::__1::allocator<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long)::$_4>(DB::PipelineExecutor::executeImpl(unsigned long)::$_4&&)::'lambda'()>, void ()>::operator()() /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/functional:1540:16 (clickhouse+0x11ab538b) #17 std::__1::__function::__func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long)::$_4>(DB::PipelineExecutor::executeImpl(unsigned long)::$_4&&)::'lambda'(), std::__1::allocator<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long)::$_4>(DB::PipelineExecutor::executeImpl(unsigned long)::$_4&&)::'lambda'()>, void ()>::operator()() /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/functional:1714:12 (clickhouse+0x11ab538b) #18 std::__1::__function::__value_func<void ()>::operator()() const /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/functional:1867:16 (clickhouse+0x8346263) #19 std::__1::function<void ()>::operator()() const /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/functional:2473:12 (clickhouse+0x8346263) #20 ThreadPoolImpl<std::__1::thread>::worker(std::__1::__list_iterator<std::__1::thread, void*>) /build/obj-x86_64-linux-gnu/../src/Common/ThreadPool.cpp:236:17 (clickhouse+0x8346263) #21 void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, int, std::__1::optional<unsigned long>)::'lambda1'()::operator()() const /build/obj-x86_64-linux-gnu/../src/Common/ThreadPool.cpp:117:73 (clickhouse+0x8349ea8) #22 decltype(std::__1::forward<void>(fp)(std::__1::forward<void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, int, std::__1::optional<unsigned long>)::'lambda1'()>(fp0)...)) std::__1::__invoke<void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, int, std::__1::optional<unsigned long>)::'lambda1'()>(void&&, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, int, std::__1::optional<unsigned long>)::'lambda1'()&&...) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/type_traits:3519:1 (clickhouse+0x8349ea8) #23 void std::__1::__thread_execute<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct> >, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, int, std::__1::optional<unsigned long>)::'lambda1'()>(std::__1::tuple<void, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, int, std::__1::optional<unsigned long>)::'lambda1'()>&, std::__1::__tuple_indices<>) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/thread:273:5 (clickhouse+0x8349ea8) #24 void* std::__1::__thread_proxy<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct> >, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, int, std::__1::optional<unsigned long>)::'lambda1'()> >(void*) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/thread:284:5 (clickhouse+0x8349ea8) Previous read of size 1 at 0x7b50008c25c2 by thread T91: #0 DB::RemoteSource::generate() /build/obj-x86_64-linux-gnu/../src/Processors/Sources/RemoteSource.cpp:35:9 (clickhouse+0x11c1fb9e) #1 DB::ISource::work() /build/obj-x86_64-linux-gnu/../src/Processors/ISource.cpp:48:31 (clickhouse+0x11a6c852) #2 DB::SourceWithProgress::work() /build/obj-x86_64-linux-gnu/../src/Processors/Sources/SourceWithProgress.cpp:36:30 (clickhouse+0x11c26d1a) #3 DB::executeJob(DB::IProcessor*) /build/obj-x86_64-linux-gnu/../src/Processors/Executors/PipelineExecutor.cpp:78:20 (clickhouse+0x11ab4836) #4 DB::PipelineExecutor::addJob(DB::ExecutingGraph::Node*)::$_0::operator()() const /build/obj-x86_64-linux-gnu/../src/Processors/Executors/PipelineExecutor.cpp:95:13 (clickhouse+0x11ab4836) #5 decltype(std::__1::forward<DB::PipelineExecutor::addJob(DB::ExecutingGraph::Node*)::$_0&>(fp)()) std::__1::__invoke<DB::PipelineExecutor::addJob(DB::ExecutingGraph::Node*)::$_0&>(DB::PipelineExecutor::addJob(DB::ExecutingGraph::Node*)::$_0&) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/type_traits:3519:1 (clickhouse+0x11ab4836) #6 void std::__1::__invoke_void_return_wrapper<void>::__call<DB::PipelineExecutor::addJob(DB::ExecutingGraph::Node*)::$_0&>(DB::PipelineExecutor::addJob(DB::ExecutingGraph::Node*)::$_0&) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/__functional_base:348:9 (clickhouse+0x11ab4836) #7 std::__1::__function::__alloc_func<DB::PipelineExecutor::addJob(DB::ExecutingGraph::Node*)::$_0, std::__1::allocator<DB::PipelineExecutor::addJob(DB::ExecutingGraph::Node*)::$_0>, void ()>::operator()() /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/functional:1540:16 (clickhouse+0x11ab4836) #8 std::__1::__function::__func<DB::PipelineExecutor::addJob(DB::ExecutingGraph::Node*)::$_0, std::__1::allocator<DB::PipelineExecutor::addJob(DB::ExecutingGraph::Node*)::$_0>, void ()>::operator()() /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/functional:1714:12 (clickhouse+0x11ab4836) #9 std::__1::__function::__value_func<void ()>::operator()() const /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/functional:1867:16 (clickhouse+0x11ab2801) #10 std::__1::function<void ()>::operator()() const /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/functional:2473:12 (clickhouse+0x11ab2801) #11 DB::PipelineExecutor::executeStepImpl(unsigned long, unsigned long, std::__1::atomic<bool>*) /build/obj-x86_64-linux-gnu/../src/Processors/Executors/PipelineExecutor.cpp:561:17 (clickhouse+0x11ab2801) #12 DB::PipelineExecutor::executeSingleThread(unsigned long, unsigned long) /build/obj-x86_64-linux-gnu/../src/Processors/Executors/PipelineExecutor.cpp:477:5 (clickhouse+0x11ab538b) #13 DB::PipelineExecutor::executeImpl(unsigned long)::$_4::operator()() const /build/obj-x86_64-linux-gnu/../src/Processors/Executors/PipelineExecutor.cpp:736:21 (clickhouse+0x11ab538b) #14 decltype(std::__1::forward<DB::PipelineExecutor::executeImpl(unsigned long)::$_4&>(fp)()) std::__1::__invoke_constexpr<DB::PipelineExecutor::executeImpl(unsigned long)::$_4&>(DB::PipelineExecutor::executeImpl(unsigned long)::$_4&) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/type_traits:3525:1 (clickhouse+0x11ab538b) #15 decltype(auto) std::__1::__apply_tuple_impl<DB::PipelineExecutor::executeImpl(unsigned long)::$_4&, std::__1::tuple<>&>(DB::PipelineExecutor::executeImpl(unsigned long)::$_4&, std::__1::tuple<>&, std::__1::__tuple_indices<>) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/tuple:1415:1 (clickhouse+0x11ab538b) #16 decltype(auto) std::__1::apply<DB::PipelineExecutor::executeImpl(unsigned long)::$_4&, std::__1::tuple<>&>(DB::PipelineExecutor::executeImpl(unsigned long)::$_4&, std::__1::tuple<>&) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/tuple:1424:1 (clickhouse+0x11ab538b) #17 ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long)::$_4>(DB::PipelineExecutor::executeImpl(unsigned long)::$_4&&)::'lambda'()::operator()() /build/obj-x86_64-linux-gnu/../src/Common/ThreadPool.h:178:13 (clickhouse+0x11ab538b) #18 decltype(std::__1::forward<DB::PipelineExecutor::executeImpl(unsigned long)::$_4>(fp)()) std::__1::__invoke<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long)::$_4>(DB::PipelineExecutor::executeImpl(unsigned long)::$_4&&)::'lambda'()&>(DB::PipelineExecutor::executeImpl(unsigned long)::$_4&&) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/type_traits:3519:1 (clickhouse+0x11ab538b) #19 void std::__1::__invoke_void_return_wrapper<void>::__call<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long)::$_4>(DB::PipelineExecutor::executeImpl(unsigned long)::$_4&&)::'lambda'()&>(DB::PipelineExecutor::executeImpl(unsigned long)::$_4&&...) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/__functional_base:348:9 (clickhouse+0x11ab538b) #20 std::__1::__function::__alloc_func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long)::$_4>(DB::PipelineExecutor::executeImpl(unsigned long)::$_4&&)::'lambda'(), std::__1::allocator<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long)::$_4>(DB::PipelineExecutor::executeImpl(unsigned long)::$_4&&)::'lambda'()>, void ()>::operator()() /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/functional:1540:16 (clickhouse+0x11ab538b) #21 std::__1::__function::__func<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long)::$_4>(DB::PipelineExecutor::executeImpl(unsigned long)::$_4&&)::'lambda'(), std::__1::allocator<ThreadFromGlobalPool::ThreadFromGlobalPool<DB::PipelineExecutor::executeImpl(unsigned long)::$_4>(DB::PipelineExecutor::executeImpl(unsigned long)::$_4&&)::'lambda'()>, void ()>::operator()() /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/functional:1714:12 (clickhouse+0x11ab538b) #22 std::__1::__function::__value_func<void ()>::operator()() const /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/functional:1867:16 (clickhouse+0x8346263) #23 std::__1::function<void ()>::operator()() const /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/functional:2473:12 (clickhouse+0x8346263) #24 ThreadPoolImpl<std::__1::thread>::worker(std::__1::__list_iterator<std::__1::thread, void*>) /build/obj-x86_64-linux-gnu/../src/Common/ThreadPool.cpp:236:17 (clickhouse+0x8346263) #25 void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, int, std::__1::optional<unsigned long>)::'lambda1'()::operator()() const /build/obj-x86_64-linux-gnu/../src/Common/ThreadPool.cpp:117:73 (clickhouse+0x8349ea8) #26 decltype(std::__1::forward<void>(fp)(std::__1::forward<void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, int, std::__1::optional<unsigned long>)::'lambda1'()>(fp0)...)) std::__1::__invoke<void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, int, std::__1::optional<unsigned long>)::'lambda1'()>(void&&, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, int, std::__1::optional<unsigned long>)::'lambda1'()&&...) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/type_traits:3519:1 (clickhouse+0x8349ea8) #27 void std::__1::__thread_execute<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct> >, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, int, std::__1::optional<unsigned long>)::'lambda1'()>(std::__1::tuple<void, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, int, std::__1::optional<unsigned long>)::'lambda1'()>&, std::__1::__tuple_indices<>) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/thread:273:5 (clickhouse+0x8349ea8) #28 void* std::__1::__thread_proxy<std::__1::tuple<std::__1::unique_ptr<std::__1::__thread_struct, std::__1::default_delete<std::__1::__thread_struct> >, void ThreadPoolImpl<std::__1::thread>::scheduleImpl<void>(std::__1::function<void ()>, int, std::__1::optional<unsigned long>)::'lambda1'()> >(void*) /build/obj-x86_64-linux-gnu/../contrib/libcxx/include/thread:284:5 (clickhouse+0x8349ea8)

…or-merge-table-function-2 Fix access rights required for the merge() table function #2.

commit 17331d2732d3de57870db222a2dc80441aa6febd Author: myrrc <[email protected]> Date: Fri Dec 18 18:51:05 2020 +0300 another fix commit 61e189d84bff6a32acbe15b3ea9ed92a9cc98890 Author: myrrc <[email protected]> Date: Fri Dec 18 18:50:05 2020 +0300 another fix commit cb2ddc7d01c810939cc24781e9511da7cf5d5294 Merge: 0e235d35f8 985876b737 Author: myrrc <[email protected]> Date: Fri Dec 18 18:49:18 2020 +0300 aMerge branch 'improvement/multiply-decimals-and-floats' of github:myrrc/clickhouse into improvement/multiply-decimals-and-floats commit 0e235d35f80af6298c5373602c065969474dccfc Author: myrrc <[email protected]> Date: Fri Dec 18 18:48:37 2020 +0300 aa commit 985876b737d8564a2850e54cefa88063c6da2f2d Author: myrrc <[email protected]> Date: Fri Dec 18 18:37:00 2020 +0300 another fix commit e2556659e04c705e370e5ac5c79e06b84d1a27a8 Author: myrrc <[email protected]> Date: Fri Dec 18 18:28:21 2020 +0300 fix3 commit a19934886028e6a8bf5320f15eea056c5fad3eb5 Author: myrrc <[email protected]> Date: Fri Dec 18 18:26:58 2020 +0300 fix2 commit fbaa8d3951f4f6056e92ab68adf6647dc2cc5caf Author: myrrc <[email protected]> Date: Fri Dec 18 18:24:31 2020 +0300 fix commit ed6d74b21837532773a3eaf870e3b6abb5547725 Author: myrrc <[email protected]> Date: Fri Dec 18 18:21:10 2020 +0300 another bad solution commit 6f1c0b118aea3ba96af3ba1a882c0fa4e6417316 Author: myrrc <[email protected]> Date: Fri Dec 18 18:17:03 2020 +0300 typo commit 0dca8562373c495ba9170ecac3bf298df022927e Author: myrrc <[email protected]> Date: Fri Dec 18 18:16:38 2020 +0300 solution fix commit d22d045a59a8e2db0b7bff0f4bd9f11ac48aa48f Author: myrrc <[email protected]> Date: Fri Dec 18 18:12:31 2020 +0300 fixed the impl commit 9d24cafccdaadf9803d02183a5af4a0856b407aa Author: myrrc <[email protected]> Date: Fri Dec 18 18:06:24 2020 +0300 added vector mult branch commit 7611f8d15b13130b2374a5f0025ed5907e77c29e Author: myrrc <[email protected]> Date: Fri Dec 18 17:54:48 2020 +0300 compile fix commit 6b956a2a0dbcf0b80ef976116006d14db60abebe Author: myrrc <[email protected]> Date: Fri Dec 18 17:50:16 2020 +0300 possible fix for non-const mult commit 58ef4c34c070c08a7f9b6cc5fd337b91781f6141 Author: myrrc <[email protected]> Date: Fri Dec 18 17:44:24 2020 +0300 prep for debug version commit 3c01cfe630bb24a24d91583d7137d57be49cb5b4 Author: myrrc <[email protected]> Date: Fri Dec 18 17:34:51 2020 +0300 no scale added commit fa1f7f40f5875b6e538c9779ae5f4b0258c44c46 Author: myrrc <[email protected]> Date: Fri Dec 18 17:32:44 2020 +0300 another try commit 6488846c9200c92629953bde0e6412a83fbdae14 Author: myrrc <[email protected]> Date: Fri Dec 18 17:23:51 2020 +0300 signature fix commit bc651b304750d28ca722430ad3b4c433b8ab82eb Author: myrrc <[email protected]> Date: Fri Dec 18 17:21:32 2020 +0300 added the suboptimal solution commit 764d4622886384b5a60229bb2a1c88d5eeac5764 Author: myrrc <[email protected]> Date: Fri Dec 18 17:16:54 2020 +0300 updated test with possible right values commit 611d400106040e5099dc47a4b7ec71f807a9f324 Author: myrrc <[email protected]> Date: Fri Dec 18 17:13:15 2020 +0300 fixed compile error commit 6c91b3dba0945a0aa40288291c2c93727ff69c59 Author: myrrc <[email protected]> Date: Fri Dec 18 17:10:37 2020 +0300 added explicit scale calc commit 1f105145994d55e903a2e0343ddaa2e706a92ff6 Author: myrrc <[email protected]> Date: Fri Dec 18 17:02:02 2020 +0300 another attempt commit 07bc3a2a4d26b6be743e511aac4dfddfb343ee97 Author: myrrc <[email protected]> Date: Fri Dec 18 16:49:00 2020 +0300 reverted the overengineering commit c4ea410a4da0872035f3ec0a0f57b87aa66999a3 Author: myrrc <[email protected]> Date: Fri Dec 18 16:45:44 2020 +0300 updated the comments and branches commit 15f0915ad32913a0032b497acad3367937cf2416 Author: myrrc <[email protected]> Date: Fri Dec 18 16:35:37 2020 +0300 replaced ternary if commit 84013d253dff75b1f522ac1756fb8c966a51f88c Author: myrrc <[email protected]> Date: Fri Dec 18 16:33:00 2020 +0300 fix: ternary if commit f34c0500dbd9b3d9af75be1151238cd3668e9b1e Author: myrrc <[email protected]> Date: Fri Dec 18 16:29:53 2020 +0300 enlarged the test, updated scales calc commit d4f8c46210fce2491cd4ad49e41f9e1bf82d0170 Author: myrrc <[email protected]> Date: Fri Dec 18 16:04:19 2020 +0300 fixed the test commit 283268c50feefcadfe914a286361d96d4c248f4b Merge: 5b6143bf2f 6a9397a64b Author: myrrc <[email protected]> Date: Fri Dec 18 15:42:39 2020 +0300 Merge branch 'improvement/multiply-decimals-and-floats' of github:myrrc/clickhouse into improvement/multiply-decimals-and-floats commit 5b6143bf2f3281a9e57f9316cf7c8c313f1b8ee6 Author: myrrc <[email protected]> Date: Fri Dec 18 15:42:12 2020 +0300 fix style error commit 05abfb04bde8685588886c75aff415c4d7aad001 Merge: a50e9548fd 26637bd7ee Author: myrrc <[email protected]> Date: Fri Dec 18 15:42:01 2020 +0300 Merge remote-tracking branch 'upstream/master' into improvement/multiply-decimals-and-floats commit 26637bd7ee690fdbe902b4cfd076edb51dadc076 Merge: 0d9519a0a2 911a1cd48f Author: alesapin <[email protected]> Date: Fri Dec 18 12:41:16 2020 +0300 Merge pull request #17943 from ClickHouse/try_rewrite_writer Small simplification of MergeTreeDataWriter commit 0d9519a0a2ca464e752b2593f7b061cb63eca4a4 Merge: 6ee2ada592 e4433157e7 Author: alexey-milovidov <[email protected]> Date: Fri Dec 18 08:08:26 2020 +0300 Merge pull request #17567 from ClickHouse/insert_quorum_parallel-default Insert quorum parallel by default commit 6ee2ada592a7015bebeee21320dfb90a58d8a934 Merge: 55604bde47 fb3d235e84 Author: alexey-milovidov <[email protected]> Date: Fri Dec 18 08:07:46 2020 +0300 Merge pull request #18204 from ClickHouse/remove-strerror Do not use non thread-safe function `strerror` commit 55604bde47f52e72998a1c3adaf50d4d1e1dfb68 Author: Alexey Milovidov <[email protected]> Date: Fri Dec 18 08:07:09 2020 +0300 Whitespaces commit c343fa1ae4322f408f9ce42c58539e3a5269df2a Merge: 6a5ce2eea7 4a1618d0b8 Author: alexey-milovidov <[email protected]> Date: Fri Dec 18 08:03:11 2020 +0300 Merge pull request #18202 from ClickHouse/update-libc-headers-2 Update libc headers commit 6a5ce2eea7378e2378b54812aa176680b663455a Author: alexey-milovidov <[email protected]> Date: Fri Dec 18 07:58:56 2020 +0300 Update config.xml commit 44734a829ea4add9ba88be3844408c1a1484f8e5 Merge: aa7793e38f b4a59aecfe Author: alexey-milovidov <[email protected]> Date: Fri Dec 18 06:39:35 2020 +0300 Merge pull request #18207 from ClickHouse/better-config Better config: example ports, security advices commit b4a59aecfe7a74e74cc8921be5e2d2454fdfc6d7 Author: alexey-milovidov <[email protected]> Date: Fri Dec 18 06:39:21 2020 +0300 Update config.xml commit aa7793e38f7bdc2de2878787c7f5b0f58675494a Merge: 8bc9d8ed7e d198f03301 Author: Nikita Mikhaylov <[email protected]> Date: Fri Dec 18 01:54:42 2020 +0300 Merge pull request #18084 from nikitamikhaylov/fix-arcadia-third Try to fix Arcadia commit 8bc9d8ed7e7140c66d5da9c56c79aaeb357d89f1 Merge: 6fc3ca8b7b 52ef4289fe Author: tavplubix <[email protected]> Date: Fri Dec 18 01:50:32 2020 +0300 Merge pull request #18198 from ClickHouse/materialize_mysql_optimize_on_insert Enable optimize_on_insert for MaterializeMySQL commit 6a9397a64bc7c3d71520d515d917a13ceab476f3 Author: alexey-milovidov <[email protected]> Date: Fri Dec 18 01:35:37 2020 +0300 Update FunctionBinaryArithmetic.h commit a50e9548fd25eb9783844e181eff44cbc215cd17 Merge: 43348bd708 0462340d8a Author: myrrc <[email protected]> Date: Fri Dec 18 01:26:23 2020 +0300 Merge branch 'improvement/multiply-decimals-and-floats' of github:myrrc/clickhouse into improvement/multiply-decimals-and-floats commit 43348bd7087b7f46b36ec60d4890287d4de78144 Author: myrrc <[email protected]> Date: Fri Dec 18 01:25:30 2020 +0300 fixed the possible values case commit 0462340d8a6c02a455b254cd12a6beb4c759c3d0 Author: alexey-milovidov <[email protected]> Date: Fri Dec 18 01:03:25 2020 +0300 Update FunctionBinaryArithmetic.h commit 5a78eafb0547b53df329c9a2b4fb7d3d1d8d7b6b Author: alexey-milovidov <[email protected]> Date: Fri Dec 18 00:59:39 2020 +0300 Update FunctionBinaryArithmetic.h commit 40c702c54a4d676fef6ce22b583a4523c287af2f Author: alexey-milovidov <[email protected]> Date: Fri Dec 18 00:56:42 2020 +0300 Update multiply.cpp commit 6fc3ca8b7b42879d36a9dfd1756b9eb772128814 Merge: 8140fbd0fb 0c04a263e5 Author: alexey-milovidov <[email protected]> Date: Fri Dec 18 00:45:27 2020 +0300 Merge pull request #16724 from kitaisreal/added-function-accurate-cast-or-null Added function accurateCastOrNull, allow different types inside IN subquery commit 92d8840ae5ae49e95341b9eb39061a455fa6e6d5 Author: Alexey Milovidov <[email protected]> Date: Fri Dec 18 00:31:09 2020 +0300 Better config: example ports, security advices commit 8140fbd0fb5b177f8d862306fb9dacd2c6254cb2 Merge: 799997db35 aecdd02be4 Author: alesapin <[email protected]> Date: Fri Dec 18 00:22:19 2020 +0300 Merge pull request #18200 from ClickHouse/more_logs_during_quorum More logs during quorum insert commit fe1b39625664c7397d7c0f18f650a1a605be2f35 Author: myrrc <[email protected]> Date: Fri Dec 18 00:14:06 2020 +0300 added test reference commit bf5e836414f68f49d363708c8d32b0a9f0d576cc Author: myrrc <[email protected]> Date: Fri Dec 18 00:03:45 2020 +0300 updated the test commit 7db7a9ef5b2727196f037af3e5d4f0834fbdc3cf Author: myrrc <[email protected]> Date: Thu Dec 17 23:55:59 2020 +0300 added another constexpr branch commit 205db4fa92a3f9086fc154997a9dc283719aefbb Author: myrrc <[email protected]> Date: Thu Dec 17 23:50:59 2020 +0300 fixed the scale bug, added the test (wo reference) commit b5e6b233eea10c5ba62ea615492f50b7363bf114 Merge: 4f7d019a9e 61d9d213e9 Author: myrrc <[email protected]> Date: Thu Dec 17 23:20:14 2020 +0300 Merge branch 'improvement/multiply-decimals-and-floats' of github:myrrc/clickhouse into improvement/multiply-decimals-and-floats commit 4f7d019a9ebd22b06b3607895a2160fb78c41f4a Author: myrrc <[email protected]> Date: Thu Dec 17 23:19:57 2020 +0300 Squashed commit of the following: commit 61d9d213e91f7fbc0381a2ef81b1e941d7fd2506 Author: myrrc <[email protected]> Date: Thu Dec 17 23:14:02 2020 +0300 fixed another variable init commit 73f3195fe17610f814453b27c8f4bbd15a54820d Author: myrrc <[email protected]> Date: Thu Dec 17 23:12:41 2020 +0300 fixed variable init commit 488f4ef42e90988667f77ec5b6d7e25fef9a3a03 Author: myrrc <[email protected]> Date: Thu Dec 17 23:09:33 2020 +0300 fixed compile condition commit e50af17545827eb9ef657ff7d17c319afb17428e Author: myrrc <[email protected]> Date: Thu Dec 17 23:05:10 2020 +0300 fixed template args1 commit f93385dcf01697a3cd5e77d8ef7f5b69aa8c90ac Author: myrrc <[email protected]> Date: Thu Dec 17 23:01:29 2020 +0300 replaced lambda with helper function commit 5974e784c29b54c59b1d84a1cecd1049cbc5e5a5 Author: myrrc <[email protected]> Date: Thu Dec 17 22:52:52 2020 +0300 added the conversion func commit 6eecef35a6b09f1d83f5e1c75db8200d4a438fe5 Author: myrrc <[email protected]> Date: Thu Dec 17 22:35:46 2020 +0300 fixed result type trait commit 31e3ca16703e06b5ac5cd3bc39631d0dfdaa12cc Author: myrrc <[email protected]> Date: Thu Dec 17 22:26:15 2020 +0300 restored type signature commit 613f4e0f04405a9ce5901f36f82935e32c1ca03b Author: myrrc <[email protected]> Date: Thu Dec 17 22:24:09 2020 +0300 removed explicit types commit 1c52842e835a661a9fb36693a45ff70a1be96633 Author: myrrc <[email protected]> Date: Thu Dec 17 22:21:23 2020 +0300 simplified the condition commit c61af32360f95b5cffa8827b77e603fcb7c01740 Author: myrrc <[email protected]> Date: Thu Dec 17 22:12:12 2020 +0300 fixed const column branch commit fd1d24c928acdcf8d0009ba975209fc2876ebfd0 Author: myrrc <[email protected]> Date: Thu Dec 17 22:10:33 2020 +0300 fixed overflow check commit b428f8fcd88c8bcc29fe3aac86361df672d5d0e4 Author: myrrc <[email protected]> Date: Thu Dec 17 22:01:04 2020 +0300 fixed scales commit 39c82fe50cb3652ae1f426650634bb89468023f5 Author: myrrc <[email protected]> Date: Thu Dec 17 21:52:19 2020 +0300 fixed result type commit 54887dacbf2a1243e1dc70dee259787141592ab2 Author: myrrc <[email protected]> Date: Thu Dec 17 21:38:36 2020 +0300 fix scale init commit 3e9428515c28aa6b9f73fa1a9ff02f7115f913a8 Author: myrrc <[email protected]> Date: Thu Dec 17 21:36:15 2020 +0300 fix deleted constuctor commit ea2da764f6bd4e1500adaebfc9794879bf414526 Author: myrrc <[email protected]> Date: Thu Dec 17 21:33:51 2020 +0300 fixed result data type init commit 1f67b0ce8d68693262a6e714d5c9f2f40b74c9a1 Author: myrrc <[email protected]> Date: Thu Dec 17 21:28:51 2020 +0300 reverting if constexpr commit 494e9066c33c9949d2063f8a63ce1f31120c8805 Author: myrrc <[email protected]> Date: Thu Dec 17 21:17:38 2020 +0300 fixing first compile bug commit d24fc58c94e270f48834451f4807aba10fe330fc Author: myrrc <[email protected]> Date: Thu Dec 17 21:12:24 2020 +0300 case fix 2 commit 9f217c5df57e6fe8d8ca5d823d4889e39830ffc1 Author: myrrc <[email protected]> Date: Thu Dec 17 21:11:39 2020 +0300 case fix commit fa6a1d3b4a70f3217df426934b14de4c6a166e6d Author: myrrc <[email protected]> Date: Thu Dec 17 20:55:35 2020 +0300 fix commit af8a72a45f2162f69c3cc0034af607cc17d288f9 Author: myrrc <[email protected]> Date: Thu Dec 17 20:16:37 2020 +0300 fix commit 737d4fc22fd2565e5551b15f6cd96aa419a271cd Author: myrrc <[email protected]> Date: Thu Dec 17 19:43:29 2020 +0300 debug fix commit fcacf5c510c1ea34f3980863c92b34a191523f7d Author: myrrc <[email protected]> Date: Thu Dec 17 19:31:54 2020 +0300 another try commit 49f3b71b5f1c731c98eb0d90421bef968a675e64 Author: myrrc <[email protected]> Date: Thu Dec 17 18:48:22 2020 +0300 another fix commit 0d319c8c612285fc249a6aea9382e9aad3b8e7c4 Author: myrrc <[email protected]> Date: Thu Dec 17 18:47:14 2020 +0300 fix commit 9d5998fd10812ae4cf6b786dbe11fb947b6ec35b Author: myrrc <[email protected]> Date: Thu Dec 17 18:46:01 2020 +0300 added debug info commit 17d996054ecd77d59246a26b48ff3f2436c17d3a Author: myrrc <[email protected]> Date: Wed Dec 16 18:47:24 2020 +0300 style fix commit 02baaddc13b5cb40f77b44bcc104421030963012 Author: myrrc <[email protected]> Date: Wed Dec 16 18:20:41 2020 +0300 removed some casts commit 799997db35856f1a71329bc6a14cc53348b34d1f Merge: 30c98adde4 832d99515b Author: alesapin <[email protected]> Date: Thu Dec 17 23:16:58 2020 +0300 Merge pull request #16621 from arenadata/ADQM-148 HDFS configuration and Kerberos Authenticaiton commit 61d9d213e91f7fbc0381a2ef81b1e941d7fd2506 Author: myrrc <[email protected]> Date: Thu Dec 17 23:14:02 2020 +0300 fixed another variable init commit 30c98adde46e6d242d8bc27e075d68c4177c06f1 Author: alesapin <[email protected]> Date: Thu Dec 17 23:13:49 2020 +0300 Fix local variable in clickhouse-test commit 73f3195fe17610f814453b27c8f4bbd15a54820d Author: myrrc <[email protected]> Date: Thu Dec 17 23:12:41 2020 +0300 fixed variable init commit 488f4ef42e90988667f77ec5b6d7e25fef9a3a03 Author: myrrc <[email protected]> Date: Thu Dec 17 23:09:33 2020 +0300 fixed compile condition commit e50af17545827eb9ef657ff7d17c319afb17428e Author: myrrc <[email protected]> Date: Thu Dec 17 23:05:10 2020 +0300 fixed template args1 commit f93385dcf01697a3cd5e77d8ef7f5b69aa8c90ac Author: myrrc <[email protected]> Date: Thu Dec 17 23:01:29 2020 +0300 replaced lambda with helper function commit b9c537ac37facaf84ef2beafd933c48027c61cac Merge: d9125a4822 da18af96a3 Author: Vitaly Baranov <[email protected]> Date: Thu Dec 17 22:59:33 2020 +0300 Merge pull request #18104 from vitlibar/fix-access-rights-for-merge-table-function-2 Fix access rights required for the merge() table function #2. commit d9125a4822109d2f60f35ee96222c77c73e00ee8 Merge: dbfe50c0c1 72df75fc50 Author: Vitaly Baranov <[email protected]> Date: Thu Dec 17 22:59:09 2020 +0300 Merge pull request #18014 from vitlibar/fix-showing-temporary-tables-in-system-tables Fix showing temporary tables in system tables commit 5974e784c29b54c59b1d84a1cecd1049cbc5e5a5 Author: myrrc <[email protected]> Date: Thu Dec 17 22:52:52 2020 +0300 added the conversion func commit dbfe50c0c1593f0bf3820cf7e36107c31c12a167 Merge: 82ed528d98 a207e3db75 Author: alesapin <[email protected]> Date: Thu Dec 17 22:52:15 2020 +0300 Merge pull request #18199 from ClickHouse/add_one_more_test_in_util Add one more case in zk test util commit 82ed528d980b9b021eafe7ffb94cb7e89f6c0b6f Merge: f82274a722 fa266790b4 Author: alesapin <[email protected]> Date: Thu Dec 17 22:51:52 2020 +0300 Merge pull request #18191 from ClickHouse/hard_watches_test Test watches for in-memory zookeeper commit e4433157e7daf43fb57123818f2f88fa3d72a7bc Merge: c2b0f9d530 f82274a722 Author: Alexey Milovidov <[email protected]> Date: Thu Dec 17 22:42:32 2020 +0300 Merge branch 'master' into insert_quorum_parallel-default commit c2b0f9d5306831fca199dcc9275925dcd496461e Author: Alexey Milovidov <[email protected]> Date: Thu Dec 17 22:42:15 2020 +0300 Update integration test commit 6eecef35a6b09f1d83f5e1c75db8200d4a438fe5 Author: myrrc <[email protected]> Date: Thu Dec 17 22:35:46 2020 +0300 fixed result type trait commit f82274a72297e863e38dc94d636fe2d7bd5f5d57 Merge: e9d97160f4 fd7fe0f84c Author: alexey-milovidov <[email protected]> Date: Thu Dec 17 22:34:05 2020 +0300 Merge pull request #16527 from kitaisreal/mmap-read-buffer-from-file-descriptor-use-getpagesize MMapReadBufferFromFileDescriptor use getpagesize commit e9d97160f4431e5b460ca77c1851146d24981791 Merge: dd78c9dc75 f7f8ff8758 Author: alexey-milovidov <[email protected]> Date: Thu Dec 17 22:28:22 2020 +0300 Merge pull request #16346 from ClickHouse/sigaltstack Provide diagnostics on stack overflow commit 31e3ca16703e06b5ac5cd3bc39631d0dfdaa12cc Author: myrrc <[email protected]> Date: Thu Dec 17 22:26:15 2020 +0300 restored type signature commit 613f4e0f04405a9ce5901f36f82935e32c1ca03b Author: myrrc <[email protected]> Date: Thu Dec 17 22:24:09 2020 +0300 removed explicit types commit 1c52842e835a661a9fb36693a45ff70a1be96633 Author: myrrc <[email protected]> Date: Thu Dec 17 22:21:23 2020 +0300 simplified the condition commit f7f8ff8758615dcdc923ce45ec327e7f2b1cd29c Merge: 01d3aef890 dd78c9dc75 Author: Alexey Milovidov <[email protected]> Date: Thu Dec 17 22:16:30 2020 +0300 Merge branch 'master' into sigaltstack commit c61af32360f95b5cffa8827b77e603fcb7c01740 Author: myrrc <[email protected]> Date: Thu Dec 17 22:12:12 2020 +0300 fixed const column branch commit fd1d24c928acdcf8d0009ba975209fc2876ebfd0 Author: myrrc <[email protected]> Date: Thu Dec 17 22:10:33 2020 +0300 fixed overflow check commit 0c04a263e539ce530bc7a4ea98f57b2c59f35919 Author: Maksim Kita <[email protected]> Date: Thu Dec 17 22:04:26 2020 +0300 Fixed ya.make commit b428f8fcd88c8bcc29fe3aac86361df672d5d0e4 Author: myrrc <[email protected]> Date: Thu Dec 17 22:01:04 2020 +0300 fixed scales commit 39c82fe50cb3652ae1f426650634bb89468023f5 Author: myrrc <[email protected]> Date: Thu Dec 17 21:52:19 2020 +0300 fixed result type commit 54887dacbf2a1243e1dc70dee259787141592ab2 Author: myrrc <[email protected]> Date: Thu Dec 17 21:38:36 2020 +0300 fix scale init commit 3e9428515c28aa6b9f73fa1a9ff02f7115f913a8 Author: myrrc <[email protected]> Date: Thu Dec 17 21:36:15 2020 +0300 fix deleted constuctor commit ea2da764f6bd4e1500adaebfc9794879bf414526 Author: myrrc <[email protected]> Date: Thu Dec 17 21:33:51 2020 +0300 fixed result data type init commit 9aaa2f934580122bb3dc84950f6ca84ffa65327b Author: Maksim Kita <[email protected]> Date: Thu Dec 17 21:32:25 2020 +0300 Fixed compilation timeout commit 1f67b0ce8d68693262a6e714d5c9f2f40b74c9a1 Author: myrrc <[email protected]> Date: Thu Dec 17 21:28:51 2020 +0300 reverting if constexpr commit fb3d235e8473d70500bf0e11788a9ec782466f37 Author: Alexey Milovidov <[email protected]> Date: Thu Dec 17 21:08:42 2020 +0300 Do not use strerror commit 494e9066c33c9949d2063f8a63ce1f31120c8805 Author: myrrc <[email protected]> Date: Thu Dec 17 21:17:38 2020 +0300 fixing first compile bug commit d24fc58c94e270f48834451f4807aba10fe330fc Author: myrrc <[email protected]> Date: Thu Dec 17 21:12:24 2020 +0300 case fix 2 commit 9f217c5df57e6fe8d8ca5d823d4889e39830ffc1 Author: myrrc <[email protected]> Date: Thu Dec 17 21:11:39 2020 +0300 case fix commit fa6a1d3b4a70f3217df426934b14de4c6a166e6d Author: myrrc <[email protected]> Date: Thu Dec 17 20:55:35 2020 +0300 fix commit dd78c9dc75ad684b4cad458a5e87f3e28d3ba775 Merge: a77acd5aa7 b25f126569 Author: alexey-milovidov <[email protected]> Date: Thu Dec 17 20:44:44 2020 +0300 Merge pull request #17566 from ClickHouse/relax-too-many-parts-1 Relax "Too many parts" threshold, part 1 commit 4a1618d0b80b6ec1d692a42a0a96ee92bbf26dbd Author: Alexey Milovidov <[email protected]> Date: Thu Dec 17 20:25:51 2020 +0300 Update libc headers commit af8a72a45f2162f69c3cc0034af607cc17d288f9 Author: myrrc <[email protected]> Date: Thu Dec 17 20:16:37 2020 +0300 fix commit 737d4fc22fd2565e5551b15f6cd96aa419a271cd Author: myrrc <[email protected]> Date: Thu Dec 17 19:43:29 2020 +0300 debug fix commit fcacf5c510c1ea34f3980863c92b34a191523f7d Author: myrrc <[email protected]> Date: Thu Dec 17 19:31:54 2020 +0300 another try commit a207e3db7555b2984275a55a2116af48ece3af48 Author: alesapin <[email protected]> Date: Thu Dec 17 19:21:46 2020 +0300 Fix bad sleep commit aecdd02be4880b262fa7d4e1cf2e6b28027c4e59 Author: alesapin <[email protected]> Date: Thu Dec 17 19:14:42 2020 +0300 Better message commit f45993cd1e4bd651b25ce73cfab1d75b775690ed Author: alesapin <[email protected]> Date: Thu Dec 17 19:13:01 2020 +0300 More logs during quorum insert commit 49f3b71b5f1c731c98eb0d90421bef968a675e64 Author: myrrc <[email protected]> Date: Thu Dec 17 18:48:22 2020 +0300 another fix commit 0d319c8c612285fc249a6aea9382e9aad3b8e7c4 Author: myrrc <[email protected]> Date: Thu Dec 17 18:47:14 2020 +0300 fix commit d198f033017dc5da327855eba62acb2657bd69cb Author: nikitamikhaylov <[email protected]> Date: Thu Dec 17 18:46:26 2020 +0300 suppress warnings commit 9d5998fd10812ae4cf6b786dbe11fb947b6ec35b Author: myrrc <[email protected]> Date: Thu Dec 17 18:46:01 2020 +0300 added debug info commit a77acd5aa753b154e475b7c6706274fbae9db8df Author: Anton Popov <[email protected]> Date: Thu Dec 17 18:12:24 2020 +0300 Fix flaky test commit e80b93939f451202e579624602ef3ec8ac596a07 Author: alesapin <[email protected]> Date: Thu Dec 17 18:09:09 2020 +0300 Add one more case in zk test uti commit cb91d64fe7a9ba589faf52a384da9f0c10392953 Author: hexiaoting <[email protected]> Date: Thu Dec 17 22:16:14 2020 +0800 Add new feature: limit length and offset setting (#17633) Co-authored-by: Alexander Kazakov <[email protected]> commit 52ef4289feca44bdd75a188c6fa558842ce6203a Author: Alexander Tokmakov <[email protected]> Date: Thu Dec 17 16:05:38 2020 +0300 enable optimize_on_insert for MaterializeMySQL commit 0f3582883c3b1b75ef96dda9ceed5c4b2e7897d1 Merge: d302685e72 8f49946a72 Author: Nikita Mikhaylov <[email protected]> Date: Thu Dec 17 15:44:55 2020 +0300 Merge pull request #18147 from kitaisreal/array-aggregation-big-integer-types-support Added array aggregation big integer types support commit d302685e726b6960b31f1df29d4f01cd5656b907 Merge: 7e73b6acd8 3e07094364 Author: Nikita Mikhaylov <[email protected]> Date: Thu Dec 17 15:12:05 2020 +0300 Merge pull request #18172 from nikitamikhaylov/julian-day-msan toModifiedJulianDayOrNull msan fix commit 3e070943644630c3297d67c878b39b5e000c60a9 Author: nikitamikhaylov <[email protected]> Date: Thu Dec 17 15:11:32 2020 +0300 style commit fa266790b42671f9b9f55354cf72c7a76498c534 Author: alesapin <[email protected]> Date: Thu Dec 17 14:29:29 2020 +0300 Better test commit 7e73b6acd874e47e3724716a8707a2b0386c70bf Merge: d82c23d5cf 294e8bbb4e Author: tavplubix <[email protected]> Date: Thu Dec 17 14:26:51 2020 +0300 Merge pull request #17642 from filimonov/detach-permanently DETACH TABLE PERMANENTLY commit b6bd84df844e3c0760847fcbe040a72eb284d61c Author: alesapin <[email protected]> Date: Thu Dec 17 14:25:59 2020 +0300 One more test for watches commit d82c23d5cf8ab49905212b0699bd43a2668fbd81 Merge: 10449695bc c6ac831d4e Author: Kruglov Pavel <[email protected]> Date: Thu Dec 17 14:00:05 2020 +0300 Merge pull request #16853 from amosbird/ss Add -SimpleState combinator commit 911a1cd48f66ba270d91b1fa8b1e3abb5b435b03 Author: alesapin <[email protected]> Date: Thu Dec 17 13:25:31 2020 +0300 Suppress gdb warning commit da18af96a33765a74cf5f762ff5d2a3623e0510b Author: Vitaly Baranov <[email protected]> Date: Thu Dec 10 23:16:53 2020 +0300 Fix access rights required for the merge() table function. commit fd7fe0f84cc53de082c530c9e133e06dd6dccff7 Author: Maksim Kita <[email protected]> Date: Thu Dec 17 12:10:46 2020 +0300 Updated ya.make commit 832d99515b4f4d68a3121579dbdeec153900af51 Author: Ilya Golshtein <[email protected]> Date: Thu Dec 17 12:05:49 2020 +0300 tag for yandex/clickhouse-kerberized-hadoop commit 72df75fc50877eee367ece609c602a9af518374f Author: Vitaly Baranov <[email protected]> Date: Fri Dec 11 23:48:27 2020 +0300 Add tests. commit af3ccb49f1e917d0f703dc9ba7102c2a6a18e29e Author: Vitaly Baranov <[email protected]> Date: Fri Dec 11 22:44:18 2020 +0300 Show create query for temporary tables in system.tables commit ede755d3bced701606b048ae7d4983c1451a3f69 Author: Vitaly Baranov <[email protected]> Date: Fri Dec 11 23:32:57 2020 +0300 Show temporary tables in system.columns as tables with empty database. commit d7a3cc8c909a6d35737968ea16b3fad2ee92190b Author: Vitaly Baranov <[email protected]> Date: Fri Dec 11 22:42:14 2020 +0300 Don't show the "_temporary_and_external_tables" database in system tables system.databases, system.tables, system.columns. commit b74e7accf15c7fe3880827ce9103a650da3c942c Author: alesapin <[email protected]> Date: Thu Dec 17 11:17:39 2020 +0300 Review fixes commit f2957d6f0545ce4aeb023bb7b71a0a49d2e888ad Merge: 1bd2f49fb5 10449695bc Author: alesapin <[email protected]> Date: Thu Dec 17 10:40:25 2020 +0300 Merge branch 'master' into try_rewrite_writer commit 10449695bc0f9dbed35b1e00303f86867d4861ce Author: Nikolai Kochetov <[email protected]> Date: Thu Dec 17 10:32:11 2020 +0300 Update boost. commit c91c5d0a686c5bfbb883318428b9c0d2c3091985 Author: Nikolai Kochetov <[email protected]> Date: Thu Dec 17 10:29:47 2020 +0300 Update boost. commit 66228f405456b74488fdb54d2fb79af9e26af567 Merge: bc0186eede 1f3702ff9e Author: alesapin <[email protected]> Date: Thu Dec 17 10:15:30 2020 +0300 Merge pull request #18065 from ClickHouse/fix_watch_race_testkeeper Remove dead list watches from TestKeeperStorage commit bc0186eede039b4c6ebe407fd427806f5bd6b28d Merge: 81c00a4e94 6c8f844442 Author: alexey-milovidov <[email protected]> Date: Thu Dec 17 07:19:04 2020 +0300 Merge pull request #18168 from ClickHouse/unknown_function_better_exception Better exception message for unknown function commit 81c00a4e94c2fc3017263aa0f6e0d4cddf219b2c Merge: b159e15b1b 76e73e4e8b Author: alexey-milovidov <[email protected]> Date: Thu Dec 17 07:18:53 2020 +0300 Merge pull request #18167 from ClickHouse/fix_checking_profile_settings_constraints Fix `Unknown setting profile` error on attempt to set settings profile commit 01d3aef89096564bf399efc8b8616fe7b3a9a48d Author: Alexey Milovidov <[email protected]> Date: Thu Dec 17 05:53:43 2020 +0300 Disable trap back commit b159e15b1b544de418344d78fe15cc856f902b4a Author: alexey-milovidov <[email protected]> Date: Thu Dec 17 05:50:04 2020 +0300 Update easy_tasks_sorted_ru.md commit 22363f6086a31f2cf7ea397b81f424a395ce23ce Author: nikitamikhaylov <[email protected]> Date: Thu Dec 17 05:29:27 2020 +0300 better commit db362e4585ae9de6c189fc8a3ea2bca7dcb5c192 Author: nikitamikhaylov <[email protected]> Date: Thu Dec 17 05:20:56 2020 +0300 done commit 4e8978e02222a2810a3e698f4203f2d12931c08e Author: Alexey Milovidov <[email protected]> Date: Thu Dec 17 05:21:27 2020 +0300 Merge with master commit 7f280bef37226f9d8dbd2873bde368206aecfb7d Merge: 2e232bad74 16e524e0de Author: Alexey Milovidov <[email protected]> Date: Thu Dec 17 05:09:10 2020 +0300 Merge branch 'master' into sigaltstack commit 7abc58526ab64ff98f13d1906c36547bdaf04da9 Author: Alexey Milovidov <[email protected]> Date: Thu Dec 17 04:55:07 2020 +0300 Update test commit 6a7c73a7bdc931d1a7f98fe543efab0970ca4dae Merge: f46eb6f2be 16e524e0de Author: Alexey Milovidov <[email protected]> Date: Thu Dec 17 04:54:17 2020 +0300 Merge branch 'master' into insert_quorum_parallel-default commit b25f126569e4870cdfcc6cba4858122ba5edd6b7 Author: Alexey Milovidov <[email protected]> Date: Thu Dec 17 04:52:27 2020 +0300 Added a test commit 9a017b77df614a2618f9ffcd706b77f970ce582d Merge: 2e6bedce91 16e524e0de Author: Alexey Milovidov <[email protected]> Date: Thu Dec 17 04:40:39 2020 +0300 Merge branch 'master' into relax-too-many-parts-1 commit d2653f91e1bbaec641c832a9764948abf3d24cf7 Merge: 792d8981ab 4edbb42ba1 Author: alexey-milovidov <[email protected]> Date: Thu Dec 17 03:40:13 2020 +0300 Merge pull request #18112 from GrigoryPervakov/join_set_s3 Use IDisk in Set and Join storages commit 792d8981ab74a58f2a909a143276ed6ef2ed8dac Merge: 37da513c36 60b916fe0b Author: alexey-milovidov <[email protected]> Date: Thu Dec 17 03:36:07 2020 +0300 Merge pull request #18115 from AnaUvarova/ana-uvarova-DOCSUP-2030-rus-faq-order DOCSUP-2030 Rus FAQ order commit 37da513c3619d14ea87c307beae3179ce0f2bc38 Merge: 484f20f77d d96ca3fb8d Author: alexey-milovidov <[email protected]> Date: Thu Dec 17 03:35:19 2020 +0300 Merge pull request #18136 from taiyang-li/explain_ast_nonselect_query Explain ast support nonselect querys commit 484f20f77d0eb6d96e312f434b4a63f8ef16d909 Merge: 908784a0d9 849db47f8a Author: alexey-milovidov <[email protected]> Date: Thu Dec 17 03:34:39 2020 +0300 Merge pull request #18140 from ClickHouse/fix_flaky_test Trying to fix 00620_optimize_on_nonleader_test commit 908784a0d982e3e09bab3876498d3047222f2f76 Merge: 2e2cc6d344 8139bab240 Author: alexey-milovidov <[email protected]> Date: Thu Dec 17 03:32:10 2020 +0300 Merge pull request #18148 from ClickHouse/suppress_error_in_test Suppress error in 00993_system_parts_race_condition_drop_zookeeper commit 71bd7e55d30d6aabf9cdf7607b828d60b8d82ae9 Author: nikitamikhaylov <[email protected]> Date: Thu Dec 17 03:15:13 2020 +0300 Bump commit 2e2cc6d344d4615b691c4c330bb5b7ff909e1ab9 Merge: a999850378 2413e82e96 Author: alexey-milovidov <[email protected]> Date: Thu Dec 17 01:19:08 2020 +0300 Merge pull request #18141 from staticor/patch-5 Update misc.md commit d70f58a98f8cf1b325823dd6c366120ce77090d8 Author: nikitamikhaylov <[email protected]> Date: Thu Dec 17 00:52:04 2020 +0300 remove ryu commit 6c8f844442102da23fb7e4cd5b7fdddb92f8cef9 Author: Alexander Tokmakov <[email protected]> Date: Thu Dec 17 00:42:14 2020 +0300 better exception message for unknown function commit 685099af7f530b75772cee40d9c3c25579a30eec Author: Maksim Kita <[email protected]> Date: Thu Dec 17 00:23:41 2020 +0300 Move getPageSize in common commit 8f49946a72b2bc9766896c732f34dce5b10db5aa Author: Maksim Kita <[email protected]> Date: Thu Dec 17 00:21:44 2020 +0300 Reused Result type commit 4b32bb323ac71948728892e275a83d0f7e55b5cc Author: Maksim Kita <[email protected]> Date: Thu Dec 17 00:04:03 2020 +0300 Fixed style issues commit 76e73e4e8b466706b0ddc3ff337b4427e0c569ff Author: Alexander Tokmakov <[email protected]> Date: Wed Dec 16 23:49:56 2020 +0300 fix 'Unknown setting profile' error commit 5a096a75b8f4e903970d5078447680e0c2b43aef Author: Maksim Kita <[email protected]> Date: Wed Dec 16 23:10:40 2020 +0300 Fixed issues with average commit 1f3702ff9eac498dec5472680e1d75ab423cf502 Merge: 422467628a a999850378 Author: alesapin <[email protected]> Date: Wed Dec 16 23:03:07 2020 +0300 Merge branch 'master' into fix_watch_race_testkeeper commit a999850378b01ffe6bc6378df4002ace98bae89a Merge: 521e3fc4ae dbbe761fa1 Author: alesapin <[email protected]> Date: Wed Dec 16 22:05:16 2020 +0300 Merge pull request #18130 from ClickHouse/fix_remove_column_ttl Fix remove TTL for column commit 521e3fc4ae26dd56cda52bd52bef7fed9a9c9df4 Merge: 170cd132da 153610b2c3 Author: Ilya Yatsishin <[email protected]> Date: Wed Dec 16 21:43:32 2020 +0300 Merge pull request #17910 from sevirov/sevirov-DOCSUP-4919-document_replication_queue_system_table DOCSUP-4919: Document the system.replication_queue system table commit 60b916fe0b72509a0151eb5fd2c0556db34a0257 Author: ana-uvarova <[email protected]> Date: Wed Dec 16 21:24:06 2020 +0300 polishing links commit 23270915d37a05491cfae7ed5b170501349524fb Author: nikitamikhaylov <[email protected]> Date: Wed Dec 16 21:03:39 2020 +0300 better commit 170cd132da9350d30cac224a937098b5cbf0e2b1 Merge: b8250882ac 95c35b318e Author: Alexander Kuzmenkov <[email protected]> Date: Wed Dec 16 20:49:43 2020 +0300 Merge pull request #18113 from azat/tld-list-symlink-fix Avoid using symlinks for top_level_domains commit b8250882ac371cff376cf0b3d46126510ad1ee3c Merge: 16e524e0de a7933ddf31 Author: alexey-milovidov <[email protected]> Date: Wed Dec 16 20:35:18 2020 +0300 Merge pull request #18056 from zhangjmruc/master Fix issue #17160 by adding show settings like '...' commit 294e8bbb4e74532af994d0118217ee5c4e4e18f0 Author: Mikhail Filimonov <[email protected]> Date: Wed Dec 16 18:16:47 2020 +0100 Fix2 commit d96ca3fb8da73ad973c7d701a0e0250b89991d35 Author: Nikolai Kochetov <[email protected]> Date: Wed Dec 16 20:11:32 2020 +0300 Fixing build. commit 16e524e0de74c0be2a6ebfe7b94e629f0e3502d0 Author: Alexey Milovidov <[email protected]> Date: Wed Dec 16 19:58:00 2020 +0300 Remove outdated info from the docs commit 422467628a1d3972d7b43117746c26e645cbf528 Merge: b347fa322c d873439846 Author: alesapin <[email protected]> Date: Wed Dec 16 19:45:57 2020 +0300 Merge branch 'master' into fix_watch_race_testkeeper commit d873439846b576cf884df01a9b23e513a918568e Merge: d30099fd78 9ad2a76d51 Author: alesapin <[email protected]> Date: Wed Dec 16 19:29:32 2020 +0300 Merge pull request #15236 from ClickHouse/run_func_tests_in_parallel Collect list of non-parallel test commit 8139bab240d2a94095707254d6a62e18910597ab Author: alesapin <[email protected]> Date: Wed Dec 16 19:12:57 2020 +0300 More relaxed check commit 9cc6fec36cf9b704858bfdf6dc06794a6813bda7 Author: alesapin <[email protected]> Date: Wed Dec 16 19:10:46 2020 +0300 Supress error in 00993_system_parts_race_condition_drop_zookeeper commit 80dbbc7e58b372f7455419b726e558a63177e936 Author: Maksim Kita <[email protected]> Date: Wed Dec 16 18:59:53 2020 +0300 Style check fix commit b82770c2ad8ef58b89aeea2b4ac4e22e2305e07c Author: Maksim Kita <[email protected]> Date: Wed Dec 16 18:47:30 2020 +0300 Added array aggregation big integer types support commit 17d996054ecd77d59246a26b48ff3f2436c17d3a Author: myrrc <[email protected]> Date: Wed Dec 16 18:47:24 2020 +0300 style fix commit 50c29d9ed007e744718725f8a1bfe94037723725 Author: nikitamikhaylov <[email protected]> Date: Wed Dec 16 18:34:29 2020 +0300 better commit d30099fd78164498432cfcf3c2917d506d4a4f2c Merge: d046164049 44d2194326 Author: Nikolai Kochetov <[email protected]> Date: Wed Dec 16 18:23:45 2020 +0300 Merge pull request #18132 from ClickHouse/try-fix-mysql-integration-test Try fix integration tests. commit d04616404937d55915faf7e38599fa3f31400776 Merge: b1dc8074ef 69ed3d1cb5 Author: alexey-milovidov <[email protected]> Date: Wed Dec 16 18:22:38 2020 +0300 Merge pull request #18128 from ClickHouse/boringssl-krb5-2 Port Kerberos to BoringSSL commit 02baaddc13b5cb40f77b44bcc104421030963012 Author: myrrc <[email protected]> Date: Wed Dec 16 18:20:41 2020 +0300 removed some casts commit f143a37693027395c873eab0e53085569508c5e1 Author: myrrc <[email protected]> Date: Wed Dec 16 18:11:26 2020 +0300 simplified case to multiply only commit f14cafee51ad974d7de3f3ab775345310976c99d Author: Mikhail Filimonov <[email protected]> Date: Wed Dec 16 16:06:43 2020 +0100 Fix tests commit d7145a5ee15fa81b64c3204a75e66d40ed70267b Author: myrrc <[email protected]> Date: Wed Dec 16 18:01:18 2020 +0300 working commit 484e6e7de4d1d1d4f95002bd4193ae4925a4fdcf Author: Maksim Kita <[email protected]> Date: Wed Dec 16 17:38:17 2020 +0300 Removed getPageSize from small files commit 849db47f8adf9423e14a79e414f8a9b05c24088b Author: alesapin <[email protected]> Date: Wed Dec 16 17:31:17 2020 +0300 Better exception messages commit b1dc8074efbc000c1509d9f2210a5343fabb77ce Merge: d99792e614 45361f752c Author: Anton Popov <[email protected]> Date: Wed Dec 16 16:58:02 2020 +0300 Merge pull request #17829 from CurtizJ/merging-map Merging data type Map #15806 commit 74ee36bdb8f40bc306323c139b6d0119839fe61b Author: ana-uvarova <[email protected]> Date: Wed Dec 16 16:39:14 2020 +0300 done commit 2413e82e9639faf90e40ad7e9f5e757db20326ae Author: Steve-金勇 <[email protected]> Date: Wed Dec 16 21:35:55 2020 +0800 Update misc.md Update translation by machine, and improve document more human-readable. commit c15f5fba3b2547b9c0a8d6b6c8eff6692e53738c Author: alesapin <[email protected]> Date: Wed Dec 16 16:16:24 2020 +0300 Fix 00620_optimize_on_nonleader_test commit b347fa322c1c19ddc3db53be4976ce13d4ceea2f Author: alesapin <[email protected]> Date: Wed Dec 16 15:58:00 2020 +0300 Trying to fix races one more time commit 5521abba1e18497c47e4d1626ce4c7a4c66b9898 Author: nikitamikhaylov <[email protected]> Date: Wed Dec 16 15:57:42 2020 +0300 fix boost commit c906b1ca769679af8bf8f0ed1db8fd80877fa416 Author: myrrc <[email protected]> Date: Wed Dec 16 15:21:23 2020 +0300 added the initial solution commit 4edbb42ba14ad7fd9bf757c1bec946f8b4f72e08 Author: Pervakov Grigorii <[email protected]> Date: Tue Dec 15 19:45:13 2020 +0300 Use IDisk in Set and Join storages commit 0a2bda002d7d94ed2931aafb1d17a6a72a5f3d44 Author: nikitamikhaylov <[email protected]> Date: Wed Dec 16 14:46:58 2020 +0300 remove last commit commit 61c1db38234f5b84bed5815d8cf6b7890863b6dc Author: nikitamikhaylov <[email protected]> Date: Wed Dec 16 14:45:40 2020 +0300 skip test commit bcd6fc1c88f334674c97a4f1fbaa7c8877893041 Author: nikitamikhaylov <[email protected]> Date: Wed Dec 16 02:53:25 2020 +0300 better commit 18d52dbc63b40784e70e57ce980b9252c37b932d Author: nikitamikhaylov <[email protected]> Date: Wed Dec 16 02:30:35 2020 +0300 better commit 20aaf48e38db2ba399ebb61aa004fcad4ffdb7bd Author: nikitamikhaylov <[email protected]> Date: Tue Dec 15 22:56:47 2020 +0300 pragmas commit 5c4e1d1db54d81acdbfa4843f81c3ffbf8ecae52 Author: nikitamikhaylov <[email protected]> Date: Tue Dec 15 20:53:10 2020 +0300 better commit 3288f1fd0cb3bbf7b316deb929b0e797d0173b4b Author: nikitamikhaylov <[email protected]> Date: Tue Dec 15 16:00:40 2020 +0300 ya make commit c3a6499f6df3e50178c301e2627147f2ec4cc723 Author: nikitamikhaylov <[email protected]> Date: Tue Dec 15 14:48:24 2020 +0300 fix ya.make commit 4ccdb3ca208a90963464b911b371aab0ed47c53b Author: nikitamikhaylov <[email protected]> Date: Tue Dec 15 06:07:43 2020 +0300 done commit a5a33f1963aa0ab18e7784f2891d692171f3e023 Author: Ilya Golshtein <[email protected]> Date: Tue Dec 15 14:52:10 2020 +0300 rpm rebuilddb and yum update in kerberized_hadoop/Dockerfile commit 39877b1a6fda55fede6aa69c59cecb4496cdd539 Author: Ilya Golshtein <[email protected]> Date: Tue Dec 15 12:46:02 2020 +0300 yum clean all in kerberized_hadoop/Dockerfile commit a4dad0acb7f326e526a91a81bad4ef6072fc10ff Author: Ilya Golshtein <[email protected]> Date: Mon Dec 14 21:35:13 2020 +0300 CentOS 6 became too old commit 09d1e896741dfd57d1ad5d56805742b8b98d922a Author: Ilya Golshtein <[email protected]> Date: Mon Dec 14 15:07:05 2020 +0300 yandex/clickhouse-kerberized-hadoop + missed header commit 407565b47f77bc8265bf3fa43ddfe365605d1c2d Author: Ilya Golshtein <[email protected]> Date: Fri Dec 11 12:16:58 2020 +0300 fix - wrong error code commit 9701d6a2d5fd1db05449f95fc5d2a12573ca488f Author: Ilya Golshtein <[email protected]> Date: Fri Dec 11 00:52:05 2020 +0300 style fix per code review, doc improvement, params consistency check commit 815856bc3d24bf553cadfce5333710d808066fc5 Author: Ilya Golshtein <[email protected]> Date: Sat Nov 28 01:17:05 2020 +0300 pass config, not context to createHDFSBuilder commit fc0a1af2141199af5315cf7453bda16dc089d45a Author: Ilya Golshtein <[email protected]> Date: Thu Nov 19 00:08:17 2020 +0300 doc minor changes, cleanup, krb5-user as a recommended package commit 7e9781485900af0240af7eabf69d7f2b537d4a78 Author: Ilya Golshtein <[email protected]> Date: Fri Oct 30 22:40:16 2020 +0300 cleanup, fixes, new submodules, ShellCommand, WriteBufferFromString commit d1d657335b62bedaf4dba7075a35131aafd1df82 Author: Ilya Golshtein <[email protected]> Date: Thu Oct 29 23:40:47 2020 +0300 USE_INTERNAL_HDFS3_LIBRARY + bash lint commit d9166a0645981bbf6c79f109b2916ae86eea0e8a Author: Ilya Golshtein <[email protected]> Date: Mon Sep 28 20:20:04 2020 +0300 HADOOP_SECURE_DN_USER way, kinit thread, docker capabilities commit eb10948ca2c928f8b10a3676162210722962db2d Author: Ilya Golshtein <[email protected]> Date: Thu Sep 10 13:02:46 2020 +0300 kerberized_hdfs cluster started commit 185ac744b1f67cfde0d7151556cc9309c1b98b46 Author: Ilya Golshtein <[email protected]> Date: Wed Sep 9 15:13:20 2020 +0300 kerberized hdfs compiled commit 7d23451e8126bb9cf19f05b56b2325a76fc19b14 Author: Maksim Kita <[email protected]> Date: Sat Oct 31 00:24:16 2020 +0300 Replaced usages of 4096 constant with getPageSize commit dbb2fbcdd54197c7689f4a5670b2834d8c24bb17 Author: Maksim Kita <[email protected]> Date: Thu Oct 29 22:52:12 2020 +0300 Unified usages of getPageSize 1. Introduced getPageSize function. 2. Replaced usages of getpagesize with getPageSize function. 3. Replaced usages of sysconf(_SG_PAGESIZE) with getPageSize function. commit 058fbd52223af7c78dac4468d5d964cc865bef50 Author: Maksim Kita <[email protected]> Date: Thu Oct 29 21:49:44 2020 +0300 MMapReadBufferFromFileDescriptor use getpagesize commit dbbe761fa10d088eb73c962e727b88f1006ace3a Author: alesapin <[email protected]> Date: Wed Dec 16 13:23:11 2020 +0300 Fix test commit cd7827f70c65b7c9042b9a722aed77b4ee3dd50b Author: taiyang-li <[email protected]> Date: Wed Dec 16 18:00:21 2020 +0800 explain ast support nonselect queries commit ea4d11cb73bef08653858207e0be5e84cde69ddf Author: alesapin <[email protected]> Date: Wed Dec 16 13:04:46 2020 +0300 Wait for connections to special servers commit 44d2194326804a36163a25c6e967b27a96cf279c Author: Nikolai Kochetov <[email protected]> Date: Wed Dec 16 11:52:04 2020 +0300 Try fix integration tests. commit 54aeb8fcff0fb50365748f33a2129aee75ee6789 Merge: 2a4a6b22b1 d99792e614 Author: alesapin <[email protected]> Date: Wed Dec 16 11:25:19 2020 +0300 Merge branch 'master' into fix_remove_column_ttl commit d99792e61404ff0ee805f7a999e3c433482476f3 Merge: 37363ae89d 86fc9ea4df Author: alesapin <[email protected]> Date: Wed Dec 16 10:54:58 2020 +0300 Merge pull request #18105 from ClickHouse/fix_docker_images Fix dependencies for docker stateful_with_coverage commit 2a4a6b22b19638d18bf51e7b83c8f0a47fd4c2fb Author: alesapin <[email protected]> Date: Wed Dec 16 10:26:18 2020 +0300 Fix remove TTL for column commit 37363ae89dd70abb8e23b6bf52bdc248c9f8bbba Author: Alexey Milovidov <[email protected]> Date: Wed Dec 16 09:43:05 2020 +0300 Comment update commit 69ed3d1cb5ba5abe7dd23f1901aa0b905f4547e5 Author: Alexey Milovidov <[email protected]> Date: Wed Dec 16 09:40:30 2020 +0300 Update submodule URL commit e3b490e9b305c2e6b16bf37271d2f13c3ca8d1d7 Author: Alexey Milovidov <[email protected]> Date: Wed Dec 16 09:36:26 2020 +0300 Port Kerberos to BoringSSL commit 42b401c89390e21537db28398d99c319c1fe0e80 Merge: 4bd5d3b662 cf35e144ff Author: alexey-milovidov <[email protected]> Date: Wed Dec 16 09:00:38 2020 +0300 Merge pull request #18127 from chienlungcheung/patch-1 Correct the unit from Kb to KB in the last section. commit cf35e144ff65c8e7ea16579dcb6451f46224214a Author: Chienlung Cheung <[email protected]> Date: Wed Dec 16 13:55:17 2020 +0800 correct the unit from Kb to KB in the last section. commit 4bd5d3b662f642d38158482a285366f318711625 Author: Alexey Milovidov <[email protected]> Date: Wed Dec 16 06:36:43 2020 +0300 Comment update commit 62ce33153a45bc3355555cc6c3a75920425fa4b2 Author: Alexey Milovidov <[email protected]> Date: Wed Dec 16 06:34:25 2020 +0300 Added valuable comment commit 88c5031dfa14f7805f0aa3a8e3570efc3cac4da7 Author: Alexey Milovidov <[email protected]> Date: Wed Dec 16 06:27:28 2020 +0300 Add a commit #16595 commit ca9ccf4850208d617085fa150b69b5ef35633925 Author: Alexey Milovidov <[email protected]> Date: Wed Dec 16 06:03:43 2020 +0300 Comment update commit a7933ddf31f26719475cb3bb10d7c8ab162cde1d Merge: b56523fd94 eed767bbab Author: jianmei zhang <[email protected]> Date: Wed Dec 16 09:38:38 2020 +0800 Merge and rebase with master commit 45361f752ca591c079888483341c1d1798b3a85f Author: Anton Popov <[email protected]> Date: Wed Dec 16 02:36:03 2020 +0300 fix test commit b485b5bd1cc7edf8a4b0a76599f040e42dc6d954 Author: Anton Popov <[email protected]> Date: Wed Dec 16 01:22:21 2020 +0300 minor fixes and comments added commit aec820362a535f30b9ab04f84117ab27e10cea91 Author: alexey-milovidov <[email protected]> Date: Wed Dec 16 00:28:53 2020 +0300 Update DecimalFunctions.h commit eed767bbab573f6f72d69f93ddc2c577539bfab2 Author: alexey-milovidov <[email protected]> Date: Wed Dec 16 00:02:44 2020 +0300 Update tips.md commit b842cb04551560ba3bb5bb0c31bc4cb2f2f271c0 Author: ana-uvarova <[email protected]> Date: Tue Dec 15 23:38:36 2020 +0300 one more try commit 4e3cc606e64abba6700dbaea7d5078ab73f0d3c0 Author: Maksim Kita <[email protected]> Date: Tue Dec 15 23:36:45 2020 +0300 Fixed tests commit 97c93fa984a4cab53620c77119c18d2e7fbe8128 Author: ana-uvarova <[email protected]> Date: Tue Dec 15 23:23:58 2020 +0300 one more try commit 86fc9ea4df3efaaef44b48d1504ef6a9599bec34 Author: alesapin <[email protected]> Date: Tue Dec 15 23:18:53 2020 +0300 Update base image to 20.04 commit 0887cf476d4e0534c648479ff1f2423aec975326 Merge: b0d27d6747 2e4aa6b9e1 Author: alesapin <[email protected]> Date: Tue Dec 15 23:09:37 2020 +0300 Merge pull request #18098 from ClickHouse/fix_clickhouse_test Fix database drop timeout in clickhouse-test commit 93b58321d0b4212cd5a21d7466901458e45d1956 Author: ana-uvarova <[email protected]> Date: Tue Dec 15 23:00:30 2020 +0300 fixes commit acfc3d4281be996520acaf0900ab9688bc502e47 Author: ana-uvarova <[email protected]> Date: Tue Dec 15 22:47:24 2020 +0300 host fixes commit 8aaef7f634ec57e744f2d8a37458169052287b7d Author: ana-uvarova <[email protected]> Date: Tue Dec 15 22:34:11 2020 +0300 host fixes commit 99ecb8ae6831a95dfe69e7598f5a6e1c71b5f9f5 Author: ana-uvarova <[email protected]> Date: Tue Dec 15 22:02:37 2020 +0300 host fixes commit b0d27d6747b32b8edb0c869e14a34615661761c6 Merge: f1e1672b54 3ec48cec53 Author: alexey-milovidov <[email protected]> Date: Tue Dec 15 22:01:57 2020 +0300 Merge pull request #18082 from den-crane/patch-3 Doc. toYYYYMM translation to Russian commit f1e1672b54045893ecc544d827e708b108d91740 Merge: 01286a6a09 96f22a5bcc Author: alexey-milovidov <[email protected]> Date: Tue Dec 15 22:01:08 2020 +0300 Merge pull request #18094 from staticor/patch-4 Update limit.md commit 95c35b318e55362c9a18d2ea723092ef9fc1f02f Author: Azat Khuzhin <[email protected]> Date: Tue Dec 15 21:48:24 2020 +0300 Avoid using symlinks for top_level_domains Move the main copy into the tests/config and ship it to the perf tests via the perf package. commit 51f53ce8e9cc4c916c4266d8a82857fb319663c3 Author: Maksim Kita <[email protected]> Date: Tue Dec 15 21:54:16 2020 +0300 Added tryParseDecimal functions commit e51cf03f21c7abd1f1c352cc23414f14d296dc79 Merge: ba63635251 01286a6a09 Author: Anton Popov <[email protected]> Date: Tue Dec 15 21:08:01 2020 +0300 Merge remote-tracking branch 'upstream/master' into HEAD commit ba6363525190c432262239f68fb5bb532ca3e4fb Author: Anton Popov <[email protected]> Date: Tue Dec 15 21:07:13 2020 +0300 add tests for formats with type map commit 9df7ecb8e640b22977f177a4a6af16936304e746 Author: Mikhail Filimonov <[email protected]> Date: Tue Dec 15 18:06:23 2020 +0100 fixes commit 2e4aa6b9e113afdac58d4b5b41069b16ec6fb33e Author: alesapin <[email protected]> Date: Tue Dec 15 19:20:09 2020 +0300 Kill not only database proc commit 01286a6a095d9abe6b77c0d61514d1a979be746a Author: Nikolai Kochetov <[email protected]> Date: Tue Dec 15 19:18:28 2020 +0300 Update libunwind. commit e10ee944bed26fc67a14e57fc6d025dd96794f32 Author: ana-uvarova <[email protected]> Date: Tue Dec 15 19:17:42 2020 +0300 links fixes commit a325c0db744374610543ae7f8b79f2a6d14f796c Author: ana-uvarova <[email protected]> Date: Tue Dec 15 19:07:25 2020 +0300 base commit 1bd2f49fb5f699e62f1aab311725163c16e5e5dc Merge: 8670836573 063488d943 Author: alesapin <[email protected]> Date: Tue Dec 15 19:05:04 2020 +0300 Merge branch 'master' into try_rewrite_writer commit dff71850a8d39ac42af7d877f75fcdae1da08402 Merge: 9d17f01dc9 063488d943 Author: alesapin <[email protected]> Date: Tue Dec 15 19:04:24 2020 +0300 Merge branch 'master' into fix_watch_race_testkeeper commit 9ad2a76d5151c613d281deaf7d66ebc895506c06 Author: alesapin <[email protected]> Date: Tue Dec 15 18:27:47 2020 +0300 Update run.sh commit 554fd738e9a783f1b7f69cae7b2e2a7d3f796a05 Author: alesapin <[email protected]> Date: Tue Dec 15 18:22:21 2020 +0300 Remove strange line commit ccabb4680ddad1bfbbdd2550353d890136ade9da Author: alesapin <[email protected]> Date: Tue Dec 15 18:19:56 2020 +0300 Fix dependencies commit 063488d94350bd7f8c0c41dc0b8009f48d7e9be8 Merge: 31bef163ba 22aba554c0 Author: alexey-milovidov <[email protected]> Date: Tue Dec 15 18:07:42 2020 +0300 Merge pull request #18103 from ClickHouse/revert-17983-fix-access-rights-for-merge-table-function Revert "Fix access rights required for the merge() table function." commit 22aba554c0fa42a8664a944e266fd69d7189e55f Author: alexey-milovidov <[email protected]> Date: Tue Dec 15 18:07:20 2020 +0300 Revert "Fix access rights required for the merge() table function." commit 27ff3a5214ab639712a48279c2afa6dd594dc837 Author: Mikhail Filimonov <[email protected]> Date: Tue Dec 15 15:46:13 2020 +0100 Rework using a separate flag file instead of renames commit 31bef163ba4c37b48f59d56423aea2ef80d46da5 Merge: b252321ef7 c3a4e5e7b7 Author: Nikita Mikhaylov <[email protected]> Date: Tue Dec 15 17:34:38 2020 +0300 Merge pull request #17848 from azat/max_distributed_connections-fix Fix max_distributed_connections commit dd09e1d78396775f4f04750f4404a1ee53680a7d Author: Anton Popov <[email protected]> Date: Tue Dec 15 17:34:37 2020 +0300 fix type map ser/de to json commit b252321ef7ea531351a29ca93c5851ce718ea260 Merge: def080c8ba 6defcbb662 Author: Nikolai Kochetov <[email protected]> Date: Tue Dec 15 16:51:54 2020 +0300 Merge pull request #16954 from Avogar/optimize-data-on-insert Optimize data on INSERT commit 6defcbb66215d775e4b736c646dcacbf693c0d83 Merge: c8c543ca94 def080c8ba Author: Nikolai Kochetov <[email protected]> Date: Tue Dec 15 16:50:42 2020 +0300 Merge branch 'master' into optimize-data-on-insert commit 873d9d1e1e22dd6a6f09c6919bfa1cf68cc4a55b Author: alesapin <[email protected]> Date: Tue Dec 15 16:34:53 2020 +0300 Better commit 9bb0326fc6bac0922b5a94f03fe4102745bb1e41 Author: alesapin <[email protected]> Date: Tue Dec 15 16:33:14 2020 +0300 Fix database drop timeout in clickhouse-test commit 96f22a5bcc8aef0159805337319d767c54208243 Author: Steve-金勇 <[email protected]> Date: Tue Dec 15 18:55:52 2020 +0800 Update limit.md Update translation of LIMIT , and providing more details for with ties modifier. Make document more human-readable for Chinese. commit 9d17f01dc9b5c7703cea8bbf0b2cd2a4679e143a Merge: 73780838a1 def080c8ba Author: alesapin <[email protected]> Date: Tue Dec 15 13:41:04 2020 +0300 Merge branch 'master' into fix_watch_race_testkeeper commit 8670836573d09282d29fe75ae9e9c43eb234bdff Author: alesapin <[email protected]> Date: Tue Dec 15 13:34:28 2020 +0300 Add some comments commit b56523fd94db0cdcde4809f247424d53fcfd2f1f Author: jianmei zhang <[email protected]> Date: Tue Dec 15 17:56:54 2020 +0800 Update test case to avoid the latest added parameter commit 74c2211510564bcc19667d31c9f0e873b5d8a6c5 Author: alesapin <[email protected]> Date: Tue Dec 15 12:54:48 2020 +0300 More clear commit def080c8bae1fb60a105e38527e1452e83f207f2 Author: Alexander Kazakov <[email protected]> Date: Tue Dec 15 11:16:25 2020 +0300 Fixed unsafe ast rewrite (#18064) Fixed unsafe assignment to a reference in InterpreterSelectWithUnionQuery::InterpreterSelectWithUnionQuery() commit a50187c9954c05fc7b70aa0a7b8d323f1fa4057c Author: alesapin <[email protected]> Date: Tue Dec 15 11:04:37 2020 +0300 Slightly better commit 508b50d121fc03c26fa9898fadc16ebb9b76f10d Author: jianmei zhang <[email protected]> Date: Tue Dec 15 14:44:39 2020 +0800 support SHOW CHANGED SETTINGS query and add test cases, also do code changes to compile SHOW SETTINGS PROFILES. commit 5a8c750b0bda0e7255bf698d2989a1b1750955cd Merge: 45b9d79f81 9310437920 Author: Vitaly Baranov <[email protected]> Date: Tue Dec 15 09:17:52 2020 +0300 Merge pull request #17983 from vitlibar/fix-access-rights-for-merge-table-function Fix access rights required for the merge() table function. commit 45b9d79f819820e30c46f6f5ed306f58cfe09afe Merge: a0405182ed 8de0c0e8fc Author: alexey-milovidov <[email protected]> Date: Tue Dec 15 07:51:14 2020 +0300 Merge pull request #18081 from azat/gcc10-sanitizers Do not pass -fsanitize-blacklist for gcc (it does not support it) for UBSAN commit 3ec48cec53f32374df82825b5534f2131e2018ec Author: Denny Crane <[email protected]> Date: Mon Dec 14 22:19:06 2020 -0400 Update date-time-functions.md toYYYYMM translation to Russian commit a0405182ed16815c7b01dd4f9f3ef7e0cb559a9b Merge: 49f65ecf9d fe6f477881 Author: Alexander Kuzmenkov <[email protected]> Date: Tue Dec 15 03:12:23 2020 +0300 Merge pull request #18066 from ClickHouse/aku/utils-split-build Build utils in CI, at least in split build commit 8de0c0e8fcf975ce074f0f19032f9ed37c8021bf Author: Azat Khuzhin <[email protected]> Date: Tue Dec 15 02:24:50 2020 +0300 Fix warning message for unusupported -fsanitize-blacklist commit 519d89dc9fde458b2c61636ef84c0ee5b0ecf5b1 Author: Azat Khuzhin <[email protected]> Date: Tue Dec 15 02:19:37 2020 +0300 Do not pass -fsanitize-blacklist for gcc (it does not support it) for UBSAN commit c78861e86e1f7c6fce2dd3cc3e6b1d9561a229c6 Merge: afc2d7099b 49f65ecf9d Author: Anton Popov <[email protected]> Date: Tue Dec 15 01:45:01 2020 +0300 Merge remote-tracking branch 'upstream/master' into HEAD commit afc2d7099b71c786620c2728f944cc992fa98b22 Author: Anton Popov <[email protected]> Date: Tue Dec 15 01:16:04 2020 +0300 add conversion from array to map commit 49f65ecf9de008a6a51b6d169e24646ed7af91ba Author: alexey-milovidov <[email protected]> Date: Mon Dec 14 23:07:28 2020 +0300 Update CHANGELOG.md commit 91be7a6f27a0901384ed95653a76f98aac03a094 Merge: 363ff79cca 5da9315ceb Author: alexey-milovidov <[email protected]> Date: Mon Dec 14 23:03:21 2020 +0300 Merge pull request #16809 from kitaisreal/read-float-8digits-unroll-performance-improvement ReadFloat 8digits unroll performance improvement commit 363ff79cca91696e391ebd55e08aa87d3d4b0ab4 Merge: 491e086435 346c241c20 Author: alexey-milovidov <[email protected]> Date: Mon Dec 14 23:00:43 2020 +0300 Merge pull request #17934 from Jokser/s3-adaptive-single-part-upload Adaptive choose of single/multi part upload in WriteBufferFromS3 commit 491e086435ce06821e9f0d781a963b66bfafeb9b Merge: 906415540a bf23bc6f0c Author: alexey-milovidov <[email protected]> Date: Mon Dec 14 22:57:27 2020 +0300 Merge pull request #18057 from azat/fix-01600_remerge_sort_lowered_memory_bytes_ratio-flap Fix 01600_remerge_sort_lowered_memory_bytes_ratio flap commit 906415540aab3a9789650c87ca337efb0d92b356 Merge: 7184746f45 14dedae9f1 Author: alexey-milovidov <[email protected]> Date: Mon Dec 14 22:57:02 2020 +0300 Merge pull request #18060 from kitaisreal/create-query-create-as-select-with-columns-specification CreateQuery create as select with columns specification commit 7184746f45793b8ecabf0a7d8616551730bfea2f Merge: 5f424f7c5c 60efab623d Author: alexey-milovidov <[email protected]> Date: Mon Dec 14 22:56:39 2020 +0300 Merge pull request #18059 from excitoon/patch-2 Fixed `std::out_of_range: basic_string` in S3 URL parsing commit 17b43ca721c48190085b3b930e87960f7a61474f Author: Maksim Kita <[email protected]> Date: Tue Dec 8 13:54:33 2020 +0300 Fixed tests commit 16a30eb4aabc4072ad51da17868e2e31c6cec727 Author: Maksim Kita <[email protected]> Date: Tue Dec 8 10:43:18 2020 +0300 Updated non-finite floating conversion into int commit e945821e1f7d5c3c0119c193c99409212fca04a7 Author: alexey-milovidov <[email protected]> Date: Mon Dec 7 20:34:16 2020 +0300 Update castColumn.h commit 26e582272f321937749b3477ca4aada3293cf706 Author: alexey-milovidov <[email protected]> Date: Mon Dec 7 20:34:01 2020 +0300 Update castColumn.h commit 6873b1358753436879665a191f605499dc54b497 Author: Maksim Kita <[email protected]> Date: Sun Dec 6 14:58:54 2020 +0300 Fixed clang build issue commit 0b565b679e40015c7a8b0e2f958f07ed8ab9d540 Author: Maksim Kita <[email protected]> Date: Sat Dec 5 17:55:37 2020 +0300 Fixed Set execute for columns that cannot be inside Nullable commit 18dc118298ffb0b49792012cf772058cd088b226 Author: Maksim Kita <[email protected]> Date: Sat Dec 5 16:46:14 2020 +0300 Fixed compile issues commit 0464859cfeb9d25af5c614173558adb62f7b9920 Author: Maksim Kita <[email protected]> Date: Sat Dec 5 16:18:56 2020 +0300 Updated usage of different types during IN query 1. Added accurateCast function. 2. Use accurateCast in Set during execute. 3. Added accurateCast tests. 4. Updated select_in_different_types tests. commit 6f4bc77dbcf35e18f85c41c61739da2355ca6834 Author: Maksim Kita <[email protected]> Date: Wed Dec 2 15:28:29 2020 +0300 Added equality comparsion commit f4b8e8ef9931a2b1d2fb4710286cbc9d066ae956 Author: Maksim Kita <[email protected]> Date: Wed Dec 2 13:09:13 2020 +0300 Allow different types inside IN subquery commit dff31e8de7f158e0dcfa4e43b6663edd130d83e8 Author: Maksim Kita <[email protected]> Date: Mon Nov 30 11:26:00 2020 +0300 Fixed compile issues commit 0dac432942c85c8803bdf8c38e54e66a3ec85867 Author: Maksim Kita <[email protected]> Date: Sat Nov 28 15:55:29 2020 +0300 Added const to arguments commit dd072a20c9ab58e0f06d1438dc75252ff301bc3b Author: Maksim Kita <[email protected]> Date: Sun Nov 15 22:24:15 2020 +0300 Fixed compile issues commit 7b66dc374c660102dbd34ee532e1bbe8a46a32e8 Author: Maksim Kita <[email protected]> Date: Sun Nov 15 13:03:53 2020 +0300 Fixed clang compile issues commit 4435642e39ae5c6f763d2356c10e8ac32020f7c6 Author: Maksim Kita <[email protected]> Date: Thu Nov 12 18:56:17 2020 +0300 Fixed style issues commit db5d0944ed47f7cd9a789ebc9e691fa2dfb3271c Author: Maksim Kita <[email protected]> Date: Thu Nov 12 14:27:02 2020 +0300 Added Decimal support commit 476fb3b677edbcaf1528011e373deee88198c0d3 Author: Maksim Kita <[email protected]> Date: Thu Nov 12 13:32:37 2020 +0300 Updated documentation commit baad78d2f2d13c5873591999765eb6b838558919 Author: Maksim Kita <[email protected]> Date: Thu Nov 12 12:28:49 2020 +0300 Fixed setting null value in vector. Updated tests. commit 4cd5025e83849790bb897d66b20fb0ee9bda85de Author: Maksim Kita <[email protected]> Date: Tue Nov 10 16:18:58 2020 +0300 Added numeric limits for UInt128 commit d636e1618ba8c055d8f09da004e8bcb2b7afca86 Author: Maksim Kita <[email protected]> Date: Thu Nov 5 22:09:17 2020 +0300 Added function accurate cast or null commit fe6f4778814ded00009fe94a82344ac5529ebba8 Author: Alexander Kuzmenkov <[email protected]> Date: Mon Dec 14 20:39:52 2020 +0300 Build utils in CI, at least in split build Currently we don't build them at all, so they were broken by https://github.com/ClickHouse/ClickHouse/pull/17988 commit 5f424f7c5cc8384cbbf87aabcc54018513d73b31 Author: Alexander Kuzmenkov <[email protected]> Date: Mon Dec 14 20:08:32 2020 +0300 Update zzz-perf-comparison-tweaks-config.xml commit 19af691aa6dd64c2ccb32e34e78b659d15352edb Merge: e7f93b5563 b08842d44e Author: alexey-milovidov <[email protected]> Date: Mon Dec 14 19:44:13 2020 +0300 Merge pull request #17738 from vklimontovich/docker-cli-example Docker cli example commit 73780838a14beabd4f2bcde74067117cbf7141c5 Author: alesapin <[email protected]> Date: Mon Dec 14 19:01:29 2020 +0300 Remove dead list watches commit b08842d44e9c50f4cba6b97f1da95981dea7de23 Author: filimonov <[email protected]> Date: Mon Dec 14 16:54:37 2020 +0100 Update README.md commit 1436986a86528072e128e4f81c771c3e5e4860b4 Author: filimonov <[email protected]> Date: Mon Dec 14 16:53:58 2020 +0100 Update README.md commit bca41bb7fd1275ed989113ef2f729e4f4fa89eac Author: filimonov <[email protected]> Date: Mon Dec 14 16:50:48 2020 +0100 Update R…

Update client-libraries.md

…ter-tests-2 Better tests for protobuf format #2.

* master: (137 commits) Updated documentation Updated documentation Better tests for protobuf format #2. Fix server stop Initialize random engine with clock and thread_id Improve performance and fix condition variable wait Resorted from std::random_device to std::rand() Fix disable null_as_default when type is Nullable Support LC type for joinGet Update settings.md Update settings.md Summing raft test more stable Update .reference file Fix replace,All functions so that they don't generate garbage to stderr Fix build Bug fix: Tuple cast to Map Updated tests for map type Added special case in documentation example Update fetchPostgreSQLTableStructure.cpp ...

Support apple m1: proposed adjustments to the original M1 support PR branch

…docs-2 Improve documentation for CREATE ROW POLICY command #2.

* master: (694 commits) Fix integration test test_storage_kafka failed error Fix test 00163_column_oriented_formats failed error Read ORC file by stripe to reduce memory cost Function toDateTime decimal overflow ubsan fix Revert "[RFC] Fix memory tracking with min_bytes_to_use_mmap_io" Zlib use attribute constructor for functable initialization Translate to Russian (clickhouse-client documentation) Simple key dictionary primary key wrong order fix Disable hedged requests Added integration test Revert "Function `arrayFold` for folding over array with accumulator" Fix documentation for the GRANT command. Added system query reload model Make function `unhex` case insensitive for compatibility Improve documentation for CREATE ROW POLICY command #2. Add exception message Fix tidy Fix waiting for all connections closed on shutdown. Disable postgresql_port in perf tests Mark 01605_adaptive_granularity_block_borders as long ...

Update build-osx.md

ASTTableIdentifier part #2: Introduce ASTTableIdentifier

Up to date master

Pull current master

* fix: DateTime64 on MaterializedPostgreSQL * Update StoragePostgreSQL.cpp

less sys calls #2: make vdso work again

Update h3.md

…_clock_gettime2 Revert "less sys calls #2: make vdso work again"

…rt-27492-less_clock_gettime2 Revert "Revert "less sys calls #2: make vdso work again""

add compression key-word and some tests

…ee.md #2

Update From Base

@den-crane

This use-after-free can be reproduced with distributed queries. Also note, that this is not sumMappedArray() and friends (that previously called sumMap()) but Map combinator. You will find ASan report in details. <details> READ of size 8 at 0x62d00012d218 thread T186 (QueryPipelineEx) 2022.07.03 05:09:40.000234 [ 31956 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 1.23 GiB, peak 1.23 GiB, will set to 1.25 GiB (RSS), difference: 19.51 MiB 2022.07.03 05:09:41.000137 [ 31956 ] {} <Trace> AsynchronousMetrics: MemoryTracking: was 1.25 GiB, peak 1.25 GiB, will set to 1.26 GiB (RSS), difference: 3.76 MiB #0 0x1233a0d8 in DB::AggregateFunctionSumData<>::get() const build_docker/../src/AggregateFunctions/AggregateFunctionSum.h:245:16 #1 0x1233a0d8 in DB::AggregateFunctionSum<>::insertResultInto(char*, DB::IColumn&, DB::Arena*) const build_docker/../src/AggregateFunctions/AggregateFunctionSum.h:536:70 #2 0x1470f910 in DB::AggregateFunctionMap<char8_t>::insertResultInto() const build_docker/../src/AggregateFunctions/AggregateFunctionMap.h:236:26 #3 0x147110ce in DB::IAggregateFunctionHelper<>::insertResultIntoBatch() const build_docker/../src/AggregateFunctions/IAggregateFunction.h:618:53 #4 0x2c4269d7 in void DB::Aggregator::convertToBlockImplFinal<>() const build_docker/../src/Interpreters/Aggregator.cpp:1878:49 #5 0x2c403b9f in void DB::Aggregator::convertToBlockImpl<>() const build_docker/../src/Interpreters/Aggregator.cpp:1714:13 #6 0x2be09b53 in DB::Aggregator::prepareBlockAndFillSingleLevel() const::$_2::operator()() const build_docker/../src/Interpreters/Aggregator.cpp:2144:9 #7 0x2be09b53 in DB::Block DB::Aggregator::prepareBlockAndFill<>() const build_docker/../src/Interpreters/Aggregator.cpp:2000:5 #8 0x2be09b53 in DB::Aggregator::prepareBlockAndFillSingleLevel() const build_docker/../src/Interpreters/Aggregator.cpp:2150:12 #9 0x2be37de3 in DB::Aggregator::mergeBlocks() build_docker/../src/Interpreters/Aggregator.cpp:3032:17 #10 0x308c27f8 in DB::MergingAggregatedBucketTransform::transform() build_docker/../src/Processors/Transforms/MergingAggregatedMemoryEfficientTransform.cpp:360:37 0x62d00012d218 is located 3608 bytes inside of 32768-byte region [0x62d00012c400,0x62d000134400) freed by thread T186 (QueryPipelineEx) here: #0 0xd701312 in free (/work1/azat/tmp/upstream/clickhouse-asan+0xd701312) (BuildId: b7977aef37e9f720) ... #8 0x2e3c22eb in DB::ColumnAggregateFunction::~ColumnAggregateFunction() build_docker/../src/Columns/ColumnAggregateFunction.cpp:89:1 ... #18 0xd9fcdd4 in std::__1::vector<DB::ColumnWithTypeAndName, std::__1::allocator<DB::ColumnWithTypeAndName> >::~vector() build_docker/../contrib/libcxx/include/vector:401:9 #19 0x2be373f4 in DB::Aggregator::mergeBlocks() build_docker/../contrib/libcxx/include/__memory/unique_ptr.h #20 0x308c27f8 in DB::MergingAggregatedBucketTransform::transform() build_docker/../src/Processors/Transforms/MergingAggregatedMemoryEfficientTransform.cpp:360:37 previously allocated by thread T186 (QueryPipelineEx) here: #0 0xd7015be in malloc (/work1/azat/tmp/upstream/clickhouse-asan+0xd7015be) (BuildId: b7977aef37e9f720) #1 0xd85190a in Allocator<false, false>::allocNoTrack(unsigned long, unsigned long) build_docker/../src/Common/Allocator.h:227:27 #2 0xd988d45 in Allocator<false, false>::alloc(unsigned long, unsigned long) build_docker/../src/Common/Allocator.h:96:16 #3 0xd988d45 in DB::Arena::MemoryChunk::MemoryChunk(unsigned long, DB::Arena::MemoryChunk*) build_docker/../src/Common/Arena.h:54:64 #4 0xd98904b in DB::Arena::addMemoryChunk(unsigned long) build_docker/../src/Common/Arena.h:122:20 #5 0xec9542c in DB::Arena::alignedAlloc(unsigned long, unsigned long) build_docker/../src/Common/Arena.h:171:13 #6 0x1470f123 in DB::AggregateFunctionMap<char8_t>::deserialize() const build_docker/../src/AggregateFunctions/AggregateFunctionMap.h:205:35 </details> P.S. Thanks to @den-crane for the reproducer. Fixes: ClickHouse#35359 (cc @den-crane @dongxiao-yang) Signed-off-by: Azat Khuzhin <[email protected]>

…yFunc() clang-15 reports [1]: <details> <summary>ASan report</summary> ``` ==1==ERROR: AddressSanitizer: stack-use-after-return on address 0x7f1d04c4eb20 at pc 0x000031c4803c bp 0x7f1d05e19a00 sp 0x7f1d05e199f8 READ of size 8 at 0x7f1d04c4eb20 thread T200 (QueryPullPipeEx) #0 0x31c4803b in DB::GetPriorityForLoadBalancing::getPriorityFunc(DB::LoadBalancing, unsigned long, unsigned long) const::$_3::operator()(unsigned long) const build_docker/../src/Common/GetPriorityForLoadBalancing.cpp:42:40 #1 0x31c4803b in decltype(static_cast<DB::GetPriorityForLoadBalancing::getPriorityFunc(DB::LoadBalancing, unsigned long, unsigned long) const::$_3&>(fp)(static_cast<unsigned long>(fp0))) std::__1::__invoke<DB::GetPriorityForLoadBalancing::getPriorityFunc(DB::LoadBalancing, unsigned long, unsigned long) const::$_3&, unsigned long>(DB::GetPriorityForLoadBalancing::getPriorityFunc(DB::LoadBalancing, unsigned long, unsigned long) const::$_3&, unsigned long&&) build_docker/../contrib/libcxx/include/type_traits:3640:23 #2 0x31c4803b in unsigned long std::__1::__invoke_void_return_wrapper<unsigned long, false>::__call<DB::GetPriorityForLoadBalancing::getPriorityFunc(DB::LoadBalancing, unsigned long, unsigned long) const::$_3&, unsigned long>(DB::GetPriorityForLoadBalancing::getPriorityFunc(DB::LoadBalancing, unsigned long, unsigned long) const::$_3&, unsigned long&&) build_docker/../contrib/libcxx/include/__functional/invoke.h:30:16 #3 0x31c4803b in std::__1::__function::__default_alloc_func<DB::GetPriorityForLoadBalancing::getPriorityFunc(DB::LoadBalancing, unsigned long, unsigned long) const::$_3, unsigned long (unsigned long)>::operator()(unsigned long&&) build_docker/../contrib/libcxx/include/__functional/function.h:230:12 #4 0x31c4803b in unsigned long std::__1::__function::__policy_invoker<unsigned long (unsigned long)>::__call_impl<std::__1::__function::__default_alloc_func<DB::GetPriorityForLoadBalancing::getPriorityFunc(DB::LoadBalancing, unsigned long, unsigned long) const::$_3, unsigned long (unsigned long)>>(std::__1::__function::__policy_storage const*, unsigned long) build_docker/../contrib/libcxx/include/__functional/function.h:711:16 #5 0x31c38b07 in std::__1::__function::__policy_func<unsigned long (unsigned long)>::operator()(unsigned long&&) const build_docker/../contrib/libcxx/include/__functional/function.h:843:16 #6 0x31c38b07 in std::__1::function<unsigned long (unsigned long)>::operator()(unsigned long) const build_docker/../contrib/libcxx/include/__functional/function.h:1184:12 #7 0x31c38b07 in PoolWithFailoverBase<DB::IConnectionPool>::getShuffledPools(unsigned long, std::__1::function<unsigned long (unsigned long)> const&) build_docker/../src/Common/PoolWithFailoverBase.h:174:39 This frame has 2 object(s): [32, 40) 'pool_size.addr' <== Memory access at offset 32 is inside this variable [64, 88) 'ref.tmp' (line 18) ``` </details> [1]: https://s3.amazonaws.com/clickhouse-test-reports/41046/adea92f847373d1fcfd733d8979c63024f9b80bf/integration_tests__asan__[1/3].html Signed-off-by: Azat Khuzhin <[email protected]>

…s and parallel KILL Right now it is possible to call QueryStatus::addPipelineExecutor() when the executors_mutex already acquired, it is possible when the query was cancelled via KILL QUERY. Here I will show some traces from debugger from a real example, where tons of ProcessList::insert() got deadlocked. Let's look at the lock owner for one of the threads that was deadlocked in ProcessList::insert(): (gdb) p *mutex $2 = { __data = { __owner = 46899, }, } And now let's see the stack trace of the 46899: #0 __lll_lock_wait () at ../sysdeps/unix/sysv/linux/x86_64/lowlevellock.S:103 #1 0x00007fb65569b714 in __GI___pthread_mutex_lock (mutex=0x7fb4a9d15298) at ../nptl/pthread_mutex_lock.c:80 #2 0x000000001b6edd91 in pthread_mutex_lock (arg=0x7fb4a9d15298) at ../src/Common/ThreadFuzzer.cpp:317 #3 std::__1::__libcpp_mutex_lock (__m=0x7fb4a9d15298) at ../contrib/libcxx/include/__threading_support:303 #4 std::__1::mutex::lock (this=0x7fb4a9d15298) at ../contrib/libcxx/src/mutex.cpp:33 #5 0x0000000014c7ae63 in std::__1::lock_guard<std::__1::mutex>::lock_guard (__m=..., this=<optimized out>) at ../contrib/libcxx/include/__mutex_base:91 #6 DB::QueryStatus::addPipelineExecutor (this=0x7fb4a9d14f90, e=0x80) at ../src/Interpreters/ProcessList.cpp:372 #7 0x0000000015bee4a7 in DB::PipelineExecutor::PipelineExecutor (this=0x7fb4b1e53618, processors=..., elem=<optimized out>) at ../src/Processors/Executors/PipelineExecutor.cpp:54 #12 std::__1::make_shared<DB::PipelineExecutor, std::__1::vector<std::__1::shared_ptr<DB::IProcessor>, std::__1::allocator<std::__1::shared_ptr<DB::IProcessor> > >&, DB::QueryStatus*&, void> (__args=@0x7fb63095b9b0: 0x7fb4a9d14f90, __args=@0x7fb63095b9b0: 0x7fb4a9d14f90) at ../contrib/libcxx/include/__memory/shared_ptr.h:963 #13 DB::QueryPipelineBuilder::execute (this=0x7fb63095b8b0) at ../src/QueryPipeline/QueryPipelineBuilder.cpp:552 #14 0x00000000158c6c27 in DB::Connection::sendExternalTablesData (this=0x7fb6545e9d98, data=...) at ../src/Client/Connection.cpp:797 #27 0x0000000014043a81 in DB::RemoteQueryExecutorRoutine::operator() (this=0x7fb63095bf20, sink=...) at ../src/QueryPipeline/RemoteQueryExecutorReadContext.cpp:46 #32 0x000000000a16dd4f in make_fcontext () at ../contrib/boost/libs/context/src/asm/make_x86_64_sysv_elf_gas.S:71 And also in the logs you can see very strange things for this thread: 2022.09.13 14:14:51.228979 [ 51145 ] {1712D4E914EC7C99} <Debug> Connection (localhost:9000): Sent data for 1 external tables, total 11 rows in 0.00046389 sec., 23688 rows/sec., 3.84 KiB (8.07 MiB/sec.), compressed 1.1070121092649958 times to 3.47 KiB (7.29 MiB/sec.) ... 2022.09.13 14:14:51.719402 [ 46899 ] {7c90ffa4-1dc8-42fd-938c-4e307c244394} <Debug> executeQuery: (from 10.101.15.181:42478) KILL QUERY WHERE query_id = '1712D4E914EC7C99' (stage: Complete) 2022.09.13 14:14:51.719488 [ 46899 ] {7c90ffa4-1dc8-42fd-938c-4e307c244394} <Debug> executeQuery: (internal) SELECT query_id, user, query FROM system.processes WHERE query_id = '1712D4E914EC7C99' (stage: Complete) 2022.09.13 14:14:51.719754 [ 46899 ] {7c90ffa4-1dc8-42fd-938c-4e307c244394} <Trace> ContextAccess (default): Access granted: SELECT(user, query_id, query) ON system.processes 2022.09.13 14:14:51.720544 [ 46899 ] {7c90ffa4-1dc8-42fd-938c-4e307c244394} <Trace> InterpreterSelectQuery: FetchColumns -> Complete 2022.09.13 14:14:53.228964 [ 46899 ] {7c90ffa4-1dc8-42fd-938c-4e307c244394} <Debug> Connection (localhost:9000): Sent data for 2 scalars, total 2 rows in 2.6838e-05 sec., 73461 rows/sec., 68.00 B (2.38 MiB/sec.), compressed 0.4594594594594595 times to 148.00 B (5.16 MiB/sec.) How is this possible? The answer is fibers and query cancellation routine. During cancellation of async queries it going into fibers again and try to do this gracefully. However because of this during canceling query it may call QueryStatus::addPipelineExecutor() from QueryStatus::cancelQuery(). Signed-off-by: Azat Khuzhin <[email protected]>

…verflow UBSAN report: $ UBSAN_SYMBOLIZER_PATH=/usr/bin/llvm-symbolizer-14 UBSAN_OPTIONS=print_stacktrace=1 ./unit_tests_dbms --gtest_filter=*Gorilla* ../src/Compression/tests/gtest_compressionCodec.cpp:1216:47: runtime error: signed integer overflow: 23 * 100000000 cannot be represented in type 'int' #0 0x14f67fd1 in auto (anonymous namespace)::$_6::operator()(int) const::'lambda'(auto)::operator()<int>(auto) const build_docker/../src/Compression/tests/gtest_compressionCodec.cpp:1216:47 #1 0x14f67fd1 in (anonymous namespace)::CodecTestSequence (anonymous namespace)::generateSeq<long, (anonymous namespace)::$_6::operator()(int) const::'lambda'(auto), int, int>((anonymous namespace)::$_6::operator()(int) const::'lambda'(auto), char const*, int, int) build_docker/../src/Compression/tests/gtest_compressionCodec.cpp:394:36 #2 0x14f67fd1 in auto (anonymous namespace)::GCompatibilityTestSequence<long>() build_docker/../src/Compression/tests/gtest_compressionCodec.cpp:1224:12 #3 0x14f3c7f3 in (anonymous namespace)::gtest_GorillaCodecTestCompatibility_EvalGenerator_() build_docker/../src/Compression/tests/gtest_compressionCodec.cpp:1227:1 #4 0x14f6bdb5 in testing::internal::ParameterizedTestSuiteInfo<(anonymous namespace)::CodecTestCompatibility>::RegisterTests() build_docker/../contrib/googletest/googletest/include/gtest/internal/gtest-param-util.h:553:45 #5 0x27d87988 in testing::internal::ParameterizedTestSuiteRegistry::RegisterTests() build_docker/../contrib/googletest/googletest/include/gtest/internal/gtest-param-util.h:726:24 #6 0x27d87988 in testing::internal::UnitTestImpl::RegisterParameterizedTests() build_docker/../contrib/googletest/googletest/src/gtest.cc:2805:34 #7 0x27d87988 in testing::internal::UnitTestImpl::PostFlagParsingInit() build_docker/../contrib/googletest/googletest/src/gtest.cc:5492:5 #8 0x27d9d002 in void testing::internal::InitGoogleTestImpl<char>(int*, char**) build_docker/../contrib/googletest/googletest/src/gtest.cc:6499:22 #9 0x14fd5495 in main build_docker/../src/Coordination/tests/gtest_coordination.cpp:2189:5 #10 0x7f8c29005209 (/lib/x86_64-linux-gnu/libc.so.6+0x29209) (BuildId: 71a7c7b97bc0b3e349a3d8640252655552082bf5) #11 0x7f8c290052bb in __libc_start_main (/lib/x86_64-linux-gnu/libc.so.6+0x292bb) (BuildId: 71a7c7b97bc0b3e349a3d8640252655552082bf5) #12 0x14ce356d in _start (/work1/azat/tmp/42190/unit_tests_dbms+0x14ce356d) (BuildId: 482550e3f8d45f06e8c7f8147f427ee798c1f645) SUMMARY: UndefinedBehaviorSanitizer: undefined-behavior ../src/Compression/tests/gtest_compressionCodec.cpp:1216:47 in Signed-off-by: Azat Khuzhin <[email protected]>

…reated ASAN report: Code: 586. DB::ErrnoException: Cannot create file: /src/.clickhouse_history, errno: 2, strerror: No such file or directory. (CANNOT_CREATE_FILE) ================================================================= ==1==ERROR: AddressSanitizer: heap-use-after-free on address 0x6240000208f0 at pc 0x000030d22ade bp 0x7ffff2ff3f70 sp 0x7ffff2ff3f68 READ of size 8 at 0x6240000208f0 thread T2 #0 0x30d22add in DB::ProcessList::insert() build_docker/../src/Interpreters/ProcessList.cpp:89:36 #1 0x31411018 in DB::executeQueryImpl() build_docker/../src/Interpreters/executeQuery.cpp:516:60 #2 0x3140e1ab in DB::executeQuery() build_docker/../src/Interpreters/executeQuery.cpp:1083:30 #3 0x3364391e in DB::LocalConnection::sendQuery() build_docker/../src/Client/LocalConnection.cpp:119:21 #4 0x3367bab0 in DB::Suggest::fetch() build_docker/../src/Client/Suggest.cpp:141:16 #5 0x336820eb in void DB::Suggest::load<DB::LocalConnection>()::'lambda'()::operator()() const build_docker/../src/Client/Suggest.cpp:118:17 0x6240000208f0 is located 2032 bytes inside of 7056-byte region [0x624000020100,0x624000021c90) freed by thread T0 here: #0 0xe381ef2 in operator delete(void*, unsigned long) (/wrk/clickhouse-asan+0xe381ef2) (BuildId: 6ea6d1a5d2d5a164f60f0fd8230936305bc8d9d0) #1 0x335509fe in DB::ClientBase::~ClientBase() build_docker/../src/Client/ClientBase.cpp:293:25 #2 0x1f809bd5 in mainEntryClickHouseLocal(int, char**) build_docker/../programs/local/LocalServer.cpp:804:5 #3 0xe3856ad in main build_docker/../programs/main.cpp:482:12 #4 0x7ffff7dc0082 in __libc_start_main /build/glibc-SzIz7B/glibc-2.31/csu/../csu/libc-start.c:308:16 previously allocated by thread T0 here: #0 0xe38128d in operator new(unsigned long) (/wrk/clickhouse-asan+0xe38128d) (BuildId: 6ea6d1a5d2d5a164f60f0fd8230936305bc8d9d0) #1 0x2f34a7f3 in std::__1::__unique_if<DB::ContextSharedPart>::__unique_single std::__1::make_unique[abi:v15003]<DB::ContextSharedPart>() build_docker/../contrib/libcxx/include/__memory/unique_ptr.h:714:28 #2 0x2f34a7f3 in DB::Context::createShared() build_docker/../src/Interpreters/Context.cpp:603:32 #3 0x1f7f901d in DB::LocalServer::processConfig() build_docker/../programs/local/LocalServer.cpp:535:22 #4 0x1f7f4d92 in DB::LocalServer::main() build_docker/../programs/local/LocalServer.cpp:419:5 #5 0x3af24ffe in Poco::Util::Application::run() build_docker/../contrib/poco/Util/src/Application.cpp:334:8 #6 0x1f809bca in mainEntryClickHouseLocal(int, char**) build_docker/../programs/local/LocalServer.cpp:803:20 #7 0xe3856ad in main build_docker/../programs/main.cpp:482:12 #8 0x7ffff7dc0082 in __libc_start_main /build/glibc-SzIz7B/glibc-2.31/csu/../csu/libc-start.c:308:16 Thread T2 created by T0 here: #0 0xe32fedc in pthread_create (/wrk/clickhouse-asan+0xe32fedc) (BuildId: 6ea6d1a5d2d5a164f60f0fd8230936305bc8d9d0) #1 0x336806df in std::__1::__libcpp_thread_create[abi:v15003](unsigned long*, void* (*)(void*), void*) build_docker/../contrib/libcxx/include/__threading_support:376:10 #2 0x336806df in std::__1::thread::thread<void DB::Suggest::load<DB::LocalConnection>()::'lambda'(), void>() build_docker/../contrib/libcxx/include/thread:311:16 #3 0x3367ff5b in void DB::Suggest::load<DB::LocalConnection>(std::__1::shared_ptr<DB::Context const>, DB::ConnectionParameters const&, int) build_docker/../src/Client/Suggest.cpp:110:22 #4 0x3357fee9 in DB::ClientBase::runInteractive() build_docker/../src/Client/ClientBase.cpp:2066:22 #5 0x1f7f5264 in DB::LocalServer::main() build_docker/../programs/local/LocalServer.cpp #6 0x3af24ffe in Poco::Util::Application::run() build_docker/../contrib/poco/Util/src/Application.cpp:334:8 #7 0x1f809bca in mainEntryClickHouseLocal(int, char**) build_docker/../programs/local/LocalServer.cpp:803:20 #8 0xe3856ad in main build_docker/../programs/main.cpp:482:12 #9 0x7ffff7dc0082 in __libc_start_main /build/glibc-SzIz7B/glibc-2.31/csu/../csu/libc-start.c:308:16 Signed-off-by: Azat Khuzhin <[email protected]>

Fix shared build (#6453)

8b9284b

* Fix shared build * Enable no-undefined check only in CI

pull bot added the ⤵️ pull label Aug 13, 2019

pull bot merged commit 8b9284b into traceon:master Aug 13, 2019

pull bot pushed a commit that referenced this pull request Sep 13, 2019

Merge pull request #2 from ObjatieGroba/questions

fab2c64

Add space reservation for each new MargeTreeDataPart.

pull bot pushed a commit that referenced this pull request Oct 18, 2019

Merge pull request #2 from ClickHouse/master

326dab8

refresh_2

pull bot pushed a commit that referenced this pull request Oct 23, 2019

Merge pull request #2 from arenadata/ADQM-61

51d1732

fix result type for avg aggregation

pull bot pushed a commit that referenced this pull request Apr 7, 2020

Enable access management in stateless tests #2.

b010ab8

pull bot pushed a commit that referenced this pull request Apr 7, 2020

Merge pull request ClickHouse#10100 from vitlibar/enable-access-manag…

e267daa

…ement-in-stateless-tests-2 Enable access management in stateless tests #2.

pull bot pushed a commit that referenced this pull request Sep 2, 2020

Merge pull request #2 from dreamerfable/dreamerfable-docs-mergetree

0358822

Update mergetree.md

pull bot pushed a commit that referenced this pull request Sep 11, 2020

Merge pull request ClickHouse#14604 from vitlibar/no-detach-threads-2

70b0fe8

Use join() instead of detach() for threads #2

pull bot pushed a commit that referenced this pull request Oct 9, 2020

Merge pull request #2 from alexelex/quorum_inserts_2

89dddb7

Quorum inserts 2

pull bot pushed a commit that referenced this pull request Oct 24, 2020

Merge pull request #2 from antikvist/master

31a2fbe

update welch to master

pull bot pushed a commit that referenced this pull request Dec 10, 2020

Fix build #2

20eeab4

pull bot pushed a commit that referenced this pull request Dec 18, 2020

Merge pull request ClickHouse#18104 from vitlibar/fix-access-rights-f…

b9c537a

…or-merge-table-function-2 Fix access rights required for the merge() table function #2.

pull bot pushed a commit that referenced this pull request Jan 8, 2021

Merge pull request #2 from long2ice/patch-3

29e5619

Update client-libraries.md

pull bot pushed a commit that referenced this pull request Feb 25, 2021

Better tests for protobuf format #2.

2480e4e

pull bot pushed a commit that referenced this pull request Feb 25, 2021

Merge pull request ClickHouse#21148 from vitlibar/protobuf-format-bet…

8601b2f

…ter-tests-2 Better tests for protobuf format #2.

traceon pushed a commit that referenced this pull request Apr 10, 2021

Merge pull request #2 from traceon/support-apple-m1-changvvb-2

8b5b0d4

Support apple m1: proposed adjustments to the original M1 support PR branch

pull bot pushed a commit that referenced this pull request Apr 17, 2021

Improve documentation for CREATE ROW POLICY command #2.

660efcc

pull bot pushed a commit that referenced this pull request Apr 17, 2021

Merge pull request ClickHouse#23228 from vitlibar/improve-row-policy-…

37b05f4

…docs-2 Improve documentation for CREATE ROW POLICY command #2.

pull bot pushed a commit that referenced this pull request May 5, 2021

Merge pull request #2 from ice1x/feature/add-osx-build-run-item

577613b

Update build-osx.md

pull bot pushed a commit that referenced this pull request Jun 15, 2021

Merge pull request ClickHouse#16401 from abyss7/ast-table-identifier-2

a52bba9

ASTTableIdentifier part #2: Introduce ASTTableIdentifier

pull bot pushed a commit that referenced this pull request Jul 6, 2021

Merge pull request #2 from ClickHouse/master

4ca17bf

Up to date master

pull bot pushed a commit that referenced this pull request Jul 6, 2021

Merge pull request #2 from ClickHouse/master

b1177ef

Pull current master

pull bot pushed a commit that referenced this pull request Jul 15, 2021

fix: DateTime64 on MaterializedPostgreSQL (#2)

a0ec8e9

* fix: DateTime64 on MaterializedPostgreSQL * Update StoragePostgreSQL.cpp

pull bot pushed a commit that referenced this pull request Aug 13, 2021

Style #2

7324c7c

pull bot pushed a commit that referenced this pull request Aug 13, 2021

Merge pull request ClickHouse#27492 from filimonov/less_clock_gettime2

fe356a7

less sys calls #2: make vdso work again

pull bot pushed a commit that referenced this pull request Aug 18, 2021

Merge pull request #2 from ka1bi4/patch-1

5d179e4

Update h3.md

pull bot pushed a commit that referenced this pull request Aug 19, 2021

Revert "less sys calls #2: make vdso work again"

3db3b40

pull bot pushed a commit that referenced this pull request Aug 19, 2021

Merge pull request ClickHouse#27829 from ClickHouse/revert-27492-less…

8f280c9

…_clock_gettime2 Revert "less sys calls #2: make vdso work again"

pull bot pushed a commit that referenced this pull request Aug 26, 2021

Revert "Revert "less sys calls #2: make vdso work again""

c6f40c5

pull bot pushed a commit that referenced this pull request Aug 26, 2021

Merge pull request ClickHouse#28132 from ClickHouse/revert-27829-reve…

0328f22

…rt-27492-less_clock_gettime2 Revert "Revert "less sys calls #2: make vdso work again""

pull bot pushed a commit that referenced this pull request Sep 15, 2021

Merge pull request #2 from FArthur-cmd/compress_output_3473

a117804

add compression key-word and some tests

pull bot pushed a commit that referenced this pull request Jan 31, 2022

Update docs/ru/engines/table-engines/mergetree-family/graphitemergetr…

4d11df5

…ee.md #2

pull bot pushed a commit that referenced this pull request Mar 18, 2022

Merge pull request #2 from ClickHouse/master

892bcd1

Update From Base

Provide feedback

Saved searches

Use saved searches to filter your results more quickly

[pull] master from yandex:master#2

[pull] master from yandex:master#2
pull[bot] merged 1 commit intotraceon:masterfrom
ClickHouse:master

pull bot commented Aug 13, 2019 •

edited

Loading

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

Conversation

pull bot commented Aug 13, 2019 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

1 participant

pull bot commented Aug 13, 2019 •

edited

Loading