Skip to content

Using zetcd instead Zookeeper #777

Closed
Closed
Using zetcd instead Zookeeper#777
@Slach

Description

@Slach
Slach
opened on May 9, 2017

i create repo
https://github.com/Slach/clickhouse-zetcd
for reproducing stand clickhouse + zetcd
latest clickhouse Dockerimage core dumped after run following query

sudo docker-compose run clickhouse-client.local -h clickhouse-ru-1.local -q "CREATE TABLE IF NOT EXISTS zetcd_test.test_replicated (timestamp UInt32, date MATERIALIZED toDate(timestamp), trackerId String,   userId String  ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/hits_replicated', '{replica}', date, cityHash64( userId), (trackerId, date, cityHash64(userId), timestamp), 8192);"

in docker-compose logs clickhouse-ru-1.local i see

2017.05.09 17:54:32.706519 [ 1 ] <Information> : Starting daemon with revision 54198

clickhouse-ru-1.local_1    | 2017.05.09 17:56:46.979663 [ 4 ] <Debug> executeQuery: (from 172.18.0.10:38834) CREATE TABLE IF NOT EXISTS zetcd_test.test_replicated (timestamp UInt32, date MATERIALIZED toDate(timestamp), trackerId String,   userId String  ) ENGINE = ReplicatedMergeTree('/clickhouse/tables/{shard}/hits_replicated', '{replica}', date, cityHash64( userId), (trackerId, date, cityHash64(userId), timestamp), 8192)
clickhouse-ru-1.local_1    | 2017.05.09 17:56:46.980335 [ 4 ] <Information> BackgroundProcessingPool: Create BackgroundProcessingPool with 16 threads
clickhouse-ru-1.local_1    | 2017.05.09 17:56:46.983051 [ 4 ] <Debug> zetcd_test.test_replicated (Data): Loading data parts
clickhouse-ru-1.local_1    | 2017.05.09 17:56:46.983116 [ 4 ] <Debug> zetcd_test.test_replicated (Data): Loaded data parts (0 items)
clickhouse-ru-1.local_1    | 2017.05.09 17:56:46.984556 [ 4 ] <Debug> zetcd_test.test_replicated (StorageReplicatedMergeTree): Creating table /clickhouse/tables/1/hits_replicated
clickhouse-ru-1.local_1    | /home/robot-metrika-test/jenkins/workspace/clickhouse-packages-build@2/sources/contrib/libtcmalloc/src/tcmalloc.cc:286] Attempt to free invalid pointer 0x7f98402a4b60
clickhouse-ru-1.local_1    | 2017.05.09 17:56:47.003653 [ 6 ] <Error> BaseDaemon: ########################################
clickhouse-ru-1.local_1    | 2017.05.09 17:56:47.003685 [ 6 ] <Error> BaseDaemon: (from thread 5) Received signal Aborted (6).
clickhouse-ru-1.local_1    | 2017.05.09 17:56:47.040628 [ 6 ] <Error> BaseDaemon: 1. /lib/x86_64-linux-gnu/libc.so.6(gsignal+0x38) [0x7f9842740428]
clickhouse-ru-1.local_1    | 2017.05.09 17:56:47.040660 [ 6 ] <Error> BaseDaemon: 2. /usr/bin/clickhouse-server(Poco::ThreadImpl::runnableEntry(void*)+0xa5) [0x33fb245]
clickhouse-ru-1.local_1    | 2017.05.09 17:56:47.040664 [ 6 ] <Error> BaseDaemon: 3. /lib/x86_64-linux-gnu/libpthread.so.0(+0x76ba) [0x7f98431f06ba]
clickhouse-ru-1.local_1    | 2017.05.09 17:56:47.040667 [ 6 ] <Error> BaseDaemon: 4. /lib/x86_64-linux-gnu/libc.so.6(clone+0x6d) [0x7f984281182d]
clickhouse-ru-1.local_1    | Aborted (core dumped)

and zktraffic container
show following logs

17:54:32:723097 ConnectRequest(ver=0, zxid=0, timeout=30000, session=0x0, readonly=False, client=172.18.0.4:39578)
————►17:54:32:723724 ConnectReply(ver=0, timeout=30000, session=0x74085bee5926d104, readonly=False, server=172.18.0.3:2181)
17:54:32:733217 CreateRequest(size=0, xid=1494352473, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:54:32:734662 CreateReply(xid=1494352473, zxid=2, error=0, path=/clickhouse, server=172.18.0.3:2181)
17:54:32:734776 CreateRequest(size=0, xid=1494352474, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:54:32:735977 CreateReply(xid=1494352474, zxid=3, error=0, path=/clickhouse/task_queue, server=172.18.0.3:2181)
17:54:32:736095 CreateRequest(size=0, xid=1494352475, path=/clickhouse/task_queue/resharding, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:54:32:739219 CreateReply(xid=1494352475, zxid=4, error=0, path=/clickhouse/task_queue/resharding, server=172.18.0.3:2181)
17:54:32:742606 CreateRequest(size=0, xid=1494352476, path=/clickhouse/task_queue/resharding/2ed7cf718922, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:54:32:746256 CreateReply(xid=1494352476, zxid=5, error=0, path=/clickhouse/task_queue/resharding/2ed7cf718922, server=172.18.0.3:2181)
17:54:32:746556 CreateRequest(size=0, xid=1494352477, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:54:32:747985 FailedCreateReply(xid=1494352477, zxid=6, error=-110, path=, server=172.18.0.3:2181)
17:54:32:748271 CreateRequest(size=0, xid=1494352478, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:54:32:757310 FailedCreateReply(xid=1494352478, zxid=7, error=-110, path=, server=172.18.0.3:2181)
17:54:32:751792 ConnectRequest(ver=0, zxid=0, timeout=30000, session=0x0, readonly=False, client=172.18.0.5:36334)
————►17:54:32:758219 ConnectReply(ver=0, timeout=30000, session=0x74085bee5926d112, readonly=False, server=172.18.0.3:2181)
17:54:32:758356 CreateRequest(size=0, xid=1494352473, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.5:36334)
————►17:54:32:759921 FailedCreateReply(xid=1494352473, zxid=9, error=-110, path=, server=172.18.0.3:2181)
17:54:32:757654 CreateRequest(size=0, xid=1494352479, path=/clickhouse/task_queue/resharding_distributed, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:54:32:760829 CreateReply(xid=1494352479, zxid=10, error=0, path=/clickhouse/task_queue/resharding_distributed, server=172.18.0.3:2181)
17:54:32:759980 CreateRequest(size=0, xid=1494352474, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.5:36334)
————►17:54:32:769516 FailedCreateReply(xid=1494352474, zxid=11, error=-110, path=, server=172.18.0.3:2181)
17:54:32:761023 CreateRequest(size=0, xid=1494352480, path=/clickhouse/task_queue/resharding_distributed/online, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:54:32:770649 CreateReply(xid=1494352480, zxid=12, error=0, path=/clickhouse/task_queue/resharding_distributed/online, server=172.18.0.3:2181)
17:54:32:770889 CreateRequest(size=0, xid=1494352481, path=/clickhouse/task_queue/resharding_distributed/online/2ed7cf718922, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:54:32:779403 CreateReply(xid=1494352481, zxid=13, error=0, path=/clickhouse/task_queue/resharding_distributed/online/2ed7cf718922, server=172.18.0.3:2181)
17:54:32:770894 CreateRequest(size=0, xid=1494352475, path=/clickhouse/task_queue/resharding, ephemeral=False, sequence=False, client=172.18.0.5:36334)
————►17:54:32:779860 FailedCreateReply(xid=1494352475, zxid=14, error=-110, path=, server=172.18.0.3:2181)
17:54:32:779658 CreateRequest(size=0, xid=1494352482, path=/clickhouse/task_queue/resharding_distributed/lock, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:54:32:782157 CreateReply(xid=1494352482, zxid=15, error=0, path=/clickhouse/task_queue/resharding_distributed/lock, server=172.18.0.3:2181)
17:54:32:782274 CreateRequest(size=0, xid=1494352483, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:54:32:785940 FailedCreateReply(xid=1494352483, zxid=16, error=-110, path=, server=172.18.0.3:2181)
17:54:32:785207 CreateRequest(size=0, xid=1494352476, path=/clickhouse/task_queue/resharding/3074d827f15e, ephemeral=False, sequence=False, client=172.18.0.5:36334)
————►17:54:32:787088 CreateReply(xid=1494352476, zxid=17, error=0, path=/clickhouse/task_queue/resharding/3074d827f15e, server=172.18.0.3:2181)
17:54:32:787177 CreateRequest(size=0, xid=1494352477, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.5:36334)
————►17:54:32:789305 FailedCreateReply(xid=1494352477, zxid=19, error=-110, path=, server=172.18.0.3:2181)
17:54:32:786246 CreateRequest(size=0, xid=1494352484, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:54:32:789376 FailedCreateReply(xid=1494352484, zxid=18, error=-110, path=, server=172.18.0.3:2181)
17:54:32:789405 CreateRequest(size=0, xid=1494352478, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.5:36334)
————►17:54:32:792920 FailedCreateReply(xid=1494352478, zxid=20, error=-110, path=, server=172.18.0.3:2181)
17:54:32:789567 CreateRequest(size=0, xid=1494352485, path=/clickhouse/task_queue/resharding_distributed, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:54:32:793309 FailedCreateReply(xid=1494352485, zxid=21, error=-110, path=, server=172.18.0.3:2181)
17:54:32:793481 CreateRequest(size=0, xid=1494352486, path=/clickhouse/task_queue/resharding_distributed/coordination, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:54:32:796984 CreateReply(xid=1494352486, zxid=22, error=0, path=/clickhouse/task_queue/resharding_distributed/coordination, server=172.18.0.3:2181)
17:54:32:803827 CreateRequest(size=0, xid=1494352481, path=/clickhouse/task_queue/resharding_distributed/online/3074d827f15e, ephemeral=False, sequence=False, client=172.18.0.5:36334)
————►17:54:32:807504 CreateReply(xid=1494352481, zxid=25, error=0, path=/clickhouse/task_queue/resharding_distributed/online/3074d827f15e, server=172.18.0.3:2181)
17:54:32:807574 CreateRequest(size=0, xid=1494352482, path=/clickhouse/task_queue/resharding_distributed/lock, ephemeral=False, sequence=False, client=172.18.0.5:36334)
————►17:54:32:816901 FailedCreateReply(xid=1494352482, zxid=26, error=-110, path=, server=172.18.0.3:2181)
17:54:32:818265 CreateRequest(size=0, xid=1494352483, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.5:36334)
————►17:54:32:819282 FailedCreateReply(xid=1494352483, zxid=27, error=-110, path=, server=172.18.0.3:2181)
17:54:32:819365 CreateRequest(size=0, xid=1494352484, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.5:36334)
————►17:54:32:820434 FailedCreateReply(xid=1494352484, zxid=28, error=-110, path=, server=172.18.0.3:2181)
17:54:32:972017 ConnectRequest(ver=0, zxid=0, timeout=30000, session=0x0, readonly=False, client=172.18.0.6:44866)
————►17:54:33:048144 ConnectReply(ver=0, timeout=30000, session=0x74085bee5926d142, readonly=False, server=172.18.0.3:2181)
17:54:33:048408 CreateRequest(size=0, xid=1494352473, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.6:44866)
————►17:54:33:049644 FailedCreateReply(xid=1494352473, zxid=32, error=-110, path=, server=172.18.0.3:2181)
17:54:33:050483 CreateRequest(size=0, xid=1494352474, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.6:44866)
————►17:54:33:051912 FailedCreateReply(xid=1494352474, zxid=33, error=-110, path=, server=172.18.0.3:2181)
17:54:33:051966 CreateRequest(size=0, xid=1494352475, path=/clickhouse/task_queue/resharding, ephemeral=False, sequence=False, client=172.18.0.6:44866)
————►17:54:33:053203 FailedCreateReply(xid=1494352475, zxid=34, error=-110, path=, server=172.18.0.3:2181)
17:54:33:053263 CreateRequest(size=0, xid=1494352476, path=/clickhouse/task_queue/resharding/1ee79866c57e, ephemeral=False, sequence=False, client=172.18.0.6:44866)
————►17:54:33:054653 CreateReply(xid=1494352476, zxid=35, error=0, path=/clickhouse/task_queue/resharding/1ee79866c57e, server=172.18.0.3:2181)
17:54:33:054714 CreateRequest(size=0, xid=1494352477, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.6:44866)
————►17:54:33:057955 FailedCreateReply(xid=1494352477, zxid=36, error=-110, path=, server=172.18.0.3:2181)
17:54:33:058027 CreateRequest(size=0, xid=1494352478, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.6:44866)
————►17:54:33:061401 FailedCreateReply(xid=1494352478, zxid=37, error=-110, path=, server=172.18.0.3:2181)
17:54:33:061473 CreateRequest(size=0, xid=1494352479, path=/clickhouse/task_queue/resharding_distributed, ephemeral=False, sequence=False, client=172.18.0.6:44866)
————►17:54:33:063499 FailedCreateReply(xid=1494352479, zxid=38, error=-110, path=, server=172.18.0.3:2181)
17:54:33:063558 CreateRequest(size=0, xid=1494352480, path=/clickhouse/task_queue/resharding_distributed/online, ephemeral=False, sequence=False, client=172.18.0.6:44866)
————►17:54:33:067791 FailedCreateReply(xid=1494352480, zxid=39, error=-110, path=, server=172.18.0.3:2181)
17:54:33:067863 CreateRequest(size=0, xid=1494352481, path=/clickhouse/task_queue/resharding_distributed/online/1ee79866c57e, ephemeral=False, sequence=False, client=172.18.0.6:44866)
————►17:54:33:069866 CreateReply(xid=1494352481, zxid=40, error=0, path=/clickhouse/task_queue/resharding_distributed/online/1ee79866c57e, server=172.18.0.3:2181)
17:54:33:069934 CreateRequest(size=0, xid=1494352482, path=/clickhouse/task_queue/resharding_distributed/lock, ephemeral=False, sequence=False, client=172.18.0.6:44866)
————►17:54:33:127621 FailedCreateReply(xid=1494352482, zxid=41, error=-110, path=, server=172.18.0.3:2181)
17:54:33:127689 CreateRequest(size=0, xid=1494352483, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.6:44866)
————►17:54:33:128840 FailedCreateReply(xid=1494352483, zxid=42, error=-110, path=, server=172.18.0.3:2181)
17:54:33:128885 CreateRequest(size=0, xid=1494352484, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.6:44866)
————►17:54:33:129947 FailedCreateReply(xid=1494352484, zxid=43, error=-110, path=, server=172.18.0.3:2181)
17:54:33:129992 CreateRequest(size=0, xid=1494352485, path=/clickhouse/task_queue/resharding_distributed, ephemeral=False, sequence=False, client=172.18.0.6:44866)
————►17:54:33:131275 FailedCreateReply(xid=1494352485, zxid=44, error=-110, path=, server=172.18.0.3:2181)
17:54:33:131321 CreateRequest(size=0, xid=1494352486, path=/clickhouse/task_queue/resharding_distributed/coordination, ephemeral=False, sequence=False, client=172.18.0.6:44866)
————►17:54:33:132699 FailedCreateReply(xid=1494352486, zxid=45, error=-110, path=, server=172.18.0.3:2181)
17:54:33:132858 GetChildren2Request(xid=1494352487, path=/clickhouse/task_queue/resharding/1ee79866c57e, watch=False, size=0, client=172.18.0.6:44866)
————►17:54:33:133600 GetChildren2Reply(xid=1494352487, zxid=45, error=0, count=0, server=172.18.0.3:2181)
17:54:33:133650 GetChildren2Request(xid=1494352488, path=/clickhouse/task_queue/resharding/1ee79866c57e, watch=True, size=0, client=172.18.0.6:44866)
————►17:54:33:134170 GetChildren2Reply(xid=1494352488, zxid=45, error=0, count=0, server=172.18.0.3:2181)
17:54:33:484583 ConnectRequest(ver=0, zxid=0, timeout=30000, session=0x0, readonly=False, client=172.18.0.7:39238)
————►17:54:33:486373 ConnectReply(ver=0, timeout=30000, session=0x74085bee5926d161, readonly=False, server=172.18.0.3:2181)
17:54:33:500355 CreateRequest(size=0, xid=1494352474, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.7:39238)
————►17:54:33:502105 FailedCreateReply(xid=1494352474, zxid=47, error=-110, path=, server=172.18.0.3:2181)
17:54:33:502732 CreateRequest(size=0, xid=1494352475, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.7:39238)
————►17:54:33:504349 FailedCreateReply(xid=1494352475, zxid=48, error=-110, path=, server=172.18.0.3:2181)
17:54:33:504511 CreateRequest(size=0, xid=1494352476, path=/clickhouse/task_queue/resharding, ephemeral=False, sequence=False, client=172.18.0.7:39238)
————►17:54:33:505941 FailedCreateReply(xid=1494352476, zxid=49, error=-110, path=, server=172.18.0.3:2181)
17:54:33:506075 CreateRequest(size=0, xid=1494352477, path=/clickhouse/task_queue/resharding/655dcde35ccc, ephemeral=False, sequence=False, client=172.18.0.7:39238)
————►17:54:33:507706 CreateReply(xid=1494352477, zxid=50, error=0, path=/clickhouse/task_queue/resharding/655dcde35ccc, server=172.18.0.3:2181)
17:54:33:507884 CreateRequest(size=0, xid=1494352478, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.7:39238)
————►17:54:33:509274 FailedCreateReply(xid=1494352478, zxid=51, error=-110, path=, server=172.18.0.3:2181)
17:54:33:509376 CreateRequest(size=0, xid=1494352479, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.7:39238)
————►17:54:33:510983 FailedCreateReply(xid=1494352479, zxid=52, error=-110, path=, server=172.18.0.3:2181)
17:54:33:511183 CreateRequest(size=0, xid=1494352480, path=/clickhouse/task_queue/resharding_distributed, ephemeral=False, sequence=False, client=172.18.0.7:39238)
————►17:54:33:513039 FailedCreateReply(xid=1494352480, zxid=53, error=-110, path=, server=172.18.0.3:2181)
17:54:33:513145 CreateRequest(size=0, xid=1494352481, path=/clickhouse/task_queue/resharding_distributed/online, ephemeral=False, sequence=False, client=172.18.0.7:39238)
————►17:54:33:514593 FailedCreateReply(xid=1494352481, zxid=54, error=-110, path=, server=172.18.0.3:2181)
17:54:33:514730 CreateRequest(size=0, xid=1494352482, path=/clickhouse/task_queue/resharding_distributed/online/655dcde35ccc, ephemeral=False, sequence=False, client=172.18.0.7:39238)
————►17:54:33:516409 CreateReply(xid=1494352482, zxid=55, error=0, path=/clickhouse/task_queue/resharding_distributed/online/655dcde35ccc, server=172.18.0.3:2181)
17:54:33:516594 CreateRequest(size=0, xid=1494352483, path=/clickhouse/task_queue/resharding_distributed/lock, ephemeral=False, sequence=False, client=172.18.0.7:39238)
————►17:54:33:520364 FailedCreateReply(xid=1494352483, zxid=56, error=-110, path=, server=172.18.0.3:2181)
17:54:33:520530 CreateRequest(size=0, xid=1494352484, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.7:39238)
————►17:54:33:521882 FailedCreateReply(xid=1494352484, zxid=57, error=-110, path=, server=172.18.0.3:2181)
17:54:33:522066 CreateRequest(size=0, xid=1494352485, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.7:39238)
————►17:54:33:526435 FailedCreateReply(xid=1494352485, zxid=58, error=-110, path=, server=172.18.0.3:2181)
17:54:33:526582 CreateRequest(size=0, xid=1494352486, path=/clickhouse/task_queue/resharding_distributed, ephemeral=False, sequence=False, client=172.18.0.7:39238)
————►17:54:33:530760 FailedCreateReply(xid=1494352486, zxid=59, error=-110, path=, server=172.18.0.3:2181)
17:54:33:530875 CreateRequest(size=0, xid=1494352487, path=/clickhouse/task_queue/resharding_distributed/coordination, ephemeral=False, sequence=False, client=172.18.0.7:39238)
————►17:54:33:532444 FailedCreateReply(xid=1494352487, zxid=60, error=-110, path=, server=172.18.0.3:2181)
17:54:33:532644 GetChildren2Request(xid=1494352488, path=/clickhouse/task_queue/resharding/655dcde35ccc, watch=False, size=0, client=172.18.0.7:39238)
————►17:54:33:534792 GetChildren2Reply(xid=1494352488, zxid=60, error=0, count=0, server=172.18.0.3:2181)
17:54:33:534876 GetChildren2Request(xid=1494352489, path=/clickhouse/task_queue/resharding/655dcde35ccc, watch=True, size=0, client=172.18.0.7:39238)
————►17:54:33:535667 GetChildren2Reply(xid=1494352489, zxid=60, error=0, count=0, server=172.18.0.3:2181)
17:54:33:551575 ConnectRequest(ver=0, zxid=0, timeout=30000, session=0x0, readonly=False, client=172.18.0.8:50670)
————►17:54:33:552834 ConnectReply(ver=0, timeout=30000, session=0x74085bee5926d180, readonly=False, server=172.18.0.3:2181)
17:54:33:554481 CreateRequest(size=0, xid=1494352474, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.8:50670)
————►17:54:33:555888 FailedCreateReply(xid=1494352474, zxid=62, error=-110, path=, server=172.18.0.3:2181)
17:54:33:555943 CreateRequest(size=0, xid=1494352475, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.8:50670)
————►17:54:33:557797 FailedCreateReply(xid=1494352475, zxid=63, error=-110, path=, server=172.18.0.3:2181)
17:54:33:557889 CreateRequest(size=0, xid=1494352476, path=/clickhouse/task_queue/resharding, ephemeral=False, sequence=False, client=172.18.0.8:50670)
————►17:54:33:559473 FailedCreateReply(xid=1494352476, zxid=64, error=-110, path=, server=172.18.0.3:2181)
17:54:33:559568 CreateRequest(size=0, xid=1494352477, path=/clickhouse/task_queue/resharding/89515b3d7f8b, ephemeral=False, sequence=False, client=172.18.0.8:50670)
————►17:54:33:560953 CreateReply(xid=1494352477, zxid=65, error=0, path=/clickhouse/task_queue/resharding/89515b3d7f8b, server=172.18.0.3:2181)
17:54:33:561020 CreateRequest(size=0, xid=1494352478, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.8:50670)
————►17:54:33:562095 FailedCreateReply(xid=1494352478, zxid=66, error=-110, path=, server=172.18.0.3:2181)
17:54:33:562191 CreateRequest(size=0, xid=1494352479, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.8:50670)
————►17:54:33:563304 FailedCreateReply(xid=1494352479, zxid=67, error=-110, path=, server=172.18.0.3:2181)
17:54:33:563398 CreateRequest(size=0, xid=1494352480, path=/clickhouse/task_queue/resharding_distributed, ephemeral=False, sequence=False, client=172.18.0.8:50670)
————►17:54:33:564441 FailedCreateReply(xid=1494352480, zxid=68, error=-110, path=, server=172.18.0.3:2181)
17:54:33:564536 CreateRequest(size=0, xid=1494352481, path=/clickhouse/task_queue/resharding_distributed/online, ephemeral=False, sequence=False, client=172.18.0.8:50670)
————►17:54:33:566551 FailedCreateReply(xid=1494352481, zxid=69, error=-110, path=, server=172.18.0.3:2181)
17:54:33:566666 CreateRequest(size=0, xid=1494352482, path=/clickhouse/task_queue/resharding_distributed/online/89515b3d7f8b, ephemeral=False, sequence=False, client=172.18.0.8:50670)
————►17:54:33:567772 CreateReply(xid=1494352482, zxid=70, error=0, path=/clickhouse/task_queue/resharding_distributed/online/89515b3d7f8b, server=172.18.0.3:2181)
17:54:33:567840 CreateRequest(size=0, xid=1494352483, path=/clickhouse/task_queue/resharding_distributed/lock, ephemeral=False, sequence=False, client=172.18.0.8:50670)
————►17:54:33:569151 FailedCreateReply(xid=1494352483, zxid=71, error=-110, path=, server=172.18.0.3:2181)
17:54:33:571107 CreateRequest(size=0, xid=1494352484, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.8:50670)
————►17:54:33:572133 FailedCreateReply(xid=1494352484, zxid=72, error=-110, path=, server=172.18.0.3:2181)
17:54:33:572270 CreateRequest(size=0, xid=1494352485, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.8:50670)
————►17:54:33:573614 FailedCreateReply(xid=1494352485, zxid=73, error=-110, path=, server=172.18.0.3:2181)
17:54:33:573715 CreateRequest(size=0, xid=1494352486, path=/clickhouse/task_queue/resharding_distributed, ephemeral=False, sequence=False, client=172.18.0.8:50670)
————►17:54:33:576892 FailedCreateReply(xid=1494352486, zxid=74, error=-110, path=, server=172.18.0.3:2181)
17:54:33:576995 CreateRequest(size=0, xid=1494352487, path=/clickhouse/task_queue/resharding_distributed/coordination, ephemeral=False, sequence=False, client=172.18.0.8:50670)
————►17:54:33:578439 FailedCreateReply(xid=1494352487, zxid=75, error=-110, path=, server=172.18.0.3:2181)
17:54:33:578866 GetChildren2Request(xid=1494352488, path=/clickhouse/task_queue/resharding/89515b3d7f8b, watch=False, size=0, client=172.18.0.8:50670)
————►17:54:33:580944 GetChildren2Reply(xid=1494352488, zxid=75, error=0, count=0, server=172.18.0.3:2181)
17:54:33:581393 GetChildren2Request(xid=1494352489, path=/clickhouse/task_queue/resharding/89515b3d7f8b, watch=True, size=0, client=172.18.0.8:50670)
————►17:54:33:582713 GetChildren2Reply(xid=1494352489, zxid=75, error=0, count=0, server=172.18.0.3:2181)
17:54:34:512765 ConnectRequest(ver=0, zxid=0, timeout=30000, session=0x0, readonly=False, client=172.18.0.9:56390)
————►17:54:34:521424 ConnectReply(ver=0, timeout=30000, session=0x74085bee5926d19f, readonly=False, server=172.18.0.3:2181)
17:54:34:521899 CreateRequest(size=0, xid=1494352475, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.9:56390)
————►17:54:34:525570 FailedCreateReply(xid=1494352475, zxid=77, error=-110, path=, server=172.18.0.3:2181)
17:54:34:525649 CreateRequest(size=0, xid=1494352476, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.9:56390)
————►17:54:34:526771 FailedCreateReply(xid=1494352476, zxid=78, error=-110, path=, server=172.18.0.3:2181)
17:54:34:526829 CreateRequest(size=0, xid=1494352477, path=/clickhouse/task_queue/resharding, ephemeral=False, sequence=False, client=172.18.0.9:56390)
————►17:54:34:527872 FailedCreateReply(xid=1494352477, zxid=79, error=-110, path=, server=172.18.0.3:2181)
17:54:34:527929 CreateRequest(size=0, xid=1494352478, path=/clickhouse/task_queue/resharding/6974dc99f908, ephemeral=False, sequence=False, client=172.18.0.9:56390)
————►17:54:34:529064 CreateReply(xid=1494352478, zxid=80, error=0, path=/clickhouse/task_queue/resharding/6974dc99f908, server=172.18.0.3:2181)
17:54:34:529125 CreateRequest(size=0, xid=1494352479, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.9:56390)
————►17:54:34:529969 FailedCreateReply(xid=1494352479, zxid=81, error=-110, path=, server=172.18.0.3:2181)
17:54:34:530030 CreateRequest(size=0, xid=1494352480, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.9:56390)
————►17:54:34:531215 FailedCreateReply(xid=1494352480, zxid=82, error=-110, path=, server=172.18.0.3:2181)
17:54:34:531273 CreateRequest(size=0, xid=1494352481, path=/clickhouse/task_queue/resharding_distributed, ephemeral=False, sequence=False, client=172.18.0.9:56390)
————►17:54:34:532346 FailedCreateReply(xid=1494352481, zxid=83, error=-110, path=, server=172.18.0.3:2181)
17:54:34:532477 CreateRequest(size=0, xid=1494352482, path=/clickhouse/task_queue/resharding_distributed/online, ephemeral=False, sequence=False, client=172.18.0.9:56390)
————►17:54:34:535046 FailedCreateReply(xid=1494352482, zxid=84, error=-110, path=, server=172.18.0.3:2181)
17:54:34:535123 CreateRequest(size=0, xid=1494352483, path=/clickhouse/task_queue/resharding_distributed/online/6974dc99f908, ephemeral=False, sequence=False, client=172.18.0.9:56390)
————►17:54:34:536696 CreateReply(xid=1494352483, zxid=85, error=0, path=/clickhouse/task_queue/resharding_distributed/online/6974dc99f908, server=172.18.0.3:2181)
17:54:34:536798 CreateRequest(size=0, xid=1494352484, path=/clickhouse/task_queue/resharding_distributed/lock, ephemeral=False, sequence=False, client=172.18.0.9:56390)
————►17:54:34:541213 FailedCreateReply(xid=1494352484, zxid=86, error=-110, path=, server=172.18.0.3:2181)
17:54:34:541289 CreateRequest(size=0, xid=1494352485, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.9:56390)
————►17:54:34:543614 FailedCreateReply(xid=1494352485, zxid=87, error=-110, path=, server=172.18.0.3:2181)
17:54:34:543666 CreateRequest(size=0, xid=1494352486, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.9:56390)
————►17:54:34:544954 FailedCreateReply(xid=1494352486, zxid=88, error=-110, path=, server=172.18.0.3:2181)
17:54:34:545003 CreateRequest(size=0, xid=1494352487, path=/clickhouse/task_queue/resharding_distributed, ephemeral=False, sequence=False, client=172.18.0.9:56390)
————►17:54:34:546192 FailedCreateReply(xid=1494352487, zxid=89, error=-110, path=, server=172.18.0.3:2181)
17:54:34:546240 CreateRequest(size=0, xid=1494352488, path=/clickhouse/task_queue/resharding_distributed/coordination, ephemeral=False, sequence=False, client=172.18.0.9:56390)
————►17:54:34:548786 FailedCreateReply(xid=1494352488, zxid=90, error=-110, path=, server=172.18.0.3:2181)
17:54:34:549071 GetChildren2Request(xid=1494352489, path=/clickhouse/task_queue/resharding/6974dc99f908, watch=False, size=0, client=172.18.0.9:56390)
————►17:54:34:549863 GetChildren2Reply(xid=1494352489, zxid=90, error=0, count=0, server=172.18.0.3:2181)
17:54:34:549917 GetChildren2Request(xid=1494352490, path=/clickhouse/task_queue/resharding/6974dc99f908, watch=True, size=0, client=172.18.0.9:56390)
————►17:54:34:550566 GetChildren2Reply(xid=1494352490, zxid=90, error=0, count=0, server=172.18.0.3:2181)
17:56:46:981019 ExistsRequest(xid=1494352489, path=/clickhouse/tables/1/hits_replicated/replicas/clickhouse-ru-1.local/flags/force_restore_data, watch=False, size=0, client=172.18.0.4:39578)
————►17:56:46:982127 FailedExistsReply(xid=1494352489, zxid=90, error=-101, server=172.18.0.3:2181)
17:56:46:983186 ExistsRequest(xid=1494352490, path=/clickhouse/tables/1/hits_replicated, watch=False, size=0, client=172.18.0.4:39578)
————►17:56:46:983957 FailedExistsReply(xid=1494352490, zxid=90, error=-101, server=172.18.0.3:2181)
17:56:46:984629 CreateRequest(size=0, xid=1494352491, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:56:46:986060 FailedCreateReply(xid=1494352491, zxid=91, error=-110, path=, server=172.18.0.3:2181)
17:56:46:987046 CreateRequest(size=0, xid=1494352492, path=/clickhouse/tables, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:56:46:993787 CreateReply(xid=1494352492, zxid=92, error=0, path=/clickhouse/tables, server=172.18.0.3:2181)
17:56:46:993953 CreateRequest(size=0, xid=1494352493, path=/clickhouse/tables/1, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:56:46:995372 CreateReply(xid=1494352493, zxid=93, error=0, path=/clickhouse/tables/1, server=172.18.0.3:2181)zktraffic_1                | 17:54:32:723097 ConnectRequest(ver=0, zxid=0, timeout=30000, session=0x0, readonly=False, client=172.18.0.4:39578)
————►17:54:32:723724 ConnectReply(ver=0, timeout=30000, session=0x74085bee5926d104, readonly=False, server=172.18.0.3:2181)
17:54:32:733217 CreateRequest(size=0, xid=1494352473, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:54:32:734662 CreateReply(xid=1494352473, zxid=2, error=0, path=/clickhouse, server=172.18.0.3:2181)
17:54:32:734776 CreateRequest(size=0, xid=1494352474, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:54:32:735977 CreateReply(xid=1494352474, zxid=3, error=0, path=/clickhouse/task_queue, server=172.18.0.3:2181)
17:54:32:736095 CreateRequest(size=0, xid=1494352475, path=/clickhouse/task_queue/resharding, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:54:32:739219 CreateReply(xid=1494352475, zxid=4, error=0, path=/clickhouse/task_queue/resharding, server=172.18.0.3:2181)
17:54:32:742606 CreateRequest(size=0, xid=1494352476, path=/clickhouse/task_queue/resharding/2ed7cf718922, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:54:32:746256 CreateReply(xid=1494352476, zxid=5, error=0, path=/clickhouse/task_queue/resharding/2ed7cf718922, server=172.18.0.3:2181)
17:54:32:746556 CreateRequest(size=0, xid=1494352477, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:54:32:747985 FailedCreateReply(xid=1494352477, zxid=6, error=-110, path=, server=172.18.0.3:2181)
17:54:32:748271 CreateRequest(size=0, xid=1494352478, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:54:32:757310 FailedCreateReply(xid=1494352478, zxid=7, error=-110, path=, server=172.18.0.3:2181)
17:54:32:751792 ConnectRequest(ver=0, zxid=0, timeout=30000, session=0x0, readonly=False, client=172.18.0.5:36334)
————►17:54:32:758219 ConnectReply(ver=0, timeout=30000, session=0x74085bee5926d112, readonly=False, server=172.18.0.3:2181)
17:54:32:758356 CreateRequest(size=0, xid=1494352473, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.5:36334)
————►17:54:32:759921 FailedCreateReply(xid=1494352473, zxid=9, error=-110, path=, server=172.18.0.3:2181)
17:54:32:757654 CreateRequest(size=0, xid=1494352479, path=/clickhouse/task_queue/resharding_distributed, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:54:32:760829 CreateReply(xid=1494352479, zxid=10, error=0, path=/clickhouse/task_queue/resharding_distributed, server=172.18.0.3:2181)
17:54:32:759980 CreateRequest(size=0, xid=1494352474, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.5:36334)
————►17:54:32:769516 FailedCreateReply(xid=1494352474, zxid=11, error=-110, path=, server=172.18.0.3:2181)
17:54:32:761023 CreateRequest(size=0, xid=1494352480, path=/clickhouse/task_queue/resharding_distributed/online, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:54:32:770649 CreateReply(xid=1494352480, zxid=12, error=0, path=/clickhouse/task_queue/resharding_distributed/online, server=172.18.0.3:2181)
17:54:32:770889 CreateRequest(size=0, xid=1494352481, path=/clickhouse/task_queue/resharding_distributed/online/2ed7cf718922, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:54:32:779403 CreateReply(xid=1494352481, zxid=13, error=0, path=/clickhouse/task_queue/resharding_distributed/online/2ed7cf718922, server=172.18.0.3:2181)
17:54:32:770894 CreateRequest(size=0, xid=1494352475, path=/clickhouse/task_queue/resharding, ephemeral=False, sequence=False, client=172.18.0.5:36334)
————►17:54:32:779860 FailedCreateReply(xid=1494352475, zxid=14, error=-110, path=, server=172.18.0.3:2181)
17:54:32:779658 CreateRequest(size=0, xid=1494352482, path=/clickhouse/task_queue/resharding_distributed/lock, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:54:32:782157 CreateReply(xid=1494352482, zxid=15, error=0, path=/clickhouse/task_queue/resharding_distributed/lock, server=172.18.0.3:2181)
17:54:32:782274 CreateRequest(size=0, xid=1494352483, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:54:32:785940 FailedCreateReply(xid=1494352483, zxid=16, error=-110, path=, server=172.18.0.3:2181)
17:54:32:785207 CreateRequest(size=0, xid=1494352476, path=/clickhouse/task_queue/resharding/3074d827f15e, ephemeral=False, sequence=False, client=172.18.0.5:36334)
————►17:54:32:787088 CreateReply(xid=1494352476, zxid=17, error=0, path=/clickhouse/task_queue/resharding/3074d827f15e, server=172.18.0.3:2181)
17:54:32:787177 CreateRequest(size=0, xid=1494352477, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.5:36334)
————►17:54:32:789305 FailedCreateReply(xid=1494352477, zxid=19, error=-110, path=, server=172.18.0.3:2181)
17:54:32:786246 CreateRequest(size=0, xid=1494352484, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:54:32:789376 FailedCreateReply(xid=1494352484, zxid=18, error=-110, path=, server=172.18.0.3:2181)
17:54:32:789405 CreateRequest(size=0, xid=1494352478, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.5:36334)
————►17:54:32:792920 FailedCreateReply(xid=1494352478, zxid=20, error=-110, path=, server=172.18.0.3:2181)
17:54:32:789567 CreateRequest(size=0, xid=1494352485, path=/clickhouse/task_queue/resharding_distributed, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:54:32:793309 FailedCreateReply(xid=1494352485, zxid=21, error=-110, path=, server=172.18.0.3:2181)
17:54:32:793481 CreateRequest(size=0, xid=1494352486, path=/clickhouse/task_queue/resharding_distributed/coordination, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:54:32:796984 CreateReply(xid=1494352486, zxid=22, error=0, path=/clickhouse/task_queue/resharding_distributed/coordination, server=172.18.0.3:2181)
17:54:32:803827 CreateRequest(size=0, xid=1494352481, path=/clickhouse/task_queue/resharding_distributed/online/3074d827f15e, ephemeral=False, sequence=False, client=172.18.0.5:36334)
————►17:54:32:807504 CreateReply(xid=1494352481, zxid=25, error=0, path=/clickhouse/task_queue/resharding_distributed/online/3074d827f15e, server=172.18.0.3:2181)
17:54:32:807574 CreateRequest(size=0, xid=1494352482, path=/clickhouse/task_queue/resharding_distributed/lock, ephemeral=False, sequence=False, client=172.18.0.5:36334)
————►17:54:32:816901 FailedCreateReply(xid=1494352482, zxid=26, error=-110, path=, server=172.18.0.3:2181)
17:54:32:818265 CreateRequest(size=0, xid=1494352483, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.5:36334)
————►17:54:32:819282 FailedCreateReply(xid=1494352483, zxid=27, error=-110, path=, server=172.18.0.3:2181)
17:54:32:819365 CreateRequest(size=0, xid=1494352484, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.5:36334)
————►17:54:32:820434 FailedCreateReply(xid=1494352484, zxid=28, error=-110, path=, server=172.18.0.3:2181)
17:54:32:972017 ConnectRequest(ver=0, zxid=0, timeout=30000, session=0x0, readonly=False, client=172.18.0.6:44866)
————►17:54:33:048144 ConnectReply(ver=0, timeout=30000, session=0x74085bee5926d142, readonly=False, server=172.18.0.3:2181)
17:54:33:048408 CreateRequest(size=0, xid=1494352473, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.6:44866)
————►17:54:33:049644 FailedCreateReply(xid=1494352473, zxid=32, error=-110, path=, server=172.18.0.3:2181)
17:54:33:050483 CreateRequest(size=0, xid=1494352474, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.6:44866)
————►17:54:33:051912 FailedCreateReply(xid=1494352474, zxid=33, error=-110, path=, server=172.18.0.3:2181)
17:54:33:051966 CreateRequest(size=0, xid=1494352475, path=/clickhouse/task_queue/resharding, ephemeral=False, sequence=False, client=172.18.0.6:44866)
————►17:54:33:053203 FailedCreateReply(xid=1494352475, zxid=34, error=-110, path=, server=172.18.0.3:2181)
17:54:33:053263 CreateRequest(size=0, xid=1494352476, path=/clickhouse/task_queue/resharding/1ee79866c57e, ephemeral=False, sequence=False, client=172.18.0.6:44866)
————►17:54:33:054653 CreateReply(xid=1494352476, zxid=35, error=0, path=/clickhouse/task_queue/resharding/1ee79866c57e, server=172.18.0.3:2181)
17:54:33:054714 CreateRequest(size=0, xid=1494352477, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.6:44866)
————►17:54:33:057955 FailedCreateReply(xid=1494352477, zxid=36, error=-110, path=, server=172.18.0.3:2181)
17:54:33:058027 CreateRequest(size=0, xid=1494352478, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.6:44866)
————►17:54:33:061401 FailedCreateReply(xid=1494352478, zxid=37, error=-110, path=, server=172.18.0.3:2181)
17:54:33:061473 CreateRequest(size=0, xid=1494352479, path=/clickhouse/task_queue/resharding_distributed, ephemeral=False, sequence=False, client=172.18.0.6:44866)
————►17:54:33:063499 FailedCreateReply(xid=1494352479, zxid=38, error=-110, path=, server=172.18.0.3:2181)
17:54:33:063558 CreateRequest(size=0, xid=1494352480, path=/clickhouse/task_queue/resharding_distributed/online, ephemeral=False, sequence=False, client=172.18.0.6:44866)
————►17:54:33:067791 FailedCreateReply(xid=1494352480, zxid=39, error=-110, path=, server=172.18.0.3:2181)
17:54:33:067863 CreateRequest(size=0, xid=1494352481, path=/clickhouse/task_queue/resharding_distributed/online/1ee79866c57e, ephemeral=False, sequence=False, client=172.18.0.6:44866)
————►17:54:33:069866 CreateReply(xid=1494352481, zxid=40, error=0, path=/clickhouse/task_queue/resharding_distributed/online/1ee79866c57e, server=172.18.0.3:2181)
17:54:33:069934 CreateRequest(size=0, xid=1494352482, path=/clickhouse/task_queue/resharding_distributed/lock, ephemeral=False, sequence=False, client=172.18.0.6:44866)
————►17:54:33:127621 FailedCreateReply(xid=1494352482, zxid=41, error=-110, path=, server=172.18.0.3:2181)
17:54:33:127689 CreateRequest(size=0, xid=1494352483, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.6:44866)
————►17:54:33:128840 FailedCreateReply(xid=1494352483, zxid=42, error=-110, path=, server=172.18.0.3:2181)
17:54:33:128885 CreateRequest(size=0, xid=1494352484, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.6:44866)
————►17:54:33:129947 FailedCreateReply(xid=1494352484, zxid=43, error=-110, path=, server=172.18.0.3:2181)
17:54:33:129992 CreateRequest(size=0, xid=1494352485, path=/clickhouse/task_queue/resharding_distributed, ephemeral=False, sequence=False, client=172.18.0.6:44866)
————►17:54:33:131275 FailedCreateReply(xid=1494352485, zxid=44, error=-110, path=, server=172.18.0.3:2181)
17:54:33:131321 CreateRequest(size=0, xid=1494352486, path=/clickhouse/task_queue/resharding_distributed/coordination, ephemeral=False, sequence=False, client=172.18.0.6:44866)
————►17:54:33:132699 FailedCreateReply(xid=1494352486, zxid=45, error=-110, path=, server=172.18.0.3:2181)
17:54:33:132858 GetChildren2Request(xid=1494352487, path=/clickhouse/task_queue/resharding/1ee79866c57e, watch=False, size=0, client=172.18.0.6:44866)
————►17:54:33:133600 GetChildren2Reply(xid=1494352487, zxid=45, error=0, count=0, server=172.18.0.3:2181)
17:54:33:133650 GetChildren2Request(xid=1494352488, path=/clickhouse/task_queue/resharding/1ee79866c57e, watch=True, size=0, client=172.18.0.6:44866)
————►17:54:33:134170 GetChildren2Reply(xid=1494352488, zxid=45, error=0, count=0, server=172.18.0.3:2181)
17:54:33:484583 ConnectRequest(ver=0, zxid=0, timeout=30000, session=0x0, readonly=False, client=172.18.0.7:39238)
————►17:54:33:486373 ConnectReply(ver=0, timeout=30000, session=0x74085bee5926d161, readonly=False, server=172.18.0.3:2181)
17:54:33:500355 CreateRequest(size=0, xid=1494352474, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.7:39238)
————►17:54:33:502105 FailedCreateReply(xid=1494352474, zxid=47, error=-110, path=, server=172.18.0.3:2181)
17:54:33:502732 CreateRequest(size=0, xid=1494352475, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.7:39238)
————►17:54:33:504349 FailedCreateReply(xid=1494352475, zxid=48, error=-110, path=, server=172.18.0.3:2181)
17:54:33:504511 CreateRequest(size=0, xid=1494352476, path=/clickhouse/task_queue/resharding, ephemeral=False, sequence=False, client=172.18.0.7:39238)
————►17:54:33:505941 FailedCreateReply(xid=1494352476, zxid=49, error=-110, path=, server=172.18.0.3:2181)
17:54:33:506075 CreateRequest(size=0, xid=1494352477, path=/clickhouse/task_queue/resharding/655dcde35ccc, ephemeral=False, sequence=False, client=172.18.0.7:39238)
————►17:54:33:507706 CreateReply(xid=1494352477, zxid=50, error=0, path=/clickhouse/task_queue/resharding/655dcde35ccc, server=172.18.0.3:2181)
17:54:33:507884 CreateRequest(size=0, xid=1494352478, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.7:39238)
————►17:54:33:509274 FailedCreateReply(xid=1494352478, zxid=51, error=-110, path=, server=172.18.0.3:2181)
17:54:33:509376 CreateRequest(size=0, xid=1494352479, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.7:39238)
————►17:54:33:510983 FailedCreateReply(xid=1494352479, zxid=52, error=-110, path=, server=172.18.0.3:2181)
17:54:33:511183 CreateRequest(size=0, xid=1494352480, path=/clickhouse/task_queue/resharding_distributed, ephemeral=False, sequence=False, client=172.18.0.7:39238)
————►17:54:33:513039 FailedCreateReply(xid=1494352480, zxid=53, error=-110, path=, server=172.18.0.3:2181)
17:54:33:513145 CreateRequest(size=0, xid=1494352481, path=/clickhouse/task_queue/resharding_distributed/online, ephemeral=False, sequence=False, client=172.18.0.7:39238)
————►17:54:33:514593 FailedCreateReply(xid=1494352481, zxid=54, error=-110, path=, server=172.18.0.3:2181)
17:54:33:514730 CreateRequest(size=0, xid=1494352482, path=/clickhouse/task_queue/resharding_distributed/online/655dcde35ccc, ephemeral=False, sequence=False, client=172.18.0.7:39238)
————►17:54:33:516409 CreateReply(xid=1494352482, zxid=55, error=0, path=/clickhouse/task_queue/resharding_distributed/online/655dcde35ccc, server=172.18.0.3:2181)
17:54:33:516594 CreateRequest(size=0, xid=1494352483, path=/clickhouse/task_queue/resharding_distributed/lock, ephemeral=False, sequence=False, client=172.18.0.7:39238)
————►17:54:33:520364 FailedCreateReply(xid=1494352483, zxid=56, error=-110, path=, server=172.18.0.3:2181)
17:54:33:520530 CreateRequest(size=0, xid=1494352484, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.7:39238)
————►17:54:33:521882 FailedCreateReply(xid=1494352484, zxid=57, error=-110, path=, server=172.18.0.3:2181)
17:54:33:522066 CreateRequest(size=0, xid=1494352485, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.7:39238)
————►17:54:33:526435 FailedCreateReply(xid=1494352485, zxid=58, error=-110, path=, server=172.18.0.3:2181)
17:54:33:526582 CreateRequest(size=0, xid=1494352486, path=/clickhouse/task_queue/resharding_distributed, ephemeral=False, sequence=False, client=172.18.0.7:39238)
————►17:54:33:530760 FailedCreateReply(xid=1494352486, zxid=59, error=-110, path=, server=172.18.0.3:2181)
17:54:33:530875 CreateRequest(size=0, xid=1494352487, path=/clickhouse/task_queue/resharding_distributed/coordination, ephemeral=False, sequence=False, client=172.18.0.7:39238)
————►17:54:33:532444 FailedCreateReply(xid=1494352487, zxid=60, error=-110, path=, server=172.18.0.3:2181)
17:54:33:532644 GetChildren2Request(xid=1494352488, path=/clickhouse/task_queue/resharding/655dcde35ccc, watch=False, size=0, client=172.18.0.7:39238)
————►17:54:33:534792 GetChildren2Reply(xid=1494352488, zxid=60, error=0, count=0, server=172.18.0.3:2181)
17:54:33:534876 GetChildren2Request(xid=1494352489, path=/clickhouse/task_queue/resharding/655dcde35ccc, watch=True, size=0, client=172.18.0.7:39238)
————►17:54:33:535667 GetChildren2Reply(xid=1494352489, zxid=60, error=0, count=0, server=172.18.0.3:2181)
17:54:33:551575 ConnectRequest(ver=0, zxid=0, timeout=30000, session=0x0, readonly=False, client=172.18.0.8:50670)
————►17:54:33:552834 ConnectReply(ver=0, timeout=30000, session=0x74085bee5926d180, readonly=False, server=172.18.0.3:2181)
17:54:33:554481 CreateRequest(size=0, xid=1494352474, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.8:50670)
————►17:54:33:555888 FailedCreateReply(xid=1494352474, zxid=62, error=-110, path=, server=172.18.0.3:2181)
17:54:33:555943 CreateRequest(size=0, xid=1494352475, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.8:50670)
————►17:54:33:557797 FailedCreateReply(xid=1494352475, zxid=63, error=-110, path=, server=172.18.0.3:2181)
17:54:33:557889 CreateRequest(size=0, xid=1494352476, path=/clickhouse/task_queue/resharding, ephemeral=False, sequence=False, client=172.18.0.8:50670)
————►17:54:33:559473 FailedCreateReply(xid=1494352476, zxid=64, error=-110, path=, server=172.18.0.3:2181)
17:54:33:559568 CreateRequest(size=0, xid=1494352477, path=/clickhouse/task_queue/resharding/89515b3d7f8b, ephemeral=False, sequence=False, client=172.18.0.8:50670)
————►17:54:33:560953 CreateReply(xid=1494352477, zxid=65, error=0, path=/clickhouse/task_queue/resharding/89515b3d7f8b, server=172.18.0.3:2181)
17:54:33:561020 CreateRequest(size=0, xid=1494352478, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.8:50670)
————►17:54:33:562095 FailedCreateReply(xid=1494352478, zxid=66, error=-110, path=, server=172.18.0.3:2181)
17:54:33:562191 CreateRequest(size=0, xid=1494352479, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.8:50670)
————►17:54:33:563304 FailedCreateReply(xid=1494352479, zxid=67, error=-110, path=, server=172.18.0.3:2181)
17:54:33:563398 CreateRequest(size=0, xid=1494352480, path=/clickhouse/task_queue/resharding_distributed, ephemeral=False, sequence=False, client=172.18.0.8:50670)
————►17:54:33:564441 FailedCreateReply(xid=1494352480, zxid=68, error=-110, path=, server=172.18.0.3:2181)
17:54:33:564536 CreateRequest(size=0, xid=1494352481, path=/clickhouse/task_queue/resharding_distributed/online, ephemeral=False, sequence=False, client=172.18.0.8:50670)
————►17:54:33:566551 FailedCreateReply(xid=1494352481, zxid=69, error=-110, path=, server=172.18.0.3:2181)
17:54:33:566666 CreateRequest(size=0, xid=1494352482, path=/clickhouse/task_queue/resharding_distributed/online/89515b3d7f8b, ephemeral=False, sequence=False, client=172.18.0.8:50670)
————►17:54:33:567772 CreateReply(xid=1494352482, zxid=70, error=0, path=/clickhouse/task_queue/resharding_distributed/online/89515b3d7f8b, server=172.18.0.3:2181)
17:54:33:567840 CreateRequest(size=0, xid=1494352483, path=/clickhouse/task_queue/resharding_distributed/lock, ephemeral=False, sequence=False, client=172.18.0.8:50670)
————►17:54:33:569151 FailedCreateReply(xid=1494352483, zxid=71, error=-110, path=, server=172.18.0.3:2181)
17:54:33:571107 CreateRequest(size=0, xid=1494352484, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.8:50670)
————►17:54:33:572133 FailedCreateReply(xid=1494352484, zxid=72, error=-110, path=, server=172.18.0.3:2181)
17:54:33:572270 CreateRequest(size=0, xid=1494352485, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.8:50670)
————►17:54:33:573614 FailedCreateReply(xid=1494352485, zxid=73, error=-110, path=, server=172.18.0.3:2181)
17:54:33:573715 CreateRequest(size=0, xid=1494352486, path=/clickhouse/task_queue/resharding_distributed, ephemeral=False, sequence=False, client=172.18.0.8:50670)
————►17:54:33:576892 FailedCreateReply(xid=1494352486, zxid=74, error=-110, path=, server=172.18.0.3:2181)
17:54:33:576995 CreateRequest(size=0, xid=1494352487, path=/clickhouse/task_queue/resharding_distributed/coordination, ephemeral=False, sequence=False, client=172.18.0.8:50670)
————►17:54:33:578439 FailedCreateReply(xid=1494352487, zxid=75, error=-110, path=, server=172.18.0.3:2181)
17:54:33:578866 GetChildren2Request(xid=1494352488, path=/clickhouse/task_queue/resharding/89515b3d7f8b, watch=False, size=0, client=172.18.0.8:50670)
————►17:54:33:580944 GetChildren2Reply(xid=1494352488, zxid=75, error=0, count=0, server=172.18.0.3:2181)
17:54:33:581393 GetChildren2Request(xid=1494352489, path=/clickhouse/task_queue/resharding/89515b3d7f8b, watch=True, size=0, client=172.18.0.8:50670)
————►17:54:33:582713 GetChildren2Reply(xid=1494352489, zxid=75, error=0, count=0, server=172.18.0.3:2181)
17:54:34:512765 ConnectRequest(ver=0, zxid=0, timeout=30000, session=0x0, readonly=False, client=172.18.0.9:56390)
————►17:54:34:521424 ConnectReply(ver=0, timeout=30000, session=0x74085bee5926d19f, readonly=False, server=172.18.0.3:2181)
17:54:34:521899 CreateRequest(size=0, xid=1494352475, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.9:56390)
————►17:54:34:525570 FailedCreateReply(xid=1494352475, zxid=77, error=-110, path=, server=172.18.0.3:2181)
17:54:34:525649 CreateRequest(size=0, xid=1494352476, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.9:56390)
————►17:54:34:526771 FailedCreateReply(xid=1494352476, zxid=78, error=-110, path=, server=172.18.0.3:2181)
17:54:34:526829 CreateRequest(size=0, xid=1494352477, path=/clickhouse/task_queue/resharding, ephemeral=False, sequence=False, client=172.18.0.9:56390)
————►17:54:34:527872 FailedCreateReply(xid=1494352477, zxid=79, error=-110, path=, server=172.18.0.3:2181)
17:54:34:527929 CreateRequest(size=0, xid=1494352478, path=/clickhouse/task_queue/resharding/6974dc99f908, ephemeral=False, sequence=False, client=172.18.0.9:56390)
————►17:54:34:529064 CreateReply(xid=1494352478, zxid=80, error=0, path=/clickhouse/task_queue/resharding/6974dc99f908, server=172.18.0.3:2181)
17:54:34:529125 CreateRequest(size=0, xid=1494352479, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.9:56390)
————►17:54:34:529969 FailedCreateReply(xid=1494352479, zxid=81, error=-110, path=, server=172.18.0.3:2181)
17:54:34:530030 CreateRequest(size=0, xid=1494352480, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.9:56390)
————►17:54:34:531215 FailedCreateReply(xid=1494352480, zxid=82, error=-110, path=, server=172.18.0.3:2181)
17:54:34:531273 CreateRequest(size=0, xid=1494352481, path=/clickhouse/task_queue/resharding_distributed, ephemeral=False, sequence=False, client=172.18.0.9:56390)
————►17:54:34:532346 FailedCreateReply(xid=1494352481, zxid=83, error=-110, path=, server=172.18.0.3:2181)
17:54:34:532477 CreateRequest(size=0, xid=1494352482, path=/clickhouse/task_queue/resharding_distributed/online, ephemeral=False, sequence=False, client=172.18.0.9:56390)
————►17:54:34:535046 FailedCreateReply(xid=1494352482, zxid=84, error=-110, path=, server=172.18.0.3:2181)
17:54:34:535123 CreateRequest(size=0, xid=1494352483, path=/clickhouse/task_queue/resharding_distributed/online/6974dc99f908, ephemeral=False, sequence=False, client=172.18.0.9:56390)
————►17:54:34:536696 CreateReply(xid=1494352483, zxid=85, error=0, path=/clickhouse/task_queue/resharding_distributed/online/6974dc99f908, server=172.18.0.3:2181)
17:54:34:536798 CreateRequest(size=0, xid=1494352484, path=/clickhouse/task_queue/resharding_distributed/lock, ephemeral=False, sequence=False, client=172.18.0.9:56390)
————►17:54:34:541213 FailedCreateReply(xid=1494352484, zxid=86, error=-110, path=, server=172.18.0.3:2181)
17:54:34:541289 CreateRequest(size=0, xid=1494352485, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.9:56390)
————►17:54:34:543614 FailedCreateReply(xid=1494352485, zxid=87, error=-110, path=, server=172.18.0.3:2181)
17:54:34:543666 CreateRequest(size=0, xid=1494352486, path=/clickhouse/task_queue, ephemeral=False, sequence=False, client=172.18.0.9:56390)
————►17:54:34:544954 FailedCreateReply(xid=1494352486, zxid=88, error=-110, path=, server=172.18.0.3:2181)
17:54:34:545003 CreateRequest(size=0, xid=1494352487, path=/clickhouse/task_queue/resharding_distributed, ephemeral=False, sequence=False, client=172.18.0.9:56390)
————►17:54:34:546192 FailedCreateReply(xid=1494352487, zxid=89, error=-110, path=, server=172.18.0.3:2181)
17:54:34:546240 CreateRequest(size=0, xid=1494352488, path=/clickhouse/task_queue/resharding_distributed/coordination, ephemeral=False, sequence=False, client=172.18.0.9:56390)
————►17:54:34:548786 FailedCreateReply(xid=1494352488, zxid=90, error=-110, path=, server=172.18.0.3:2181)
17:54:34:549071 GetChildren2Request(xid=1494352489, path=/clickhouse/task_queue/resharding/6974dc99f908, watch=False, size=0, client=172.18.0.9:56390)
————►17:54:34:549863 GetChildren2Reply(xid=1494352489, zxid=90, error=0, count=0, server=172.18.0.3:2181)
17:54:34:549917 GetChildren2Request(xid=1494352490, path=/clickhouse/task_queue/resharding/6974dc99f908, watch=True, size=0, client=172.18.0.9:56390)
————►17:54:34:550566 GetChildren2Reply(xid=1494352490, zxid=90, error=0, count=0, server=172.18.0.3:2181)
17:56:46:981019 ExistsRequest(xid=1494352489, path=/clickhouse/tables/1/hits_replicated/replicas/clickhouse-ru-1.local/flags/force_restore_data, watch=False, size=0, client=172.18.0.4:39578)
————►17:56:46:982127 FailedExistsReply(xid=1494352489, zxid=90, error=-101, server=172.18.0.3:2181)
17:56:46:983186 ExistsRequest(xid=1494352490, path=/clickhouse/tables/1/hits_replicated, watch=False, size=0, client=172.18.0.4:39578)
————►17:56:46:983957 FailedExistsReply(xid=1494352490, zxid=90, error=-101, server=172.18.0.3:2181)
17:56:46:984629 CreateRequest(size=0, xid=1494352491, path=/clickhouse, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:56:46:986060 FailedCreateReply(xid=1494352491, zxid=91, error=-110, path=, server=172.18.0.3:2181)
17:56:46:987046 CreateRequest(size=0, xid=1494352492, path=/clickhouse/tables, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:56:46:993787 CreateReply(xid=1494352492, zxid=92, error=0, path=/clickhouse/tables, server=172.18.0.3:2181)
17:56:46:993953 CreateRequest(size=0, xid=1494352493, path=/clickhouse/tables/1, ephemeral=False, sequence=False, client=172.18.0.4:39578)
————►17:56:46:995372 CreateReply(xid=1494352493, zxid=93, error=0, path=/clickhouse/tables/1, server=172.18.0.3:2181)

unfontunally i can't catch coredump files ;( i will improve this issue later maybe

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions