Skip to content

Faster server startup after stress test#44606

Merged
alesapin merged 6 commits intomasterfrom
faster-startup-bc-check
Dec 28, 2022
Merged

Faster server startup after stress test#44606
alesapin merged 6 commits intomasterfrom
faster-startup-bc-check

Conversation

@alexey-milovidov
Copy link
Copy Markdown
Member

Changelog category (leave one):

  • Not for changelog (changelog entry is not required)

Sometimes it take long time to start due to:

2022.12.25 00:18:34.895837 [ 256684 ] {} <Error> ZooKeeperClient: Code: 999. Coordination::Exception: Session expired, path: Session expired (fault injected on recv). (KEEPER_EXCEPTION)

and for some reason, it did not repair in 9 minutes.

@robot-ch-test-poll robot-ch-test-poll added the pr-not-for-changelog This PR should not be mentioned in the changelog label Dec 26, 2022
@alesapin
Copy link
Copy Markdown
Member

The reason is clear

grep 'injected' clickhouse-server.backward.clean.log | wc -l
217

@alexey-milovidov
Copy link
Copy Markdown
Member Author

#44613

@alexey-milovidov
Copy link
Copy Markdown
Member Author

#44573

@alesapin
Copy link
Copy Markdown
Member

Won't run stateful tests because test data wasn't loaded.
Traceback (most recent call last):
  File "/usr/bin/clickhouse-test", line 2354, in <module>
    main(args)
  File "/usr/bin/clickhouse-test", line 1893, in main
    processlist = get_processlist(args)
  File "/usr/bin/clickhouse-test", line 236, in get_processlist
    return clickhouse_execute_json(args, "SHOW PROCESSLIST")
  File "/usr/bin/clickhouse-test", line 131, in clickhouse_execute_json
    data = clickhouse_execute_http(base_args, query, timeout, settings, "JSONEachRow")
  File "/usr/bin/clickhouse-test", line 118, in clickhouse_execute_http
    res = client.getresponse()
  File "/usr/lib/python3.8/http/client.py", line 1348, in getresponse
    response.begin()
  File "/usr/lib/python3.8/http/client.py", line 316, in begin
    version, status, reason = self._read_status()
  File "/usr/lib/python3.8/http/client.py", line 277, in _read_status
    line = str(self.fp.readline(_MAXLINE + 1), "iso-8859-1")
  File "/usr/lib/python3.8/socket.py", line 669, in readinto
    return self._sock.recv_into(b)
ConnectionResetError: [Errno 104] Connection reset by peer
2022-12-28 18:28:46,753 Hung check failed with exit code 1

Hung check failure unrelated

@alesapin alesapin merged commit 6d27e2d into master Dec 28, 2022
@alesapin alesapin deleted the faster-startup-bc-check branch December 28, 2022 18:41
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

pr-not-for-changelog This PR should not be mentioned in the changelog

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants