Skip to content

Run three nodes with Replicated database and NuKeeper in CI#21690

Merged
tavplubix merged 25 commits intomasterfrom
test_multiple_nodes
Mar 31, 2021
Merged

Run three nodes with Replicated database and NuKeeper in CI#21690
tavplubix merged 25 commits intomasterfrom
test_multiple_nodes

Conversation

@tavplubix
Copy link
Copy Markdown
Member

@tavplubix tavplubix commented Mar 13, 2021

I hereby agree to the terms of the CLA available at: https://yandex.ru/legal/cla/?lang=en

Changelog category (leave one):

  • Not for changelog (changelog entry is not required)

Detailed description / Documentation draft:
Depends on #22274

@robot-clickhouse robot-clickhouse added the pr-not-for-changelog This PR should not be mentioned in the changelog label Mar 13, 2021
@tavplubix tavplubix changed the title Try run two nodes with Replicated database and NuKeeper Try run three nodes with Replicated database and NuKeeper Mar 17, 2021
@alesapin alesapin self-assigned this Mar 17, 2021
@alesapin
Copy link
Copy Markdown
Member

Looks like with force_fsync NuKeeper doesn't work properly on sandbox HDDs.

@tavplubix
Copy link
Copy Markdown
Member Author

01396_inactive_replica_cleanup_nodes_zookeeper - need fix test
01149_zookeeper_mutation_stuck_after_replace_partition - something strange happened, test is probably flaky
01079_parallel_alter_add_drop_column_zookeeper - Timeout - DDLWorker hung due to All connection tries failed while connecting to ZooKeeper
01018_ddl_dictionaries_concurrent_requrests - database test_ha0hh4 was not created due to Coordination::Exception: Operation timeout, path: /clickhouse
00992_system_parts_race_condition_zookeeper_long - Coordination::Exception: Operation timeout, path: /test/clickhouse/db/default/log/query-0000000032
00965_set_index_string_functions - database test_1jv5ht was not created - Coordination::Exception: Operation timeout, path: /clickhouse
00732_quorum_insert_lost_part_zookeeper - Replica doesn't have part 20181115_0_0_0 which was successfully written to quorum of other replicas. Send query to another replica or disable 'select_sequential_consistency' setting - seems like part was written to another replica

@tavplubix
Copy link
Copy Markdown
Member Author

Functional stateless tests (release, DatabaseReplicated) — fail: 0, passed: 2781, skipped: 105
Functional stateful tests (release, DatabaseReplicated) — fail: 0, passed: 108, skipped: 3

@tavplubix
Copy link
Copy Markdown
Member Author

tavplubix commented Mar 19, 2021

00652_replicated_mutations_default_database_zookeeper - fails because for_subquery table is not replicated, need add to skip list
00620_optimize_on_nonleader_replica_zookeeper - need SYSTEM SYNC REPLICA rename1 before the first select to make it work with additional replicas (or just add it to skip list)

@tavplubix
Copy link
Copy Markdown
Member Author

Functional stateless tests (release, DatabaseReplicated) — fail: 0, passed: 2784, skipped: 107
Functional stateful tests (release, DatabaseReplicated) — fail: 0, passed: 108, skipped: 3

@alesapin
Copy link
Copy Markdown
Member

Need to merge with #22274.

@tavplubix
Copy link
Copy Markdown
Member Author

Functional stateful tests (release, DatabaseReplicated) — fail: 0, passed: 109, skipped: 3
Functional stateless tests (release, DatabaseReplicated) — fail: 0, passed: 2812, skipped: 107

@tavplubix tavplubix changed the title Try run three nodes with Replicated database and NuKeeper Run three nodes with Replicated database and NuKeeper in CI Mar 30, 2021
@tavplubix tavplubix marked this pull request as ready for review March 30, 2021 07:47
@alesapin
Copy link
Copy Markdown
Member

Waiting for tests.

@alesapin
Copy link
Copy Markdown
Member

Need to fix flaky check?

@alesapin
Copy link
Copy Markdown
Member

Stress thread -- OOM

2021.03.30 12:41:50.266427 [ 301 ] {} <Fatal> Application: Child process was terminated by signal 9 (KILL). If it is not done by 'forcestop' command or manually, the possible cause is OOM Killer (see 'dmesg' and look at the '/var/log/kern.log' for the details).

@tavplubix tavplubix merged commit 6c1e2a0 into master Mar 31, 2021
@tavplubix tavplubix deleted the test_multiple_nodes branch March 31, 2021 09:31
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

pr-not-for-changelog This PR should not be mentioned in the changelog

Projects

None yet

Development

Successfully merging this pull request may close these issues.

3 participants