Skip to content

Add settings to check hyperscan regexp length.#27378

Merged
alexey-milovidov merged 4 commits intoClickHouse:masterfrom
amosbird:hyperscansanitizer
Aug 8, 2021
Merged

Add settings to check hyperscan regexp length.#27378
alexey-milovidov merged 4 commits intoClickHouse:masterfrom
amosbird:hyperscansanitizer

Conversation

@amosbird
Copy link
Copy Markdown
Collaborator

@amosbird amosbird commented Aug 7, 2021

I hereby agree to the terms of the CLA available at: https://yandex.ru/legal/cla/?lang=en

Changelog category (leave one):

  • Improvement

Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):

Add two settings max_hyperscan_regexp_length and max_hyperscan_regexp_total_length to prevent huge regexp being used in hyperscan related functions, such as multiMatchAny.

Detailed description / Documentation draft:
.

@robot-clickhouse robot-clickhouse added the pr-improvement Pull request with some product improvements label Aug 7, 2021
@amosbird
Copy link
Copy Markdown
Collaborator Author

amosbird commented Aug 7, 2021

2021-08-07 08:42:33 Code: 48. DB::Exception: Received from localhost:9000. DB::Exception: multi-search all indices is not implemented when hyperscan is off (is it x86 processor?): While processing multiMatchAllIndices('123', ['1']). (NOT_IMPLEMENTED)

But why only multiMatchAllIndices fails.

@alexey-milovidov
Copy link
Copy Markdown
Member

Fast test does not build ClickHouse with Hyperscan.

@alexey-milovidov alexey-milovidov self-assigned this Aug 7, 2021
@alexey-milovidov
Copy link
Copy Markdown
Member

LGTM.

Please add the exception to docker/test/fasttest/run.sh

@alexey-milovidov
Copy link
Copy Markdown
Member

@Mergifyio update

@mergify
Copy link
Copy Markdown
Contributor

mergify bot commented Aug 8, 2021

Command update: success

Branch has been successfully updated

@alexey-milovidov alexey-milovidov merged commit 5f84564 into ClickHouse:master Aug 8, 2021
@gyuton
Copy link
Copy Markdown
Contributor

gyuton commented Aug 31, 2021

Internal documentation ticket: DOCSUP-14089.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

pr-improvement Pull request with some product improvements

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants