Skip to content

Add ability to convert ClickHouse table structure to CapnProto/Protobuf format schema#52278

Merged
Avogar merged 15 commits intoClickHouse:masterfrom
Avogar:structure-to-schema
Aug 1, 2023
Merged

Add ability to convert ClickHouse table structure to CapnProto/Protobuf format schema#52278
Avogar merged 15 commits intoClickHouse:masterfrom
Avogar:structure-to-schema

Conversation

@Avogar
Copy link
Copy Markdown
Member

@Avogar Avogar commented Jul 18, 2023

Changelog category (leave one):

  • New Feature

Changelog entry (a user-readable short description of the changes that goes to CHANGELOG.md):

Add new functions structureToCapnProtoSchema/structureToProtobufSchema that convert ClickHouse table structure to CapnProto/Protobuf format schema. Allow to intput/output data in CapnProto/Protobuf format without external format schema using autogenerated schema from table structure (controled by settings format_capn_proto_use_autogenerated_schema/format_protobuf_use_autogenerated_schema). Allow to export autogenerated schema while input/outoput using setting output_format_schema.

Documentation entry for user-facing changes

  • Documentation is written (mandatory for new features)

Information about CI checks: https://clickhouse.com/docs/en/development/continuous-integration/

@robot-clickhouse-ci-2 robot-clickhouse-ci-2 added the pr-feature Pull request with new product feature label Jul 18, 2023
@robot-clickhouse-ci-2
Copy link
Copy Markdown
Contributor

robot-clickhouse-ci-2 commented Jul 18, 2023

This is an automated comment for commit 8f6526a with description of existing statuses. It's updated for the latest CI running
The full report is available here
The overall status of the commit is 🔴 failure

Check nameDescriptionStatus
CI runningA meta-check that indicates the running CI. Normally, it's in success or pending state. The failed status indicates some problems with the PR🟢 success
Docs CheckBuilds and tests the documentation🟢 success
Fast testNormally this is the first check that is ran for a PR. It builds ClickHouse and runs most of stateless functional tests, omitting some. If it fails, further checks are not started until it is fixed. Look at the report to see which tests fail, then reproduce the failure locally as described here🔴 failure
Mergeable CheckChecks if all other necessary checks are successful🟢 success
Push to DockerhubThe check for building and pushing the CI related docker images to docker hub🟢 success
Style CheckRuns a set of checks to keep the code style clean. If some of tests failed, see the related log from the report🟢 success

@Avogar Avogar marked this pull request as ready for review July 24, 2023 17:57
@antonio2368 antonio2368 self-assigned this Jul 26, 2023
@antonio2368
Copy link
Copy Markdown
Member

LGTM, after you resolve the comment for loop I'll approve (want to avoid auto merge)

@Avogar Avogar merged commit 9bd2ff9 into ClickHouse:master Aug 1, 2023
yokofly pushed a commit to timeplus-io/proton that referenced this pull request Mar 1, 2025
* Bump protobuf to v3.18.x (ref: ClickHouse/ClickHouse#50400)

* Bump protobuf to v3.19.6 (ref: ClickHouse/ClickHouse#55963)

* Bump protobuf to v3.19.6 (ref: ClickHouse/ClickHouse#50920)

* Update contribe/orc (ref: ClickHouse/ClickHouse#53324)

* Bump protobuf to v21.9 (ref: ClickHouse/ClickHouse#56014)

* Removed unused code in google-protobuf-cmake/CMakeLists.txt (ref: ClickHouse/ClickHouse#56102)

* Bump gRPC to v1.55.4 and protobuf to v22.5 (ref: ClickHouse/ClickHouse#56664)

* Bump gRPC to v1.59 and protobuf to v24.4 (ref: ClickHouse/ClickHouse#56853)

* enable functions in readonly mode (ref: ClickHouse/ClickHouse#42708)

* Introduce more fields for in-source function documentation (ref: ClickHouse/ClickHouse#49300)

* Add ability to convert timeplusd table structure to CapnProto/Protobuf format schema (ref: ClickHouse/ClickHouse#52278)

* Well known protos (ref: ClickHouse/ClickHouse#56741)

* Update protobuf to v25.1 (ref: ClickHouse/ClickHouse#58020)

* fixed unit_tests_dbms build

* Avoid ignoring errors of execute_process() (set COMMAND_ERROR_IS_FATAL=ANY) (ref: ClickHouse/ClickHouse#68267)

* fixed reigsterFunction

* fixed error after rebase
yokofly added a commit to timeplus-io/proton that referenced this pull request Mar 1, 2025
* Bump protobuf to v3.18.x (ref: ClickHouse/ClickHouse#50400)

* Bump protobuf to v3.19.6 (ref: ClickHouse/ClickHouse#55963)

* Bump protobuf to v3.19.6 (ref: ClickHouse/ClickHouse#50920)

* Update contribe/orc (ref: ClickHouse/ClickHouse#53324)

* Bump protobuf to v21.9 (ref: ClickHouse/ClickHouse#56014)

* Removed unused code in google-protobuf-cmake/CMakeLists.txt (ref: ClickHouse/ClickHouse#56102)

* Bump gRPC to v1.55.4 and protobuf to v22.5 (ref: ClickHouse/ClickHouse#56664)

* Bump gRPC to v1.59 and protobuf to v24.4 (ref: ClickHouse/ClickHouse#56853)

* enable functions in readonly mode (ref: ClickHouse/ClickHouse#42708)

* Introduce more fields for in-source function documentation (ref: ClickHouse/ClickHouse#49300)

* Add ability to convert timeplusd table structure to CapnProto/Protobuf format schema (ref: ClickHouse/ClickHouse#52278)

* Well known protos (ref: ClickHouse/ClickHouse#56741)

* Update protobuf to v25.1 (ref: ClickHouse/ClickHouse#58020)

* fixed unit_tests_dbms build

* Avoid ignoring errors of execute_process() (set COMMAND_ERROR_IS_FATAL=ANY) (ref: ClickHouse/ClickHouse#68267)

* fixed reigsterFunction

* fixed error after rebase
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

pr-feature Pull request with new product feature

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants