Skip to content

Conversation

@aloyszhang
Copy link
Contributor

@aloyszhang aloyszhang commented Jan 17, 2022

Fixes #13761

Motivation

Support split partitions belonging to specified topic in a bundle

Modifications

  1. add a new algorithm for bundle split named SpecifiedTopicCountEquallyDivideBundleSplitAlgorithm
  2. abstract split arguments to BundleSplitOption
  3. add the new split algorithm to CmdNamespaces and REST API
  4. add test for new split algorithm

Does this pull request potentially affect one of the following parts:

If yes was chosen, please highlight the changes

  • Dependencies (does it add or upgrade a dependency): ( no)
  • The public API: ( no)
  • The schema: ( no)
  • The default values of configurations: ( no)
  • The wire protocol: ( no)
  • The rest endpoints: ( no)
  • The admin cli options: ( no)
  • Anything that affects deployment: ( no)

Documentation

Need to update docs?

  • no-need-doc

@github-actions
Copy link

@aloyszhang:Thanks for your contribution. For this PR, do we need to update docs?
(The PR template contains info about doc, which helps others know more about the changes. Can you provide doc-related info in this and future PR descriptions? Thanks)

@Anonymitaet
Copy link
Member

Confirmed with @aloyszhang, since code is WIP, currently we do not know whether need to add docs or not, he will label this PR w/ a doc-related label later

@github-actions
Copy link

@aloyszhang:Thanks for providing doc info!

@github-actions github-actions bot added the doc-not-needed Your PR changes do not impact docs label Jan 19, 2022
@aloyszhang aloyszhang changed the title [Broker] [WIP]support split bundle by specified topic [Broker]support split bundle by specified topic Jan 19, 2022
@aloyszhang
Copy link
Contributor Author

/pulsarbot run-failure-checks

@aloyszhang aloyszhang force-pushed the split branch 2 times, most recently from f127773 to b8a7619 Compare January 20, 2022 16:06
@aloyszhang
Copy link
Contributor Author

/pulsarbot run-failure-checks

@aloyszhang aloyszhang changed the title [Broker]support split bundle by specified topic [WIP][Broker]support split bundle by specified topic Feb 22, 2022
@aloyszhang aloyszhang force-pushed the split branch 2 times, most recently from cc0d3be to 87a2af5 Compare February 26, 2022 02:55
@aloyszhang aloyszhang changed the title [WIP][Broker]support split bundle by specified topic [Broker]support split bundle by specified topic Feb 26, 2022
@aloyszhang aloyszhang changed the title [Broker]support split bundle by specified topic [Broker]support split bundle by specified boundaries Feb 26, 2022
@aloyszhang
Copy link
Contributor Author

/pulsarbot run-failure-checks

1 similar comment
@aloyszhang
Copy link
Contributor Author

/pulsarbot run-failure-checks

@aloyszhang
Copy link
Contributor Author

@codelipenghui @Jason918 PTAL, thanks

@aloyszhang
Copy link
Contributor Author

/pulsarbot run-failure-checks

@aloyszhang aloyszhang requested a review from Jason918 March 2, 2022 08:02
@aloyszhang
Copy link
Contributor Author

cc @codelipenghui @Jason918

Copy link
Contributor

@Jason918 Jason918 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@codelipenghui codelipenghui added this to the 2.11.0 milestone Mar 4, 2022
@codelipenghui codelipenghui added the type/feature The PR added a new feature or issue requested a new feature label Mar 4, 2022
@aloyszhang aloyszhang changed the title [Broker]support split bundle by specified boundaries [PIP-143] Support split bundle by specified boundaries Mar 4, 2022
@aloyszhang aloyszhang requested a review from codelipenghui March 4, 2022 16:40
@aloyszhang
Copy link
Contributor Author

/pulsarbot run-failure-checks

@aloyszhang
Copy link
Contributor Author

@codelipenghui PTAL

Copy link
Contributor

@codelipenghui codelipenghui left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Looks good to me, just left a minor comment, PTAL.

@aloyszhang
Copy link
Contributor Author

/pulsarbot run-failure-checks

@aloyszhang
Copy link
Contributor Author

/pulsarbot run-failure-checks

@aloyszhang aloyszhang merged commit 7998c44 into apache:master Mar 11, 2022
Nicklee007 pushed a commit to Nicklee007/pulsar that referenced this pull request Apr 20, 2022
* support split bundle by specified boundaries

* add license header

* fix checkstyle

* fix test NPE

* fix test

* fix checkstyle

* fix test

* apply comments

* remove un-used import

* apply comments

* apply comments

* fix test
dlg99 pushed a commit to dlg99/pulsar that referenced this pull request Nov 8, 2022
* support split bundle by specified boundaries

* add license header

* fix checkstyle

* fix test NPE

* fix test

* fix checkstyle

* fix test

* apply comments

* remove un-used import

* apply comments

* apply comments

* fix test

(cherry picked from commit 7998c44)
dlg99 pushed a commit to datastax/pulsar that referenced this pull request Nov 8, 2022
* support split bundle by specified boundaries

* add license header

* fix checkstyle

* fix test NPE

* fix test

* fix checkstyle

* fix test

* apply comments

* remove un-used import

* apply comments

* apply comments

* fix test

(cherry picked from commit 7998c44)
@aloyszhang aloyszhang deleted the split branch November 30, 2022 01:44
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

doc-not-needed Your PR changes do not impact docs type/feature The PR added a new feature or issue requested a new feature type/PIP

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[PIP-143] Support split bundle by specified boundaries

6 participants