Skip to content

[Bug] (fix) DeltaWriter::mem_consumption() coredump - #9245

Merged
yiguolei merged 8 commits into
apache:masterfrom
chenlinzhong:regession_coredump
May 7, 2022
Merged

yiguolei merged 8 commits into
apache:masterfrom
chenlinzhong:regession_coredump

Conversation

@chenlinzhong

@chenlinzhong chenlinzhong commented Apr 26, 2022 •

Copy link
Copy Markdown
Contributor

Proposed changes

Issue Number: open #9237

Problem Summary:

  • mem_consumption() returned value may be changed during sort period for same element, this does not meet comp requirements
  • make snapshot for memory consumption before call std::sort and used snapshot where start call std::sort

Checklist(Required)

  1. Does it affect the original behavior: (Yes/No/I Don't know)
  2. Has unit tests been added: (Yes/No/No Need)
  3. Has document been added or modified: (Yes/No/No Need)
  4. Does it need to update dependencies: (Yes/No)
  5. Are there any changes that cannot be rolled back: (Yes/No)

Further comments

If this is a relatively large or complex change, kick off the discussion at [email protected] by explaining why you chose the solution you did and what alternatives you considered, etc...

@chenlinzhong chenlinzhong changed the title Regession coredump [Bug] (fix) DeltaWriter::mem_consumption() coredump issue#9237 Apr 26, 2022
@chenlinzhong chenlinzhong changed the title [Bug] (fix) DeltaWriter::mem_consumption() coredump issue#9237 [Bug] (fix) DeltaWriter::mem_consumption() coredump Apr 26, 2022
// Sort the DeltaWriters by mem consumption in descend order.
std::vector<DeltaWriter*> writers;
for (auto& it : _tablet_writers) {
it.second->save_mem_consumption_snapshot();

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What's the core reason?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

What's the core reason?

mem_consumption() returned value may be changed during sort period for same element, this does not meet comp requirements

@HappenLee

Copy link
Copy Markdown
Contributor

why the case normal in old code?

HappenLee
HappenLee previously approved these changes Apr 28, 2022

@HappenLee HappenLee left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@github-actions github-actions Bot added the approved Indicates a PR has been approved by one committer. label Apr 28, 2022
@github-actions

Copy link
Copy Markdown
Contributor

PR approved by anyone and no changes requested.

@morningman morningman added dev/1.0.1-deprecated should be merged into dev-1.0.1 branch kind/fix Categorizes issue or PR as related to a bug. area/load Issues or PRs related to all kinds of load labels Apr 28, 2022
@github-actions github-actions Bot removed the approved Indicates a PR has been approved by one committer. label Apr 29, 2022
yiguolei
yiguolei previously approved these changes Apr 29, 2022

@yiguolei yiguolei left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@github-actions github-actions Bot added the approved Indicates a PR has been approved by one committer. label Apr 29, 2022
@github-actions

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

yiguolei
yiguolei previously approved these changes Apr 29, 2022

@yiguolei yiguolei left a comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

mem_consumption() returned value may be changed during sort period for same element, this does not meet comp requirements
mem_consumption() returned value may be changed during sort period for same element, this does not meet comp requirements
mem_consumption() returned value may be changed during sort period for same element, this does not meet comp requirements
@github-actions github-actions Bot removed the approved Indicates a PR has been approved by one committer. label May 1, 2022
@github-actions github-actions Bot added the approved Indicates a PR has been approved by one committer. label May 7, 2022
@github-actions

github-actions Bot commented May 7, 2022

Copy link
Copy Markdown
Contributor

PR approved by at least one committer and no changes requested.

@yiguolei
yiguolei merged commit 53574ce into apache:master May 7, 2022
@morningman morningman added dev/merged-1.0.1-deprecated PR has been merged into dev-1.0.1 and removed dev/1.0.1-deprecated should be merged into dev-1.0.1 branch labels May 15, 2022
@morningman morningman added this to the v1.1 milestone May 15, 2022
starocean999 pushed a commit to starocean999/incubator-doris that referenced this pull request May 19, 2022
englefly pushed a commit to englefly/incubator-doris that referenced this pull request May 23, 2022
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

approved Indicates a PR has been approved by one committer. area/load Issues or PRs related to all kinds of load dev/merged-1.0.1-deprecated PR has been merged into dev-1.0.1 kind/fix Categorizes issue or PR as related to a bug. reviewed

Projects

None yet

Development

Successfully merging this pull request may close these issues.

4 participants