Skip to content

Speed up tinkerpop test#19

Closed
javeme wants to merge 1 commit intomasterfrom
speed-up-tinkerpop-test
Closed

Speed up tinkerpop test#19
javeme wants to merge 1 commit intomasterfrom
speed-up-tinkerpop-test

Conversation

@javeme
Copy link
Copy Markdown
Contributor

@javeme javeme commented Aug 21, 2018

how to:
1.speed up rocksdb backend by truncating tables
2.don't need to clear if the database is empty
3.don't need to clear variables if it's empty
4.don't need to commit hbase each len-prefix for delete index-label

potential problems:
1.mysql may block if create task vertex-label when truncating table
2.rocksdb may miss CF if create task vertex-label when truncating table
3.hbase may block if truncate hbase with version<2.0

improve #14

Change-Id: I4b2393aea8b0fc63c1886e984a576a1f5808b25c

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

combine state checking before open() in initBackend() with this commit

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

delete comment

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

keep 'backend' and 'serializer' original

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

no need to clear variables?

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

done

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

delete ‘count’

Copy link
Copy Markdown
Contributor

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

truncate will delete system pk and vl, is it necessary?
Otherwise, counter will not be cleared

Copy link
Copy Markdown
Contributor Author

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

yes it will delete system pk and vl.
counter should also be cleared. maybe some backends are forgotten to clear counter, but now they are all done.

@javeme javeme force-pushed the speed-up-tinkerpop-test branch 3 times, most recently from 7feedc9 to 2c0736b Compare August 22, 2018 08:59
@javeme javeme force-pushed the speed-up-tinkerpop-test branch from 2c0736b to 72b8fb1 Compare August 22, 2018 13:11
how to:
1.speed up rocksdb backend by truncating tables
2.don't need to clear if the database is empty
3.don't need to clear variables if it's empty
4.don't need to commit hbase each len-prefix for delete index-label

potential problems:
1.mysql may block if create task vertex-label when truncating table
2.rocksdb may miss CF if create task vertex-label when truncating table
3.hbase may block if truncate hbase with version<2.0

improve #14

Change-Id: I4b2393aea8b0fc63c1886e984a576a1f5808b25c
@javeme javeme force-pushed the speed-up-tinkerpop-test branch from 72b8fb1 to de16634 Compare September 6, 2018 03:47
@javeme javeme added the ci-cd Build or deploy label Nov 20, 2018
@javeme
Copy link
Copy Markdown
Contributor Author

javeme commented Nov 21, 2018

close since fixed at #208

@javeme javeme closed this Nov 21, 2018
@javeme javeme deleted the speed-up-tinkerpop-test branch November 21, 2018 10:50
zhoney pushed a commit to zhoney/hugegraph that referenced this pull request Nov 9, 2021
imbajin pushed a commit that referenced this pull request Oct 19, 2022
imbajin pushed a commit that referenced this pull request Nov 2, 2022
imbajin pushed a commit that referenced this pull request Nov 7, 2022
imbajin pushed a commit that referenced this pull request Nov 9, 2022
imbajin added a commit to koi2000/incubator-hugegraph that referenced this pull request Aug 11, 2025
[pull] master from apache:master
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

ci-cd Build or deploy

Projects

None yet

Development

Successfully merging this pull request may close these issues.

2 participants