Repository navigation
Commit 28593d5
Steve Loughran
* GH-3451. Add a JMH benchmark for variants
Initial impl.
* WiP: add a deeper version.
* revert plans for a deeper version
* fixes to this benchmark (copilot review)
* deser to recurse down
* include uuid and bigdecimal
* reset counter on benchmark setup
* Measure parquet write/read costs.
iterations of class code and #of rows are the same
for easy compare of overheads.
* WiP, on a file read/write benchmark
Using the same structure as the iceberg tests do
* building a projection schema
* projection works
* Test to validate impact of lean schema against unshredded files.
painful.
* GH-561 ongoing work
* GH-561 profile driven review of VariantConverters.
* GH-561 Variant benchmarks
* Move under variant package to access private members
* add "variant" group to run.sh
* new benchmark VariantConverterBenchmark
* spotless
* Benchmark enhancements
* UUIDs in projection benchmark.
* col4 var column now a long string and named as such.
* builder and converter benchmarks use @OperationsPerInvocation
rather than internal iterators.
* revert production code enhancement.
including pulling a benchmark from VariantConverters.
Pull the warmup/measurement times to a shared constant.
If someone thinks the numbers should be bigger: one place to change.
1 parent 492b686 commit 28593d5
6 files changed
Lines changed: 1858 additions & 0 deletions
File tree
- parquet-benchmarks
- src/main/java/org/apache/parquet/variant
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
52 | 52 | | |
53 | 53 | | |
54 | 54 | | |
| 55 | + | |
| 56 | + | |
| 57 | + | |
| 58 | + | |
| 59 | + | |
55 | 60 | | |
56 | 61 | | |
57 | 62 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
43 | 43 | | |
44 | 44 | | |
45 | 45 | | |
| 46 | + | |
46 | 47 | | |
47 | 48 | | |
48 | 49 | | |
| |||
100 | 101 | | |
101 | 102 | | |
102 | 103 | | |
| 104 | + | |
| 105 | + | |
| 106 | + | |
103 | 107 | | |
104 | 108 | | |
105 | 109 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
| 1 | + | |
| 2 | + | |
| 3 | + | |
| 4 | + | |
| 5 | + | |
| 6 | + | |
| 7 | + | |
| 8 | + | |
| 9 | + | |
| 10 | + | |
| 11 | + | |
| 12 | + | |
| 13 | + | |
| 14 | + | |
| 15 | + | |
| 16 | + | |
| 17 | + | |
| 18 | + | |
| 19 | + | |
| 20 | + | |
| 21 | + | |
| 22 | + | |
| 23 | + | |
| 24 | + | |
| 25 | + | |
| 26 | + | |
| 27 | + | |
| 28 | + | |
| 29 | + | |
| 30 | + | |
| 31 | + | |
| 32 | + | |
| 33 | + | |
| 34 | + | |
| 35 | + | |
| 36 | + | |
0 commit comments