refactor: remove ParseSpec#19239
Conversation
changes: * `ParseSpec` and all of its implementations have been removed, including `JavascriptParseSpec` and `JSONLowercaseParseSpec`, which have no `InputFormat` equivalents * migrated all tests which were still using `ParseSpec` to convert into a normal schema + input format to just use `InputFormat` directly instead * `FlattenJSONBenchmark` now measures the `JsonInputFormat` instead of using a json parse spec/parser
|
Hello, Good work on release 37! Was dropping Asking because I'm currently relying on JS at the aggregation layer for things like a bitwise day-of-week mask during rollup: {
"type": "javascript",
"name": "days_mask",
"fieldNames": ["day_of_week"],
"fnAggregate": "function(current, dow) { return current | (1 << dow); }",
"fnCombine": "function(a, b) { return a | b; }",
"fnReset": "function() { return 0; }"
}No native |
I think in your case you could use an expression aggregator: https://druid.apache.org/docs/latest/querying/aggregations/#expression-aggregator. The functions |
just in case you need that expression aggregator at ingest time: #19508 |
|
Thanks both! |
changes:
ParseSpecand all of its implementations have been removed, includingJavascriptParseSpecandJSONLowercaseParseSpec, which have noInputFormatequivalentsParseSpecto convert into a normal schema + input format to just useInputFormatdirectly insteadFlattenJSONBenchmarknow measures theJsonInputFormatinstead of using a json parse spec/parser