-
Notifications
You must be signed in to change notification settings - Fork 25.8k
Open
Labels
:StorageEngine/MappingThe storage related side of mappingsThe storage related side of mappingsTeam:StorageEngine
Description
In PR #126492, we implemented an optimization to skip some redundant UTF8 to UTF16 conversions.
There were several follow-ups to that PR, which are tracked here.
- Support for escaped and/or non-ascii characters (Optimized text for full unicode and some escape sequences #129169)
- Support for match_only_text fields (Use optimized text in match_only_text fields #129371)
- Support for text fields. Change field type to use the
UTF8DecodingReaderfor indexed field. - Support for wildcard fields. Adopt
UTF8DecodingReaderfor indexed field. There is also an unneeded utf16 to utf8 conversion for binary doc values.
Optional followups:
- Support for other xcontent types (
cborEnable optimizedText for CBOR #132542, smile, yaml) - Remove
XContentParser#optimizedText()and instead haveXContentParser#text()returnXContentStringinstead ofString
Maybe not even possible:
- Support for running normalizers on utf-8 encoded data instead of needing to convert to utf-16 strings
Reactions are currently unavailable
Metadata
Metadata
Assignees
Labels
:StorageEngine/MappingThe storage related side of mappingsThe storage related side of mappingsTeam:StorageEngine