You signed in with another tab or window. Reload to refresh your session.You signed out in another tab or window. Reload to refresh your session.You switched accounts on another tab or window. Reload to refresh your session.Dismiss alert
{{ message }}
Repository navigation
Commit 500cad6
Browse filesBrowse the repository at this point in the historyBrowse files
[fix](iceberg) Support GZIP for iceberg/hive Parquet writers.
The BE Parquet writers only accepted PLAIN/SNAPPY/ZSTD/LZ4 and rejected the GZ codec
that Iceberg's write.parquet.compression-codec=gzip (and Hive's parquet.compression=GZIP)
map to, so INSERT/DELETE failed with 'Unsupported compress type GZ with parquet' while
Spark/Trino wrote the same table fine.
Factor the whole TFileCompressType -> TParquetCompressionType mapping into
ParquetBuildHelper (GZ -> GZIP included) so the Iceberg data-file writer, the Iceberg
delete-file writer and the Hive Parquet writer share one definition instead of three
copies of the switch, and accept gzip in the Hive CREATE TABLE parquet compression
allow-list.
Copy file name to clipboardExpand all lines: fe/fe-connector/fe-connector-hive/src/test/java/org/apache/doris/connector/hive/HiveWritePlanProviderTest.java
+4Lines changed: 4 additions & 0 deletions
Original file line number
Diff line number
Diff line change
@@ -388,6 +388,10 @@ public void planWriteCompressionPerFormat() {
0 commit comments