Uploaded image for project: 'Hive'
  1. Hive
  2. HIVE-7858

Parquet compression should be configurable via table property

    XMLWordPrintableJSON

Details

    • Improvement
    • Status: Resolved
    • Major
    • Resolution: Fixed
    • None
    • 1.1.0
    • None
    • The property parquet.compression can now be configured as a table property.

    Description

      ORC supports the orc.compress table property:

      https://cwiki.apache.org/confluence/display/Hive/LanguageManual+ORC

      create table Addresses (
  name string,
  street string,
  city string,
  state string,
  zip int
) stored as orc tblproperties ("orc.compress"="NONE");

      I think it'd be great to support the same for Parquet.

      Attachments

        1. HIVE-7858.patch
          5 kB
          Ferdinand Xu
        2. HIVE-7858.patch
          5 kB
          Brock Noland
        3. HIVE-7858.1.patch
          6 kB
          Ferdinand Xu

        Issue Links

          blocks

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-8120 Umbrella JIRA tracking Parquet improvements

          • Major - Major loss of function.
          • Open
          is related to

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-8823 Add additional serde properties for parquet

          • Major - Major loss of function.
          • Resolved

          Improvement - An improvement or enhancement to an existing feature or task. HIVE-8469 Add parquet.compression as a Serde Property

          • Minor - Minor loss of function, or other problem where easy workaround is present.
          • Resolved

          Task - A task that needs to be done. HIVE-11598 Document Configuration for Parquet Files

          • Major - Major loss of function.
          • Open

          Activity

            People

              Ferd Ferdinand Xu
              brocknoland Brock Noland
              Votes:
              0 Vote for this issue
              Watchers:
              6 Start watching this issue

              Dates

                Created:
                Updated:
                Resolved: