Skip to content

Record ignoring table because of ... errors from crawl_tables step for later analysis #231

@nfx

Description

@nfx

Corner-case errors are not surfaced outside of the crawl_tables task run. These errors are rather rare conditions, but still it's good to surface them somewhere:

  • java.lang.IllegalArgumentException: Error: type expected at the position 34508 ...
  • org.apache.spark.SparkException: [CANNOT_RECOGNIZE_HIVE_TYPE] Cannot recognize hive type string: ...
  • java.lang.UnsupportedOperationException: Parquet does not support timestamp. See HIVE-6384
  • java.lang.RuntimeException: MetaException(message:java.lang.ClassNotFoundException Class org.apache.hadoop.hive.serde2.OpenCSVSerde not found)
image

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions