Skip to content

[BUG]: Scan tables in mounts doesn't handle partitioned CSVs and JSON tables #1389

@william-conti

Description

@william-conti

Is there an existing issue for this?

  • I have searched the existing issues

Current Behavior

When creating a partitioned CSV or JSON table in a mount point, the TablesInMounts crawler will identify those tables as PARQUET tables. This is wrong and can create unexpected issues downstream.

Expected Behavior

Any table type supported by the TablesInMounts crawler can be partitioned, therefore the logic must be updated.

Steps To Reproduce

No response

Cloud

AWS

Operating System

macOS

Version

latest via Databricks CLI

Relevant log output

No response

Metadata

Metadata

Assignees

No one assigned

    Type

    No type

    Projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions