Skip to content

Support skipping comments in CsvReader #10262

@bbannier

Description

@bbannier

It would be great if datafusion had out-of-the-box support for skipping comment lines. While non of this is "standardized" many CSV readers support skipping full comment lines. An often used comment indentifier is a # prefix (default in e.g. pandas or R).

I originally posted this as a comment #8824 (comment).

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions