Skip to content

Conversation

@litiliu
Copy link
Contributor

@litiliu litiliu commented Mar 6, 2025

Purpose of this pull request

Use common-csv to parse the csv file line by line, close #6748 , #8444

Does this PR introduce any user-facing change?

How was this patch tested?

Added E2E test case

Check list

@litiliu litiliu changed the title use csv parser to read csv file [Fix][Opt][File]use csv parser to read csv file Mar 6, 2025
@litiliu litiliu changed the title [Fix][Opt][File]use csv parser to read csv file [Opt][File]use csv parser to read csv file Mar 7, 2025
@litiliu litiliu force-pushed the optimize-csv branch 3 times, most recently from 6a936af to dff6107 Compare March 13, 2025 08:31
@github-actions github-actions bot added the e2e label Mar 14, 2025
@litiliu litiliu marked this pull request as ready for review March 14, 2025 02:27
@litiliu litiliu changed the title [Opt][File]use csv parser to read csv file [Opt][File]use common-csv to read csv file Mar 14, 2025
@litiliu litiliu marked this pull request as draft March 14, 2025 05:22
@litiliu litiliu marked this pull request as ready for review March 17, 2025 03:00
@litiliu litiliu changed the title [Opt][File]use common-csv to read csv file [Fix][File]use common-csv to read csv file Mar 17, 2025
@litiliu
Copy link
Contributor Author

litiliu commented Mar 17, 2025

@TyrantLucifer @hailin0 PTAL

@litiliu
Copy link
Contributor Author

litiliu commented Mar 18, 2025

@Hisoka-X @zhangshenghang PTAL

@Hisoka-X
Copy link
Member

cc @corgy-w

@hailin0 hailin0 merged commit 3e64a42 into apache:dev Mar 19, 2025
4 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Projects

None yet

Development

Successfully merging this pull request may close these issues.

[Bug] [Seatunnel-formats] 读取csv的时候遇到字段里有换行的会被解析成新的一行 导致数据错乱

3 participants