Repository navigation
Commit b70ad0b
authored
### Rationale for this change
Legacy ParquetDataset has been deprecated for a while now, see
#31529. This PR is removing the
legacy implementation from the code.
### What changes are included in this PR?
The PR is removing:
- `ParquetDatasetPiece `
- `ParquetManifest`
- `_ParquetDatasetMetadata `
- `ParquetDataset`
The PR is renaming `_ParquetDatasetV2` to `ParquetDataset` which was
removed. It is also updating the docstrings.
The PR is updating:
- `read_table`
- `write_to_dataset`
The PR is updating all the tests to not use `use_legacy_dataset` keyword
or legacy parametrisation.
### Are these changes tested?
Yes.
### Are there any user-facing changes?
Deprecated code is removed.
* Closes: #31303
1 parent e5145bf commit b70ad0b
15 files changed
Lines changed: 630 additions & 3029 deletions
File tree
- docs/source/python
- python
- benchmarks
- pyarrow
- parquet
- tests
- parquet
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
511 | 511 | | |
512 | 512 | | |
513 | 513 | | |
514 | | - | |
515 | | - | |
516 | | - | |
517 | | - | |
518 | | - | |
519 | | - | |
520 | | - | |
521 | | - | |
522 | | - | |
523 | | - | |
524 | | - | |
525 | | - | |
526 | | - | |
527 | | - | |
528 | | - | |
529 | | - | |
530 | | - | |
531 | | - | |
| 514 | + | |
532 | 515 | | |
533 | | - | |
| 516 | + | |
| 517 | + | |
| 518 | + | |
| 519 | + | |
| 520 | + | |
| 521 | + | |
534 | 522 | | |
535 | | - | |
536 | | - | |
537 | | - | |
| 523 | + | |
538 | 524 | | |
539 | | - | |
540 | | - | |
541 | | - | |
542 | | - | |
543 | | - | |
| 525 | + | |
| 526 | + | |
| 527 | + | |
544 | 528 | | |
545 | 529 | | |
546 | 530 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
29 | 29 | | |
30 | 30 | | |
31 | 31 | | |
32 | | - | |
33 | | - | |
34 | | - | |
35 | | - | |
36 | | - | |
37 | | - | |
38 | | - | |
39 | | - | |
40 | | - | |
41 | | - | |
42 | | - | |
43 | | - | |
44 | | - | |
45 | | - | |
46 | | - | |
47 | | - | |
48 | | - | |
49 | | - | |
50 | | - | |
51 | | - | |
52 | | - | |
53 | | - | |
54 | | - | |
55 | | - | |
56 | | - | |
57 | | - | |
58 | | - | |
59 | | - | |
60 | | - | |
61 | 32 | | |
62 | 33 | | |
63 | 34 | | |
| |||
0 commit comments