Repository navigation
Commit 5852636
authored
Give each inline V2 scan root its own IO session (#11226)
When the DataFusion V2 scan driver runs chunks inline (`concurrency ×
available parallelism <= 1`), it admits each spawned chunk to the scan's
own `Run` as another root. Every root was given the same `IoSource`
session. The run clears a root's session when that root retires, so once
the first chunk finished, its `clear()` cancelled the reads of the
others, and they waited forever for completions that never came.
- `vortex-datafusion/src/persistent/scan_v2.rs`: `RunState` holds the
scan's `IoService` instead of a single session, and the driver calls
`io.session()` for every root it admits: the first root and each inline
child. Each root's session is now cleared on its own. All sessions still
read from the same `SegmentSource`.
---------
Signed-off-by: Joe Isaacs <[email protected]>1 parent e5f7534 commit 5852636
1 file changed
Lines changed: 68 additions & 0 deletions
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
724 | 724 | | |
725 | 725 | | |
726 | 726 | | |
| 727 | + | |
| 728 | + | |
| 729 | + | |
| 730 | + | |
| 731 | + | |
| 732 | + | |
| 733 | + | |
| 734 | + | |
| 735 | + | |
| 736 | + | |
| 737 | + | |
| 738 | + | |
| 739 | + | |
| 740 | + | |
| 741 | + | |
| 742 | + | |
| 743 | + | |
| 744 | + | |
| 745 | + | |
| 746 | + | |
| 747 | + | |
| 748 | + | |
| 749 | + | |
| 750 | + | |
| 751 | + | |
| 752 | + | |
| 753 | + | |
| 754 | + | |
| 755 | + | |
| 756 | + | |
| 757 | + | |
| 758 | + | |
| 759 | + | |
| 760 | + | |
| 761 | + | |
| 762 | + | |
| 763 | + | |
| 764 | + | |
| 765 | + | |
| 766 | + | |
| 767 | + | |
| 768 | + | |
| 769 | + | |
| 770 | + | |
| 771 | + | |
| 772 | + | |
| 773 | + | |
| 774 | + | |
| 775 | + | |
| 776 | + | |
| 777 | + | |
| 778 | + | |
| 779 | + | |
| 780 | + | |
| 781 | + | |
| 782 | + | |
| 783 | + | |
| 784 | + | |
| 785 | + | |
| 786 | + | |
| 787 | + | |
| 788 | + | |
| 789 | + | |
| 790 | + | |
| 791 | + | |
| 792 | + | |
| 793 | + | |
| 794 | + | |
727 | 795 | | |
728 | 796 | | |
729 | 797 | | |
| |||
0 commit comments