Repository navigation
Commit 8c433af
Global join selection (#183)
* Feature/determine prunability (#139)
* ready to review
* license added
* simplifications
* simplifications
* sort expr's are taken separately for each table
* we can return the sort info of the expression now
* check filter conditions
* simplifications
* simplifications
* functions are implemented for SortInfo calculations
* node specialized tableSide functions
* NotImplemented errors are added, test comments are added
* Comment change
* Simplify comparison node calculations
* Simplfications and better commenting
* is_prunable function is updated with new Prunability function
* Indices of sort expressions are updated with intermediate schema columns of the filter
* Unused function is removed
* Future-proof index updating
* An if let check is removed
* simplifications
* Simplifications
* simplifications
* Change if condition
* Determine prunability of tables for join operations (#90)
* ready to review
* license added
* simplifications
* simplifications
* sort expr's are taken separately for each table
* we can return the sort info of the expression now
* check filter conditions
* simplifications
* simplifications
* functions are implemented for SortInfo calculations
* node specialized tableSide functions
* NotImplemented errors are added, test comments are added
* Comment change
* Simplify comparison node calculations
* Simplfications and better commenting
* is_prunable function is updated with new Prunability function
* Indices of sort expressions are updated with intermediate schema columns of the filter
* Unused function is removed
* Future-proof index updating
* An if let check is removed
* simplifications
* Simplifications
* simplifications
* Change if condition
---------
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Mehmet Ozan Kabak <[email protected]>
* fix the tables' unboundedness
---------
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Mehmet Ozan Kabak <[email protected]>
* [GITHUB ACTION] Refactor for license and actions (#148)
* Delete datafusion main publication
* Adding licence information, refactoring prunibility issues
* Update SYNNADA-CONTRIBUTIONS.txt
* Update rat_exclude_files.txt
* Enhanced Pipeline Execution: Now Supporting Complex Query Plans for Improved Performance (#132)
* Very initial test passing algorithm
* Working except a minor bug in interval calculations
* After clippy
* Plan
* initial implemantation
* Before prune check ability is added.
Order equivalence implementations will vanish after we send a seperate PR
* minor changes
* Fix bug, ordering equivalence random head
* minor changes
* Add ordering equivalence for sort merge join
* Improvement on tests
* Upstream changes
* Add ordering equivalence for sort merge join
* Fmt issues
* Update comment
* Add ordering equivalence support for hash join
* Make 1 file
* Code enhancements/comment improvements
* Add projection cast handling
* Fix output ordering for sort merge join
* projection bug fix
* Minor changes
* minor changes
* simplify sort_merge_join
* Update equivalence implementation
* Update test_utils.rs
* Update cast implementation
* More idiomatic code
* After merge
* Comments visisted
* Add key swap according to the children orders
* Refactoring
* After merge refactor
* Update sort_enforcement.rs
* Update datafusion/core/src/physical_optimizer/join_selection.rs
Co-authored-by: Mustafa Akur <[email protected]>
* Comments are applied
* Feature/determine prunability (#139)
* ready to review
* license added
* simplifications
* simplifications
* sort expr's are taken separately for each table
* we can return the sort info of the expression now
* check filter conditions
* simplifications
* simplifications
* functions are implemented for SortInfo calculations
* node specialized tableSide functions
* NotImplemented errors are added, test comments are added
* Comment change
* Simplify comparison node calculations
* Simplfications and better commenting
* is_prunable function is updated with new Prunability function
* Indices of sort expressions are updated with intermediate schema columns of the filter
* Unused function is removed
* Future-proof index updating
* An if let check is removed
* simplifications
* Simplifications
* simplifications
* Change if condition
* Determine prunability of tables for join operations (#90)
* ready to review
* license added
* simplifications
* simplifications
* sort expr's are taken separately for each table
* we can return the sort info of the expression now
* check filter conditions
* simplifications
* simplifications
* functions are implemented for SortInfo calculations
* node specialized tableSide functions
* NotImplemented errors are added, test comments are added
* Comment change
* Simplify comparison node calculations
* Simplfications and better commenting
* is_prunable function is updated with new Prunability function
* Indices of sort expressions are updated with intermediate schema columns of the filter
* Unused function is removed
* Future-proof index updating
* An if let check is removed
* simplifications
* Simplifications
* simplifications
* Change if condition
---------
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Mehmet Ozan Kabak <[email protected]>
* fix the tables' unboundedness
---------
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Mehmet Ozan Kabak <[email protected]>
* Comment improvements and minor code improvements
* Splitting the order based join selection
* Update rat_exclude_files.txt
* Revert "Feature/determine prunability (#139)"
This reverts commit cf56105.
* Commented
---------
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Mehmet Ozan Kabak <[email protected]>
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Berkay Şahin <[email protected]>
* Bug fix: Fix lexicographical column search among provided ordering (#156)
* Initial comments on working
* License update (#157)
This extension adds Synnada license information to the existing one.
* Adding comments
* Update sort_hash_join.rs
* After merge silent error
* Change the query in HashJoin
* Revert "Feature/determine prunability (#139)"
This reverts commit cf56105.
* Update rat_exclude_files.txt
* Clippy solving.
* [GITHUB ACTION] Refactor for license and actions (#148)
* Delete datafusion main publication
* Adding licence information, refactoring prunibility issues
* Update SYNNADA-CONTRIBUTIONS.txt
* Update rat_exclude_files.txt
* Enhanced Pipeline Execution: Now Supporting Complex Query Plans for Improved Performance (#132)
* Very initial test passing algorithm
* Working except a minor bug in interval calculations
* After clippy
* Plan
* initial implemantation
* Before prune check ability is added.
Order equivalence implementations will vanish after we send a seperate PR
* minor changes
* Fix bug, ordering equivalence random head
* minor changes
* Add ordering equivalence for sort merge join
* Improvement on tests
* Upstream changes
* Add ordering equivalence for sort merge join
* Fmt issues
* Update comment
* Add ordering equivalence support for hash join
* Make 1 file
* Code enhancements/comment improvements
* Add projection cast handling
* Fix output ordering for sort merge join
* projection bug fix
* Minor changes
* minor changes
* simplify sort_merge_join
* Update equivalence implementation
* Update test_utils.rs
* Update cast implementation
* More idiomatic code
* After merge
* Comments visisted
* Add key swap according to the children orders
* Refactoring
* After merge refactor
* Update sort_enforcement.rs
* Update datafusion/core/src/physical_optimizer/join_selection.rs
Co-authored-by: Mustafa Akur <[email protected]>
* Comments are applied
* Feature/determine prunability (#139)
* ready to review
* license added
* simplifications
* simplifications
* sort expr's are taken separately for each table
* we can return the sort info of the expression now
* check filter conditions
* simplifications
* simplifications
* functions are implemented for SortInfo calculations
* node specialized tableSide functions
* NotImplemented errors are added, test comments are added
* Comment change
* Simplify comparison node calculations
* Simplfications and better commenting
* is_prunable function is updated with new Prunability function
* Indices of sort expressions are updated with intermediate schema columns of the filter
* Unused function is removed
* Future-proof index updating
* An if let check is removed
* simplifications
* Simplifications
* simplifications
* Change if condition
* Determine prunability of tables for join operations (#90)
* ready to review
* license added
* simplifications
* simplifications
* sort expr's are taken separately for each table
* we can return the sort info of the expression now
* check filter conditions
* simplifications
* simplifications
* functions are implemented for SortInfo calculations
* node specialized tableSide functions
* NotImplemented errors are added, test comments are added
* Comment change
* Simplify comparison node calculations
* Simplfications and better commenting
* is_prunable function is updated with new Prunability function
* Indices of sort expressions are updated with intermediate schema columns of the filter
* Unused function is removed
* Future-proof index updating
* An if let check is removed
* simplifications
* Simplifications
* simplifications
* Change if condition
---------
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Mehmet Ozan Kabak <[email protected]>
* fix the tables' unboundedness
---------
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Mehmet Ozan Kabak <[email protected]>
* Comment improvements and minor code improvements
* Splitting the order based join selection
* Update rat_exclude_files.txt
* Revert "Feature/determine prunability (#139)"
This reverts commit cf56105.
* Commented
---------
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Mehmet Ozan Kabak <[email protected]>
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Berkay Şahin <[email protected]>
* Bug fix: Fix lexicographical column search among provided ordering (#156)
* License update (#157)
This extension adds Synnada license information to the existing one.
* [GITHUB ACTION] Refactor for license and actions (#148)
* Delete datafusion main publication
* Adding licence information, refactoring prunibility issues
* Update SYNNADA-CONTRIBUTIONS.txt
* Update rat_exclude_files.txt
* Enhanced Pipeline Execution: Now Supporting Complex Query Plans for Improved Performance (#132)
* Very initial test passing algorithm
* Working except a minor bug in interval calculations
* After clippy
* Plan
* initial implemantation
* Before prune check ability is added.
Order equivalence implementations will vanish after we send a seperate PR
* minor changes
* Fix bug, ordering equivalence random head
* minor changes
* Add ordering equivalence for sort merge join
* Improvement on tests
* Upstream changes
* Add ordering equivalence for sort merge join
* Fmt issues
* Update comment
* Add ordering equivalence support for hash join
* Make 1 file
* Code enhancements/comment improvements
* Add projection cast handling
* Fix output ordering for sort merge join
* projection bug fix
* Minor changes
* minor changes
* simplify sort_merge_join
* Update equivalence implementation
* Update test_utils.rs
* Update cast implementation
* More idiomatic code
* After merge
* Comments visisted
* Add key swap according to the children orders
* Refactoring
* After merge refactor
* Update sort_enforcement.rs
* Update datafusion/core/src/physical_optimizer/join_selection.rs
Co-authored-by: Mustafa Akur <[email protected]>
* Comments are applied
* Feature/determine prunability (#139)
* ready to review
* license added
* simplifications
* simplifications
* sort expr's are taken separately for each table
* we can return the sort info of the expression now
* check filter conditions
* simplifications
* simplifications
* functions are implemented for SortInfo calculations
* node specialized tableSide functions
* NotImplemented errors are added, test comments are added
* Comment change
* Simplify comparison node calculations
* Simplfications and better commenting
* is_prunable function is updated with new Prunability function
* Indices of sort expressions are updated with intermediate schema columns of the filter
* Unused function is removed
* Future-proof index updating
* An if let check is removed
* simplifications
* Simplifications
* simplifications
* Change if condition
* Determine prunability of tables for join operations (#90)
* ready to review
* license added
* simplifications
* simplifications
* sort expr's are taken separately for each table
* we can return the sort info of the expression now
* check filter conditions
* simplifications
* simplifications
* functions are implemented for SortInfo calculations
* node specialized tableSide functions
* NotImplemented errors are added, test comments are added
* Comment change
* Simplify comparison node calculations
* Simplfications and better commenting
* is_prunable function is updated with new Prunability function
* Indices of sort expressions are updated with intermediate schema columns of the filter
* Unused function is removed
* Future-proof index updating
* An if let check is removed
* simplifications
* Simplifications
* simplifications
* Change if condition
---------
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Mehmet Ozan Kabak <[email protected]>
* fix the tables' unboundedness
---------
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Mehmet Ozan Kabak <[email protected]>
* Comment improvements and minor code improvements
* Splitting the order based join selection
* Update rat_exclude_files.txt
* Revert "Feature/determine prunability (#139)"
This reverts commit cf56105.
* Commented
---------
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Mehmet Ozan Kabak <[email protected]>
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Berkay Şahin <[email protected]>
* Bug fix: Fix lexicographical column search among provided ordering (#156)
* License update (#157)
This extension adds Synnada license information to the existing one.
* Sliding Nested Join Algorithm (#142)
* Sliding Hash Join Algorithm (SWHJ) (#147)
* Fix errors introduced during rebase
* [GITHUB ACTION] Refactor for license and actions (#148)
* Delete datafusion main publication
* Adding licence information, refactoring prunibility issues
* Update SYNNADA-CONTRIBUTIONS.txt
* Update rat_exclude_files.txt
* Enhanced Pipeline Execution: Now Supporting Complex Query Plans for Improved Performance (#132)
* Very initial test passing algorithm
* Working except a minor bug in interval calculations
* After clippy
* Plan
* initial implemantation
* Before prune check ability is added.
Order equivalence implementations will vanish after we send a seperate PR
* minor changes
* Fix bug, ordering equivalence random head
* minor changes
* Add ordering equivalence for sort merge join
* Improvement on tests
* Upstream changes
* Add ordering equivalence for sort merge join
* Fmt issues
* Update comment
* Add ordering equivalence support for hash join
* Make 1 file
* Code enhancements/comment improvements
* Add projection cast handling
* Fix output ordering for sort merge join
* projection bug fix
* Minor changes
* minor changes
* simplify sort_merge_join
* Update equivalence implementation
* Update test_utils.rs
* Update cast implementation
* More idiomatic code
* After merge
* Comments visisted
* Add key swap according to the children orders
* Refactoring
* After merge refactor
* Update sort_enforcement.rs
* Update datafusion/core/src/physical_optimizer/join_selection.rs
Co-authored-by: Mustafa Akur <[email protected]>
* Comments are applied
* Feature/determine prunability (#139)
* ready to review
* license added
* simplifications
* simplifications
* sort expr's are taken separately for each table
* we can return the sort info of the expression now
* check filter conditions
* simplifications
* simplifications
* functions are implemented for SortInfo calculations
* node specialized tableSide functions
* NotImplemented errors are added, test comments are added
* Comment change
* Simplify comparison node calculations
* Simplfications and better commenting
* is_prunable function is updated with new Prunability function
* Indices of sort expressions are updated with intermediate schema columns of the filter
* Unused function is removed
* Future-proof index updating
* An if let check is removed
* simplifications
* Simplifications
* simplifications
* Change if condition
* Determine prunability of tables for join operations (#90)
* ready to review
* license added
* simplifications
* simplifications
* sort expr's are taken separately for each table
* we can return the sort info of the expression now
* check filter conditions
* simplifications
* simplifications
* functions are implemented for SortInfo calculations
* node specialized tableSide functions
* NotImplemented errors are added, test comments are added
* Comment change
* Simplify comparison node calculations
* Simplfications and better commenting
* is_prunable function is updated with new Prunability function
* Indices of sort expressions are updated with intermediate schema columns of the filter
* Unused function is removed
* Future-proof index updating
* An if let check is removed
* simplifications
* Simplifications
* simplifications
* Change if condition
---------
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Mehmet Ozan Kabak <[email protected]>
* fix the tables' unboundedness
---------
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Mehmet Ozan Kabak <[email protected]>
* Comment improvements and minor code improvements
* Splitting the order based join selection
* Update rat_exclude_files.txt
* Revert "Feature/determine prunability (#139)"
This reverts commit cf56105.
* Commented
---------
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Mehmet Ozan Kabak <[email protected]>
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Berkay Şahin <[email protected]>
* Bug fix: Fix lexicographical column search among provided ordering (#156)
* License update (#157)
This extension adds Synnada license information to the existing one.
* Sliding Nested Join Algorithm (#142)
* Sliding Hash Join Algorithm (SWHJ) (#147)
* Fix errors introduced during rebase
* Keep Track of Global Ordering Requirement (#165)
* Prunability of Join Filter Physical Expressions (#161)
* BinaryExpr Equivalence (#116)
* Fix errors introduced during rebase
* Support multiple ordered columns on joins and expression graph (#163)
* After merge
* SlidingHashJoin and SlidingNestedLoopJoin planner integration (#171)
* Before clippy fmt etc.
* lazy loading tables
* mini test
* [GITHUB ACTION] Refactor for license and actions (#148)
* Delete datafusion main publication
* Adding licence information, refactoring prunibility issues
* Update SYNNADA-CONTRIBUTIONS.txt
* Update rat_exclude_files.txt
* Enhanced Pipeline Execution: Now Supporting Complex Query Plans for Improved Performance (#132)
* Very initial test passing algorithm
* Working except a minor bug in interval calculations
* After clippy
* Plan
* initial implemantation
* Before prune check ability is added.
Order equivalence implementations will vanish after we send a seperate PR
* minor changes
* Fix bug, ordering equivalence random head
* minor changes
* Add ordering equivalence for sort merge join
* Improvement on tests
* Upstream changes
* Add ordering equivalence for sort merge join
* Fmt issues
* Update comment
* Add ordering equivalence support for hash join
* Make 1 file
* Code enhancements/comment improvements
* Add projection cast handling
* Fix output ordering for sort merge join
* projection bug fix
* Minor changes
* minor changes
* simplify sort_merge_join
* Update equivalence implementation
* Update test_utils.rs
* Update cast implementation
* More idiomatic code
* After merge
* Comments visisted
* Add key swap according to the children orders
* Refactoring
* After merge refactor
* Update sort_enforcement.rs
* Update datafusion/core/src/physical_optimizer/join_selection.rs
Co-authored-by: Mustafa Akur <[email protected]>
* Comments are applied
* Feature/determine prunability (#139)
* ready to review
* license added
* simplifications
* simplifications
* sort expr's are taken separately for each table
* we can return the sort info of the expression now
* check filter conditions
* simplifications
* simplifications
* functions are implemented for SortInfo calculations
* node specialized tableSide functions
* NotImplemented errors are added, test comments are added
* Comment change
* Simplify comparison node calculations
* Simplfications and better commenting
* is_prunable function is updated with new Prunability function
* Indices of sort expressions are updated with intermediate schema columns of the filter
* Unused function is removed
* Future-proof index updating
* An if let check is removed
* simplifications
* Simplifications
* simplifications
* Change if condition
* Determine prunability of tables for join operations (#90)
* ready to review
* license added
* simplifications
* simplifications
* sort expr's are taken separately for each table
* we can return the sort info of the expression now
* check filter conditions
* simplifications
* simplifications
* functions are implemented for SortInfo calculations
* node specialized tableSide functions
* NotImplemented errors are added, test comments are added
* Comment change
* Simplify comparison node calculations
* Simplfications and better commenting
* is_prunable function is updated with new Prunability function
* Indices of sort expressions are updated with intermediate schema columns of the filter
* Unused function is removed
* Future-proof index updating
* An if let check is removed
* simplifications
* Simplifications
* simplifications
* Change if condition
---------
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Mehmet Ozan Kabak <[email protected]>
* fix the tables' unboundedness
---------
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Mehmet Ozan Kabak <[email protected]>
* Comment improvements and minor code improvements
* Splitting the order based join selection
* Update rat_exclude_files.txt
* Revert "Feature/determine prunability (#139)"
This reverts commit cf56105.
* Commented
---------
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Mehmet Ozan Kabak <[email protected]>
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Berkay Şahin <[email protected]>
* Bug fix: Fix lexicographical column search among provided ordering (#156)
* License update (#157)
This extension adds Synnada license information to the existing one.
* Sliding Nested Join Algorithm (#142)
* Sliding Hash Join Algorithm (SWHJ) (#147)
* Fix errors introduced during rebase
* Keep Track of Global Ordering Requirement (#165)
* Prunability of Join Filter Physical Expressions (#161)
* BinaryExpr Equivalence (#116)
* Fix errors introduced during rebase
* Support multiple ordered columns on joins and expression graph (#163)
* SlidingHashJoin and SlidingNestedLoopJoin planner integration (#171)
* Add license, add contribution hash commits, minor changes
* Before rebase merge
* Add license, add contribution hash commits, minor changes, add scripts to automate hash generation,Delete docs yaml file
* Update utils.rs
* Print deletion
* Update Cargo.lock
* Refactor for review
* Working without slt
* [GITHUB ACTION] Refactor for license and actions (#148)
* Delete datafusion main publication
* Adding licence information, refactoring prunibility issues
* Update SYNNADA-CONTRIBUTIONS.txt
* Update rat_exclude_files.txt
* Enhanced Pipeline Execution: Now Supporting Complex Query Plans for Improved Performance (#132)
* Very initial test passing algorithm
* Working except a minor bug in interval calculations
* After clippy
* Plan
* initial implemantation
* Before prune check ability is added.
Order equivalence implementations will vanish after we send a seperate PR
* minor changes
* Fix bug, ordering equivalence random head
* minor changes
* Add ordering equivalence for sort merge join
* Improvement on tests
* Upstream changes
* Add ordering equivalence for sort merge join
* Fmt issues
* Update comment
* Add ordering equivalence support for hash join
* Make 1 file
* Code enhancements/comment improvements
* Add projection cast handling
* Fix output ordering for sort merge join
* projection bug fix
* Minor changes
* minor changes
* simplify sort_merge_join
* Update equivalence implementation
* Update test_utils.rs
* Update cast implementation
* More idiomatic code
* After merge
* Comments visisted
* Add key swap according to the children orders
* Refactoring
* After merge refactor
* Update sort_enforcement.rs
* Update datafusion/core/src/physical_optimizer/join_selection.rs
Co-authored-by: Mustafa Akur <[email protected]>
* Comments are applied
* Feature/determine prunability (#139)
* ready to review
* license added
* simplifications
* simplifications
* sort expr's are taken separately for each table
* we can return the sort info of the expression now
* check filter conditions
* simplifications
* simplifications
* functions are implemented for SortInfo calculations
* node specialized tableSide functions
* NotImplemented errors are added, test comments are added
* Comment change
* Simplify comparison node calculations
* Simplfications and better commenting
* is_prunable function is updated with new Prunability function
* Indices of sort expressions are updated with intermediate schema columns of the filter
* Unused function is removed
* Future-proof index updating
* An if let check is removed
* simplifications
* Simplifications
* simplifications
* Change if condition
* Determine prunability of tables for join operations (#90)
* ready to review
* license added
* simplifications
* simplifications
* sort expr's are taken separately for each table
* we can return the sort info of the expression now
* check filter conditions
* simplifications
* simplifications
* functions are implemented for SortInfo calculations
* node specialized tableSide functions
* NotImplemented errors are added, test comments are added
* Comment change
* Simplify comparison node calculations
* Simplfications and better commenting
* is_prunable function is updated with new Prunability function
* Indices of sort expressions are updated with intermediate schema columns of the filter
* Unused function is removed
* Future-proof index updating
* An if let check is removed
* simplifications
* Simplifications
* simplifications
* Change if condition
---------
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Mehmet Ozan Kabak <[email protected]>
* fix the tables' unboundedness
---------
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Mehmet Ozan Kabak <[email protected]>
* Comment improvements and minor code improvements
* Splitting the order based join selection
* Update rat_exclude_files.txt
* Revert "Feature/determine prunability (#139)"
This reverts commit cf56105.
* Commented
---------
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Mehmet Ozan Kabak <[email protected]>
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Berkay Şahin <[email protected]>
* Bug fix: Fix lexicographical column search among provided ordering (#156)
* License update (#157)
This extension adds Synnada license information to the existing one.
* Sliding Nested Join Algorithm (#142)
* Sliding Hash Join Algorithm (SWHJ) (#147)
* Fix errors introduced during rebase
* Keep Track of Global Ordering Requirement (#165)
* Prunability of Join Filter Physical Expressions (#161)
* BinaryExpr Equivalence (#116)
* Fix errors introduced during rebase
* Support multiple ordered columns on joins and expression graph (#163)
* SlidingHashJoin and SlidingNestedLoopJoin planner integration (#171)
* Add license, add contribution hash commits, minor changes, add scripts to automate hash generation,Delete docs yaml file
* Change in test folders
* Update join_pipeline_selection.rs
* Update utils.rs
* Before clippy
* Before SLT
* Tests are passing and clippy OK.
* [GITHUB ACTION] Refactor for license and actions (#148)
* Delete datafusion main publication
* Adding licence information, refactoring prunibility issues
* Update SYNNADA-CONTRIBUTIONS.txt
* Update rat_exclude_files.txt
* Enhanced Pipeline Execution: Now Supporting Complex Query Plans for Improved Performance (#132)
* Very initial test passing algorithm
* Working except a minor bug in interval calculations
* After clippy
* Plan
* initial implemantation
* Before prune check ability is added.
Order equivalence implementations will vanish after we send a seperate PR
* minor changes
* Fix bug, ordering equivalence random head
* minor changes
* Add ordering equivalence for sort merge join
* Improvement on tests
* Upstream changes
* Add ordering equivalence for sort merge join
* Fmt issues
* Update comment
* Add ordering equivalence support for hash join
* Make 1 file
* Code enhancements/comment improvements
* Add projection cast handling
* Fix output ordering for sort merge join
* projection bug fix
* Minor changes
* minor changes
* simplify sort_merge_join
* Update equivalence implementation
* Update test_utils.rs
* Update cast implementation
* More idiomatic code
* After merge
* Comments visisted
* Add key swap according to the children orders
* Refactoring
* After merge refactor
* Update sort_enforcement.rs
* Update datafusion/core/src/physical_optimizer/join_selection.rs
Co-authored-by: Mustafa Akur <[email protected]>
* Comments are applied
* Feature/determine prunability (#139)
* ready to review
* license added
* simplifications
* simplifications
* sort expr's are taken separately for each table
* we can return the sort info of the expression now
* check filter conditions
* simplifications
* simplifications
* functions are implemented for SortInfo calculations
* node specialized tableSide functions
* NotImplemented errors are added, test comments are added
* Comment change
* Simplify comparison node calculations
* Simplfications and better commenting
* is_prunable function is updated with new Prunability function
* Indices of sort expressions are updated with intermediate schema columns of the filter
* Unused function is removed
* Future-proof index updating
* An if let check is removed
* simplifications
* Simplifications
* simplifications
* Change if condition
* Determine prunability of tables for join operations (#90)
* ready to review
* license added
* simplifications
* simplifications
* sort expr's are taken separately for each table
* we can return the sort info of the expression now
* check filter conditions
* simplifications
* simplifications
* functions are implemented for SortInfo calculations
* node specialized tableSide functions
* NotImplemented errors are added, test comments are added
* Comment change
* Simplify comparison node calculations
* Simplfications and better commenting
* is_prunable function is updated with new Prunability function
* Indices of sort expressions are updated with intermediate schema columns of the filter
* Unused function is removed
* Future-proof index updating
* An if let check is removed
* simplifications
* Simplifications
* simplifications
* Change if condition
---------
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Mehmet Ozan Kabak <[email protected]>
* fix the tables' unboundedness
---------
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Mehmet Ozan Kabak <[email protected]>
* Comment improvements and minor code improvements
* Splitting the order based join selection
* Update rat_exclude_files.txt
* Revert "Feature/determine prunability (#139)"
This reverts commit cf56105.
* Commented
---------
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Mehmet Ozan Kabak <[email protected]>
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Berkay Şahin <[email protected]>
* Bug fix: Fix lexicographical column search among provided ordering (#156)
* License update (#157)
This extension adds Synnada license information to the existing one.
* Sliding Nested Join Algorithm (#142)
* Sliding Hash Join Algorithm (SWHJ) (#147)
* Fix errors introduced during rebase
* Keep Track of Global Ordering Requirement (#165)
* Prunability of Join Filter Physical Expressions (#161)
* BinaryExpr Equivalence (#116)
* Fix errors introduced during rebase
* Support multiple ordered columns on joins and expression graph (#163)
* SlidingHashJoin and SlidingNestedLoopJoin planner integration (#171)
* Add license, add contribution hash commits, minor changes, add scripts to automate hash generation,Delete docs yaml file
* Resolve errors introduced during rebase
* After merge
* Update rat_exclude_files.txt
* Comments visited
* Synnada Streaming SQL Tests (#190)
* Adds a new method to construct window function for the given input
* For mustafa
* Final
* Update rat_exclude_files.txt
* More commenting
* Fix linter errors, compile errors after rebase, Update commit hashes
* After merge refactors
* Dir
* Additional test for coverage
* Update join_disable_repartition_joins.slt
* Review changes, remove code duplicates
* Update subdirectory hashes
---------
Co-authored-by: Berkay Şahin <[email protected]>
Co-authored-by: Mustafa Akur <[email protected]>
Co-authored-by: Mehmet Ozan Kabak <[email protected]>
Co-authored-by: Mustafa Akur <[email protected]>1 parent 6156c3c commit 8c433af
17 files changed
Lines changed: 5205 additions & 1203 deletions
File tree
- datafusion
- core
- src/physical_optimizer
- tests/sql
- physical-plan/src/joins
- sqllogictest
- src/engines/datafusion_engine
- test_files
- dev/release
Large diffs are not rendered by default.
Large diffs are not rendered by default.
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
397 | 397 | | |
398 | 398 | | |
399 | 399 | | |
| 400 | + | |
| 401 | + | |
| 402 | + | |
| 403 | + | |
| 404 | + | |
| 405 | + | |
| 406 | + | |
| 407 | + | |
| 408 | + | |
| 409 | + | |
| 410 | + | |
| 411 | + | |
| 412 | + | |
| 413 | + | |
| 414 | + | |
| 415 | + | |
| 416 | + | |
| 417 | + | |
| 418 | + | |
400 | 419 | | |
401 | 420 | | |
402 | 421 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
21 | 21 | | |
22 | 22 | | |
23 | 23 | | |
| 24 | + | |
| 25 | + | |
24 | 26 | | |
25 | | - | |
| 27 | + | |
26 | 28 | | |
27 | 29 | | |
28 | 30 | | |
| |||
164 | 166 | | |
165 | 167 | | |
166 | 168 | | |
| 169 | + | |
| 170 | + | |
| 171 | + | |
| 172 | + | |
| 173 | + | |
| 174 | + | |
| 175 | + | |
| 176 | + | |
| 177 | + | |
| 178 | + | |
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
125 | 125 | | |
126 | 126 | | |
127 | 127 | | |
128 | | - | |
| 128 | + | |
129 | 129 | | |
130 | | - | |
| 130 | + | |
131 | 131 | | |
132 | 132 | | |
133 | 133 | | |
134 | | - | |
| 134 | + | |
135 | 135 | | |
136 | 136 | | |
137 | 137 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
20 | 20 | | |
21 | 21 | | |
22 | 22 | | |
| 23 | + | |
23 | 24 | | |
24 | 25 | | |
25 | 26 | | |
| |||
33 | 34 | | |
34 | 35 | | |
35 | 36 | | |
| 37 | + | |
36 | 38 | | |
37 | 39 | | |
38 | 40 | | |
| |||
| Original file line number | Diff line number | Diff line change | |
|---|---|---|---|
| |||
191 | 191 | | |
192 | 192 | | |
193 | 193 | | |
| 194 | + | |
| 195 | + | |
| 196 | + | |
| 197 | + | |
| 198 | + | |
| 199 | + | |
| 200 | + | |
| 201 | + | |
| 202 | + | |
| 203 | + | |
| 204 | + | |
| 205 | + | |
| 206 | + | |
| 207 | + | |
| 208 | + | |
| 209 | + | |
194 | 210 | | |
195 | 211 | | |
196 | 212 | | |
| |||
744 | 760 | | |
745 | 761 | | |
746 | 762 | | |
747 | | - | |
748 | | - | |
749 | | - | |
750 | | - | |
| 763 | + | |
| 764 | + | |
| 765 | + | |
751 | 766 | | |
752 | 767 | | |
753 | 768 | | |
754 | 769 | | |
755 | 770 | | |
756 | 771 | | |
757 | | - | |
758 | | - | |
759 | | - | |
760 | | - | |
761 | | - | |
762 | 772 | | |
763 | 773 | | |
764 | 774 | | |
| |||
831 | 841 | | |
832 | 842 | | |
833 | 843 | | |
834 | | - | |
835 | | - | |
836 | | - | |
837 | | - | |
838 | | - | |
839 | | - | |
840 | | - | |
841 | | - | |
842 | | - | |
843 | | - | |
844 | | - | |
845 | | - | |
846 | | - | |
847 | | - | |
848 | | - | |
849 | | - | |
850 | | - | |
851 | | - | |
852 | | - | |
853 | | - | |
854 | | - | |
855 | | - | |
856 | | - | |
857 | | - | |
858 | | - | |
859 | | - | |
860 | | - | |
861 | | - | |
862 | | - | |
863 | | - | |
864 | | - | |
865 | | - | |
866 | | - | |
867 | | - | |
868 | | - | |
869 | | - | |
870 | | - | |
871 | | - | |
872 | | - | |
873 | | - | |
874 | | - | |
875 | | - | |
876 | | - | |
877 | | - | |
878 | | - | |
879 | | - | |
880 | | - | |
881 | | - | |
882 | | - | |
883 | 844 | | |
884 | 845 | | |
885 | 846 | | |
886 | 847 | | |
887 | 848 | | |
888 | 849 | | |
889 | | - | |
| 850 | + | |
890 | 851 | | |
891 | 852 | | |
892 | 853 | | |
| |||
915 | 876 | | |
916 | 877 | | |
917 | 878 | | |
918 | | - | |
| 879 | + | |
919 | 880 | | |
920 | 881 | | |
921 | 882 | | |
| |||
946 | 907 | | |
947 | 908 | | |
948 | 909 | | |
949 | | - | |
| 910 | + | |
950 | 911 | | |
951 | 912 | | |
952 | 913 | | |
| |||
977 | 938 | | |
978 | 939 | | |
979 | 940 | | |
980 | | - | |
| 941 | + | |
981 | 942 | | |
982 | 943 | | |
983 | 944 | | |
| |||
1010 | 971 | | |
1011 | 972 | | |
1012 | 973 | | |
1013 | | - | |
| 974 | + | |
1014 | 975 | | |
1015 | 976 | | |
1016 | 977 | | |
| |||
1039 | 1000 | | |
1040 | 1001 | | |
1041 | 1002 | | |
1042 | | - | |
| 1003 | + | |
1043 | 1004 | | |
1044 | 1005 | | |
1045 | 1006 | | |
| |||
1069 | 1030 | | |
1070 | 1031 | | |
1071 | 1032 | | |
1072 | | - | |
| 1033 | + | |
1073 | 1034 | | |
1074 | 1035 | | |
1075 | 1036 | | |
| |||
1098 | 1059 | | |
1099 | 1060 | | |
1100 | 1061 | | |
1101 | | - | |
| 1062 | + | |
1102 | 1063 | | |
1103 | 1064 | | |
1104 | 1065 | | |
| |||
1152 | 1113 | | |
1153 | 1114 | | |
1154 | 1115 | | |
1155 | | - | |
| 1116 | + | |
1156 | 1117 | | |
1157 | 1118 | | |
1158 | 1119 | | |
| |||
1171 | 1132 | | |
1172 | 1133 | | |
1173 | 1134 | | |
1174 | | - | |
1175 | | - | |
1176 | | - | |
1177 | | - | |
1178 | | - | |
1179 | 1135 | | |
0 commit comments