Skip to content

Commit e1bfa50

Browse files
committed
docs: list the native Text scan in Supported Spark Operators
1 parent 02c3405 commit e1bfa50

1 file changed

Lines changed: 1 addition & 1 deletion

File tree

‎docs/source/user-guide/latest/operators.md‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -62,7 +62,7 @@ omitted from the tables below and may be reconsidered based on demand:
6262
| Operator | Status | Notes |
6363
| ----------------------- | ------ | ------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------ |
6464
| `FileSourceScanExec` | ✅ | Parquet only. Some types and configurations fall back. See [Parquet](parquet.md#reading). |
65-
| `BatchScanExec` | ✅ | Apache Iceberg Parquet scans run natively. Native CSV scans are experimental and disabled by default. DataSource V2 Parquet scans are not accelerated. See [Parquet](parquet.md#reading) and the [Iceberg Guide](iceberg.md). |
65+
| `BatchScanExec` | ✅ | Apache Iceberg Parquet scans run natively. Native CSV and Text scans are experimental and disabled by default. DataSource V2 Parquet scans are not accelerated. See [Parquet](parquet.md#reading) and the [Iceberg Guide](iceberg.md). |
6666
| `LocalTableScanExec` | ⚠️ | Disabled by default. Converting it rarely speeds up the scan itself, but a native Iceberg write needs it to write the rows of `INSERT ... VALUES` or a local DataFrame natively; see [Iceberg Writes](iceberg.md#native-parquet-write-eligibility). Enable it with `spark.comet.exec.localTableScan.enabled=true` ([#4393](https://github.com/apache/datafusion-comet/pull/4393)). |
6767
| `EmptyRelationExec` | ✅ | Spark 4.0 and later. See [Empty Relations](compatibility/operators.md#empty-relations) for native-input support, including native Parquet writes. |
6868
| `RangeExec` | ⚠️ | Disabled by default. Set `spark.comet.exec.range.enabled=true` to generate the rows of `spark.range` and SQL `range()` in native code, so the operators above them run natively. It can be slower than Spark when those operators are only cheap expressions, such as a filter, which Spark compiles together with the range into one loop. Ranges whose arithmetic overflows the `Long` range fall back to Spark. |

0 commit comments

Comments
 (0)