Skip to content

[Feature][Zeta][E2E] Enable zeta e2e and Fix the error when e2e enable #4615

New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Merged
EricJoy2048 merged 28 commits into from
Apr 23, 2023
Merged

[Feature][Zeta][E2E] Enable zeta e2e and Fix the error when e2e enable #4615

Show file tree
Hide file tree
Changes from all commits
Commits
Show all changes
28 commits
Select commit Hold shift + click to select a range
5d220cc
[Feature][E2E][Zeta] Enable zeta e2e
TyrantLucifer Apr 10, 2023
0461ea5
[Feature][E2E][Zeta] Enable zeta e2e
TyrantLucifer Apr 10, 2023
fcc0600
[Feature][Zeta] Fix kafka & iceberg IT cases
TyrantLucifer Apr 10, 2023
fe49b24
[Feature][Zeta] Copy hadoop dependency into zeta container
TyrantLucifer Apr 11, 2023
86641f4
[Feature][Zeta] Optimize CI
TyrantLucifer Apr 11, 2023
58ac335
[Feature][Zeta] Only enable zeta e2e to find the failed case
TyrantLucifer Apr 11, 2023
df8b946
[Feature][Zeta] Fix http IT case
TyrantLucifer Apr 11, 2023
f3073df
[Feature][Zeta] Fix jdbc-part-3 IT cases
TyrantLucifer Apr 12, 2023
8810812
[Feature][CI] Improve the stability of CI
TyrantLucifer Apr 13, 2023
d2837f4
[Feature][E2E][Zeta] Remove redundant annotation
TyrantLucifer Apr 17, 2023
efdccff
[Feature][Zeta][E2E] Improve CI process
TyrantLucifer Apr 18, 2023
e74e50a
[Feature][Zeta][E2E] Change jvm options
TyrantLucifer Apr 18, 2023
876ac7d
add server log
Hisoka-X Apr 18, 2023
f555cde
[Feature][Zeta][E2E] Change log appender
TyrantLucifer Apr 18, 2023
9479dad
[Feature][Zeta][E2E] Optimize CI process
TyrantLucifer Apr 21, 2023
783cb71
[Feature][Zeta][E2E] Fix Zeta bug
TyrantLucifer Apr 21, 2023
e0e44e9
[Feature][Zeta][E2E] Remove useless annotation
TyrantLucifer Apr 21, 2023
170f2f7
[Feature][Zeta][E2E] Temporary disabled zeta engine for rocketmq e2e
TyrantLucifer Apr 21, 2023
a235b8c
[Feature][Zeta][E2E] Enable all engine test cases
TyrantLucifer Apr 21, 2023
0785975
[Feature][Zeta][E2E] Revert log4j2.properties
TyrantLucifer Apr 21, 2023
19b9f85
[Feature][Zeta][E2E] Remove useless code & Add log4j2.properties
TyrantLucifer Apr 21, 2023
073280b
[Feature][Zeta][E2E] Improve iceberg case
TyrantLucifer Apr 21, 2023
4e3d647
[Feature][Zeta][E2E] Fix http e2e case
TyrantLucifer Apr 21, 2023
8d41728
[Feature][Zeta][E2E] Update log4j2.properties
TyrantLucifer Apr 21, 2023
898cba2
[Feature][Zeta][E2E] Remove useless CI check & Optimize CI check step
TyrantLucifer Apr 22, 2023
18ed106
[Feature][Zeta][E2E] Optimize http it cases
TyrantLucifer Apr 22, 2023
641a330
[Feature][Zeta][E2E] Fix dead links
TyrantLucifer Apr 22, 2023
93368c7
[Feature][Zeta][E2E] Fix dead links
TyrantLucifer Apr 22, 2023
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
210 changes: 138 additions & 72 deletions .github/workflows/backend.yml
View file
Open in desktop

Large diffs are not rendered by default.

4 changes: 2 additions & 2 deletions config/jvm_client_options
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -34,8 +34,8 @@
# Xms represents the initial size of total heap space
# Xmx represents the maximum size of total heap space

-Xms128m
-Xmx512m
-Xms1g
-Xmx1g

################################################################
## Expert settings
Expand Down
4 changes: 2 additions & 2 deletions config/jvm_options
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -34,8 +34,8 @@
# Xms represents the initial size of total heap space
# Xmx represents the maximum size of total heap space

#-Xms4g
#-Xmx4g
-Xms2g
-Xmx2g

################################################################
## Expert settings
Expand Down
4 changes: 2 additions & 2 deletions docs/en/connector-v2/source/Github.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -202,7 +202,7 @@ Http {

Here is an example:

- Test data can be found at this link [mockserver-contentjson-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-contentjson-config.json)
- Test data can be found at this link [mockserver-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-config.json)
- See this link for task configuration [http_contentjson_to_assert.conf](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/http_contentjson_to_assert.conf).

### json_field [Config]
Expand Down Expand Up @@ -263,7 +263,7 @@ source {
}
```

- Test data can be found at this link [mockserver-jsonpath-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-jsonpath-config.json)
- Test data can be found at this link [mockserver-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-config.json)
- See this link for task configuration [http_jsonpath_to_assert.conf](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/http_jsonpath_to_assert.conf).

### common options
Expand Down
4 changes: 2 additions & 2 deletions docs/en/connector-v2/source/Gitlab.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -202,7 +202,7 @@ Http {

Here is an example:

- Test data can be found at this link [mockserver-contentjson-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-contentjson-config.json)
- Test data can be found at this link [mockserver-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-config.json)
- See this link for task configuration [http_contentjson_to_assert.conf](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/http_contentjson_to_assert.conf).

### json_field [Config]
Expand Down Expand Up @@ -263,7 +263,7 @@ source {
}
```

- Test data can be found at this link [mockserver-jsonpath-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-jsonpath-config.json)
- Test data can be found at this link [mockserver-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-config.json)
- See this link for task configuration [http_jsonpath_to_assert.conf](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/http_jsonpath_to_assert.conf).

### common options
Expand Down
4 changes: 2 additions & 2 deletions docs/en/connector-v2/source/Http.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -203,7 +203,7 @@ Http {

Here is an example:

- Test data can be found at this link [mockserver-contentjson-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-contentjson-config.json)
- Test data can be found at this link [mockserver-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-config.json)
- See this link for task configuration [http_contentjson_to_assert.conf](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/http_contentjson_to_assert.conf).

### json_field [Config]
Expand Down Expand Up @@ -264,7 +264,7 @@ source {
}
```

- Test data can be found at this link [mockserver-jsonpath-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-jsonpath-config.json)
- Test data can be found at this link [mockserver-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-config.json)
- See this link for task configuration [http_jsonpath_to_assert.conf](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/http_jsonpath_to_assert.conf).

### common options
Expand Down
4 changes: 2 additions & 2 deletions docs/en/connector-v2/source/Jira.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -209,7 +209,7 @@ Http {

Here is an example:

- Test data can be found at this link [mockserver-contentjson-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-contentjson-config.json)
- Test data can be found at this link [mockserver-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-config.json)
- See this link for task configuration [http_contentjson_to_assert.conf](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/http_contentjson_to_assert.conf).

### json_field [Config]
Expand Down Expand Up @@ -270,7 +270,7 @@ source {
}
```

- Test data can be found at this link [mockserver-jsonpath-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-jsonpath-config.json)
- Test data can be found at this link [mockserver-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-config.json)
- See this link for task configuration [http_jsonpath_to_assert.conf](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/http_jsonpath_to_assert.conf).

### common options
Expand Down
4 changes: 2 additions & 2 deletions docs/en/connector-v2/source/Klaviyo.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -208,7 +208,7 @@ Http {

Here is an example:

- Test data can be found at this link [mockserver-contentjson-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-contentjson-config.json)
- Test data can be found at this link [mockserver-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-config.json)
- See this link for task configuration [http_contentjson_to_assert.conf](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/http_contentjson_to_assert.conf).

### json_field [Config]
Expand Down Expand Up @@ -269,7 +269,7 @@ source {
}
```

- Test data can be found at this link [mockserver-jsonpath-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-jsonpath-config.json)
- Test data can be found at this link [mockserver-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-config.json)
- See this link for task configuration [http_jsonpath_to_assert.conf](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/http_jsonpath_to_assert.conf).

### common options
Expand Down
4 changes: 2 additions & 2 deletions docs/en/connector-v2/source/Lemlist.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -204,7 +204,7 @@ Http {

Here is an example:

- Test data can be found at this link [mockserver-contentjson-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-contentjson-config.json)
- Test data can be found at this link [mockserver-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-config.json)
- See this link for task configuration [http_contentjson_to_assert.conf](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/http_contentjson_to_assert.conf).

### json_field [Config]
Expand Down Expand Up @@ -265,7 +265,7 @@ source {
}
```

- Test data can be found at this link [mockserver-jsonpath-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-jsonpath-config.json)
- Test data can be found at this link [mockserver-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-config.json)
- See this link for task configuration [http_jsonpath_to_assert.conf](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/http_jsonpath_to_assert.conf).

### common options
Expand Down
4 changes: 2 additions & 2 deletions docs/en/connector-v2/source/MyHours.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -208,7 +208,7 @@ Http {

Here is an example:

- Test data can be found at this link [mockserver-contentjson-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-contentjson-config.json)
- Test data can be found at this link [mockserver-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-config.json)
- See this link for task configuration [http_contentjson_to_assert.conf](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/http_contentjson_to_assert.conf).

### json_field [Config]
Expand Down Expand Up @@ -269,7 +269,7 @@ source {
}
```

- Test data can be found at this link [mockserver-jsonpath-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-jsonpath-config.json)
- Test data can be found at this link [mockserver-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-config.json)
- See this link for task configuration [http_jsonpath_to_assert.conf](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/http_jsonpath_to_assert.conf).

### common options
Expand Down
4 changes: 2 additions & 2 deletions docs/en/connector-v2/source/Notion.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -209,7 +209,7 @@ Http {

Here is an example:

- Test data can be found at this link [mockserver-contentjson-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-contentjson-config.json)
- Test data can be found at this link [mockserver-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-config.json)
- See this link for task configuration [http_contentjson_to_assert.conf](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/http_contentjson_to_assert.conf).

### json_field [Config]
Expand Down Expand Up @@ -270,7 +270,7 @@ source {
}
```

- Test data can be found at this link [mockserver-jsonpath-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-jsonpath-config.json)
- Test data can be found at this link [mockserver-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-config.json)
- See this link for task configuration [http_jsonpath_to_assert.conf](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/http_jsonpath_to_assert.conf).

### common options
Expand Down
4 changes: 2 additions & 2 deletions docs/en/connector-v2/source/OneSignal.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -205,7 +205,7 @@ Http {

Here is an example:

- Test data can be found at this link [mockserver-contentjson-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-contentjson-config.json)
- Test data can be found at this link [mockserver-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-config.json)
- See this link for task configuration [http_contentjson_to_assert.conf](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/http_contentjson_to_assert.conf).

### json_field [Config]
Expand Down Expand Up @@ -266,7 +266,7 @@ source {
}
```

- Test data can be found at this link [mockserver-jsonpath-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-jsonpath-config.json)
- Test data can be found at this link [mockserver-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-config.json)
- See this link for task configuration [http_jsonpath_to_assert.conf](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/http_jsonpath_to_assert.conf).

### common options
Expand Down
4 changes: 2 additions & 2 deletions docs/en/connector-v2/source/Persistiq.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -203,7 +203,7 @@ Http {

Here is an example:

- Test data can be found at this link [mockserver-contentjson-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-contentjson-config.json)
- Test data can be found at this link [mockserver-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-config.json)
- See this link for task configuration [http_contentjson_to_assert.conf](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/http_contentjson_to_assert.conf).

### json_field [Config]
Expand Down Expand Up @@ -264,7 +264,7 @@ source {
}
```

- Test data can be found at this link [mockserver-jsonpath-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-jsonpath-config.json)
- Test data can be found at this link [mockserver-config.json](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/mockserver-config.json)
- See this link for task configuration [http_jsonpath_to_assert.conf](../../../../seatunnel-e2e/seatunnel-connector-v2-e2e/connector-http-e2e/src/test/resources/http_jsonpath_to_assert.conf).

### common options
Expand Down
2 changes: 1 addition & 1 deletion seatunnel-api/src/main/java/org/apache/seatunnel/api/env/EnvCommonOptions.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -41,7 +41,7 @@ public interface EnvCommonOptions {
Option<JobMode> JOB_MODE =
Options.key("job.mode")
.enumType(JobMode.class)
.noDefaultValue()
.defaultValue(JobMode.BATCH)
.withDescription("The job mode of this job, support Batch and Stream");

Option<Long> CHECKPOINT_INTERVAL =
Expand Down
2 changes: 0 additions & 2 deletions seatunnel-connectors-v2/README.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -16,8 +16,6 @@ development at the current stage, and reduces the difficulty of merging.
- ../`seatunnel-translation` translation layer for the connector-v2
- ../`seatunnel-transform-v2` transform v2 connector implementation
- ../seatunnel-e2e/`seatunnel-connector-v2-e2e` connector v2 e2e code
- ../seatunnel-e2e/`seatunnel-flink-connector-v2-e2e` Obsolete, replaced by seatunnel-connector-v2-e2e
- ../seatunnel-e2e/`seatunnel-spark-connector-v2-e2e` Obsolete, replaced by seatunnel-connector-v2-e2e
- ../seatunnel-examples/`seatunnel-flink-connector-v2-example` seatunnel connector-v2 example use flink local running instance
- ../seatunnel-examples/`seatunnel-spark-connector-v2-example` seatunnel connector-v2 example use spark local running instance

Expand Down
4 changes: 2 additions & 2 deletions seatunnel-connectors-v2/README.zh.md
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -11,8 +11,8 @@ SeaTunnel为与计算引擎进行解耦，设计了新的连接器API，通过

- ../`seatunnel-connectors-v2` connector-v2代码实现
- ../`seatunnel-translation` connector-v2的翻译层
- ../seatunnel-e2e/`seatunnel-flink-connector-v2-e2e` flink上运行的端到端testcase
- ../seatunnel-e2e/`seatunnel-spark-connector-v2-e2e` spark上运行的端到端testcase
- ../`seatunnel-transform-v2` transform-v2代码实现
- ../seatunnel-e2e/`seatunnel-connector-v2-e2e` connector-v2端到端测试
- ../seatunnel-examples/`seatunnel-flink-connector-v2-example` seatunnel connector-v2的flink local运行的实例
- ../seatunnel-examples/`seatunnel-spark-connector-v2-example` seatunnel connector-v2的spark local运行的实例

Expand Down
1 change: 1 addition & 0 deletions ...nector-v2-e2e/connector-assert-e2e/src/test/resources/assertion/fakesource_to_assert.conf
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,7 @@
env {
# You can set flink configuration here
execution.parallelism = 1
job.mode = BATCH
#execution.checkpoint.interval = 10000
#execution.checkpoint.data-uri = "hdfs://localhost:9000/checkpoint"
}
Expand Down
2 changes: 1 addition & 1 deletion ...va/org/apache/seatunnel/connectors/seatunnel/clickhouse/ClickhouseSinkCDCChangelogIT.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -52,7 +52,7 @@

@DisabledOnContainer(
value = {},
type = {EngineType.SPARK, EngineType.SEATUNNEL},
type = {EngineType.SPARK},
disabledReason = "Spark engine will lose the row kind of record")
@Slf4j
public class ClickhouseSinkCDCChangelogIT extends TestSuiteBase implements TestResource {
Expand Down
5 changes: 2 additions & 3 deletions ...le-local-e2e/src/test/java/org/apache/seatunnel/e2e/connector/file/local/LocalFileIT.java
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -19,7 +19,6 @@

import org.apache.seatunnel.e2e.common.TestSuiteBase;
import org.apache.seatunnel.e2e.common.container.ContainerExtendedFactory;
import org.apache.seatunnel.e2e.common.container.EngineType;
import org.apache.seatunnel.e2e.common.container.TestContainer;
import org.apache.seatunnel.e2e.common.container.TestContainerId;
import org.apache.seatunnel.e2e.common.junit.DisabledOnContainer;
Expand All @@ -36,7 +35,7 @@

@DisabledOnContainer(
value = {TestContainerId.SPARK_2_4},
type = {EngineType.SEATUNNEL},
type = {},
disabledReason = "The apache-compress version is not compatible with apache-poi")
public class LocalFileIT extends TestSuiteBase {

Expand Down Expand Up @@ -70,7 +69,7 @@ public class LocalFileIT extends TestSuiteBase {
public void testLocalFileReadAndWrite(TestContainer container)
throws IOException, InterruptedException {
Container.ExecResult excelWriteResult =
container.executeJob("/excel/fakesource_to_local_excel.conf");
container.executeJob("/excel/fake_to_local_excel.conf");
Assertions.assertEquals(0, excelWriteResult.getExitCode(), excelWriteResult.getStderr());
Container.ExecResult excelReadResult =
container.executeJob("/excel/local_excel_to_assert.conf");
Expand Down
0 ...rces/excel/fakesource_to_local_excel.conf → .../resources/excel/fake_to_local_excel.conf
View file
Open in desktop
File renamed without changes.
10 changes: 10 additions & 0 deletions ...e/connector-file-local-e2e/src/test/resources/excel/local_excel_projection_to_assert.conf
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -18,6 +18,16 @@
###### This config file is a demonstration of streaming processing in seatunnel config
######

env {
execution.parallelism = 1
spark.app.name = "SeaTunnel"
spark.executor.instances = 2
spark.executor.cores = 1
spark.executor.memory = "1g"
spark.master = local
job.mode = "BATCH"
}

source {
LocalFile {
path="/seatunnel/read/excel"
Expand Down
30 changes: 0 additions & 30 deletions ...tor-http-e2e/src/test/java/org/apache/seatunnel/e2e/connector/http/HttpContentJsonIT.java
View file
Open in desktop

This file was deleted.

31 changes: 0 additions & 31 deletions ...onnector-http-e2e/src/test/java/org/apache/seatunnel/e2e/connector/http/HttpGithubIT.java
View file
Open in desktop

This file was deleted.

Loading