Skip to content

[Bug] [Zeta] The checkpoint manager did not delete the historical checkpoint file #5046

@wu-a-ge

Description

@wu-a-ge

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

After running a CDC task, I set the maximum number of checkpoint retention to be 3, but during the operation, I found that the checkpoint file kept increasing but did not decrease

SeaTunnel Version

2.3.2

SeaTunnel Config

seatunnel:
  engine:
    checkpoint:
      interval: 6000
      timeout: 7000
      max-concurrent: 1
      tolerable-failure: 2
      storage:
        type: hdfs
        max-retained: 3
        plugin-config:
          storage.type: hdfs
          fs.defaultFS: file:///

Running Command

seatunnel.sh -c config/mysql_cdc_to_mysql.conf

Error Exception

no error

Flink or Spark Version

No response

Java or Scala Version

1.8

Screenshots

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions