Skip to content

[Bug] [mysql cdc] MySQL process cannot be released #6542

@zhongbinde

Description

@zhongbinde

Search before asking

  • I had searched in the issues and found no similar issues.

What happened

作业创建后经过多次停作业,加表,恢复作业后业务库的连接进程越来越多,释放不了,停掉作业也不管用,重启seatunnel可释放。
image

SeaTunnel Version

seatunnel:2.3.4

SeaTunnel Config

env {
  execution.parallelism = 2
  job.mode = "STREAMING"
  checkpoint.interval = 3000
}
source {
    MySQL-CDC {
        parallelism = 1
        username = "xxx"
        password = "xxxx"
        base-url = "jdbc:mysql://xxxx"
        table-names = ["xfs_product_base.area","xfs_product_base.bi_test","xfs_product_base.check_standard_detail","xfs_product_base.check_standard_detail_audit","xfs_product_base.check_standard_sku_rel","xfs_product_base.check_standard_update_log","xfs_product_base.data_batch","xfs_product_base.product_accept_item_category_rel","xfs_product_base.product_add_state","xfs_product_base.product_alias","xfs_product_base.product_alias_name","xfs_product_base.product_area_salemin","xfs_product_base.product_brand","xfs_product_base.product_brand_audit","xfs_product_base.product_brand_series","xfs_product_base.product_category_brand_rel","xfs_product_base.product_category_platform","xfs_product_base.product_cate_temp_rel","xfs_product_base.product_classification","xfs_product_base.product_classification_cate_rel","xfs_product_base.product_collect","xfs_product_base.product_collect_potential_saleprice","xfs_product_base.product_collect_potential_supprice","xfs_product_base.product_collect_standard","xfs_product_base.product_dev_plan","xfs_product_base.product_enable_sku_record","xfs_product_base.product_enable_sku_record_detail","xfs_product_base.product_exclusive_main","xfs_product_base.product_exclusive_sku","xfs_product_base.product_keyword","xfs_product_base.product_label_sku_rel","xfs_product_base.product_main","xfs_product_base.product_main_description","xfs_product_base.product_main_image","xfs_product_base.product_main_multi_image","xfs_product_base.product_management_attrinfo_audit","xfs_product_base.product_manager_marketing_sku_rel","xfs_product_base.product_not_spec_attrinfo","xfs_product_base.product_org","xfs_product_base.product_potential","xfs_product_base.product_potential_change_log","xfs_product_base.product_potential_record","xfs_product_base.product_potential_record_detail","xfs_product_base.product_potential_standard","xfs_product_base.product_potential_standard_detail","xfs_product_base.product_prepare_commit_record","xfs_product_base.product_prepare_commit_record_main","xfs_product_base.product_qualification","xfs_product_base.product_qualificationtypesku_qua_rel","xfs_product_base.product_qualificationtype_sku_rel","xfs_product_base.product_qualification_attachment","xfs_product_base.product_restrict_show_plat","xfs_product_base.product_scene_category","xfs_product_base.product_scene_category_spu","xfs_product_base.product_sku","xfs_product_base.product_sku_audit","xfs_product_base.product_sku_image","xfs_product_base.product_sku_package_detail","xfs_product_base.product_sku_package_main","xfs_product_base.product_supply_price","xfs_product_base.product_supply_province_relate","xfs_product_base.product_supply_salearea_product","xfs_product_base.product_supply_salearea_sku","xfs_product_base.product_supply_salecity_product","xfs_product_base.product_supply_sku_rel","xfs_product_base.product_tax_category","xfs_product_base.product_template","xfs_product_base.product_template_attr","xfs_product_base.product_temporary_add_attrinfo","xfs_product_base.product_temporary_add_attrinfo_audit","xfs_product_base.product_twins_sku","xfs_product_base.product_unit","xfs_product_base.product_unit_sku_rel","xfs_product_base.product_update_commit_record","xfs_product_base.product_update_commit_record_limit_detail","xfs_product_base.product_updown_sku_record","xfs_product_base.product_updown_sku_record_detail","xfs_product_base.purchase_price_rule","xfs_product_base.raw_material_todo_list","xfs_product_base.temp_project_sku","xfs_product_base.temp_sku_spec"]
        result_table_name = "阿里云_xfs_product_base"
        startup.mode = "latest"
    }
}
sink {
    StarRocks {
        base-url = "jdbc:mysql://xxxx"
        username = "xxx"
        password = "xxx"
        database = "xfs_product_base"
        source_table_name = ["阿里云_xfs_product_base"]
        nodeUrls = ["xxxx"]
        enable_upsert_delete = true
    }
}

Running Command

/data/seatunnel-2.3.4/bin/seatunnel.sh --async --config /data/seatunnel-2.3.4/job/xxx.conf
/data/seatunnel-2.3.4/bin/seatunnel.sh -s 822317531900411905 
/data/seatunnel-2.3.4/bin/seatunnel.sh -r 822317531900411905 --async --config /data/seatunnel-2.3.4/job/xxx.conf
/data/seatunnel-2.3.4/bin/seatunnel.sh -s 822317531900411905 
/data/seatunnel-2.3.4/bin/seatunnel.sh -r 822317531900411905 --async --config /data/seatunnel-2.3.4/job/xxx.conf

Error Exception

no errors

Zeta or Flink or Spark Version

No response

Java or Scala Version

No response

Screenshots

No response

Are you willing to submit PR?

  • Yes I am willing to submit a PR!

Code of Conduct

Metadata

Metadata

Assignees

Type

No type

Projects

No projects

Milestone

No milestone

Relationships

None yet

Development

No branches or pull requests

Issue actions