Details
-
Improvement
-
Status: Closed
-
Major
-
Resolution: Implemented
-
cdc-3.2.0
Description
Current, PostgresDialect.discoverDataCollections will lookup tableSchemas for each table.
@Override public Map<TableId, TableChange> discoverDataCollectionSchemas(JdbcSourceConfig sourceConfig) { final List<TableId> capturedTableIds = discoverDataCollections(sourceConfig); try (JdbcConnection jdbc = openJdbcConnection(sourceConfig)) { // fetch table schemas Map<TableId, TableChange> tableSchemas = new HashMap<>(); for (TableId tableId : capturedTableIds) { TableChange tableSchema = queryTableSchema(jdbc, tableId); tableSchemas.put(tableId, tableSchema); } return tableSchemas; } catch (Exception e) { throw new FlinkRuntimeException( "Error to discover table schemas: " + e.getMessage(), e); } }
I have a job with table name which match hundreds of table will start for 1 hour.
Attachments
Issue Links
- links to