Skip to main content

3.2.1.0

CloudCanal-3.2.1.0​

Release Date: September 14th, 2023, Version Number: 3.2.1.0.

New Connection​

  • Add MySQL to Dameng structure migration, full data, incremental, data verification and correction, DDL synchronization (add/drop columns).
  • Add MySQL to Redshift structure migration, full data, incremental, data verification, and DDL synchronization (add/drop/modify/rename columns, drop/truncate/rename tables).
  • Add Hana to StarRocks/Doris/SelectDB/MySQL/MariaDB structure migration, full data, incremental, data verification and correction.
  • Add TiDB to StarRocks structure migration, full data, incremental, data verification, and DDL synchronization (add/drop columns).
  • Add Aurora MySQL to ElasticSearch structure migration, full data, incremental, data verification and correction, DDL synchronization (add columns).

New Features​

  • Support K8s deployment of CloudCanal (CentOS/Ubuntu/macOS).
  • Support DDL synchronization (column addition/deletion/modification/rename, table rename) during Oracle to PostgreSQL incremental.
  • Support data correction for Aurora MySQL to StarRocks migration.
  • Support automatic bucketing when bucketing is empty in StarRocks (StarRocks version needs to be greater than 2.5.7)
  • Support using the 'auto' keyword for bucketing input in Doris/SelectDB, creating tables with automatic bucketing (Doris/SelectDB version needs to be greater than 1.2.2)
  • Support ROW writing mode for Dameng/PostgreSQL/SQL Server as the target database.
  • Support automatic rescheduling to other machines when there is insufficient memory on the current machine during task specification modification.
  • Support new interfaces in the open API SDK to help users integrate CloudCanal into their own systems quickly.

Optimization​

  • Optimized TiDB source position strategy.
  • Optimized resource monitoring for Console and Sidecar (number of CPUs, memory usage).
  • Optimized data verification logging logic, where data is printed in JSON format when diff fails.
  • Optimized writing strategy for PostgreSQL/SQL Server, added the target writing parameter "dstSameEventReduce" with a default value of false. Setting it to true enables merging similar events to optimize batch writing performance.
  • Optimized the writeStrategy parameter when set to MULTI_SQL. The spelling format changed from "insert into ...values(...),(...)" to multiple independent insert statements.

Problem Fixing​

  • Fixed the issue where the search function was not working in the table mapping dialog for PostgreSQL as the source database.
  • Fixed the issue where the backtrack position and clear position functions were not available for PostgreSQL as the source database.
  • Fixed the issue where modifying a subscription without updating tables or columns was still allowed.
  • Fixed the issue where adding an empty MySQL/PostgreSQL database as the source in modifying a subscription caused an error on the page and the inability to close the component for adding a database.
  • Fixed the issue where trailing spaces and line breaks in CHARACTER, GRAPHIC, VARCHAR, and VARGRAPHIC data types in Db2 as the source caused inconsistent data synchronization.
  • Fixed the issue where SQL Server ColReader did not require trimming when reading CHAR/NCHAR data types.
  • Fixed the issue where SQL Server as the target database did not add quotation marks around column names in Update/Where fields for writing.
  • Fixed the issue where writing large amounts of data (over 100MB) to StarRocks failed.
  • Fixed the issue where MySQL to Doris structure migration failed due to unescaped single quotes in default values.
  • Fixed the issue where the first step of creating a task for MySQL to RabbitMQ resulted in a NullPointerException during the test connection to the target.
  • Fixed the issue where enabling sqlCaseConversionEnable in bidirectional synchronization between MySQL instances caused the /ccw/ anti-loop identifier to be lost.
  • Fixed the issue where full database synchronization from MySQL to MySQL failed.
  • Fixed the issue where certain versions of MySQL without the useSSL=false setting caused exceptions.
  • Fixed the issue where monitoring metrics were missing in MULTI_SQL mode for PostgreSQL, SQL Server, and Dameng as the target database.
  • Fixed the issue where monitoring metrics records were inaccurate for PostgreSQL, Dameng, and SQL Server as the target database.
  • Fixed the issue where in COPY mode with PostgreSQL as the target database, writing NULL from the source resulted in an empty string in the target.
  • Fixed the issue where a mismatch between the database time zone and the serverTimeZone in the connection string caused task exceptions.