Skip to main content

Data Synchronization Masking

Overview​

This article introduces how to use CloudCanal to mask specified data during data migration and synchronization.

Key Points​

Custom Code​

CloudCanal allows users to upload business code to DataJob, in order to transform data during data migration and synchronization.

Data masking is also based on Custom Code and has the following characteristics:

  • The masking scope is flexible and any one or more table fields can be selected.
  • The masking algorithm can rely on external algorithm packages.
  • The masking logic and policy are customizable.

Example​

Mask Code Development​

Install CloudCanal​

Create DataJob​

  • DataJob > Create DataJob.
  • Select the source and target databases.click Next Step. custom_task_1
  • Select Incremental , check Full Data option.click Next Step. custom_task_2
  • Select tables.click Next Step. custom_task_3
  • Select fields, click Upload Custom Code in the upper-right corner and upload package. custom_task_4
  • Click Create DataJob. custom_task_5
  • DataJob running normally.

Validate Data​

  • Check source and target data,data has been masked as defined. custom_data_1custom_data_1
  • Do some DMLs, and check source and target data,data has been masked. custom_data_1custom_data_1

FAQ​

What Are The Remaining Problems？​

  • Only support Java language, not friendly enough for non-development people.
  • Verification and Correction DataJob are not support Custom Code.

Summary​

This article introduces how to use CloudCanal to mask specified data during data migration and synchronization.