dm table-routing need support regular expressions

[glkappe]

demand:

db list: test
table list:
t_1
t_2
t_11
t_12

now,table routing need write:

routes:
  r1:
    s-p: 'test'
    t-p: 't_[0-9]'
    t-s: 'test'
    t-t: 't'
  r2:
    s-p: 'test'
    t-p: 't_[0-9][0-9]'
    t-s: 'test'
    t-t: 't'
  r3:
    t-s: 'test'
    s-p: 'test'

i wish:

routes:
  r1:
    s-p: 'test'
    t-p: '~t_*'
    t-s: 'test'
    t-t: 't'

include version:
v2.x
v1.x
v5.3.0

[D3Hunter]

you can use wildcard matching to get the same effects, check this:

routes:                           # The routing mapping rule set between the data source tables and downstream TiDB tables. You can set multiple rules at the same time.
  route-rule-1:                   # The name of the routing mapping rule.
    schema-pattern: "test"      # The pattern of the upstream schema name. Wildcard characters (*?) are supported.
    table-pattern: "t_*"          # The pattern of the upstream table name. Wildcard characters (*?) are supported.
    target-schema: "test"         # The name of the downstream TiDB schema.
    target-table: "t"             # The name of the downstream TiDB table.

[buchuitoudegou]

Technical Design of the New Router

The new router reuses the filter module in the tidb-tools project, which is able to recognize regular expressions and matches them against input strings. The filter has also been part of the block-allow-list and thus, reusing the filter module ensures consistency amongst all the components.