Code

feat: new table stream graph#12240

Code

Merged

shanicky merged 25 commits intomainrisingwavelabs/risingwave:mainfrom peng/new-table-dagrisingwavelabs/risingwave:peng/new-table-dagCopy head branch name to clipboardNov 15, 2023

+473-287

Commits

Commits on Nov 14, 2023

• Added modules and commented code blocks in create_table.rs. Imported modules and modified functions in mod.rs.

  Show description for 59faa8f
  shanicky

  committed
  59faa8f

• Delete "recursive.rs" & modify PlanRoot struct logic for stream_plan variable implementation. Replace filter_map with filter and map operations.

  shanicky

  committed
  7b2266e

• Remove println! statement, introduce is_external_source variable.

  shanicky

  committed
  daccb1c

• Refactor assigning source ID

  shanicky

  committed
  7906775

• Modify distribution key in StreamTableScan and BatchScan operations for "order_line" and "stock" tables

  shanicky

  committed
  945bb99

• Code changes: import type, add function, refactor code, add enum variant, add documentation comments.

  shanicky

  committed
  d60511c

• Code cleanup: Removal of unnecessary println! statements

  shanicky

  committed
  02e8e33

• Update no_shuffle.rs: new import, predicate added, test case updated.

  shanicky

  committed
  a9b6c41

• Import Serial type, add fallback_row_id, and modify map function for None serial value.

  shanicky

  committed
  6f6c007

• Remove Union import, add GenericPlanNode import.

  shanicky

  committed
  1c50108

• Modified table scan and exchange distribution in query plan. Updated distribution keys.

  shanicky

  committed
  9343c67

• Modified file vnode.rs: updated use statement, changed behavior of iter method, added hash calculation.

  shanicky

  committed
  34be31c

• Add compute_row() method to VirtualNode implementation

  shanicky

  committed
  3cb69c2

• update dapt

  Show description for d469547
  shanicky

  committed
  d469547

• add assert back

  Show description for a5aa40b
  shanicky

  committed
  a5aa40b

• Update optimizer/mod.rs & optimizer/plan_node/stream_union.rs. Create stream_plan var & handle union_inputs. Add new constructor to StreamUnion.

  shanicky

  committed
  c6b0ba1

• Modify unique method & simplify logic for creating new StreamRowIdGen instances. Remove redundant methods & fields.

  shanicky

  committed
  ab9dc01

• rollback

  Show description for 8479f43
  shanicky

  committed
  8479f43

• Added VirtualNode::compute_row, removed logic for empty project.

  shanicky

  committed
  379e20a

• Update "create materialized view" clause & add comment about hash differentiation in "distinct_on.slt"

  shanicky

  committed
  f905f87

• Added StreamExchange operator with HashShard distribution strategy to optimize data exchange between fragments.

  shanicky

  committed
  e12d2fa

• Add StreamUnion & StreamExchange operators for shuffling, modify StreamSource, StreamDml, StreamCdcTableScan & StreamWatermarkFilter

  shanicky

  committed
  0b87816

• Remove commented out portion, refactor code to clone and use input's distribution in new_with_dist function.

  shanicky

  committed
  9eb0db1

• Skip empty sources, fill ID with connector, generate random server ID for MySQL CDC sources

  shanicky

  committed
  2e447d8

Commits on Nov 15, 2023

• try update e2e

  Show description for 9a89780
  shanicky

  committed
  9a89780