Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat(batch): support query data without checkpoint #5850

Merged
merged 16 commits into from
Jan 3, 2023
Merged

Conversation

xxhZs
Copy link
Contributor

@xxhZs xxhZs commented Oct 14, 2022

I hereby agree to the terms of the Singularity Data, Inc. Contributor License Agreement.

What's changed and what's your intention?

PLEASE DO NOT LEAVE THIS EMPTY !!!
In this pr, We can query data with barrier(checkpoint = false)'s epoch.
VISIBILITY_MODE == all: all epochs are visible
VISIBILITY_MODE == checkpoint: only checkpoin epochs are visible

Checklist

  • I have written necessary rustdoc comments
  • I have added necessary unit tests and integration tests
  • All checks passed in ./risedev check (or alias, ./risedev c)

Documentation

If your pull request contains user-facing changes, please specify the types of the changes, and create a release note. Otherwise, please feel free to remove this section.

Types of user-facing changes

Please keep the types that apply to your changes, and remove those that do not apply.

  • Installation and deployment
  • Connector (sources & sinks)
  • SQL commands, functions, and operators
  • RisingWave cluster configuration changes
  • Other (please specify in the release note below)

Release note

Please create a release note for your changes. In the release note, focus on the impact on users, and mention the environment or conditions where the impact may occur.

Refer to a related PR or issue link (optional)

#6558

@BugenZhao
Copy link
Member

#5446 might be necessary after this PR. 👀

@xxhZs xxhZs force-pushed the xxh/barrier_query branch 2 times, most recently from 5d41e3c to bd12005 Compare October 17, 2022 06:21
@codecov
Copy link

codecov bot commented Oct 17, 2022

Codecov Report

Merging #5850 (e1a0aa2) into main (f229fd6) will increase coverage by 0.00%.
The diff coverage is 56.25%.

@@           Coverage Diff           @@
##             main    #5850   +/-   ##
=======================================
  Coverage   73.13%   73.14%           
=======================================
  Files        1052     1053    +1     
  Lines      167604   167652   +48     
=======================================
+ Hits       122584   122626   +42     
- Misses      45020    45026    +6     
Flag Coverage Δ
rust 73.14% <56.25%> (+<0.01%) ⬆️

Flags with carried forward coverage won't be shown. Click here to find out more.

Impacted Files Coverage Δ
src/batch/src/executor/row_seq_scan.rs 22.43% <ø> (ø)
src/common/src/session_config/mod.rs 26.41% <0.00%> (-1.26%) ⬇️
src/frontend/src/handler/flush.rs 0.00% <0.00%> (ø)
src/frontend/src/handler/query.rs 18.64% <0.00%> (+0.41%) ⬆️
src/frontend/src/scheduler/local.rs 0.00% <ø> (ø)
src/common/src/session_config/visibility_mode.rs 79.16% <79.16%> (ø)
...frontend/src/scheduler/hummock_snapshot_manager.rs 59.42% <85.71%> (+0.81%) ⬆️
src/frontend/src/scheduler/distributed/query.rs 75.24% <100.00%> (-0.07%) ⬇️
src/object_store/src/object/mem.rs 87.12% <0.00%> (-0.38%) ⬇️
src/meta/src/manager/cluster.rs 76.86% <0.00%> (-0.25%) ⬇️
... and 6 more

📣 We’re building smart automated test selection to slash your CI/CD build times. Learn more

@xxhZs xxhZs marked this pull request as ready for review October 17, 2022 07:20
@xxhZs xxhZs requested review from xxchan and hzxa21 October 17, 2022 07:20
src/batch/src/executor/row_seq_scan.rs Outdated Show resolved Hide resolved
src/common/src/session_config/mod.rs Outdated Show resolved Hide resolved
@zwang28
Copy link
Contributor

zwang28 commented Oct 21, 2022

With VISIBILITY_MODE == all, after scaling batch executors are scheduled based on the new data partition, but old uncommitted data may not be accessible to new CN, will this be a problem?

@hzxa21
Copy link
Collaborator

hzxa21 commented Oct 21, 2022

With VISIBILITY_MODE == all, after scaling batch executors are scheduled based on the new data partition, but old uncommitted data may not be accessible to new CN, will this be a problem?

Good question. I think scale always comes with a checkpoint first so the uncommitted data prior to scale will become committed after scale. But that requires the new CN to wait epoch for scale epoch to make sure the checkpointed version is in place before batch query comes in. cc @BugenZhao I think the scaling process already makes sure that?

However, I am thinking whether there will be a problem if there are two rounds of scaling and the second round assigns back the data partition to the original CN.

src/frontend/src/handler/query.rs Outdated Show resolved Hide resolved
proto/common.proto Outdated Show resolved Hide resolved
e2e_test/batch/all_visible_local.slt Outdated Show resolved Hide resolved
@BugenZhao
Copy link
Member

Good question. I think scale always comes with a checkpoint first so the uncommitted data prior to scale will become committed after scale. But that requires the new CN to wait epoch for scale epoch to make sure the checkpointed version is in place before batch query comes in. cc @BugenZhao I think the scaling process already makes sure that?

Yes. We'll ensure all versions are checkpointed and synced to the latest before scaling. But there might be some race cases due to asynchronous notification, as described in #5446. Some changes need to be made to the batch scheduler.

However, I am thinking whether there will be a problem if there are two rounds of scaling and the second round assigns back the data partition to the original CN.

🤔 Not quite get that. Do you mean that there might be some stale data in the shared buffer?

@xxhZs
Copy link
Contributor Author

xxhZs commented Oct 27, 2022

About batch bench: Concurrent run query and insert. Don't create mv, and only query the table.
The value of each column in this table is the time spent per query

one node with q12

VISIBILITY_MODE = all VISIBILITY_MODE = checkpoint
58ms 65us 941ns 50ms 950us 684ns
72ms 338us 354ns 62ms 637us 613ns
6s 119ms 911us 845ns 6s 191ms 831us 520ns
8s 235ms 929us 778ns 7s 994ms 642us 785ns

one node with q20

VISIBILITY_MODE = all VISIBILITY_MODE = checkpoint
56ms 439us 231ns 52ms 245us 688ns
165ms 7us 672ns 140ms 559us 962ns
169ms 882us 864ns 152ms 513us 607ns
4s 157ms 146us 347ns 4s 130ms 38us 444ns
4s 589ms 509us 819ns 4s 532ms 949us 997ns

one node with q1

VISIBILITY_MODE = all VISIBILITY_MODE = checkpoint
23ms 852us 266ns 32ms 613us 837ns
58ms 358us 154ns 59ms 27us 27ns
68ms 548us 863ns 64ms 69us 408ns
6s 504ms 284us 984ns 6s 276ms 2us 792ns

@xxhZs xxhZs requested a review from hzxa21 October 28, 2022 02:23
@xxhZs
Copy link
Contributor Author

xxhZs commented Nov 1, 2022

Batch Query2:

  1. create mv
  2. concurrent run point query from mv query and insert data.
    query:
    SELECT * FROM tpch_test_sysbench WHERE id = random_id
    mv
    create materialized view tpch_test_sysbench as select l_partkey as id, sum(l_quantity) as l1, sum(l_tax) as l2, sum(l_discount) as l3 from lineitem group by l_partkey

VISIBILITY_MODE = all:

queries performed:

    read:                            136322
    write:                           0
    other:                           136322
    total:                           272644

transactions: 136322 (1361.85 per sec.)
queries: 272644 (2723.70 per sec.)
ignored errors: 0 (0.00 per sec.)
reconnects: 0 (0.00 per sec.)

Throughput:

events/s (eps):                      1361.8480
time elapsed:                        100.1007s
total number of events:              136322

Latency (ms):

     min:                                   11.97
     avg:                                  110.09
     max:                                  513.11
     95th percentile:                      153.02
     sum:                             15007943.37

Threads fairness:

events (avg/stddev):           908.8133/2.99
execution time (avg/stddev):   100.0530/0.03 

VISIBILITY_MODE = checkpoint:

queries performed:

    read:                            135366
    write:                           0
    other:                           135366
    total:                           270732

transactions: 135366 (1352.28 per sec.)
queries: 270732 (2704.57 per sec.)
ignored errors: 0 (0.00 per sec.)
reconnects: 0 (0.00 per sec.)

Throughput:

events/s (eps):                      1352.2836
time elapsed:                        100.1018s
total number of events:              135366

Latency (ms):

     min:                                    8.05
     avg:                                  110.85
     max:                                  780.38
     95th percentile:                      150.29
     sum:                             15005802.66

Threads fairness:

events (avg/stddev):           902.4400/2.86
execution time (avg/stddev):   100.0387/0.03

@fuyufjh
Copy link
Member

fuyufjh commented Nov 11, 2022

This PR has been suspended for a while. May I know the reason?

@xxhZs
Copy link
Contributor Author

xxhZs commented Nov 11, 2022

This PR has been suspended for a while. May I know the reason?

It need to wait #5446

@zwang28 zwang28 self-requested a review December 28, 2022 03:53
# Conflicts:
#	proto/common.proto
#	src/batch/src/executor/mod.rs
#	src/batch/src/executor/row_seq_scan.rs
#	src/batch/src/rpc/service/task_service.rs
#	src/batch/src/task/task_manager.rs
#	src/common/src/session_config/mod.rs
#	src/compute/tests/integration_tests.rs
#	src/frontend/src/handler/flush.rs
#	src/frontend/src/scheduler/distributed/query.rs
#	src/frontend/src/scheduler/hummock_snapshot_manager.rs
#	src/frontend/src/scheduler/local.rs
#	src/rpc_client/src/compute_client.rs
#	src/storage/hummock_sdk/src/lib.rs
@zwang28 zwang28 removed their request for review December 29, 2022 05:46
HummockSnapshotGuard,
// `only_checkpoint_visible`.
// It's embedded here because we always use it together with snapshot.
bool,
Copy link
Contributor

@zwang28 zwang28 Dec 29, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Refactor to embed only_checkpoint_visible here, instead of previously

  • case 1 for local execution: passing another boolean variable around. It complicates interfaces.
  • case 2 for distributed execution: reading from session config each time. It is unsafe because config can be changed between multiple reads within a same query.

@xxhZs

@@ -48,6 +48,10 @@ pub async fn run_slt_task(cluster: Arc<Cluster>, glob: &str, opts: &KillOpts) {
// Simply ignore the tpch test cases when enable kill nodes.
continue;
}
if kill && path.ends_with("visibility_all.slt") {
Copy link
Contributor

@zwang28 zwang28 Dec 29, 2022

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

These test cases are skipped in recovery test because there is no guarantee for data persistency in them when flush(checkpoint=false).

@zwang28
Copy link
Contributor

zwang28 commented Dec 30, 2022

This PR is ready for review.
@xxhZs @BugenZhao @hzxa21

Copy link
Collaborator

@hzxa21 hzxa21 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@zwang28 zwang28 added mergify/can-merge user-facing-changes Contains changes that are visible to users labels Jan 3, 2023
Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

license-eye has totally checked 2592 files.

Valid Invalid Ignored Fixed
0 1244 1348 0
Click to see the invalid file list
  • dashboard/components/StatusLamp.js
  • dashboard/hook/useWindowSize.js
  • dashboard/lib/algo.ts
  • dashboard/lib/color.js
  • dashboard/lib/extractInfo.ts
  • dashboard/lib/graaphEngine/canvasEngine.js
  • dashboard/lib/graaphEngine/svgEngine.js
  • dashboard/lib/layout.ts
  • dashboard/lib/str.js
  • dashboard/lib/streamPlan/parser.js
  • dashboard/lib/streamPlan/streamChartHelper.js
  • dashboard/lib/util.js
  • dashboard/mock-server.js
  • dashboard/next.config.js
  • dashboard/pages/api/api.ts
  • dashboard/pages/api/cluster.ts
  • dashboard/pages/api/streaming.ts
  • dashboard/test/algo.test.js
  • src/batch/benches/expand.rs
  • src/batch/benches/filter.rs
  • src/batch/benches/hash_agg.rs
  • src/batch/benches/hash_join.rs
  • src/batch/benches/limit.rs
  • src/batch/benches/nested_loop_join.rs
  • src/batch/benches/sort.rs
  • src/batch/benches/sort_merge_join.rs
  • src/batch/benches/top_n.rs
  • src/batch/benches/utils/mod.rs
  • src/batch/src/error.rs
  • src/batch/src/exchange_source.rs
  • src/batch/src/execution/grpc_exchange.rs
  • src/batch/src/execution/local_exchange.rs
  • src/batch/src/execution/mod.rs
  • src/batch/src/executor/delete.rs
  • src/batch/src/executor/expand.rs
  • src/batch/src/executor/filter.rs
  • src/batch/src/executor/generic_exchange.rs
  • src/batch/src/executor/group_top_n.rs
  • src/batch/src/executor/hash_agg.rs
  • src/batch/src/executor/hop_window.rs
  • src/batch/src/executor/insert.rs
  • src/batch/src/executor/join/chunked_data.rs
  • src/batch/src/executor/join/distributed_lookup_join.rs
  • src/batch/src/executor/join/hash_join.rs
  • src/batch/src/executor/join/local_lookup_join.rs
  • src/batch/src/executor/join/lookup_join_base.rs
  • src/batch/src/executor/join/mod.rs
  • src/batch/src/executor/join/nested_loop_join.rs
  • src/batch/src/executor/join/sort_merge_join.rs
  • src/batch/src/executor/limit.rs
  • src/batch/src/executor/merge_sort_exchange.rs
  • src/batch/src/executor/mod.rs
  • src/batch/src/executor/monitor/mod.rs
  • src/batch/src/executor/monitor/stats.rs
  • src/batch/src/executor/order_by.rs
  • src/batch/src/executor/project.rs
  • src/batch/src/executor/project_set.rs
  • src/batch/src/executor/row_seq_scan.rs
  • src/batch/src/executor/sort_agg.rs
  • src/batch/src/executor/source.rs
  • src/batch/src/executor/sys_row_seq_scan.rs
  • src/batch/src/executor/table_function.rs
  • src/batch/src/executor/test_utils.rs
  • src/batch/src/executor/top_n.rs
  • src/batch/src/executor/trace.rs
  • src/batch/src/executor/union.rs
  • src/batch/src/executor/update.rs
  • src/batch/src/executor/utils.rs
  • src/batch/src/executor/values.rs
  • src/batch/src/lib.rs
  • src/batch/src/rpc/mod.rs
  • src/batch/src/rpc/service/exchange.rs
  • src/batch/src/rpc/service/mod.rs
  • src/batch/src/rpc/service/task_service.rs
  • src/batch/src/task/broadcast_channel.rs
  • src/batch/src/task/channel.rs
  • src/batch/src/task/consistent_hash_shuffle_channel.rs
  • src/batch/src/task/context.rs
  • src/batch/src/task/data_chunk_in_channel.rs
  • src/batch/src/task/env.rs
  • src/batch/src/task/fifo_channel.rs
  • src/batch/src/task/hash_shuffle_channel.rs
  • src/batch/src/task/mod.rs
  • src/batch/src/task/task_execution.rs
  • src/batch/src/task/task_manager.rs
  • src/bench/file_cache_bench/analyze.rs
  • src/bench/file_cache_bench/bench.rs
  • src/bench/file_cache_bench/bpf.rs
  • src/bench/file_cache_bench/main.rs
  • src/bench/file_cache_bench/rate.rs
  • src/bench/file_cache_bench/utils.rs
  • src/bench/s3_bench/main.rs
  • src/cmd/src/bin/compactor.rs
  • src/cmd/src/bin/compute_node.rs
  • src/cmd/src/bin/ctl.rs
  • src/cmd/src/bin/frontend_node.rs
  • src/cmd/src/bin/meta_node.rs
  • src/cmd_all/src/bin/risingwave.rs
  • src/cmd_all/src/lib.rs
  • src/cmd_all/src/playground.rs
  • src/common/benches/bench_encoding.rs
  • src/common/benches/bitmap.rs
  • src/common/common_service/src/lib.rs
  • src/common/common_service/src/metrics_manager.rs
  • src/common/common_service/src/observer_manager.rs
  • src/common/src/array/bool_array.rs
  • src/common/src/array/bytes_array.rs
  • src/common/src/array/chrono_array.rs
  • src/common/src/array/column.rs
  • src/common/src/array/column_proto_readers.rs
  • src/common/src/array/data_chunk.rs
  • src/common/src/array/data_chunk_iter.rs
  • src/common/src/array/decimal_array.rs
  • src/common/src/array/error.rs
  • src/common/src/array/interval_array.rs
  • src/common/src/array/iterator.rs
  • src/common/src/array/list_array.rs
  • src/common/src/array/macros.rs
  • src/common/src/array/mod.rs
  • src/common/src/array/primitive_array.rs
  • src/common/src/array/stream_chunk.rs
  • src/common/src/array/stream_chunk_iter.rs
  • src/common/src/array/struct_array.rs
  • src/common/src/array/utf8_array.rs
  • src/common/src/array/value_reader.rs
  • src/common/src/array/vis.rs
  • src/common/src/buffer/bitmap.rs
  • src/common/src/buffer/mod.rs
  • src/common/src/cache.rs
  • src/common/src/catalog/column.rs
  • src/common/src/catalog/internal_table.rs
  • src/common/src/catalog/mod.rs
  • src/common/src/catalog/physical_table.rs
  • src/common/src/catalog/schema.rs
  • src/common/src/catalog/test_utils.rs
  • src/common/src/collection/estimate_size.rs
  • src/common/src/collection/mod.rs
  • src/common/src/config.rs
  • src/common/src/constants.rs
  • src/common/src/error.rs
  • src/common/src/field_generator/mod.rs
  • src/common/src/field_generator/numeric.rs
  • src/common/src/field_generator/timestamp.rs
  • src/common/src/field_generator/varchar.rs
  • src/common/src/hash/dispatcher.rs
  • src/common/src/hash/key.rs
  • src/common/src/hash/mod.rs
  • src/common/src/hash/vnode.rs
  • src/common/src/lib.rs
  • src/common/src/monitor/mod.rs
  • src/common/src/monitor/my_stats.rs
  • src/common/src/monitor/process_linux.rs
  • src/common/src/monitor/rwlock.rs
  • src/common/src/row/chain.rs
  • src/common/src/row/compacted_row.rs
  • src/common/src/row/empty.rs
  • src/common/src/row/mod.rs
  • src/common/src/row/once.rs
  • src/common/src/row/owned_row.rs
  • src/common/src/row/project.rs
  • src/common/src/row/repeat_n.rs
  • src/common/src/session_config/mod.rs
  • src/common/src/session_config/query_mode.rs
  • src/common/src/session_config/search_path.rs
  • src/common/src/session_config/transaction_isolation_level.rs
  • src/common/src/session_config/visibility_mode.rs
  • src/common/src/test_utils/mod.rs
  • src/common/src/test_utils/rand_array.rs
  • src/common/src/test_utils/test_stream_chunk.rs
  • src/common/src/types/chrono_wrapper.rs
  • src/common/src/types/decimal.rs
  • src/common/src/types/interval.rs
  • src/common/src/types/mod.rs
  • src/common/src/types/native_type.rs
  • src/common/src/types/ops.rs
  • src/common/src/types/ordered_float.rs
  • src/common/src/types/postgres_type.rs
  • src/common/src/types/scalar_impl.rs
  • src/common/src/types/struct_type.rs
  • src/common/src/types/to_binary.rs
  • src/common/src/types/to_text.rs
  • src/common/src/util/addr.rs
  • src/common/src/util/chunk_coalesce.rs
  • src/common/src/util/compress.rs
  • src/common/src/util/encoding_for_comparison.rs
  • src/common/src/util/env_var.rs
  • src/common/src/util/epoch.rs
  • src/common/src/util/future_utils.rs
  • src/common/src/util/hash_util.rs
  • src/common/src/util/match_util.rs
  • src/common/src/util/mod.rs
  • src/common/src/util/ordered/mod.rs
  • src/common/src/util/ordered/serde.rs
  • src/common/src/util/prost.rs
  • src/common/src/util/resource_util.rs
  • src/common/src/util/scan_range.rs
  • src/common/src/util/schema_check.rs
  • src/common/src/util/sort_util.rs
  • src/common/src/util/value_encoding/error.rs
  • src/common/src/util/value_encoding/mod.rs
  • src/common/src/util/worker_util.rs
  • src/compute/src/lib.rs
  • src/compute/src/memory_management/memory_manager.rs
  • src/compute/src/memory_management/mod.rs
  • src/compute/src/rpc/mod.rs
  • src/compute/src/rpc/service/config_service.rs
  • src/compute/src/rpc/service/exchange_metrics.rs
  • src/compute/src/rpc/service/exchange_service.rs
  • src/compute/src/rpc/service/health_service.rs
  • src/compute/src/rpc/service/mod.rs
  • src/compute/src/rpc/service/monitor_service.rs
  • src/compute/src/rpc/service/stream_service.rs
  • src/compute/src/server.rs
  • src/compute/tests/integration_tests.rs
  • src/connector/src/aws_utils.rs
  • src/connector/src/error.rs
  • src/connector/src/lib.rs
  • src/connector/src/macros.rs
  • src/connector/src/sink/console.rs
  • src/connector/src/sink/kafka.rs
  • src/connector/src/sink/mod.rs
  • src/connector/src/sink/redis.rs
  • src/connector/src/sink/remote.rs
  • src/connector/src/source/base.rs
  • src/connector/src/source/cdc/enumerator/mod.rs
  • src/connector/src/source/cdc/mod.rs
  • src/connector/src/source/cdc/source/message.rs
  • src/connector/src/source/cdc/source/mod.rs
  • src/connector/src/source/cdc/source/reader.rs
  • src/connector/src/source/cdc/split.rs
  • src/connector/src/source/datagen/enumerator/mod.rs
  • src/connector/src/source/datagen/mod.rs
  • src/connector/src/source/datagen/source/generator.rs
  • src/connector/src/source/datagen/source/mod.rs
  • src/connector/src/source/datagen/source/reader.rs
  • src/connector/src/source/datagen/split.rs
  • src/connector/src/source/dummy_connector.rs
  • src/connector/src/source/filesystem/file_common.rs
  • src/connector/src/source/filesystem/mod.rs
  • src/connector/src/source/filesystem/s3/enumerator.rs
  • src/connector/src/source/filesystem/s3/mod.rs
  • src/connector/src/source/filesystem/s3/source/mod.rs
  • src/connector/src/source/filesystem/s3/source/reader.rs
  • src/connector/src/source/google_pubsub/enumerator/client.rs
  • src/connector/src/source/google_pubsub/enumerator/mod.rs
  • src/connector/src/source/google_pubsub/mod.rs
  • src/connector/src/source/google_pubsub/source/message.rs
  • src/connector/src/source/google_pubsub/source/mod.rs
  • src/connector/src/source/google_pubsub/source/reader.rs
  • src/connector/src/source/google_pubsub/split.rs
  • src/connector/src/source/kafka/enumerator/client.rs
  • src/connector/src/source/kafka/enumerator/mod.rs
  • src/connector/src/source/kafka/mod.rs
  • src/connector/src/source/kafka/source/message.rs
  • src/connector/src/source/kafka/source/mod.rs
  • src/connector/src/source/kafka/source/reader.rs
  • src/connector/src/source/kafka/split.rs
  • src/connector/src/source/kinesis/config.rs
  • src/connector/src/source/kinesis/enumerator/client.rs
  • src/connector/src/source/kinesis/enumerator/mod.rs
  • src/connector/src/source/kinesis/mod.rs
  • src/connector/src/source/kinesis/source/message.rs
  • src/connector/src/source/kinesis/source/mod.rs
  • src/connector/src/source/kinesis/source/reader.rs
  • src/connector/src/source/kinesis/split.rs
  • src/connector/src/source/mod.rs
  • src/connector/src/source/nexmark/enumerator/mod.rs
  • src/connector/src/source/nexmark/mod.rs
  • src/connector/src/source/nexmark/source/combined_event.rs
  • src/connector/src/source/nexmark/source/message.rs
  • src/connector/src/source/nexmark/source/mod.rs
  • src/connector/src/source/nexmark/source/reader.rs
  • src/connector/src/source/nexmark/split.rs
  • src/connector/src/source/pulsar/admin/client.rs
  • src/connector/src/source/pulsar/admin/mod.rs
  • src/connector/src/source/pulsar/enumerator/client.rs
  • src/connector/src/source/pulsar/enumerator/mod.rs
  • src/connector/src/source/pulsar/mod.rs
  • src/connector/src/source/pulsar/source/message.rs
  • src/connector/src/source/pulsar/source/mod.rs
  • src/connector/src/source/pulsar/source/reader.rs
  • src/connector/src/source/pulsar/split.rs
  • src/connector/src/source/pulsar/topic.rs
  • src/ctl/src/cmd_impl.rs
  • src/ctl/src/cmd_impl/bench.rs
  • src/ctl/src/cmd_impl/compute.rs
  • src/ctl/src/cmd_impl/hummock.rs
  • src/ctl/src/cmd_impl/hummock/compaction_group.rs
  • src/ctl/src/cmd_impl/hummock/disable_commit_epoch.rs
  • src/ctl/src/cmd_impl/hummock/list_kv.rs
  • src/ctl/src/cmd_impl/hummock/list_version.rs
  • src/ctl/src/cmd_impl/hummock/list_version_deltas.rs
  • src/ctl/src/cmd_impl/hummock/sst_dump.rs
  • src/ctl/src/cmd_impl/hummock/trigger_full_gc.rs
  • src/ctl/src/cmd_impl/hummock/trigger_manual_compaction.rs
  • src/ctl/src/cmd_impl/meta.rs
  • src/ctl/src/cmd_impl/meta/backup_meta.rs
  • src/ctl/src/cmd_impl/meta/cluster_info.rs
  • src/ctl/src/cmd_impl/meta/pause_resume.rs
  • src/ctl/src/cmd_impl/meta/reschedule.rs
  • src/ctl/src/cmd_impl/profile.rs
  • src/ctl/src/cmd_impl/table.rs
  • src/ctl/src/cmd_impl/table/list.rs
  • src/ctl/src/cmd_impl/table/scan.rs
  • src/ctl/src/cmd_impl/trace.rs
  • src/ctl/src/common.rs
  • src/ctl/src/common/hummock_service.rs
  • src/ctl/src/common/meta_service.rs
  • src/ctl/src/lib.rs
  • src/expr/benches/expr.rs
  • src/expr/src/error.rs
  • src/expr/src/expr/agg.rs
  • src/expr/src/expr/build_expr_from_prost.rs
  • src/expr/src/expr/data_types.rs
  • src/expr/src/expr/expr_array_concat.rs
  • src/expr/src/expr/expr_binary_bytes.rs
  • src/expr/src/expr/expr_binary_nonnull.rs
  • src/expr/src/expr/expr_binary_nullable.rs
  • src/expr/src/expr/expr_case.rs
  • src/expr/src/expr/expr_coalesce.rs
  • src/expr/src/expr/expr_concat_ws.rs
  • src/expr/src/expr/expr_field.rs
  • src/expr/src/expr/expr_in.rs
  • src/expr/src/expr/expr_input_ref.rs
  • src/expr/src/expr/expr_is_null.rs
  • src/expr/src/expr/expr_literal.rs
  • src/expr/src/expr/expr_nested_construct.rs
  • src/expr/src/expr/expr_quaternary_bytes.rs
  • src/expr/src/expr/expr_regexp.rs
  • src/expr/src/expr/expr_ternary_bytes.rs
  • src/expr/src/expr/expr_to_char_const_tmpl.rs
  • src/expr/src/expr/expr_to_timestamp_const_tmpl.rs
  • src/expr/src/expr/expr_unary.rs
  • src/expr/src/expr/expr_vnode.rs
  • src/expr/src/expr/mod.rs
  • src/expr/src/expr/template.rs
  • src/expr/src/expr/template_fast.rs
  • src/expr/src/expr/test_utils.rs
  • src/expr/src/lib.rs
  • src/expr/src/sig/agg.rs
  • src/expr/src/sig/cast.rs
  • src/expr/src/sig/func.rs
  • src/expr/src/sig/mod.rs
  • src/expr/src/table_function/generate_series.rs
  • src/expr/src/table_function/mod.rs
  • src/expr/src/table_function/regexp_matches.rs
  • src/expr/src/table_function/unnest.rs
  • src/expr/src/vector_op/agg/aggregator.rs
  • src/expr/src/vector_op/agg/approx_count_distinct.rs
  • src/expr/src/vector_op/agg/array_agg.rs
  • src/expr/src/vector_op/agg/count_star.rs
  • src/expr/src/vector_op/agg/filter.rs
  • src/expr/src/vector_op/agg/functions.rs
  • src/expr/src/vector_op/agg/general_agg.rs
  • src/expr/src/vector_op/agg/general_distinct_agg.rs
  • src/expr/src/vector_op/agg/general_sorted_grouper.rs
  • src/expr/src/vector_op/agg/mod.rs
  • src/expr/src/vector_op/agg/string_agg.rs
  • src/expr/src/vector_op/arithmetic_op.rs
  • src/expr/src/vector_op/array_access.rs
  • src/expr/src/vector_op/ascii.rs
  • src/expr/src/vector_op/bitwise_op.rs
  • src/expr/src/vector_op/cast.rs
  • src/expr/src/vector_op/cmp.rs
  • src/expr/src/vector_op/concat_op.rs
  • src/expr/src/vector_op/conjunction.rs
  • src/expr/src/vector_op/date_trunc.rs
  • src/expr/src/vector_op/extract.rs
  • src/expr/src/vector_op/length.rs
  • src/expr/src/vector_op/like.rs
  • src/expr/src/vector_op/lower.rs
  • src/expr/src/vector_op/ltrim.rs
  • src/expr/src/vector_op/md5.rs
  • src/expr/src/vector_op/mod.rs
  • src/expr/src/vector_op/overlay.rs
  • src/expr/src/vector_op/position.rs
  • src/expr/src/vector_op/repeat.rs
  • src/expr/src/vector_op/replace.rs
  • src/expr/src/vector_op/round.rs
  • src/expr/src/vector_op/rtrim.rs
  • src/expr/src/vector_op/split_part.rs
  • src/expr/src/vector_op/substr.rs
  • src/expr/src/vector_op/tests.rs
  • src/expr/src/vector_op/timestamptz.rs
  • src/expr/src/vector_op/to_char.rs
  • src/expr/src/vector_op/to_timestamp.rs
  • src/expr/src/vector_op/translate.rs
  • src/expr/src/vector_op/trim.rs
  • src/expr/src/vector_op/trim_characters.rs
  • src/expr/src/vector_op/tumble.rs
  • src/expr/src/vector_op/upper.rs
  • src/frontend/planner_test/src/bin/apply.rs
  • src/frontend/planner_test/src/lib.rs
  • src/frontend/planner_test/src/resolve_id.rs
  • src/frontend/planner_test/tests/planner_test_runner.rs
  • src/frontend/src/binder/bind_context.rs
  • src/frontend/src/binder/delete.rs
  • src/frontend/src/binder/expr/binary_op.rs
  • src/frontend/src/binder/expr/column.rs
  • src/frontend/src/binder/expr/function.rs
  • src/frontend/src/binder/expr/mod.rs
  • src/frontend/src/binder/expr/order_by.rs
  • src/frontend/src/binder/expr/subquery.rs
  • src/frontend/src/binder/expr/value.rs
  • src/frontend/src/binder/insert.rs
  • src/frontend/src/binder/mod.rs
  • src/frontend/src/binder/query.rs
  • src/frontend/src/binder/relation/join.rs
  • src/frontend/src/binder/relation/mod.rs
  • src/frontend/src/binder/relation/subquery.rs
  • src/frontend/src/binder/relation/table_or_source.rs
  • src/frontend/src/binder/relation/watermark.rs
  • src/frontend/src/binder/relation/window_table_function.rs
  • src/frontend/src/binder/select.rs
  • src/frontend/src/binder/set_expr.rs
  • src/frontend/src/binder/statement.rs
  • src/frontend/src/binder/struct_field.rs
  • src/frontend/src/binder/update.rs
  • src/frontend/src/binder/values.rs
  • src/frontend/src/catalog/catalog_service.rs
  • src/frontend/src/catalog/column_catalog.rs
  • src/frontend/src/catalog/database_catalog.rs
  • src/frontend/src/catalog/index_catalog.rs
  • src/frontend/src/catalog/mod.rs
  • src/frontend/src/catalog/root_catalog.rs
  • src/frontend/src/catalog/schema_catalog.rs
  • src/frontend/src/catalog/sink_catalog.rs
  • src/frontend/src/catalog/source_catalog.rs
  • src/frontend/src/catalog/system_catalog/information_schema/columns.rs
  • src/frontend/src/catalog/system_catalog/information_schema/mod.rs
  • src/frontend/src/catalog/system_catalog/information_schema/tables.rs
  • src/frontend/src/catalog/system_catalog/mod.rs
  • src/frontend/src/catalog/system_catalog/pg_catalog/mod.rs
  • src/frontend/src/catalog/system_catalog/pg_catalog/pg_am.rs
  • src/frontend/src/catalog/system_catalog/pg_catalog/pg_attrdef.rs
  • src/frontend/src/catalog/system_catalog/pg_catalog/pg_attribute.rs
  • src/frontend/src/catalog/system_catalog/pg_catalog/pg_cast.rs
  • src/frontend/src/catalog/system_catalog/pg_catalog/pg_class.rs
  • src/frontend/src/catalog/system_catalog/pg_catalog/pg_collation.rs
  • src/frontend/src/catalog/system_catalog/pg_catalog/pg_database.rs
  • src/frontend/src/catalog/system_catalog/pg_catalog/pg_description.rs
  • src/frontend/src/catalog/system_catalog/pg_catalog/pg_index.rs
  • src/frontend/src/catalog/system_catalog/pg_catalog/pg_keywords.rs
  • src/frontend/src/catalog/system_catalog/pg_catalog/pg_matviews.rs
  • src/frontend/src/catalog/system_catalog/pg_catalog/pg_namespace.rs
  • src/frontend/src/catalog/system_catalog/pg_catalog/pg_opclass.rs
  • src/frontend/src/catalog/system_catalog/pg_catalog/pg_operator.rs
  • src/frontend/src/catalog/system_catalog/pg_catalog/pg_roles.rs
  • src/frontend/src/catalog/system_catalog/pg_catalog/pg_settings.rs
  • src/frontend/src/catalog/system_catalog/pg_catalog/pg_shdescription.rs
  • src/frontend/src/catalog/system_catalog/pg_catalog/pg_tablespace.rs
  • src/frontend/src/catalog/system_catalog/pg_catalog/pg_type.rs
  • src/frontend/src/catalog/system_catalog/pg_catalog/pg_user.rs
  • src/frontend/src/catalog/system_catalog/pg_catalog/pg_views.rs
  • src/frontend/src/catalog/system_catalog/rw_catalog/mod.rs
  • src/frontend/src/catalog/system_catalog/rw_catalog/rw_meta_snapshot.rs
  • src/frontend/src/catalog/table_catalog.rs
  • src/frontend/src/catalog/view_catalog.rs
  • src/frontend/src/expr/agg_call.rs
  • src/frontend/src/expr/correlated_input_ref.rs
  • src/frontend/src/expr/expr_mutator.rs
  • src/frontend/src/expr/expr_rewriter.rs
  • src/frontend/src/expr/expr_visitor.rs
  • src/frontend/src/expr/function_call.rs
  • src/frontend/src/expr/input_ref.rs
  • src/frontend/src/expr/literal.rs
  • src/frontend/src/expr/mod.rs
  • src/frontend/src/expr/order_by_expr.rs
  • src/frontend/src/expr/subquery.rs
  • src/frontend/src/expr/table_function.rs
  • src/frontend/src/expr/type_inference/cast.rs
  • src/frontend/src/expr/type_inference/func.rs
  • src/frontend/src/expr/type_inference/mod.rs
  • src/frontend/src/expr/utils.rs
  • src/frontend/src/expr/window_function.rs
  • src/frontend/src/handler/alter_user.rs
  • src/frontend/src/handler/create_database.rs
  • src/frontend/src/handler/create_index.rs
  • src/frontend/src/handler/create_mv.rs
  • src/frontend/src/handler/create_schema.rs
  • src/frontend/src/handler/create_sink.rs
  • src/frontend/src/handler/create_source.rs
  • src/frontend/src/handler/create_table.rs
  • src/frontend/src/handler/create_table_as.rs
  • src/frontend/src/handler/create_user.rs
  • src/frontend/src/handler/create_view.rs
  • src/frontend/src/handler/describe.rs
  • src/frontend/src/handler/drop_database.rs
  • src/frontend/src/handler/drop_index.rs
  • src/frontend/src/handler/drop_mv.rs
  • src/frontend/src/handler/drop_schema.rs
  • src/frontend/src/handler/drop_sink.rs
  • src/frontend/src/handler/drop_source.rs
  • src/frontend/src/handler/drop_table.rs
  • src/frontend/src/handler/drop_user.rs
  • src/frontend/src/handler/drop_view.rs
  • src/frontend/src/handler/explain.rs
  • src/frontend/src/handler/flush.rs
  • src/frontend/src/handler/handle_privilege.rs
  • src/frontend/src/handler/mod.rs
  • src/frontend/src/handler/privilege.rs
  • src/frontend/src/handler/query.rs
  • src/frontend/src/handler/show.rs
  • src/frontend/src/handler/util.rs
  • src/frontend/src/handler/variable.rs
  • src/frontend/src/health_service.rs
  • src/frontend/src/lib.rs
  • src/frontend/src/meta_client.rs
  • src/frontend/src/monitor/mod.rs
  • src/frontend/src/monitor/stats.rs
  • src/frontend/src/observer/mod.rs
  • src/frontend/src/observer/observer_manager.rs
  • src/frontend/src/optimizer/delta_join_solver.rs
  • src/frontend/src/optimizer/heuristic.rs
  • src/frontend/src/optimizer/max_one_row_visitor.rs
  • src/frontend/src/optimizer/mod.rs
  • src/frontend/src/optimizer/optimizer_context.rs
  • src/frontend/src/optimizer/plan_correlated_id_finder.rs
  • src/frontend/src/optimizer/plan_node/batch_delete.rs
  • src/frontend/src/optimizer/plan_node/batch_exchange.rs
  • src/frontend/src/optimizer/plan_node/batch_expand.rs
  • src/frontend/src/optimizer/plan_node/batch_filter.rs
  • src/frontend/src/optimizer/plan_node/batch_group_topn.rs
  • src/frontend/src/optimizer/plan_node/batch_hash_agg.rs
  • src/frontend/src/optimizer/plan_node/batch_hash_join.rs
  • src/frontend/src/optimizer/plan_node/batch_hop_window.rs
  • src/frontend/src/optimizer/plan_node/batch_insert.rs
  • src/frontend/src/optimizer/plan_node/batch_limit.rs
  • src/frontend/src/optimizer/plan_node/batch_lookup_join.rs
  • src/frontend/src/optimizer/plan_node/batch_nested_loop_join.rs
  • src/frontend/src/optimizer/plan_node/batch_project.rs
  • src/frontend/src/optimizer/plan_node/batch_project_set.rs
  • src/frontend/src/optimizer/plan_node/batch_seq_scan.rs
  • src/frontend/src/optimizer/plan_node/batch_simple_agg.rs
  • src/frontend/src/optimizer/plan_node/batch_sort.rs
  • src/frontend/src/optimizer/plan_node/batch_sort_agg.rs
  • src/frontend/src/optimizer/plan_node/batch_source.rs
  • src/frontend/src/optimizer/plan_node/batch_table_function.rs
  • src/frontend/src/optimizer/plan_node/batch_topn.rs
  • src/frontend/src/optimizer/plan_node/batch_union.rs
  • src/frontend/src/optimizer/plan_node/batch_update.rs
  • src/frontend/src/optimizer/plan_node/batch_values.rs
  • src/frontend/src/optimizer/plan_node/col_pruning.rs
  • src/frontend/src/optimizer/plan_node/convert.rs
  • src/frontend/src/optimizer/plan_node/eq_join_predicate.rs
  • src/frontend/src/optimizer/plan_node/generic/agg.rs
  • src/frontend/src/optimizer/plan_node/generic/dynamic_filter.rs
  • src/frontend/src/optimizer/plan_node/generic/expand.rs
  • src/frontend/src/optimizer/plan_node/generic/filter.rs
  • src/frontend/src/optimizer/plan_node/generic/hop_window.rs
  • src/frontend/src/optimizer/plan_node/generic/join.rs
  • src/frontend/src/optimizer/plan_node/generic/mod.rs
  • src/frontend/src/optimizer/plan_node/generic/project.rs
  • src/frontend/src/optimizer/plan_node/generic/project_set.rs
  • src/frontend/src/optimizer/plan_node/generic/scan.rs
  • src/frontend/src/optimizer/plan_node/generic/share.rs
  • src/frontend/src/optimizer/plan_node/generic/source.rs
  • src/frontend/src/optimizer/plan_node/generic/top_n.rs
  • src/frontend/src/optimizer/plan_node/generic/union.rs
  • src/frontend/src/optimizer/plan_node/logical_agg.rs
  • src/frontend/src/optimizer/plan_node/logical_apply.rs
  • src/frontend/src/optimizer/plan_node/logical_delete.rs
  • src/frontend/src/optimizer/plan_node/logical_expand.rs
  • src/frontend/src/optimizer/plan_node/logical_filter.rs
  • src/frontend/src/optimizer/plan_node/logical_hop_window.rs
  • src/frontend/src/optimizer/plan_node/logical_insert.rs
  • src/frontend/src/optimizer/plan_node/logical_join.rs
  • src/frontend/src/optimizer/plan_node/logical_limit.rs
  • src/frontend/src/optimizer/plan_node/logical_multi_join.rs
  • src/frontend/src/optimizer/plan_node/logical_over_agg.rs
  • src/frontend/src/optimizer/plan_node/logical_project.rs
  • src/frontend/src/optimizer/plan_node/logical_project_set.rs
  • src/frontend/src/optimizer/plan_node/logical_scan.rs
  • src/frontend/src/optimizer/plan_node/logical_share.rs
  • src/frontend/src/optimizer/plan_node/logical_source.rs
  • src/frontend/src/optimizer/plan_node/logical_table_function.rs
  • src/frontend/src/optimizer/plan_node/logical_topn.rs
  • src/frontend/src/optimizer/plan_node/logical_union.rs
  • src/frontend/src/optimizer/plan_node/logical_update.rs
  • src/frontend/src/optimizer/plan_node/logical_values.rs
  • src/frontend/src/optimizer/plan_node/mod.rs
  • src/frontend/src/optimizer/plan_node/plan_base.rs
  • src/frontend/src/optimizer/plan_node/plan_tree_node.rs
  • src/frontend/src/optimizer/plan_node/plan_tree_node_v2.rs
  • src/frontend/src/optimizer/plan_node/predicate_pushdown.rs
  • src/frontend/src/optimizer/plan_node/stream.rs
  • src/frontend/src/optimizer/plan_node/stream_delta_join.rs
  • src/frontend/src/optimizer/plan_node/stream_derive.rs
  • src/frontend/src/optimizer/plan_node/stream_dml.rs
  • src/frontend/src/optimizer/plan_node/stream_dynamic_filter.rs
  • src/frontend/src/optimizer/plan_node/stream_exchange.rs
  • src/frontend/src/optimizer/plan_node/stream_expand.rs
  • src/frontend/src/optimizer/plan_node/stream_filter.rs
  • src/frontend/src/optimizer/plan_node/stream_global_simple_agg.rs
  • src/frontend/src/optimizer/plan_node/stream_group_topn.rs
  • src/frontend/src/optimizer/plan_node/stream_hash_agg.rs
  • src/frontend/src/optimizer/plan_node/stream_hash_join.rs
  • src/frontend/src/optimizer/plan_node/stream_hop_window.rs
  • src/frontend/src/optimizer/plan_node/stream_index_scan.rs
  • src/frontend/src/optimizer/plan_node/stream_local_simple_agg.rs
  • src/frontend/src/optimizer/plan_node/stream_materialize.rs
  • src/frontend/src/optimizer/plan_node/stream_now.rs
  • src/frontend/src/optimizer/plan_node/stream_project.rs
  • src/frontend/src/optimizer/plan_node/stream_project_set.rs
  • src/frontend/src/optimizer/plan_node/stream_row_id_gen.rs
  • src/frontend/src/optimizer/plan_node/stream_share.rs
  • src/frontend/src/optimizer/plan_node/stream_sink.rs
  • src/frontend/src/optimizer/plan_node/stream_source.rs
  • src/frontend/src/optimizer/plan_node/stream_table_scan.rs
  • src/frontend/src/optimizer/plan_node/stream_topn.rs
  • src/frontend/src/optimizer/plan_node/stream_union.rs
  • src/frontend/src/optimizer/plan_node/to_prost.rs
  • src/frontend/src/optimizer/plan_node/utils.rs
  • src/frontend/src/optimizer/plan_rewriter.rs
  • src/frontend/src/optimizer/plan_visitor.rs
  • src/frontend/src/optimizer/property/distribution.rs
  • src/frontend/src/optimizer/property/func_dep.rs
  • src/frontend/src/optimizer/property/mod.rs
  • src/frontend/src/optimizer/property/order.rs
  • src/frontend/src/optimizer/rule/agg_dedup_group_key_rule.rs
  • src/frontend/src/optimizer/rule/agg_project_merge_rule.rs
  • src/frontend/src/optimizer/rule/apply_agg_transpose_rule.rs
  • src/frontend/src/optimizer/rule/apply_filter_transpose_rule.rs
  • src/frontend/src/optimizer/rule/apply_join_transpose_rule.rs
  • src/frontend/src/optimizer/rule/apply_project_transpose_rule.rs
  • src/frontend/src/optimizer/rule/apply_scan_rule.rs
  • src/frontend/src/optimizer/rule/apply_share_eliminate_rule.rs
  • src/frontend/src/optimizer/rule/apply_to_join_rule.rs
  • src/frontend/src/optimizer/rule/dag_to_tree_rule.rs
  • src/frontend/src/optimizer/rule/distinct_agg_rule.rs
  • src/frontend/src/optimizer/rule/index_delta_join_rule.rs
  • src/frontend/src/optimizer/rule/index_selection_rule.rs
  • src/frontend/src/optimizer/rule/join_commute_rule.rs
  • src/frontend/src/optimizer/rule/max_one_row_eliminate_rule.rs
  • src/frontend/src/optimizer/rule/merge_multijoin_rule.rs
  • src/frontend/src/optimizer/rule/mod.rs
  • src/frontend/src/optimizer/rule/over_agg_to_topn_rule.rs
  • src/frontend/src/optimizer/rule/project_eliminate_rule.rs
  • src/frontend/src/optimizer/rule/project_join_merge_rule.rs
  • src/frontend/src/optimizer/rule/project_merge_rule.rs
  • src/frontend/src/optimizer/rule/pull_up_correlated_predicate_rule.rs
  • src/frontend/src/optimizer/rule/push_calculation_of_join_rule.rs
  • src/frontend/src/optimizer/rule/reorder_multijoin_rule.rs
  • src/frontend/src/optimizer/rule/translate_apply_rule.rs
  • src/frontend/src/optimizer/rule/union_merge_rule.rs
  • src/frontend/src/optimizer/rule/union_to_distinct_rule.rs
  • src/frontend/src/optimizer/share_parent_counter.rs
  • src/frontend/src/optimizer/share_source_rewriter.rs
  • src/frontend/src/planner/delete.rs
  • src/frontend/src/planner/insert.rs
  • src/frontend/src/planner/mod.rs
  • src/frontend/src/planner/query.rs
  • src/frontend/src/planner/relation.rs
  • src/frontend/src/planner/select.rs
  • src/frontend/src/planner/set_expr.rs
  • src/frontend/src/planner/set_operation.rs
  • src/frontend/src/planner/statement.rs
  • src/frontend/src/planner/update.rs
  • src/frontend/src/planner/values.rs
  • src/frontend/src/scheduler/distributed/mod.rs
  • src/frontend/src/scheduler/distributed/query.rs
  • src/frontend/src/scheduler/distributed/query_manager.rs
  • src/frontend/src/scheduler/distributed/stage.rs
  • src/frontend/src/scheduler/error.rs
  • src/frontend/src/scheduler/hummock_snapshot_manager.rs
  • src/frontend/src/scheduler/local.rs
  • src/frontend/src/scheduler/mod.rs
  • src/frontend/src/scheduler/plan_fragmenter.rs
  • src/frontend/src/scheduler/task_context.rs
  • src/frontend/src/scheduler/worker_node_manager.rs
  • src/frontend/src/session.rs
  • src/frontend/src/stream_fragmenter/graph/fragment_graph.rs
  • src/frontend/src/stream_fragmenter/graph/mod.rs
  • src/frontend/src/stream_fragmenter/mod.rs
  • src/frontend/src/stream_fragmenter/rewrite/delta_join.rs
  • src/frontend/src/stream_fragmenter/rewrite/mod.rs
  • src/frontend/src/test_utils.rs
  • src/frontend/src/user/mod.rs
  • src/frontend/src/user/user_authentication.rs
  • src/frontend/src/user/user_manager.rs
  • src/frontend/src/user/user_privilege.rs
  • src/frontend/src/user/user_service.rs
  • src/frontend/src/utils/column_index_mapping.rs
  • src/frontend/src/utils/condition.rs
  • src/frontend/src/utils/connected_components.rs
  • src/frontend/src/utils/mod.rs
  • src/frontend/src/utils/rewrite_index.rs
  • src/frontend/src/utils/stream_graph_formatter.rs
  • src/frontend/src/utils/with_options.rs
  • src/meta/src/backup_restore/backup_manager.rs
  • src/meta/src/backup_restore/error.rs
  • src/meta/src/backup_restore/meta_snapshot_builder.rs
  • src/meta/src/backup_restore/metrics.rs
  • src/meta/src/backup_restore/mod.rs
  • src/meta/src/backup_restore/restore.rs
  • src/meta/src/backup_restore/utils.rs
  • src/meta/src/barrier/command.rs
  • src/meta/src/barrier/info.rs
  • src/meta/src/barrier/mod.rs
  • src/meta/src/barrier/notifier.rs
  • src/meta/src/barrier/progress.rs
  • src/meta/src/barrier/recovery.rs
  • src/meta/src/barrier/schedule.rs
  • src/meta/src/barrier/snapshot.rs
  • src/meta/src/dashboard/mod.rs
  • src/meta/src/dashboard/prometheus.rs
  • src/meta/src/dashboard/proxy.rs
  • src/meta/src/error.rs
  • src/meta/src/hummock/compaction/base_level_compaction_picker.rs
  • src/meta/src/hummock/compaction/compaction_config.rs
  • src/meta/src/hummock/compaction/level_selector.rs
  • src/meta/src/hummock/compaction/manual_compaction_picker.rs
  • src/meta/src/hummock/compaction/min_overlap_compaction_picker.rs
  • src/meta/src/hummock/compaction/mod.rs
  • src/meta/src/hummock/compaction/overlap_strategy.rs
  • src/meta/src/hummock/compaction/prost_type.rs
  • src/meta/src/hummock/compaction/tier_compaction_picker.rs
  • src/meta/src/hummock/compaction_group/mod.rs
  • src/meta/src/hummock/compaction_schedule_policy.rs
  • src/meta/src/hummock/compaction_scheduler.rs
  • src/meta/src/hummock/compactor_manager.rs
  • src/meta/src/hummock/error.rs
  • src/meta/src/hummock/level_handler.rs
  • src/meta/src/hummock/manager/compaction.rs
  • src/meta/src/hummock/manager/compaction_group_manager.rs
  • src/meta/src/hummock/manager/context.rs
  • src/meta/src/hummock/manager/gc.rs
  • src/meta/src/hummock/manager/mod.rs
  • src/meta/src/hummock/manager/tests.rs
  • src/meta/src/hummock/manager/versioning.rs
  • src/meta/src/hummock/manager/worker.rs
  • src/meta/src/hummock/metrics_utils.rs
  • src/meta/src/hummock/mock_hummock_meta_client.rs
  • src/meta/src/hummock/mod.rs
  • src/meta/src/hummock/model/compact_task_assignment.rs
  • src/meta/src/hummock/model/mod.rs
  • src/meta/src/hummock/model/pinned_snapshot.rs
  • src/meta/src/hummock/model/pinned_version.rs
  • src/meta/src/hummock/model/version.rs
  • src/meta/src/hummock/model/version_delta.rs
  • src/meta/src/hummock/model/version_stats.rs
  • src/meta/src/hummock/test_utils.rs
  • src/meta/src/hummock/utils.rs
  • src/meta/src/hummock/vacuum.rs
  • src/meta/src/lib.rs
  • src/meta/src/manager/catalog/database.rs
  • src/meta/src/manager/catalog/fragment.rs
  • src/meta/src/manager/catalog/mod.rs
  • src/meta/src/manager/catalog/user.rs
  • src/meta/src/manager/cluster.rs
  • src/meta/src/manager/env.rs
  • src/meta/src/manager/id.rs
  • src/meta/src/manager/idle.rs
  • src/meta/src/manager/mod.rs
  • src/meta/src/manager/notification.rs
  • src/meta/src/manager/streaming_job.rs
  • src/meta/src/model/barrier.rs
  • src/meta/src/model/catalog.rs
  • src/meta/src/model/cluster.rs
  • src/meta/src/model/error.rs
  • src/meta/src/model/mod.rs
  • src/meta/src/model/notification.rs
  • src/meta/src/model/stream.rs
  • src/meta/src/model/user.rs
  • src/meta/src/rpc/elections.rs
  • src/meta/src/rpc/follower_svc.rs
  • src/meta/src/rpc/intercept.rs
  • src/meta/src/rpc/leader_svc.rs
  • src/meta/src/rpc/metrics.rs
  • src/meta/src/rpc/mod.rs
  • src/meta/src/rpc/server.rs
  • src/meta/src/rpc/service/backup_service.rs
  • src/meta/src/rpc/service/cluster_service.rs
  • src/meta/src/rpc/service/ddl_service.rs
  • src/meta/src/rpc/service/health_service.rs
  • src/meta/src/rpc/service/heartbeat_service.rs
  • src/meta/src/rpc/service/hummock_service.rs
  • src/meta/src/rpc/service/mod.rs
  • src/meta/src/rpc/service/notification_service.rs
  • src/meta/src/rpc/service/scale_service.rs
  • src/meta/src/rpc/service/stream_service.rs
  • src/meta/src/rpc/service/user_service.rs
  • src/meta/src/storage/etcd_meta_store.rs
  • src/meta/src/storage/etcd_retry_client.rs
  • src/meta/src/storage/mem_meta_store.rs
  • src/meta/src/storage/meta_store.rs
  • src/meta/src/storage/mod.rs
  • src/meta/src/storage/tests.rs
  • src/meta/src/storage/transaction.rs
  • src/meta/src/storage/wrapped_etcd_client.rs
  • src/meta/src/stream/mapping.rs
  • src/meta/src/stream/mod.rs
  • src/meta/src/stream/scale.rs
  • src/meta/src/stream/scheduler.rs
  • src/meta/src/stream/source_manager.rs
  • src/meta/src/stream/stream_graph.rs
  • src/meta/src/stream/stream_manager.rs
  • src/meta/src/stream/test_fragmenter.rs
  • src/meta/src/stream/test_scale.rs
  • src/object_store/src/lib.rs
  • src/object_store/src/object/disk.rs
  • src/object_store/src/object/error.rs
  • src/object_store/src/object/mem.rs
  • src/object_store/src/object/mod.rs
  • src/object_store/src/object/object_metrics.rs
  • src/object_store/src/object/s3.rs
  • src/prost/build.rs
  • src/prost/helpers/src/generate.rs
  • src/prost/helpers/src/lib.rs
  • src/prost/src/lib.rs
  • src/risedevtool/src/bin/risedev-compose.rs
  • src/risedevtool/src/bin/risedev-config.rs
  • src/risedevtool/src/bin/risedev-dev.rs
  • src/risedevtool/src/bin/risedev-docslt.rs
  • src/risedevtool/src/compose.rs
  • src/risedevtool/src/compose_deploy.rs
  • src/risedevtool/src/config.rs
  • src/risedevtool/src/config/dollar_expander.rs
  • src/risedevtool/src/config/id_expander.rs
  • src/risedevtool/src/config/provide_expander.rs
  • src/risedevtool/src/config/use_expander.rs
  • src/risedevtool/src/config_gen.rs
  • src/risedevtool/src/config_gen/grafana_gen.rs
  • src/risedevtool/src/config_gen/kafka_gen.rs
  • src/risedevtool/src/config_gen/prometheus_gen.rs
  • src/risedevtool/src/config_gen/zookeeper_gen.rs
  • src/risedevtool/src/lib.rs
  • src/risedevtool/src/preflight_check.rs
  • src/risedevtool/src/risectl_env.rs
  • src/risedevtool/src/service_config.rs
  • src/risedevtool/src/task.rs
  • src/risedevtool/src/task/compactor_service.rs
  • src/risedevtool/src/task/compute_node_service.rs
  • src/risedevtool/src/task/configure_tmux_service.rs
  • src/risedevtool/src/task/connector_service.rs
  • src/risedevtool/src/task/ensure_stop_service.rs
  • src/risedevtool/src/task/etcd_service.rs
  • src/risedevtool/src/task/frontend_service.rs
  • src/risedevtool/src/task/grafana_service.rs
  • src/risedevtool/src/task/jaeger_service.rs
  • src/risedevtool/src/task/kafka_service.rs
  • src/risedevtool/src/task/meta_node_service.rs
  • src/risedevtool/src/task/minio_service.rs
  • src/risedevtool/src/task/prometheus_service.rs
  • src/risedevtool/src/task/pubsub_service.rs
  • src/risedevtool/src/task/redis_service.rs
  • src/risedevtool/src/task/task_configure_grpc_node.rs
  • src/risedevtool/src/task/task_configure_minio.rs
  • src/risedevtool/src/task/task_etcd_ready_check.rs
  • src/risedevtool/src/task/task_kafka_ready_check.rs
  • src/risedevtool/src/task/task_pubsub_emu_ready_check.rs
  • src/risedevtool/src/task/task_redis_ready_check.rs
  • src/risedevtool/src/task/utils.rs
  • src/risedevtool/src/task/zookeeper_service.rs
  • src/risedevtool/src/util.rs
  • src/risedevtool/src/wait.rs
  • src/rpc_client/src/compute_client.rs
  • src/rpc_client/src/connector_client.rs
  • src/rpc_client/src/error.rs
  • src/rpc_client/src/hummock_meta_client.rs
  • src/rpc_client/src/lib.rs
  • src/rpc_client/src/meta_client.rs
  • src/rpc_client/src/stream_client.rs
  • src/source/benches/json_parser.rs
  • src/source/src/common.rs
  • src/source/src/connector_source.rs
  • src/source/src/dml_manager.rs
  • src/source/src/fs_connector_source.rs
  • src/source/src/lib.rs
  • src/source/src/manager.rs
  • src/source/src/monitor/metrics.rs
  • src/source/src/monitor/mod.rs
  • src/source/src/parser/avro/mod.rs
  • src/source/src/parser/avro/parser.rs
  • src/source/src/parser/avro/schema_resolver.rs
  • src/source/src/parser/canal/json_parser.rs
  • src/source/src/parser/canal/mod.rs
  • src/source/src/parser/canal/operators.rs
  • src/source/src/parser/canal/simd_json_parser.rs
  • src/source/src/parser/canal/util.rs
  • src/source/src/parser/common.rs
  • src/source/src/parser/csv_parser.rs
  • src/source/src/parser/debezium/json_parser.rs
  • src/source/src/parser/debezium/mod.rs
  • src/source/src/parser/debezium/operators.rs
  • src/source/src/parser/debezium/simd_json_parser.rs
  • src/source/src/parser/json_parser.rs
  • src/source/src/parser/macros.rs
  • src/source/src/parser/maxwell/json_parser.rs
  • src/source/src/parser/maxwell/mod.rs
  • src/source/src/parser/maxwell/operators.rs
  • src/source/src/parser/maxwell/simd_json_parser.rs
  • src/source/src/parser/mod.rs
  • src/source/src/parser/protobuf/mod.rs
  • src/source/src/parser/protobuf/parser.rs
  • src/source/src/parser/protobuf/schema_resolver.rs
  • src/source/src/parser/schema_registry/client.rs
  • src/source/src/parser/schema_registry/mod.rs
  • src/source/src/parser/schema_registry/util.rs
  • src/source/src/parser/util.rs
  • src/source/src/row_id.rs
  • src/source/src/table.rs
  • src/storage/backup/cmd/src/bin/backup_restore.rs
  • src/storage/backup/cmd/src/lib.rs
  • src/storage/backup/src/error.rs
  • src/storage/backup/src/lib.rs
  • src/storage/backup/src/meta_snapshot.rs
  • src/storage/backup/src/storage.rs
  • src/storage/benches/bench_block_iter.rs
  • src/storage/benches/bench_compactor.rs
  • src/storage/benches/bench_compression.rs
  • src/storage/benches/bench_fs_operation.rs
  • src/storage/benches/bench_lru_cache.rs
  • src/storage/benches/bench_merge_iter.rs
  • src/storage/benches/bench_multi_builder.rs
  • src/storage/compactor/src/compactor_observer/mod.rs
  • src/storage/compactor/src/compactor_observer/observer_manager.rs
  • src/storage/compactor/src/lib.rs
  • src/storage/compactor/src/rpc.rs
  • src/storage/compactor/src/server.rs
  • src/storage/hummock_sdk/src/compact.rs
  • src/storage/hummock_sdk/src/compaction_group/hummock_version_ext.rs
  • src/storage/hummock_sdk/src/compaction_group/mod.rs
  • src/storage/hummock_sdk/src/filter_key_extractor.rs
  • src/storage/hummock_sdk/src/key.rs
  • src/storage/hummock_sdk/src/key_cmp.rs
  • src/storage/hummock_sdk/src/key_range.rs
  • src/storage/hummock_sdk/src/lib.rs
  • src/storage/hummock_sdk/src/prost_key_range.rs
  • src/storage/hummock_sdk/src/table_stats.rs
  • src/storage/hummock_test/benches/bench_hummock_iter.rs
  • src/storage/hummock_test/src/compactor_tests.rs
  • src/storage/hummock_test/src/failpoint_tests.rs
  • src/storage/hummock_test/src/hummock_read_version_tests.rs
  • src/storage/hummock_test/src/hummock_storage_tests.rs
  • src/storage/hummock_test/src/lib.rs
  • src/storage/hummock_test/src/local_version_manager_tests.rs
  • src/storage/hummock_test/src/mock_notification_client.rs
  • src/storage/hummock_test/src/snapshot_tests.rs
  • src/storage/hummock_test/src/state_store_tests.rs
  • src/storage/hummock_test/src/sync_point_tests.rs
  • src/storage/hummock_test/src/test_utils.rs
  • src/storage/hummock_test/src/vacuum_tests.rs
  • src/storage/src/error.rs
  • src/storage/src/hummock/backup_reader.rs
  • src/storage/src/hummock/block_cache.rs
  • src/storage/src/hummock/compactor/compaction_executor.rs
  • src/storage/src/hummock/compactor/compaction_filter.rs
  • src/storage/src/hummock/compactor/compactor_runner.rs
  • src/storage/src/hummock/compactor/context.rs
  • src/storage/src/hummock/compactor/iterator.rs
  • src/storage/src/hummock/compactor/mod.rs
  • src/storage/src/hummock/compactor/shared_buffer_compact.rs
  • src/storage/src/hummock/compactor/sstable_store.rs
  • src/storage/src/hummock/compactor/task_progress.rs
  • src/storage/src/hummock/conflict_detector.rs
  • src/storage/src/hummock/error.rs
  • src/storage/src/hummock/event_handler/hummock_event_handler.rs
  • src/storage/src/hummock/event_handler/mod.rs
  • src/storage/src/hummock/event_handler/uploader.rs
  • src/storage/src/hummock/file_cache/alloc.rs
  • src/storage/src/hummock/file_cache/buffer.rs
  • src/storage/src/hummock/file_cache/cache.rs
  • src/storage/src/hummock/file_cache/error.rs
  • src/storage/src/hummock/file_cache/file.rs
  • src/storage/src/hummock/file_cache/meta.rs
  • src/storage/src/hummock/file_cache/metrics.rs
  • src/storage/src/hummock/file_cache/mod.rs
  • src/storage/src/hummock/file_cache/store.rs
  • src/storage/src/hummock/file_cache/test_utils.rs
  • src/storage/src/hummock/file_cache/utils.rs
  • src/storage/src/hummock/hummock_meta_client.rs
  • src/storage/src/hummock/iterator/backward_concat.rs
  • src/storage/src/hummock/iterator/backward_merge.rs
  • src/storage/src/hummock/iterator/backward_user.rs
  • src/storage/src/hummock/iterator/concat_inner.rs
  • src/storage/src/hummock/iterator/delete_range_iterator.rs
  • src/storage/src/hummock/iterator/forward_concat.rs
  • src/storage/src/hummock/iterator/forward_merge.rs
  • src/storage/src/hummock/iterator/forward_user.rs
  • src/storage/src/hummock/iterator/merge_inner.rs
  • src/storage/src/hummock/iterator/mod.rs
  • src/storage/src/hummock/iterator/test_utils.rs
  • src/storage/src/hummock/local_version/local_version_impl.rs
  • src/storage/src/hummock/local_version/local_version_manager.rs
  • src/storage/src/hummock/local_version/mod.rs
  • src/storage/src/hummock/local_version/pinned_version.rs
  • src/storage/src/hummock/local_version/upload_handle_manager.rs
  • src/storage/src/hummock/mod.rs
  • src/storage/src/hummock/observer_manager.rs
  • src/storage/src/hummock/shared_buffer/mod.rs
  • src/storage/src/hummock/shared_buffer/shared_buffer_batch.rs
  • src/storage/src/hummock/shared_buffer/shared_buffer_uploader.rs
  • src/storage/src/hummock/sstable/backward_sstable_iterator.rs
  • src/storage/src/hummock/sstable/block.rs
  • src/storage/src/hummock/sstable/block_iterator.rs
  • src/storage/src/hummock/sstable/bloom.rs
  • src/storage/src/hummock/sstable/builder.rs
  • src/storage/src/hummock/sstable/delete_range_aggregator.rs
  • src/storage/src/hummock/sstable/forward_sstable_iterator.rs
  • src/storage/src/hummock/sstable/mod.rs
  • src/storage/src/hummock/sstable/multi_builder.rs
  • src/storage/src/hummock/sstable/sstable_id_manager.rs
  • src/storage/src/hummock/sstable/utils.rs
  • src/storage/src/hummock/sstable/writer.rs
  • src/storage/src/hummock/sstable_store.rs
  • src/storage/src/hummock/state_store.rs
  • src/storage/src/hummock/state_store_v1.rs
  • src/storage/src/hummock/store/event_handler.rs
  • src/storage/src/hummock/store/memtable.rs
  • src/storage/src/hummock/store/mod.rs
  • src/storage/src/hummock/store/state_store.rs
  • src/storage/src/hummock/store/version.rs
  • src/storage/src/hummock/test_utils.rs
  • src/storage/src/hummock/tiered_cache.rs
  • src/storage/src/hummock/utils.rs
  • src/storage/src/hummock/vacuum.rs
  • src/storage/src/hummock/validator.rs
  • src/storage/src/hummock/value.rs
  • src/storage/src/lib.rs
  • src/storage/src/memory.rs
  • src/storage/src/monitor/hummock_metrics.rs
  • src/storage/src/monitor/local_metrics.rs
  • src/storage/src/monitor/mod.rs
  • src/storage/src/monitor/monitored_store.rs
  • src/storage/src/monitor/state_store_metrics.rs
  • src/storage/src/panic_store.rs
  • src/storage/src/row_serde/mod.rs
  • src/storage/src/row_serde/row_serde_util.rs
  • src/storage/src/storage_failpoints/mod.rs
  • src/storage/src/storage_failpoints/test_iterator.rs
  • src/storage/src/storage_failpoints/test_sstable.rs
  • src/storage/src/storage_value.rs
  • src/storage/src/store.rs
  • src/storage/src/store_impl.rs
  • src/storage/src/table/batch_table/iter_utils.rs
  • src/storage/src/table/batch_table/mod.rs
  • src/storage/src/table/batch_table/storage_table.rs
  • src/storage/src/table/mod.rs
  • src/storage/src/table/streaming_table/mem_table.rs
  • src/storage/src/table/streaming_table/mod.rs
  • src/storage/src/write_batch.rs
  • src/stream/src/cache/managed_lru.rs
  • src/stream/src/cache/mod.rs
  • src/stream/src/common/builder.rs
  • src/stream/src/common/column_mapping.rs
  • src/stream/src/common/infallible_expr.rs
  • src/stream/src/common/mod.rs
  • src/stream/src/common/table/mod.rs
  • src/stream/src/common/table/state_table.rs
  • src/stream/src/common/table/test_batch_table.rs
  • src/stream/src/common/table/test_streaming_table.rs
  • src/stream/src/error.rs
  • src/stream/src/executor/actor.rs
  • src/stream/src/executor/aggregation/agg_call.rs
  • src/stream/src/executor/aggregation/agg_group.rs
  • src/stream/src/executor/aggregation/agg_impl/approx_count_distinct.rs
  • src/stream/src/executor/aggregation/agg_impl/approx_distinct_append.rs
  • src/stream/src/executor/aggregation/agg_impl/approx_distinct_utils.rs
  • src/stream/src/executor/aggregation/agg_impl/foldable.rs
  • src/stream/src/executor/aggregation/agg_impl/mod.rs
  • src/stream/src/executor/aggregation/agg_impl/row_count.rs
  • src/stream/src/executor/aggregation/agg_state.rs
  • src/stream/src/executor/aggregation/minput.rs
  • src/stream/src/executor/aggregation/mod.rs
  • src/stream/src/executor/aggregation/state_cache/array_agg.rs
  • src/stream/src/executor/aggregation/state_cache/cache.rs
  • src/stream/src/executor/aggregation/state_cache/extreme.rs
  • src/stream/src/executor/aggregation/state_cache/mod.rs
  • src/stream/src/executor/aggregation/state_cache/string_agg.rs
  • src/stream/src/executor/aggregation/table.rs
  • src/stream/src/executor/aggregation/value.rs
  • src/stream/src/executor/backfill.rs
  • src/stream/src/executor/barrier_align.rs
  • src/stream/src/executor/batch_query.rs
  • src/stream/src/executor/chain.rs
  • src/stream/src/executor/dispatch.rs
  • src/stream/src/executor/dml.rs
  • src/stream/src/executor/dynamic_filter.rs
  • src/stream/src/executor/error.rs
  • src/stream/src/executor/exchange/input.rs
  • src/stream/src/executor/exchange/mod.rs
  • src/stream/src/executor/exchange/output.rs
  • src/stream/src/executor/exchange/permit.rs
  • src/stream/src/executor/expand.rs
  • src/stream/src/executor/filter.rs
  • src/stream/src/executor/global_simple_agg.rs
  • src/stream/src/executor/hash_agg.rs
  • src/stream/src/executor/hash_join.rs
  • src/stream/src/executor/hop_window.rs
  • src/stream/src/executor/integration_tests.rs
  • src/stream/src/executor/local_simple_agg.rs
  • src/stream/src/executor/lookup.rs
  • src/stream/src/executor/lookup/cache.rs
  • src/stream/src/executor/lookup/impl_.rs
  • src/stream/src/executor/lookup/sides.rs
  • src/stream/src/executor/lookup/tests.rs
  • src/stream/src/executor/lookup_union.rs
  • src/stream/src/executor/managed_state/join/join_entry_state.rs
  • src/stream/src/executor/managed_state/join/mod.rs
  • src/stream/src/executor/managed_state/mod.rs
  • src/stream/src/executor/managed_state/top_n/mod.rs
  • src/stream/src/executor/managed_state/top_n/top_n_state.rs
  • src/stream/src/executor/merge.rs
  • src/stream/src/executor/mod.rs
  • src/stream/src/executor/monitor/mod.rs
  • src/stream/src/executor/monitor/streaming_stats.rs
  • src/stream/src/executor/mview/materialize.rs
  • src/stream/src/executor/mview/mod.rs
  • src/stream/src/executor/mview/test_utils.rs
  • src/stream/src/executor/now.rs
  • src/stream/src/executor/project.rs
  • src/stream/src/executor/project_set.rs
  • src/stream/src/executor/rearranged_chain.rs
  • src/stream/src/executor/receiver.rs
  • src/stream/src/executor/row_id_gen.rs
  • src/stream/src/executor/simple.rs
  • src/stream/src/executor/sink.rs
  • src/stream/src/executor/sort.rs
  • src/stream/src/executor/source/fs_source_executor.rs
  • src/stream/src/executor/source/mod.rs
  • src/stream/src/executor/source/reader.rs
  • src/stream/src/executor/source/source_executor_v2.rs
  • src/stream/src/executor/source/state_table_handler.rs
  • src/stream/src/executor/subtask.rs
  • src/stream/src/executor/test_utils.rs
  • src/stream/src/executor/top_n/group_top_n.rs
  • src/stream/src/executor/top_n/mod.rs
  • src/stream/src/executor/top_n/top_n_appendonly.rs
  • src/stream/src/executor/top_n/top_n_cache.rs
  • src/stream/src/executor/top_n/top_n_plain.rs
  • src/stream/src/executor/top_n/utils.rs
  • src/stream/src/executor/union.rs
  • src/stream/src/executor/watermark_filter.rs
  • src/stream/src/executor/wrapper.rs
  • src/stream/src/executor/wrapper/epoch_check.rs
  • src/stream/src/executor/wrapper/schema_check.rs
  • src/stream/src/executor/wrapper/trace.rs
  • src/stream/src/executor/wrapper/update_check.rs
  • src/stream/src/from_proto/agg_common.rs
  • src/stream/src/from_proto/batch_query.rs
  • src/stream/src/from_proto/chain.rs
  • src/stream/src/from_proto/dml.rs
  • src/stream/src/from_proto/dynamic_filter.rs
  • src/stream/src/from_proto/expand.rs
  • src/stream/src/from_proto/filter.rs
  • src/stream/src/from_proto/global_simple_agg.rs
  • src/stream/src/from_proto/group_top_n.rs
  • src/stream/src/from_proto/hash_agg.rs
  • src/stream/src/from_proto/hash_join.rs
  • src/stream/src/from_proto/hop_window.rs
  • src/stream/src/from_proto/local_simple_agg.rs
  • src/stream/src/from_proto/lookup.rs
  • src/stream/src/from_proto/lookup_union.rs
  • src/stream/src/from_proto/merge.rs
  • src/stream/src/from_proto/mod.rs
  • src/stream/src/from_proto/mview.rs
  • src/stream/src/from_proto/now.rs
  • src/stream/src/from_proto/project.rs
  • src/stream/src/from_proto/project_set.rs
  • src/stream/src/from_proto/row_id_gen.rs
  • src/stream/src/from_proto/sink.rs
  • src/stream/src/from_proto/sort.rs
  • src/stream/src/from_proto/source.rs
  • src/stream/src/from_proto/top_n.rs
  • src/stream/src/from_proto/top_n_appendonly.rs
  • src/stream/src/from_proto/union.rs
  • src/stream/src/from_proto/watermark_filter.rs
  • src/stream/src/lib.rs
  • src/stream/src/task/barrier_manager.rs
  • src/stream/src/task/barrier_manager/managed_state.rs
  • src/stream/src/task/barrier_manager/progress.rs
  • src/stream/src/task/barrier_manager/tests.rs
  • src/stream/src/task/env.rs
  • src/stream/src/task/mod.rs
  • src/stream/src/task/stream_manager.rs
  • src/test_runner/src/lib.rs
  • src/test_runner/src/test_runner.rs
  • src/tests/compaction_test/src/bin/compaction.rs
  • src/tests/compaction_test/src/bin/delete_range.rs
  • src/tests/compaction_test/src/delete_range_runner.rs
  • src/tests/compaction_test/src/lib.rs
  • src/tests/compaction_test/src/runner.rs
  • src/tests/regress/src/bin/main.rs
  • src/tests/regress/src/env.rs
  • src/tests/regress/src/file.rs
  • src/tests/regress/src/lib.rs
  • src/tests/regress/src/opts.rs
  • src/tests/regress/src/psql.rs
  • src/tests/regress/src/schedule.rs
  • src/tests/simulation/src/client.rs
  • src/tests/simulation/src/cluster.rs
  • src/tests/simulation/src/ctl_ext.rs
  • src/tests/simulation/src/kafka.rs
  • src/tests/simulation/src/lib.rs
  • src/tests/simulation/src/main.rs
  • src/tests/simulation/src/nexmark.rs
  • src/tests/simulation/src/slt.rs
  • src/tests/simulation/src/utils.rs
  • src/tests/simulation/tests/cascade_materialized_view.rs
  • src/tests/simulation/tests/dynamic_filter.rs
  • src/tests/simulation/tests/hello.rs
  • src/tests/simulation/tests/nexmark_chaos.rs
  • src/tests/simulation/tests/nexmark_q4.rs
  • src/tests/simulation/tests/nexmark_source.rs
  • src/tests/simulation/tests/singleton_migration.rs
  • src/tests/sqlsmith/src/bin/main.rs
  • src/tests/sqlsmith/src/lib.rs
  • src/tests/sqlsmith/src/runner.rs
  • src/tests/sqlsmith/src/sql_gen/expr.rs
  • src/tests/sqlsmith/src/sql_gen/mod.rs
  • src/tests/sqlsmith/src/sql_gen/query.rs
  • src/tests/sqlsmith/src/sql_gen/relation.rs
  • src/tests/sqlsmith/src/sql_gen/scalar.rs
  • src/tests/sqlsmith/src/sql_gen/time_window.rs
  • src/tests/sqlsmith/src/sql_gen/utils.rs
  • src/tests/sqlsmith/src/validation.rs
  • src/tests/sqlsmith/tests/frontend/mod.rs
  • src/tests/sqlsmith/tests/test_runner.rs
  • src/tracing/src/lib.rs
  • src/utils/async_stack_trace/src/context.rs
  • src/utils/async_stack_trace/src/lib.rs
  • src/utils/async_stack_trace/src/manager.rs
  • src/utils/async_stack_trace/src/tests.rs
  • src/utils/global_stats_alloc/src/lib.rs
  • src/utils/local_stats_alloc/src/lib.rs
  • src/utils/pgwire/src/error.rs
  • src/utils/pgwire/src/error_or_notice.rs
  • src/utils/pgwire/src/lib.rs
  • src/utils/pgwire/src/pg_extended.rs
  • src/utils/pgwire/src/pg_field_descriptor.rs
  • src/utils/pgwire/src/pg_message.rs
  • src/utils/pgwire/src/pg_protocol.rs
  • src/utils/pgwire/src/pg_response.rs
  • src/utils/pgwire/src/pg_server.rs
  • src/utils/pgwire/src/types.rs
  • src/utils/runtime/src/lib.rs
  • src/utils/sync-point/src/lib.rs
  • src/utils/task_stats_alloc/src/lib.rs
  • src/utils/task_stats_alloc/tests/integration.rs
  • src/utils/task_stats_alloc/tests/loom.rs
  • src/utils/workspace-config/src/lib.rs
  • src/workspace-hack/build.rs
  • src/workspace-hack/src/lib.rs

@mergify
Copy link
Contributor

mergify bot commented Jan 3, 2023

Hey @xxhZs, this pull request failed to merge and has been dequeued from the merge train. If you believe your PR failed in the merge train because of a flaky test, requeue it by clicking "Update branch" or pushing an empty commit with git commit --allow-empty -m "rerun" && git push.

Copy link
Contributor

@github-actions github-actions bot left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

license-eye has totally checked 2592 files.

Valid Invalid Ignored Fixed
1243 1 1348 0
Click to see the invalid file list
  • src/common/src/session_config/visibility_mode.rs

Co-authored-by: github-actions[bot] <41898282+github-actions[bot]@users.noreply.github.com>
@mergify mergify bot merged commit 78b10c2 into main Jan 3, 2023
@mergify mergify bot deleted the xxh/barrier_query branch January 3, 2023 05:30

#[derive(Copy, Default, Debug, Clone, PartialEq, Eq)]
pub enum VisibilityMode {
#[default]
Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

May I ask the reason to read Checkpoint by default? Do we have the plan to change the default value to All?

Copy link
Contributor

@zwang28 zwang28 Jan 4, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

When VISIBILITY_MODE=all, a FLUSH command no more enforce a checkpoint barrier, thus may surprise user that their data is still lost even they have FLUSHed. Besides this, I don't think of other concerns not to use VISIBILITY_MODE=all by default. @hzxa21 @xxhZs
Or shall we even change FLUSH back to always enforce a checkpoint?

Copy link
Collaborator

@hzxa21 hzxa21 Jan 4, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

+1 to enable VISIBILITY_MODE=all by default since it provides better freshness and normally user doesn't pay serious attention to data rewind.

shall we even change FLUSH back to always enforce a checkpoint?

This sounds reasonable to me since FLUSH normally indicates persistence.

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Or shall we even change FLUSH back to always enforce a checkpoint?

+1, agree with Patrick

Copy link
Contributor

@zwang28 zwang28 Jan 4, 2023

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

fix in #7188

Copy link
Member

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Some earlier discussions: #4966 (comment)

Should we adopt the CHECKPOINT command now?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
type/feature user-facing-changes Contains changes that are visible to users
Projects
None yet
Development

Successfully merging this pull request may close these issues.

6 participants