Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

feat: add wal replay benchmark #1511

Merged
merged 20 commits into from
Apr 17, 2024
Merged

Conversation

zealchen
Copy link
Contributor

@zealchen zealchen commented Apr 9, 2024

Rationale

Add benchmark cases for wal replay.

Detailed Changes

Add benchmark cases for wal replay.

Test Plan

Benchmark test. The result is as follows:

replay/replay/0         time:   [932.44 ms 1.0022 s 1.0705 s]
                                  change: [-12.172% -2.4758% +8.7572%] (p = 0.67 > 0.05)

chunshao90 and others added 16 commits April 9, 2024 17:36
…1487)

Update version to 2.0.0, prepare for releasing v2.0.0.
Upgrade rustc version
- upgrade rustc version
- upgrade rand version
- upgrade obkv-client version
- upgrade clap version
- Adapt to new APIs

CI
Prepare for releasing v2.0.0 .

* Add NOTICE file.
* Add ASF license header.

CI.
## Rationale

Related with apache#1466

## Detailed Changes
Replay logs of different tables in parallel

## Test Plan
CI

---------

Co-authored-by: jiacai2050 <dev@liujiacai.net>
## Rationale
All source file should have ASF headers.

## Detailed Changes


## Test Plan
CI
## Rationale
Add some dependency project descriptions in `NOTICE`.

## Detailed Changes
1. Add some dependency project descriptions in `NOTICE`.
2. Add `DEPENDENCIES` file.

## Test Plan
No need.
## Rationale
Implement horaectl using rust

## Detailed Changes
- Support `cluster list`, `cluster diagnose`, `cluster schedule`

```
$ target/debug/horaectl -h
HoraeCTL is a command line tool for HoraeDB

Usage: horaectl [OPTIONS] [COMMAND]

Commands:
  cluster  Operations on cluster
  help     Print this message or the help of the given subcommand(s)

Options:
  -m, --meta <META_ADDR>        Meta addr [env: HORAECTL_META_ADDR=] [default: 127.0.0.1:8080]
  -c, --cluster <CLUSTER_NAME>  Cluster name [env: HORAECTL_CLUSTER=] [default: defaultCluster]
  -i, --interactive             Enter interactive mode
  -h, --help                    Print help

$ target/debug/horaectl cluster -h
Operations on cluster

Usage: horaectl cluster [OPTIONS] <COMMAND>

Commands:
  list      List cluster
  diagnose  Diagnose cluster
  schedule  Schedule cluster
  help      Print this message or the help of the given subcommand(s)

Options:
  -m, --meta <META_ADDR>        Meta addr [env: HORAECTL_META_ADDR=] [default: 127.0.0.1:8080]
  -c, --cluster <CLUSTER_NAME>  Cluster name [env: HORAECTL_CLUSTER=] [default: defaultCluster]
  -h, --help                    Print help


```

## Test Plan
- Manual tests

---------

Co-authored-by: jiacai2050 <dev@liujiacai.net>
…1487)

Update version to 2.0.0, prepare for releasing v2.0.0.
Upgrade rustc version
- upgrade rustc version
- upgrade rand version
- upgrade obkv-client version
- upgrade clap version
- Adapt to new APIs

CI
Prepare for releasing v2.0.0 .

* Add NOTICE file.
* Add ASF license header.

CI.
## Rationale

Related with apache#1466

## Detailed Changes
Replay logs of different tables in parallel

## Test Plan
CI

---------

Co-authored-by: jiacai2050 <dev@liujiacai.net>
## Rationale
All source file should have ASF headers.

## Detailed Changes


## Test Plan
CI
Add some dependency project descriptions in `NOTICE`.

1. Add some dependency project descriptions in `NOTICE`.
2. Add `DEPENDENCIES` file.

No need.
## Rationale
Implement horaectl using rust

## Detailed Changes
- Support `cluster list`, `cluster diagnose`, `cluster schedule`

```
$ target/debug/horaectl -h
HoraeCTL is a command line tool for HoraeDB

Usage: horaectl [OPTIONS] [COMMAND]

Commands:
  cluster  Operations on cluster
  help     Print this message or the help of the given subcommand(s)

Options:
  -m, --meta <META_ADDR>        Meta addr [env: HORAECTL_META_ADDR=] [default: 127.0.0.1:8080]
  -c, --cluster <CLUSTER_NAME>  Cluster name [env: HORAECTL_CLUSTER=] [default: defaultCluster]
  -i, --interactive             Enter interactive mode
  -h, --help                    Print help

$ target/debug/horaectl cluster -h
Operations on cluster

Usage: horaectl cluster [OPTIONS] <COMMAND>

Commands:
  list      List cluster
  diagnose  Diagnose cluster
  schedule  Schedule cluster
  help      Print this message or the help of the given subcommand(s)

Options:
  -m, --meta <META_ADDR>        Meta addr [env: HORAECTL_META_ADDR=] [default: 127.0.0.1:8080]
  -c, --cluster <CLUSTER_NAME>  Cluster name [env: HORAECTL_CLUSTER=] [default: defaultCluster]
  -h, --help                    Print help


```

## Test Plan
- Manual tests

---------

Co-authored-by: jiacai2050 <dev@liujiacai.net>
@zealchen zealchen force-pushed the feat_replay_benchmark branch from a91e07b to 36079a5 Compare April 9, 2024 09:58
@jiacai2050 jiacai2050 self-requested a review April 12, 2024 02:57
Copy link
Contributor

@jiacai2050 jiacai2050 left a comment

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

LGTM

@jiacai2050 jiacai2050 changed the title Feat replay benchmark feat: add wal replay benchmark Apr 17, 2024
@jiacai2050 jiacai2050 merged commit 0cee69f into apache:main Apr 17, 2024
10 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

5 participants