Skip to content

Commit

Permalink
QA: v0.34 - 2/3 TM 1/3 CM (tendermint#292) (tendermint#308)
Browse files Browse the repository at this point in the history
* Report Skeleton

* Added results on 2/3TM and 1/3CMT

* Added img files

* Cropped pics

* First batch of results

* Fixed image offsets

* All metrics in

* Added average plots, merged with Sergios branch

* Added todo

* Updated graphs

* scaling img

* scaling img

* Added versions

---------

Co-authored-by: Sergio Mena <sergio@informal.systems>
(cherry picked from commit f6e70af)

Co-authored-by: Jasmina Malicevic <jasmina.dustinac@gmail.com>
  • Loading branch information
mergify[bot] and jmalicevic authored Feb 10, 2023
1 parent 892516a commit fd15b98
Show file tree
Hide file tree
Showing 12 changed files with 27 additions and 9 deletions.
36 changes: 27 additions & 9 deletions docs/qa/v034/README.md
Original file line number Diff line number Diff line change
Expand Up @@ -360,7 +360,9 @@ TODO

#### 2/3 Tendermint Core - 1/3 CometBFT

TODO
![latencies_all_tm2_3_cmt1_3](img/v034_200node_tm2cmt1/latency_all.png)

![latencies_run1_tm2_3_cmt1_3](img/v034_200node_tm2cmt1/latency_run1.png){width=250}

#### Prometheus Metrics

Expand Down Expand Up @@ -404,7 +406,9 @@ TODO

###### 2/3 Tendermint Core - 1/3 CometBFT

TODO
![mempool_tm2_3_cmt_1_3](./img/v034_200node_tm2cmt1/mempool_size.png)

![mempool-avg_tm2_3_cmt_1_3](./img/v034_200node_tm2cmt1/mempool_avg.png)

##### Peers

Expand Down Expand Up @@ -432,10 +436,13 @@ TODO

###### 2/3 Tendermint Core - 1/3 CometBFT

TODO
![peers-tm2_3_cmt1_3](./img/v034_200node_tm2cmt1/peers.png)

##### Consensus Rounds per Height

TODO Move this under mempool as we refer to it


For reference, this is the baseline plot.

![rounds](./img/v034_r200c2_rounds.png)
Expand All @@ -456,7 +463,7 @@ TODO

###### 2/3 Tendermint Core - 1/3 CometBFT

TODO
![rounds-tm2_3_cmt1_3](./img/v034_200node_tm2cmt1/consensus_rounds.png)

##### Blocks Produced per Minute, Transactions Processed per Minute

Expand Down Expand Up @@ -489,7 +496,13 @@ TODO

###### 2/3 Tendermint Core - 1/3 CometBFT

TODO
![blocks_min_run1_tm2_3_cmt1_4](./img/v034_200node_tm2cmt1/height.png)

In two minutes the height goes from 32 to 90 which gives an average of 29 blocks per minutes.

![tx_min_run1_tm2_3_cmt1_3](./img/v034_200node_tm2cmt1/num_tx.png)

In 1 minutes and 30 seconds the system processes 35600 transactions which amounts to 23000 transactions per minute.

##### Memory Resident Set Size

Expand Down Expand Up @@ -518,7 +531,9 @@ TODO

###### 2/3 Tendermint Core - 1/3 CometBFT

TODO
![rss_run1_tm2_3_cmt1_3](./img/v034_200node_tm2cmt1/resident_memory_bytes.png)

![rss_avg_run1_tm2_3_cmt1_3](./img/v034_200node_tm2cmt1/resident_memory_bytes_avg.png)

##### CPU utilization

Expand All @@ -538,7 +553,7 @@ TODO

###### 2/3 Tendermint Core - 1/3 CometBFT

TODO
![cpuload_run1_tm2_3_cmt1_3](./img/v034_200node_tm2cmt1/cpu_load.png)

### Test Results

Expand All @@ -560,8 +575,11 @@ Version: xxxxxxxxxxxxxxxxx

#### 2/3 Tendermint Core - 1/3 CometBFT

**Result: ????**
**Result: PASS**

Date: 2023-02-08

Version: xxxxxxxxxxxxxxxxx
Versions:

CometBFT 3b783434f26b0e87994e6a77c5411927aad9ce3f
Tendermint Core 66c2cb63416e66bff08e11f9088e21a0ed142790
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/qa/v034/img/v034_200node_tm2cmt1/height.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/qa/v034/img/v034_200node_tm2cmt1/num_tx.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Binary file added docs/qa/v034/img/v034_200node_tm2cmt1/peers.png
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.
Loading
Sorry, something went wrong. Reload?
Sorry, we cannot display this file.
Sorry, this file is invalid so it cannot be displayed.

0 comments on commit fd15b98

Please sign in to comment.