Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

move omg_performance json rpc tests to perf project #1691

Merged
merged 63 commits into from
Aug 28, 2020
Merged
Show file tree
Hide file tree
Changes from 60 commits
Commits
Show all changes
63 commits
Select commit Hold shift + click to select a range
301573c
start moving omg_performance json rpc tests to perf project
ayrat555 Aug 10, 2020
1949fe0
move contract_transact to Ethereum module
ayrat555 Aug 11, 2020
8ee8743
use watch api client generated with openapi
ayrat555 Aug 11, 2020
8066624
move api wrappers from elixir-omg to perf
ayrat555 Aug 11, 2020
66d6e8a
fix warnings
ayrat555 Aug 11, 2020
aecd3e1
fix more errors
ayrat555 Aug 11, 2020
f75562a
add approve_token
ayrat555 Aug 11, 2020
7a372f0
Merge branch 'master' into ayrat555/omg_performance-to-perf
ayrat555 Aug 14, 2020
0dc4f2a
fix base build
ayrat555 Aug 14, 2020
2a431d0
add additional functions
ayrat555 Aug 14, 2020
54027cc
fix warnings
ayrat555 Aug 15, 2020
31b7a8b
make tests fail
ayrat555 Aug 16, 2020
159e9db
fix warnings
ayrat555 Aug 17, 2020
add9996
make deposit_to_childchain work
ayrat555 Aug 17, 2020
ea97a15
make ExtendedPerftest pass
ayrat555 Aug 17, 2020
8c43703
fix warnings
ayrat555 Aug 17, 2020
d1f01db
make the first byzantine events test pass
ayrat555 Aug 17, 2020
a40aef3
fix wrapper errors
ayrat555 Aug 17, 2020
6e7700e
fix local run for peformance tests
ayrat555 Aug 19, 2020
834c08b
Merge branch 'master' into ayrat555/omg_performance-to-perf
ayrat555 Aug 24, 2020
25d0d83
fix start_many_exits params encoding
ayrat555 Aug 24, 2020
a7b62e7
add exit queue
ayrat555 Aug 25, 2020
f5bfc9b
add recover payment transaction
ayrat555 Aug 26, 2020
616bd88
decode fee transaction
ayrat555 Aug 26, 2020
48e43f6
fix one more test
ayrat555 Aug 26, 2020
4369953
skip not compatible test
ayrat555 Aug 26, 2020
e597768
remove legacy byzantine tests
ayrat555 Aug 26, 2020
41fc548
mix test --trace
ayrat555 Aug 26, 2020
7a75e19
increase task timeout
ayrat555 Aug 26, 2020
9d8e131
Merge branch 'master' into ayrat555/omg_performance-to-perf
ayrat555 Aug 27, 2020
a967cf8
add logs to investigate failures
ayrat555 Aug 27, 2020
93cce91
add more logs
ayrat555 Aug 27, 2020
207c404
wait for only child chain number
ayrat555 Aug 27, 2020
62c72c0
print heights
ayrat555 Aug 27, 2020
6d2a3de
increase timeout
ayrat555 Aug 27, 2020
e3f9e03
skip stuck heights
ayrat555 Aug 27, 2020
0db90f6
uncomment regular cabbage tests
ayrat555 Aug 27, 2020
f75c2e2
fix credo
ayrat555 Aug 27, 2020
7502eae
fix credo
ayrat555 Aug 27, 2020
d021489
fix linter
ayrat555 Aug 27, 2020
d70d94c
fix ci
ayrat555 Aug 27, 2020
6de8f6d
remove redundant pattern matching
ayrat555 Aug 27, 2020
46e6e83
remove pattern matching in update_state_with_tx_submission
ayrat555 Aug 27, 2020
2c56c62
fix perf
ayrat555 Aug 27, 2020
d4ae059
remove omg_performance application
ayrat555 Aug 28, 2020
97631ff
add new ci step
ayrat555 Aug 28, 2020
5737837
fix start daemon services
ayrat555 Aug 28, 2020
4642471
add make init_test
ayrat555 Aug 28, 2020
e8baac5
start docker in background
ayrat555 Aug 28, 2020
bc86a68
remove debug docker logs
ayrat555 Aug 28, 2020
39463c8
fix warning
ayrat555 Aug 28, 2020
e7abd78
add circleci commands
ayrat555 Aug 28, 2020
8509e6b
load env vars from file
ayrat555 Aug 28, 2020
d0b38da
print env vars
ayrat555 Aug 28, 2020
9cb3139
leave only used abi functions
ayrat555 Aug 28, 2020
e131a9e
fix check warnings step
ayrat555 Aug 28, 2020
4178ac7
remove unused functions from abi fields
ayrat555 Aug 28, 2020
d32edc1
change requests
ayrat555 Aug 28, 2020
a67299f
Merge branch 'master' into ayrat555/omg_performance-to-perf
ayrat555 Aug 28, 2020
39e88c2
remove init function
ayrat555 Aug 28, 2020
da5a3ae
Update priv/perf/apps/load_test/lib/common/byzantine_events.ex
ayrat555 Aug 28, 2020
60a11cf
Update priv/perf/apps/load_test/lib/common/sender_server.ex
ayrat555 Aug 28, 2020
0019044
fix compilation warning
ayrat555 Aug 28, 2020
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
154 changes: 78 additions & 76 deletions .circleci/config.yml
Original file line number Diff line number Diff line change
Expand Up @@ -55,6 +55,43 @@ commands:
name: Attach workspace
at: .

make_docker_images:
description: Builds docker images
steps:
- run: make docker-child_chain
- run: make docker-watcher
- run: make docker-watcher_info

install_elixir_and_check_docker_status:
description: Installs elixir and checks if docker is healthy
steps:
- run:
name: Print docker states
command: |
docker image ls
docker-compose ps
- restore_cache:
key: v2-asdf-install
- run:
name: Install Erlang and Elixir
command: |
[ -d ~/.asdf-vm ] || git clone https://github.com/asdf-vm/asdf.git ~/.asdf-vm --branch v0.7.4
echo 'source ~/.asdf-vm/asdf.sh' >> $BASH_ENV
source $BASH_ENV
asdf plugin-add erlang || asdf plugin-update erlang
asdf plugin-add elixir || asdf plugin-update elixir
asdf install
no_output_timeout: 2400
- save_cache:
key: v2-asdf-install
paths:
- ~/.asdf
- ~/.asdf-vm
- run: make install-hex-rebar
- run: sh .circleci/status.sh
- restore_cache:
key: v2-mix-specs-cache-{{ .Branch }}-{{ checksum "mix.lock" }}

jobs:
barebuild:
executor: metal
Expand Down Expand Up @@ -446,40 +483,13 @@ jobs:
name: Setup data dir
command: |
[ -d data ] || mkdir data && chmod 777 data
- run: make docker-child_chain
- run: make docker-watcher
- run: make docker-watcher_info
- make_docker_images
- run:
name: Start daemon services
command: |
cd priv/cabbage
make start_daemon_services-2 || (START_RESULT=$?; docker-compose logs; exit $START_RESULT;)
- run:
name: Print docker states
command: |
docker image ls
docker-compose ps
- restore_cache:
key: v2-asdf-install
- run:
name: Install Erlang and Elixir
command: |
[ -d ~/.asdf-vm ] || git clone https://github.com/asdf-vm/asdf.git ~/.asdf-vm --branch v0.7.4
echo 'source ~/.asdf-vm/asdf.sh' >> $BASH_ENV
source $BASH_ENV
asdf plugin-add erlang || asdf plugin-update erlang
asdf plugin-add elixir || asdf plugin-update elixir
asdf install
no_output_timeout: 2400
- save_cache:
key: v2-asdf-install
paths:
- ~/.asdf
- ~/.asdf-vm
- run: make install-hex-rebar
- run: sh .circleci/status.sh
- restore_cache:
key: v2-mix-specs-cache-{{ .Branch }}-{{ checksum "mix.lock" }}
- install_elixir_and_check_docker_status
- run:
name: Run specs
command: |
Expand All @@ -488,12 +498,6 @@ jobs:
make generate_api_code
mix deps.get
mix test
- run:
name: Run load test
command: |
cd priv/perf
make init
make test
- run:
name: (Cabbage) Format generated code and check for warnings
command: |
Expand All @@ -504,9 +508,42 @@ jobs:
mix format apps/watcher_info_api/lib/watcher_info_api/model/*.ex
mix format apps/watcher_security_critical_api/lib/watcher_security_critical_api/model/*.ex
MIX_ENV=test mix do compile --warnings-as-errors --ignore-module-conflict --force, test --exclude test
- save_cache:
key: v2-mix-specs-cache-{{ .Branch }}-{{ checksum "mix.lock" }}
paths:
- "priv/cabbage/deps"
- run:
name: (Cabbage) Credo and formatting
command: |
cd priv/cabbage
mix do credo, format --check-formatted --dry-run

test_docker_compose_performance:
machine:
image: ubuntu-1604:201903-01
steps:
- checkout
- run:
name: Setup data dir
command: |
[ -d data ] || mkdir data && chmod 777 data
- make_docker_images
- run:
name: Start daemon services
command: |
SNAPSHOT=SNAPSHOT_MIX_EXIT_PERIOD_SECONDS_120 make init_test && docker-compose -f ./docker-compose.yml up -d || (START_RESULT=$?; docker-compose logs; exit $START_RESULT;)
- install_elixir_and_check_docker_status
- run:
name: Run load test
command: |
export $(cat ./localchain_contract_addresses.env | xargs)
cd priv/perf
make init
make test
- run:
name: (Perf) Format generated code and check for warnings
command: |
export $(cat ./localchain_contract_addresses.env | xargs)
cd priv/perf
# run format ONLY on formatted code so that it cleans up quoted atoms because
# we cannot exclude folders to --warnings-as-errors
Expand All @@ -515,13 +552,8 @@ jobs:
- save_cache:
key: v2-mix-specs-cache-{{ .Branch }}-{{ checksum "mix.lock" }}
paths:
- "priv/cabbage/deps"
- "priv/perf/deps"
- run:
name: (Cabbage) Credo and formatting
command: |
cd priv/cabbage
mix do credo, format --check-formatted --dry-run

- run:
name: (Perf) Credo and formatting
command: |
Expand All @@ -546,40 +578,13 @@ jobs:
[ -d data1 ] || mkdir data1 && chmod 777 data1
[ -d data2 ] || mkdir data2 && chmod 777 data2
[ -d data ] || mkdir data && chmod 777 data
- run: make docker-child_chain
- run: make docker-watcher
- run: make docker-watcher_info
- make_docker_images
- run:
name: Start daemon services
command: |
cd priv/cabbage
make start_daemon_services_reorg-2 || (START_RESULT=$?; docker-compose logs; exit $START_RESULT;)
- run:
name: Print docker states
command: |
docker image ls
docker-compose ps
- restore_cache:
key: v2-asdf-install
- run:
name: Install Erlang and Elixir
command: |
[ -d ~/.asdf-vm ] || git clone https://github.com/asdf-vm/asdf.git ~/.asdf-vm --branch v0.7.4
echo 'source ~/.asdf-vm/asdf.sh' >> $BASH_ENV
source $BASH_ENV
asdf plugin-add erlang || asdf plugin-update erlang
asdf plugin-add elixir || asdf plugin-update elixir
asdf install
no_output_timeout: 2400
- save_cache:
key: v2-asdf-install
paths:
- ~/.asdf
- ~/.asdf-vm
- run: make install-hex-rebar
- run: sh .circleci/status.sh
- restore_cache:
key: v2-mix-specs-cache-{{ .Branch }}-{{ checksum "mix.lock" }}
- install_elixir_and_check_docker_status
- run:
name: Print watcher logs
command: make cabbage-reorg-watcher-logs
Expand Down Expand Up @@ -714,12 +719,6 @@ jobs:
command: |
cd priv/cabbage
mix test
- run:
name: Run load test
command: |
cd priv/perf
make init
make test

publish_child_chain:
machine:
Expand Down Expand Up @@ -920,6 +919,9 @@ workflows:
- test_docker_compose_release:
requires: [build]
filters: *all_branches_and_tags
- test_docker_compose_performance:
requires: [build]
filters: *all_branches_and_tags
- test_docker_compose_reorg:
requires: [build]
filters: *all_branches_and_tags
Expand Down
60 changes: 0 additions & 60 deletions apps/omg_performance/lib/omg_performance/block_creator.ex

This file was deleted.

This file was deleted.

Loading