Sync/feat substrate main merge (cosmos#1016)

* Merge PR cosmos#919: Clean up and move scripts folder and dev-env

* clean up scripts

* clean up Makerfile

* cleanup configs

* fix shebang

* update data folder path

* move to examples dir

* update build-gaia path for make

* add-dir description

* examples

* examples readme

* add killall note to readme

* fix link

* remove extra config dir

* update path in demo.md

* readme nit

* Use self-hosted runner for ibctest integration tests (cosmos#943)

* bugfix - intermittent channel handshake failure (cosmos#937)

* bugfix for intermittent channel handshake failure

* Add unit tests for connection and channel state caches

* Log messages in failed txs

* Tidy

* Adding MinGasAmount (cosmos#940)

* Adding MinGasAmount

* go.mod updates

* Updating ibctest/go.mod

* Adding min-gas-amount to CHANGELOG and troubleshooting

* Merge PR cosmos#953: cosmos - begin and end block event parsing

* Add begin and end block events

* tidy

* Handle multiple ibc messages in begin block and end block

* Fix logic with accumulator

* tidy

* Fix nil pointer for begin/end block events (cosmos#956)

* Fix bug with tracking processing channel msgs (cosmos#970)

* add debug output

* add more debug output

* NEEDS MOAR DEBUG OUTPUT

* test purging MsgTimeout on src vs. counterparty

* reverse channel close msg purging

* don't delete channel close msgs until another iteration in getUnrelayedPacketsAndAcks

* add debug output

* add more debug output

* NEEDS MOAR DEBUG OUTPUT

* test purging MsgTimeout on src vs. counterparty

* reverse channel close msg purging

* don't delete channel close msgs until another iteration in getUnrelayedPacketsAndAcks

* reverse channel close msg purging

* don't delete channel close msgs until another iteration in getUnrelayedPacketsAndAcks

* undo previous changes regarding purging cache on max retries

* undo more changes made in shouldSendChannelMessage

* more undo

* add debug output on msg send and channel cache purge

* add debug output

* remove pointless log

* add logs in process latest msgs

* more logs

* logs

* remove all debug logs and implement fix for tracking processing packets correctly

* Merge PR cosmos#974: Clarify demo

* update demo

* remove extra dev-env

* Merge PR cosmos#963: Additional Metrics

* Adding block height and wallet balance metrics

* Fixing duplicate registration

* Assigning metrics during NewCosmosChainProcessor

* Fixing latest height to use ChainId

* Metrics are optional...

* Merge PR cosmos#981: Update IBCdata struct

Update IBCdata struct based on recent changes made at the Cosmos Chain Registry

* Fix flattening of events (cosmos#979)

* Fix flattening of events

* Parse events without flattened tx.Log

* Add missing write ack to switch case

* Fix unnecessary retention of irrelevant messages (cosmos#980)

* Merge PR cosmos#987: Use config.lock file to guard access to config.yaml in the case of linking multiple paths concurrently

* ignore recv packet with empty ack bytes (cosmos#985)

Co-authored-by: Jack Zampolin <jack.zampolin@gmail.com>

* Relay multiple paths from the same process (cosmos#988)

* wip: add test for relaying on many paths

This test instantiates a relayer with the event processor that relays on
two paths across three chains.

This was ported from previous WIP that attempted to add multi-path
support to the legacy processor for the relayer; multi-path support in
the legacy processor had some subtle bugs that caused the test to fail.

Now with the new event processor, the test is failing in a different
way that we need to further debug.

* Multiple paths same process with test

* go mod tidy

* fix old tests

* Update to ibctest with race fix

* Fix legacy relayer

Co-authored-by: Mark Rushakoff <mark.rushakoff@gmail.com>

* Default to events processor (cosmos#989)

* Default to events processor

* events processor is now default

* sort packet messages by sequence number (cosmos#992)

only process 1 packet at a time on ordered channels

* path processor race (cosmos#995)

* fix path processor indexing

* clone maps before passing to pathprocessor

* Merge should Clone

* pre-size maps

* Use in process Relayer for race detection (cosmos#996)

* clone maps before passing to pathprocessor

* Add local relayer implementation to help catch race conditions in CI

* use existing relayerfactory

* Isolate mutex to totalFees

* handle feedback

* fix fatalf format

* Merge PR cosmos#999: Add ability to run all paths in config easil

* Add ability to run all paths in config easily

* PR review fixes

* Fix tests and patch readme

* Merge PR cosmos#1005: Fix legacy race condition

* fix counterparty path filter (cosmos#1000)

* fix counterparty path filter

* Filter fix test

* Add denylist test and add makefile and gh action

* Slim test for non-self-hosted runner

* Update ibctest to latest main

* Make better assertion for denylist acks. Constants for allowlist/denylist. Validate filterRule in CLI

* Use isolated prometheus registry per relayer instance instead of prometheus default registry

* run path filter tests in parallel

* dockerfile: move TARGET* args for fast workflow & ... (cosmos#993)

- Single COPY step for go mod and sum
- Use ENV GOOS & GOARCH from TARGET* args

Co-authored-by: pratikbin <pratikbin+010101@no-reply-github.com>

* Respect the `override` flag upon client creation (cosmos#997)

* respect the override flag

* add test case for --override usage

* add missing godoc comment for test

* disable CountTotal (cosmos#1009)

* Fix account sequence mismatch errors (cosmos#1007)

* Use mutex for tx account sequence query through tx broadcast, track account sequence number on chain provider

* Make updateNextAccountSequence private

* Retry for account sequence mismatch errors

* Allow decrementing account sequence if node says it is expected

* Add test for handleAccountSequenceMismatchError

* Keystore implementation for substrate chain (cosmos#922)

* add substrate keystore implementation

* implement key provider for substrate chain

* clean up keystore code

* run go mod tidy moving rename test to _test
* remove verbs from error messages
* correct interface method comments in Keyring and Info types
* initialize log in NewProvider method

* move type definitions to method implementation files

* check if KeyDirectory is empty before overwriting it in the NewProvider method

* remove comments in ExportPrivKeyArmor

* bump substrate-rpc-client to latest master

* change network type to uint16

* update go.mod in ibctest

* feat: add chain processor implementation (cosmos#924)

* feat: add chain processor implementation

* fix: go-schnorrkel version fix

* fix: go mod update dockertest

* feature/ implement substrate event parser (cosmos#923)

* feat: implement substrate event parser

* fix: event parser switch fallthrough

* fix: go-schnorrkel version fix

* fix: go mod update for dcokertest

* create helper functions between substrate <> ibc events

* use intoIBCEventType

* fix: event parser accumulation support

* fix: spearate parsing and handling of ibc messages

* feat: parachain header parse

* fix: packet accumulator separate switch case

* fix: go.mod docker issue

* fix: ics11-beefy repo version fix

* fix: accumulator events to messages

* fix: add connection event type conversion

* fix: ibctest go.mod fix

Co-authored-by: Blas Rodriguez Irizar <rodrigblas@gmail.com>

* fix: go.mod

Co-authored-by: Dan Kanefsky <56059752+boojamya@users.noreply.github.com>
Co-authored-by: Andrew Gouin <andrew@gouin.io>
Co-authored-by: Joe Abbey <joe.abbey@gmail.com>
Co-authored-by: Justin Tieri <37750742+jtieri@users.noreply.github.com>
Co-authored-by: JeremyParish69 <95667791+JeremyParish69@users.noreply.github.com>
Co-authored-by: Jack Zampolin <jack.zampolin@gmail.com>
Co-authored-by: Mark Rushakoff <mark.rushakoff@gmail.com>
Co-authored-by: pratikbin <68642400+pratikbin@users.noreply.github.com>
Co-authored-by: pratikbin <pratikbin+010101@no-reply-github.com>
Co-authored-by: Osho Emmanuel <oshoklinsmann@gmail.com>
Co-authored-by: Blas Rodriguez Irizar <rodrigblas@gmail.com>

go.mod

@@ -19,13 +19,17 @@ require (
 	github.com/prometheus/client_golang v1.12.2
 	github.com/spf13/cobra v1.5.0
 	github.com/spf13/viper v1.12.0
-	github.com/strangelove-ventures/lens v0.5.2-0.20220810214843-6af97ce869d8
+	github.com/strangelove-ventures/lens v0.5.2-0.20220822201013-1e7ffd450f20
 	github.com/stretchr/testify v1.8.0
 	github.com/tendermint/tendermint v0.34.21
 	go.uber.org/multierr v1.8.0
 	go.uber.org/zap v1.22.0
 	golang.org/x/sync v0.0.0-20220722155255-886fb9371eb4
 	golang.org/x/term v0.0.0-20220722155259-a9ba230a4035
+	go.uber.org/zap v1.22.0
+	golang.org/x/crypto v0.0.0-20220817201139-bc19a97f63c8
+	golang.org/x/sync v0.0.0-20220513210516-0976fa681c29
+	golang.org/x/term v0.0.0-20220526004731-065cf7ba2467
 	gopkg.in/yaml.v3 v3.0.1
 )