Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Flush not complete #1464

Open
avolon42x opened this issue May 19, 2024 · 6 comments
Open

Flush not complete #1464

avolon42x opened this issue May 19, 2024 · 6 comments
Assignees

Comments

@avolon42x
Copy link

I saw this error in my relayer and it keeps coming back:

Flush not complete {"error": "failed to enqueue pending messages for flush: no ibc messages found for write_acknowledgement query: write_acknowledgement.packet_dst_channel='channel-13' AND write_acknowledgement.packet_sequence='58128'"}

rly tx flush does not seems to resolve the problem. Any ideas?

@Reecepbcups
Copy link
Member

Hey @avolon42x did you get this resolved? It's possible that packet was already relayed or the packet was never created properly. Can you confirm if this was the case?

(it's also possible you have a relay max size limit set, and thus packets of select size are not relayed)

@avolon42x
Copy link
Author

Hey @Reecepbcups - no haven't solved it yet. I think it must have been something like not being created properly. Any other way to clear/flush this channel?

@Reecepbcups
Copy link
Member

@avolon42x There is a new rly tx flush --stuck-packet-height-start flag which helps to get previous heights and push stuck packets. Mess with this and see if it can be pushed through

@avolon42x
Copy link
Author

I tried several heights and ranges with the start and end-flag but it's still not going through.. What else is possible?

@agouin
Copy link
Member

agouin commented Sep 3, 2024

I believe this is due to the relayer trying to flush out old packets that were previously filtered (e.g. the IBC spam packets). Once the height that contains the packet commitment is pruned from IAVL on the node that rly is connected to, rly cannot query it anymore and the flush will get stuck like this.

This is both a relayer level issue and a chain level issue, because if all relayers are configured to ignore certain packets, then the chain should probably also remove them from state with an upgrade migration.

@TheMarstonConnell
Copy link
Contributor

Dealing with this same thing now, any fix?

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

5 participants