In the meantime, check out our paper "On the Markov Property of Neural Algorithmic Reasoning: Analyses and Methods".
To cite our paper:
@article{bohde2024markov,
title={On the Markov Property of Neural Algorithmic Reasoning: Analyses and Methods},
author={Montgomery Bohde and Meng Liu and Alexandra Saxton and Shuiwang Ji},
journal={The Twelfth International Conference on Learning Representations},
year={2024},
url={https://openreview.net/forum?id=Kn7tWhuetn}
}