This repo was our playground for experiments that lead to e.g. https://openreview.net/forum?id=0ku2hIm4BS
The code is very messy. If you want to reproduce our results / check the code we recommend looking at: https://github.com/Butanium/llm-lang-agnostic