initial GitHubApp for Hydros AI

[jlewi]

GitHub App

Check in rudimentary code to run Hydros as a GitHub App. Until now Hydros primarily ran as a periodic reconciler on Kubernetes. It was configured via a ConfigMap that mounted in the ManifestSync objects.

We want to combine the advantages of reconcilers with GitHub Apps. Notably,

• Respond to GitHub events via push notifications to allow faster response times
• Pull GitHubApp configuration directly from the repository so that users can update their configuration just by pushing changes to their repository
• Better surfacing of information in GitHub via CheckRuns

To support this

• Create a simple webserver that can respond to GitHub webhooks
• Use Palantir tools for reading app configurations and dispatching events

Miscellaneous changes

• Add a helper function to RepoHelper to detect if there are changes to be committed.
• Introduce Manager && Reconciler interface
  • These are basically mimicing Kubernetes controller infrastructure in an effort to wrap reconciler in an event queue
  • This is pretty rudimentary at this point and probably needs a lot of changes before it works well
• Update the Dispatcher to avoid trying to filter out overlay directories

Follow On Issues

• The information displayed in the checks could be significantly more informative
  • Cloud Logging Links would be superhelpful
• Support GitOps.Syncer
• Properly implement level based semantics ; e.g. retry failed runs automatically if none permanent error

Update containerization

• Docker image, Google Cloud Build workflow, and Kubernetes manifests for deploying Hydros
• Switch the docker image to use Chainguard's minimal image. This wasn't what we were doing at Primer. Notably the Syncer shells out to a bunch of tools (e.g. Git) which require libc and other dependencies
  • In order to get them to run inside the Docker container we will probably want to update the code to use GoGit