Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

chore(recordings): don't DLQ on PostgreSQL errors #14438

Merged
merged 1 commit into from
Feb 28, 2023

Conversation

hazzadous
Copy link
Contributor

@hazzadous hazzadous commented Feb 28, 2023

The lookup for fetchTeam and getTeamByToken shouldn't fail in a
non-retriable way. Maybe there is something where team_id or token isn't
valid 🤔 but that's a issue to solve with some schema
validation.

Instead we let the error bubble up to KafkaJS which will then not commit offsets
and rather perform an exponential backoff. This is key for e.g. migrating for a new
PG without needing to first bring down the recordings ingester.

Problem

Changes

👉 Stay up-to-date with PostHog coding conventions for a smoother review.

How did you test this code?

The lookup for `fetchTeam` and `getTeamByToken` shouldn't fail in a
non-retriable way. Maybe there is something where team_id or token isn't
valid 🤔 but that's a issue to solve with some schema
validation.
@hazzadous hazzadous requested a review from a team February 28, 2023 10:59
@hazzadous hazzadous enabled auto-merge (squash) February 28, 2023 10:59
@hazzadous hazzadous merged commit 3b170cc into master Feb 28, 2023
@hazzadous hazzadous deleted the chore/no-dlq-on-postgresql-errors branch February 28, 2023 11:07
fuziontech added a commit that referenced this pull request Feb 28, 2023
* master: (53 commits)
  fix: cut the undeterministic snapshots (#14461)
  feat(hogql): Events table based on hogql (#14315)
  fix(breakdown): ensure breakdown sort can sort through values of different types (#14459)
  feat(capture): gracefully catch non-string tokens (#14453)
  chore(plugin-server): add healthcheck logging for failure (#14455)
  fix(tests): Safer migrations (#14452)
  revert: "fix(person-overrides): add constraints to catch race conditions" (#14445)
  dev(codespaces): update to python3.10 (#14449)
  chore(deps): Update posthog-js to 1.50.0 (#14448)
  feat(capture): support LIGHTWEIGHT_CAPTURE_ENDPOINT_ENABLED_TOKENS=* (#14421)
  chore: upgrade d3 (#14442)
  fix(person-overrides): add constraints to catch race conditions (#14277)
  feat(cohorts): Remove postgres calculations for flags (#14272)
  feat(capture): check token shape before team resolution too (#14439)
  feat: dashboard templates (#14322)
  feat: add a 'What's New?' button to the dropdown (#14379)
  chore(recordings): don't DLQ on PostgreSQL errors (#14438)
  chore: update autocapture attribute capture (#14435)
  chore(recordings): remove hub dependency on recordings ingestion (#14418)
  chore(deps): Update posthog-js to 1.49.0 (#14436)
  ...
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant