Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Unexpected drift reported for message.timestamp.before.max.ms, message.timestamp.after.max.ms settings #191

Open
nickdella opened this issue Apr 17, 2024 · 0 comments

Comments

@nickdella
Copy link

When running topicctl check, we're getting drift-related failures for two settings on a particular topic:

[2024-04-17 09:47:27]  INFO Check failed for topic <topic> (cluster=<cluster>, env=staging):
-----------------------------+----+----------------------------------------------------------------------------------------------------------------------------------
             NAME            | OK |                                                             DETAILS
-----------------------------+----+----------------------------------------------------------------------------------------------------------------------------------
  config correct             | ✓  |
  configs consistent         | ✓  |
  topic exists               | ✓  |
  config settings correct    | ✗  | 2 keys have different values between cluster and topic config: [message.timestamp.after.max.ms message.timestamp.before.max.ms]
  replication factor correct | ✓  |
  partition count correct    | ✓  |
  throttles clear            | ✓  |
  replicas in-sync           | ✓  |

Our topic configuration YAML does not explicitly configure these settings. From what I can tell, these happen to be fairly new settings introduced in Kafka 3.6 (Oct 2023). I noticed a similar issue in the Confluent Terraform provider. Perhaps these settings need to be added to topicctl?

Additional details:

confluent kafka topic describe reports the following values for these settings (these are the defaults):

message.timestamp.after.max.ms 9223372036854775807
message.timestamp.before.max.ms 9223372036854775807

When running apply, I see the following output:

[2024-04-17 10:32:52]  WARN Found 2 key(s) set in cluster but missing from config:
----------------------------------+----------------------
                KEY               |    CLUSTER VALUE
----------------------------------+----------------------
  message.timestamp.before.max.ms | 9223372036854775807
  message.timestamp.after.max.ms  | 9223372036854775807
----------------------------------+----------------------
These will be left as-is.

Running check after the apply results in the same output as above.

  • topicctl version: v1.16.1
  • Kafka version: 3.6 (Confluent Cloud)
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant