Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Improved dry run and execution log for topics and schemas #411

Closed
wants to merge 51 commits into from

Conversation

purbon
Copy link
Collaborator

@purbon purbon commented Dec 9, 2021

take over from #383 to fix merge conflict.

Thanks again for all your contributions @akselh and @sverrehu !! all your help is very much appreciated.

close #295

akselh and others added 30 commits June 17, 2021 13:56
Split SyncTopicAction into separate actions for the different parts: create topic, update config and update schema reg
Create a topic config update plan for the UpdateTopicConfigAction. And let the adminClient only update according to the plan.
Rename methods and ManagerOfThings
Log details on the actual topic config changes that will be done. Also fixed logic for detecting new configs added.
Test logic for detecting new, updated and removed topic configs.
…e design around TopologyAclBinding builders, the Action concept and managers for adding actions to the ExecutionPlan.
akselh and others added 21 commits November 9, 2021 13:32
…aised (#386)

* ammend wrong state initialization in the kafka backend

* terminate jvm if there is an execution
… the reverse of the creation (#392)

* in ksql artefact manager, compile the list of artefacts to be orders in reverse order as sorted before this way tables will go first and then streams

* add sample example test for ksql create and delete with dependencies
* use julie.instance.id  in case group.id is not defined for the kafka backend

* make default variable as consumer group id for kafka backend consumer, by default named julieops, if not it can be configured via property file or env var

* ammend kafka tests, not to use same group.id, so consumption is done back from beginiing
)

* feat: add exactly-once to kstreams and create transactionalid permissions

* reformat

* refactor: initialize eos
…corrupted. (#396)

* strengh the kafka backend resilence model

* add example props for kafka as backend

* add call to create julieops internal topic

* update simplified topology file

* add kafka config topic as defult internal topic if using kafka backend

* Revert "add kafka config topic as defult internal topic if using kafka backend"

This reverts commit 2f84410.

* ammend tests
…e type) (#398)

* fix delete problem on resource used from the rbac api

* ammend localization of the resourceType capitalization as not all rbac resources follow this pattern
ammend criteria for time fix in kafka backend consumer
* Resolve #25: Quotas implementation, only quotas based in user principal

* Add doc usage of quotas

Co-authored-by: Pere Urbón <purbon@users.noreply.github.com>
Co-authored-by: Marcos Martinez Cedillo <marcos.martinez@orangebank.es>
@purbon purbon closed this Dec 9, 2021
@purbon purbon deleted the akselh-execution_log_improvements_2 branch December 9, 2021 11:14
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Improve output for topic changes on dryRun and apply
5 participants