Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Reduce schema registry calls by using cached calls #189

Merged
merged 4 commits into from
Apr 9, 2021

Conversation

alok87
Copy link
Contributor

@alok87 alok87 commented Apr 8, 2021

Add support to use cached calls instead of making latest calls for the KEY schema of the topic
Batcher does compute the id of the key
Passes it to the loader via the loader kafka job
Loader now retrives the job by ID which is cached and no longer there is a need to query registry everytime

This will reduce the schema registry calls

Fixes #182
Hides #187

Add support to use cached calls instead of making latest calls for the KEY schema of the topic
Batcher does compute the id of the key
Passes it to the loader via the loader kafka job
Loader now retrives the job by ID which is cached and no longer there is a need to query kafka everytime

This will reduce the schema registry calls
@alok87
Copy link
Contributor Author

alok87 commented Apr 9, 2021

Tested OK

@alok87 alok87 merged commit a4838c6 into master Apr 9, 2021
@alok87 alok87 deleted the reduce-schema-registry-call-loader branch May 31, 2021 07:21
alok87 added a commit that referenced this pull request Jun 5, 2021
Reduce schema registry calls by using cached calls
alok87 added a commit that referenced this pull request Jun 7, 2021
Reduce schema registry calls by using cached calls
alok87 added a commit that referenced this pull request Jun 17, 2021
Reduce schema registry calls by using cached calls
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

Context deadline exceeded: i/o timeout in talking to schema registry
1 participant