Skip to content

Kafka synchronization library to consume all messages that specific broker is leader for.

License

Notifications You must be signed in to change notification settings

dvsekhvalnov/sync4kafka

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

sync4kafka

This is simple synchronization library that connects to single kafka broker and syncs all messages from all topics / partitions that broker is leader for into outbound go channel.

It keeps dynamically listen to broker metadata updates, picks up or drops re-assigned partitions, and keep consuming all relevant messages.

Primarily developed for https://github.com/dvsekhvalnov/k-ray and unlikely can be very useful outside of it.

Status

Experimental. Born from hackathon project. Not really follows any go best practices and patterns for channels.

About

Kafka synchronization library to consume all messages that specific broker is leader for.

Topics

Resources

License

Stars

Watchers

Forks

Languages