Kafka Connect

Standalone 
bin/connect-standalone worker.properties connector1.properties connector2.properties ...

Converters

• AVRO: http://debezium.io/blog/2016/09/19/Serializing-Debezium-events-with-Avro
• LongConverter: https://github.com/2gis/kafka-connect-hdfs-ext/blob/master/src/main/java/ru/dgis/casino/plain/LongConverter.java

Connectors
http://www.landoop.com/kafka/connectors/

Tasks
A single call to "put" may include messages from different topics.

"flush" is invoked periodically (offset.flush.interval.ms).
Both put and flush may be invoked with zero messages.

Custom connector
https://github.com/mcandre/hello-kafka-connect