Skip to content

Initial version of zmq2kafka-streamer #12

@smorin

Description

@smorin

this is the scope of development for the kafka-streamer Sparkngin adapter:

  • Single ZeroMQ subscriber to start, configurable socket type response, pull
  • Kafka producer with single topic and multiple partition support (initially random partitioner)
  • Configuration file with "key = value" syntax.
  • Configuration update by SIGHUP signal.
  • Application log output to syslog
  • High performance C daemon
  • ZeroMQ publisher test script written in Python
  • Documentation for the applications
  • Well commented code
  • Build scripts
  • Detailed dependencies to install

Metadata

Metadata

Assignees

Labels

No labels
No labels

Type

No type

Projects

No projects

Relationships

None yet

Development

No branches or pull requests

Issue actions