I am trying to write a service that will subscribe to some external streaming data source, and publish that data in RabbitMQ. I already wrote an Entrypoint class that subscribes to the external data source and triggers an event for each incoming message, so all the service class does is publish this message to Rabbit.
This all works fine.
However, in the next phase, this will be a LOT of data, far too much for one instance of the service to handle. I was thinking of spinning up many instances of the service, and [somehow] indicate to each instance which subset of external data it should listen to and publish. (Identifying the subsets of data is easy, and can be identified by a simple string). I was thinking perhaps a command line param could be passed to the service when starting up, but I don’t know if/how that can be done.
Do you have any suggestions? Thanks very much in advance.