Federated queues

googlegroup
1

Hi
We want to use federated queues on some of our services.
Does nameko support federated queues?
If so, is anything need to be configured?

Thanks,
Tsachi

2

We make extensive use of federation at Student.com.

It's completely configured within RabbitMQ -- Nameko has no knowledge of
federation and treats federated queues (and exchanges) exactly as it does
the "normal" varieties.

···

On Thursday, September 8, 2016 at 1:17:55 PM UTC+1, tsachi...@gmail.com wrote:

Hi
We want to use federated queues on some of our services.
Does nameko support federated queues?
If so, is anything need to be configured?

Thanks,
Tsachi

3

Thanks Matt,

I was mainly worried about the following comment in RabbitMQ's docs:
basic.get cannot retrieve messages over federation if there aren't any in a
local queue

By the way, are you using a rabbit cluster (not HA) behind ELB?
I am also worried that there may be problems with the request-response
cycle due to ELB switching to another node for the reply phase, making the
client wait for response at the wrong node.
Is this scenario valid?

thanks again
T.

···

On Thursday, September 8, 2016 at 5:01:01 PM UTC+3, Matt Yule-Bennett wrote:

We make extensive use of federation at Student.com.

It's completely configured within RabbitMQ -- Nameko has no knowledge of
federation and treats federated queues (and exchanges) exactly as it does
the "normal" varieties.

On Thursday, September 8, 2016 at 1:17:55 PM UTC+1, tsachi...@gmail.com > wrote:

Hi
We want to use federated queues on some of our services.
Does nameko support federated queues?
If so, is anything need to be configured?

Thanks,
Tsachi

4

Thanks Matt,

I was mainly worried about the following comment in RabbitMQ's docs:
basic.get cannot retrieve messages over federation if there aren't any in
a local queue

This is describing the way queue federation works. It's saying that
consuming from an empty federated queue will not block while messages are
fetched from upstream queues, i.e. that the consumption process and the
federation process are independent.

By the way, are you using a rabbit cluster (not HA) behind ELB?
I am also worried that there may be problems with the request-response
cycle due to ELB switching to another node for the reply phase, making the
client wait for response at the wrong node.
Is this scenario valid?

We are using a cluster behind ELB. You can publish and consume from any
node in the cluster, so it doesn't matter if the load-balancer splits
requests and responses between different nodes.

···

On Thursday, September 8, 2016 at 3:08:51 PM UTC+1, tsachi...@gmail.com wrote:

thanks again
T.

On Thursday, September 8, 2016 at 5:01:01 PM UTC+3, Matt Yule-Bennett > wrote:

We make extensive use of federation at Student.com.

It's completely configured within RabbitMQ -- Nameko has no knowledge of
federation and treats federated queues (and exchanges) exactly as it does
the "normal" varieties.

On Thursday, September 8, 2016 at 1:17:55 PM UTC+1, tsachi...@gmail.com >> wrote:

Hi
We want to use federated queues on some of our services.
Does nameko support federated queues?
If so, is anything need to be configured?

Thanks,
Tsachi

5

Thanks again.

Are you using an autoscale feature?
If so, how is it configured?
We have a service that is expected to grow.
We want the load balancer to spin a new machine whenever the rabbit node with that service queue is stressed, and make the queue in the new machine an upstream to the federated queue.
Can this be done script-ally?

6

We're not doing this yet, although I expect we will at some point in the not-too-distant future.

I don't think it'd be too hard as long as you can for start a process on the new box. The nameko service should start running and pick up messages without any fuss.