Skip to content
This repository has been archived by the owner on Jan 19, 2022. It is now read-only.

Is there a way to increase the no of listener threads for a queue? #497

Open
ranjitaneesh opened this issue Oct 9, 2019 · 4 comments
Open
Labels
component: sqs SQS integration related issue status: waiting-for-triage An issue we've not yet triaged

Comments

@ranjitaneesh
Copy link

ranjitaneesh commented Oct 9, 2019

Question

I wanted to know if there is a way to increase the no of listener threads that are listening for messages in the queue.
I see that we can configure the no of worker threads that process the messages but my question is specifically for the listener threads.
I stumbled at this question while doing some performance tests in my system where I use a single instance annotated with @SQSListenter, i observed that even if I increase the no of core pool size to 20 or more, there are only only 10 messages in flight at max on the SQS Queue.
This brought me to the question of whether there is only a single listener thread which is retrieving messages from the SQS queue and how do I increase it.

@spring-projects-issues spring-projects-issues added the status: waiting-for-triage An issue we've not yet triaged label Oct 9, 2019
@RaymondHsu
Copy link

Our team run into the same issue and ended up with overwriting the SimpleMessageListenerContainer class to read multiple times (configurable) of 10 messages to increase the throughput. This is totally wrong way to use framework. I am currently looking for alternative framework. See my question in stackoverflow. I strongly suggest spring-cloud-aws developers to rewrite the SimpleMessageListenerContainer.java class

@lwis
Copy link

lwis commented May 13, 2020

Has any progress been made on this limitation? High throughput applications that wish to fully utilise hardware currently require a custom solution to achieve full utilisation.

@maciejwalkowiak maciejwalkowiak added the component: sqs SQS integration related issue label May 29, 2020
@douglasmanzelmann
Copy link

There is a PR open to allow for individual listeners determine their max concurrency which mirrors what spring-amqp does. #380

@kmalali
Copy link

kmalali commented Aug 17, 2020

what is the targetted date for releasing functionality-"increase the no of listener threads for a queue"?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
component: sqs SQS integration related issue status: waiting-for-triage An issue we've not yet triaged
Development

No branches or pull requests

7 participants