Thread number in queue listener keeps increasing when using two different RqueueListener "concurrency" properties on two different queues.

[sravindran2020]

Hi there,

I have a situation wherein I have two different queues, and I am attempting to set different concurrent thread counts for them via two different properties. Example below.

 @RqueueListener(value = "Queue1", concurrency = "${property1}")
public void method1();

 @RqueueListener(value = "Queue2", concurrency = "${property2}")
public void method2();

I set "property1" to 5, and "property2" to 7

In this situation, I noticed that thread number in the "QueueListener" keeps increasing on successive attempts to queue new messages. For example, in the logs I see this.

2022-03-02 23:54:20.490 DEBUG 1 --- [QueueListener-1] c.t.d.p.l.i.RqueueProcessorQueueListener 
........
.......

2022-03-02 23:54:20.490 DEBUG 1 --- [QueueListener-7] c.t.d.p.l.i.RqueueProcessorQueueListener

2022-03-02 23:54:20.490 DEBUG 1 --- [QueueListener-8] c.t.d.p.l.i.RqueueProcessorQueueListener 

2022-03-02 23:54:20.490 DEBUG 1 --- [QueueListener-9] c.t.d.p.l.i.RqueueProcessorQueueListener 

2022-03-02 23:54:20.490 DEBUG 1 --- [QueueListener-10] c.t.d.p.l.i.RqueueProcessorQueueListener
........... 

If I just have one property, and set it to say 5 or 7 for example. The thread number only goes from 1 to 5 (or 1 to 7). Could this be an issue if we try to employ different concurrent thread counts for different queues in the same micro service?

[sonus21]

What;s the concurrency value?

[sravindran2020]

I will try the latest version out based on your suggestion from the other discussion. The concurrency is just "7"

[sonus21]

ok, this is likely some bug in the older version. I do remember there's an issue in this area and that's been fixed now.

[sravindran2020]

We attempted to use the latest version of rqueue like you suggested (2.10.1), but we still see the issue with the thread number increasing beyond the max concurrency value (in our case, 5).

2022-03-16 17:24:31.806 DEBUG 1 --- [QueueListener-8] c.t.d.p.l.i.RqueueProcessorQueueListener
2022-03-16 17:24:31.836 DEBUG 1 --- [ueueListener-10] c.t.d.p.l.i.RqueueProcessorQueueListener

[sonus21]

can you share your sample app? Or can you produce this with example app in this repo?

[sonus21]

I feel there's something wrong with the config.

[sonus21]

rqueue/rqueue-core/src/main/java/com/github/sonus21/rqueue/listener/RqueueMessageListenerContainer.java

Line 367 in 6a775f3

AsyncTaskExecutor executor = createTaskExecutor(queueDetail, corePoolSize, maxPoolSize);

Add a debugger at this line and share the number it's using for maxPoolSize

Also add a debugger here

rqueue/rqueue-core/src/main/java/com/github/sonus21/rqueue/utils/ThreadUtils.java

Line 47 in 6a775f3

public static ThreadPoolTaskExecutor createTaskExecutor(

This method is supposed to create ThreadPoolExecutor of the said size,