it appears that the error only comes when i increase the number of
consumers. It seems to work fine with around 100 consumers but as soon as i
bump it up at about 150 consumers all hell breaks lose with error such as
below

"Commit cannot be completed due to group rebalance"
"Failed to retain connection due to No current assignment for partition
TEST_KAFKA_TOPIC: "

Quite strangely the consumers start consuming messages that have already
been read before. I cant wrap me head around why that is happening.
Can someone point to the right direction here? I tried wild carding all the
topics in one consumer but then it becomes very slow. All the consumers are
running on the primary node with single concurrent tasks .

On Mon, Jun 11, 2018 at 11:17 AM Joe Witt <[EMAIL PROTECTED]> wrote: