In our experiment around 9 months ago, for a topic with certain number of partitions , when we created a Sink connector using Benthos - the number of consumer threads spawned exceeded the number of partitions of the topic and operation wise it was sluggish and slow waiting for very very long for a very simple sink operation
In our experiment around 9 months ago, for a topic with certain number of partitions , when we created a Sink connector using Benthos - the number of consumer threads spawned exceeded the number of partitions of the topic and operation wise it was sluggish and slow waiting for very very long for a very simple sink operation
Very interesting! Would you mind sharing any specific details?
I love the benthos project, it's fast (thanks to Go) and well written. This drama though...