Errors When Reading From Kafka Topics

Support/help with CloverETL (4.9) and CloverDX (5.0 or newer) implementation problems

Bea95
Posts: 6
Joined: Mon Mar 15, 2021 4:44 pm

Errors When Reading From Kafka Topics

Postby Bea95 » Fri May 14, 2021 10:14 am

Hi there,


I have been trying to use both the Kafka event listener in the server and the Kafka reader in the designer to read from some Kafka topics. It works well for reading from some of the topics but for others I get errors like this

Received exception when fetching the next record from <Kafka-Topic>. If needed, please seek past the record to continue consumption.
Could not initialize class org.apache.kafka.common.record.CompressionType$SnappyConstructors

I have tried deserialising it as bytes as well as a string type but still get the same error. I have also gotten a similar error for another topic

Received exception when fetching the next record from <Kafka-Topic>. If needed, please seek past the record to continue consumption.
Could not initialize class org.xerial.snappy.SnappyInputStream

I'm not sure what is causing the errors for some topics and not other so any help would be appreciated

Thank you!

cholastal
Posts: 142
Joined: Tue Sep 01, 2015 1:22 pm

Re: Errors When Reading From Kafka Topics

Postby cholastal » Tue Jun 01, 2021 12:21 pm

Hi Bea95,

As discussed via direct email communication, the issue is caused by a bug that affects the Snappy-compressed topics reading. Unfortunately, there is currently no other way to work around this issue but to switch the topic compression to gzip. This bug is going to be fixed in version 5.11.

Best regards.

---
Lukas Cholasta
CloverCARE Support
CloverDX

Visit us online at http://www.cloverdx.com


cron