We're customizing docker through docker file, executing them in kubernetes, trying to ingest data from Kafka topics, followed by few transformations. We could receive data from kafka topics when no transformations applied. We're trying Kafka Single Message Tranforms referenced from Robin Moffatt's Youtube video ;list=PL5T99fPsK7pq7LiaaL-S6b7wQqzxyjgya&index=11
.adoc to filter specific data from topic but throws us below error
Error Message:
This class is abstract and cannot be created. Did you mean io.confluent.connect.transforms.Filter$Value, io.confluent.connect.transforms.Filter$Key?
Background:
We downloaded jar "connect-transforms-1.3.2.jar" from . We used Snowflake sink connector, executing in standalone mode
Code (file name where code accommodated is SF_connect.properties):
name=kafka_snowflake_prd
connector.class=com.snowflake.kafka.connector.SnowflakeSinkConnector
.............
key.converter=org.apache.kafka.connect.storage.StringConverter
value.converter=org.apache.kafka.connect.json.JsonConverter
transforms=filterdemo
transforms.filterdemo.type=io.confluent.connect.transforms.Filter.$Value
transforms.filterdemo.filter.condition=$.[*][?(@.after.service_sector == 'Government')]
transforms.filterdemo.filter.type=include
We could see plugins loaded (referenced in logs)
file:/opt/Kafka/libs/connect-transforms-1.3.2.jar io.confluent.connect.transforms.Filter$Value transformation undefined
classpath io.confluent.connect.transforms.Filter$Value transformation undefined
[2025-01-02 15:08:17,973] INFO Added plugin 'io.confluent.connect.transforms.Filter$Value' (org.apache.kafka.connect.runtime.isolation.DelegatingClassLoader:105)
But the caveat here is io.confluent.connect.transforms.Filter$Value is an abstract class in the jar file connect-transforms-1.3.2.jar, with no logic in it. @Robin Moffatt Please suggest on how to proceed