Skip to content

Header serialization exception in aggregator processor with Redis #500

@CEDDM

Description

@CEDDM

When I configure my aggregator with Redis to cache JSON messages, I get a serialization exception because the object does not implement Serializable. This is an known problem with Redis default serializer (JdkSerializationRedisSerializer).

The problem is we don't have a real Java object when the aggregator is used in SCDF (the messages come from Kafka or RabbitMQ)
The recommanded workaround I found is to use GenericJackson2JsonRedisSerializer but there is no way to do this without forking the aggregator (see the answer of @artembilan here : https://stackoverflow.com/questions/77088203/redis-serializer-properties-in-scdf).

It would be great to add a property to set the Redis serializer in the app configuration.

EDIT : According to @artembilan analysis, the problem comes from headers not the payload so the description above is wrong. Some headers must be filtered if not serializable

Metadata

Metadata

Assignees

No one assigned

    Labels

    bugSomething isn't working

    Type

    No type

    Projects

    No projects

    Milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions