Redis SADD doesn't work with size of passed items larger than 1024*1024

Hello,

In my project I'm using SADD command where I'm passing more than 1048576 (1024 *1024) elements Unfortunately, all clients (written in Python, Java, C#) fail when I run the mentioned command due to some query limit restriction on Redis side. First, I thought that I could fix this issue by increasing default values of client-query-buffer-limit and proto-max-bulk-len properties. But it didn't help.

It's appeared that failure was caused by the limitation hardcoded in Redis source code that you can find right here: https://github.com/antirez/redis/blob/unstable/src/networking.c#L1294

Can someone please explain why it was done in this way? Why do we have this limit 1024*1024 for multibulk operations (e.g.sadd) ? Does it make sense to make this parameter configurable?

Thanks! - Roman

Comment From: aksonlyaks

If this is resolved? I'm facing similar issue. trying to write 100000 elements but redis can only write 6774.

Thanks