Create a minimal Redis cluster (locally three master nodes on a single machine) completely follow the Redis tutorial. When trying to insert 1.3 billion key-values (about 576 bytes per key-value) into the redis cluster, it will crash.
Since we are simulating the redis cluster based on a single node and each virtual node has the turn on append-only mode, it may crash due to the problem of creating many incremental files in case of repeated failures and retries of an AOF rewrite. Not sure if this is a bug of Redis or an unreasonable cluster configuration.
Crash report
Paste the complete crash log between the quotes below. Please include a few lines from the log preceding the crash report to provide some context.
Additional information
- OS distribution and version Ubuntu 20.04.4 LTS, two AMDEPYC 7742 CPUs, 2TB of CPU memory
Comment From: oranagra
@yingcanw please post the crash report from the log. since you mention incremental files, i assume you're using redis 7.0?
Comment From: xtxxtxxtx
Would like to ask why the cluster configuration mode is so configured? And have any other configuration patterns been tested?