Notice! - If a Redis module was involved, please open an issue in the module's repo instead! - If you're using docker on Apple M1, please make sure the image you're using was compiled for ARM!
Crash report
Paste the complete crash log between the quotes below. Please include a few lines from the log preceding the crash report to provide some context.
=== REDIS BUG REPORT START: Cut & paste starting from here ===
773381:C 04 Dec 14:09:26.232 # === ASSERTION FAILED ===
773381:C 04 Dec 14:09:26.232 # ==> ziplist.c:411 'NULL' is not true
773381:C 04 Dec 14:09:26.232 # (forcing SIGSEGV to print the bug report.)
773381:C 04 Dec 14:09:26.232 # Redis 3.2.11 crashed by signal: 11
773381:C 04 Dec 14:09:26.232 # Crashed running the instuction at: 0x458a3f
773381:C 04 Dec 14:09:26.232 # Accessing address: 0xffffffffffffffff
773381:C 04 Dec 14:09:26.232 # Failed assertion: NULL (ziplist.c:411)
------ STACK TRACE ------
EIP:
redis-aof-rewrite 127.0.0.1:7003 [cluster](_serverAssert+0x6f)[0x458a3f]
Backtrace:
redis-aof-rewrite 127.0.0.1:7003 [cluster](logStackTrace+0x3c)[0x458f6c]
redis-aof-rewrite 127.0.0.1:7003 [cluster](sigsegvHandler+0xa3)[0x459e53]
/lib64/libpthread.so.0(+0x12ce0)[0x7f94d1461ce0]
redis-aof-rewrite 127.0.0.1:7003 [cluster](_serverAssert+0x6f)[0x458a3f]
redis-aof-rewrite 127.0.0.1:7003 [cluster](zipLoadInteger+0xaf)[0x42d59f]
redis-aof-rewrite 127.0.0.1:7003 [cluster](ziplistGet+0x72)[0x42d7b2]
redis-aof-rewrite 127.0.0.1:7003 [cluster](quicklistNext+0x1ec)[0x41b10c]
redis-aof-rewrite 127.0.0.1:7003 [cluster](rewriteListObject+0x8a)[0x45579a]
redis-aof-rewrite 127.0.0.1:7003 [cluster](rewriteAppendOnlyFile+0x4ab)[0x4568cb]
redis-aof-rewrite 127.0.0.1:7003 [cluster](rewriteAppendOnlyFileBackground+0x99)[0x456d59]
redis-aof-rewrite 127.0.0.1:7003 [cluster](serverCron+0x62c)[0x4251ac]
redis-aof-rewrite 127.0.0.1:7003 [cluster](aeProcessEvents+0x2ad)[0x41c66d]
redis-aof-rewrite 127.0.0.1:7003 [cluster](aeMain+0x2b)[0x41c7fb]
redis-aof-rewrite 127.0.0.1:7003 [cluster](main+0x370)[0x423fc0]
/lib64/libc.so.6(__libc_start_main+0xf3)[0x7f94d10c4cf3]
redis-aof-rewrite 127.0.0.1:7003 [cluster][0x419cc9]
------ INFO OUTPUT ------
# Server
redis_version:3.2.11
redis_git_sha1:00000000
redis_git_dirty:0
redis_build_id:45bc887e70d4272b
redis_mode:cluster
os:Linux 4.18.0-372.9.1.el8.x86_64 x86_64
arch_bits:64
multiplexing_api:epoll
gcc_version:4.4.7
process_id:773381
run_id:24d5d99c7dda101049c3395cd8aa41a53ba432ed
tcp_port:7003
uptime_in_seconds:1366420
uptime_in_days:15
hz:10
lru_clock:9189782
executable:/root/redis_env/redis-3.2.11/cluster-3.2.11/nodes-7003/redis-server
config_file:/root/redis_env/redis-3.2.11/cluster-3.2.11/nodes-7003/7003.conf
# Clients
connected_clients:5
client_longest_output_list:0
client_biggest_input_buf:0
blocked_clients:0
# Memory
used_memory:51970160
used_memory_human:49.56M
used_memory_rss:63074304
used_memory_rss_human:60.15M
used_memory_peak:64703824
used_memory_peak_human:61.71M
total_system_memory:67122069504
total_system_memory_human:62.51G
used_memory_lua:37888
used_memory_lua_human:37.00K
maxmemory:0
maxmemory_human:0B
maxmemory_policy:noeviction
mem_fragmentation_ratio:1.21
mem_allocator:jemalloc-4.0.3
# Persistence
loading:0
rdb_changes_since_last_save:6478
rdb_bgsave_in_progress:0
rdb_last_save_time:1670134161
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:0
rdb_current_bgsave_time_sec:-1
aof_enabled:1
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:1
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:err
aof_last_write_status:ok
aof_current_size:68468039
aof_base_size:29463886
aof_pending_rewrite:0
aof_buffer_length:0
aof_rewrite_buffer_length:0
aof_pending_bio_fsync:0
aof_delayed_fsync:0
# Stats
total_connections_received:5
total_commands_processed:2288194362
instantaneous_ops_per_sec:6300
total_net_input_bytes:121839443060
total_net_output_bytes:272399553
instantaneous_input_kbps:200.32
instantaneous_output_kbps:31.27
rejected_connections:0
sync_full:0
sync_partial_ok:0
sync_partial_err:0
expired_keys:0
evicted_keys:0
keyspace_hits:22278
keyspace_misses:18
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:232
migrate_cached_sockets:0
# Replication
role:master
connected_slaves:0
master_repl_offset:0
repl_backlog_active:0
repl_backlog_size:1048576
repl_backlog_first_byte_offset:0
repl_backlog_histlen:0
# CPU
used_cpu_sys:0.00
used_cpu_user:0.02
used_cpu_sys_children:0.00
used_cpu_user_children:0.00
# Commandstats
cmdstat_get:calls=6938,usec=5949,usec_per_call=0.86
cmdstat_set:calls=2219719840,usec=915921774,usec_per_call=0.41
cmdstat_del:calls=523832,usec=8805702,usec_per_call=16.81
cmdstat_exists:calls=17280,usec=9825,usec_per_call=0.57
cmdstat_rpush:calls=27046697,usec=66936701,usec_per_call=2.47
cmdstat_lpop:calls=40012597,usec=36627555,usec_per_call=0.92
cmdstat_llen:calls=14210,usec=12031,usec_per_call=0.85
cmdstat_lrange:calls=1148,usec=163029,usec_per_call=142.01
cmdstat_lrem:calls=715646,usec=51298969,usec_per_call=71.68
cmdstat_select:calls=1,usec=0,usec_per_call=0.00
cmdstat_ping:calls=136173,usec=23091,usec_per_call=0.17
# Cluster
cluster_enabled:1
# Keyspace
db0:keys=119620,expires=0,avg_ttl=0
hash_init_value: 1668881831
------ CLIENT LIST OUTPUT ------
id=3 addr=127.0.0.1:34696 fd=9 name= age=3939 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=lrem
id=4 addr=127.0.0.1:34702 fd=12 name= age=3939 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=lpop
id=5 addr=127.0.0.1:34708 fd=15 name= age=3939 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=rpush
id=6 addr=127.0.0.1:34714 fd=17 name= age=3938 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=set
id=7 addr=127.0.0.1:34720 fd=18 name= age=3938 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
------ REGISTERS ------
773381:C 04 Dec 14:09:26.233 #
RAX:0000000000000000 RBX:000000000000019b
RCX:0000000001877010 RDX:0000000000000000
RDI:00000000018799d0 RSI:0000000000000001
RBP:00000000004e5080 RSP:00007ffd61666ce0
R8 :000000000187704a R9 :0000000000000000
R10:0000000000000000 R11:0000000000000206
R12:00000000004e5617 R13:00007ffd61666dd8
R14:000000000042d1d0 R15:0000000000000000
RIP:0000000000458a3f EFL:0000000000010202
CSGSFS:002b000000000033
773381:C 04 Dec 14:09:26.233 # (00007ffd61666cef) -> 0000000000000001
773381:C 04 Dec 14:09:26.233 # (00007ffd61666cee) -> 00007ffd61666db0
773381:C 04 Dec 14:09:26.233 # (00007ffd61666ced) -> 00007f94c09f8620
773381:C 04 Dec 14:09:26.233 # (00007ffd61666cec) -> 00007ffd61666f60
773381:C 04 Dec 14:09:26.233 # (00007ffd61666ceb) -> 00007f94bf8dc22e
773381:C 04 Dec 14:09:26.233 # (00007ffd61666cea) -> 000000e400000002
773381:C 04 Dec 14:09:26.233 # (00007ffd61666ce9) -> 0000000000000001
773381:C 04 Dec 14:09:26.233 # (00007ffd61666ce8) -> 0000002800000001
773381:C 04 Dec 14:09:26.233 # (00007ffd61666ce7) -> 000000000042d7b2
773381:C 04 Dec 14:09:26.233 # (00007ffd61666ce6) -> 0000000000000002
773381:C 04 Dec 14:09:26.233 # (00007ffd61666ce5) -> 00007ffd61666f60
773381:C 04 Dec 14:09:26.233 # (00007ffd61666ce4) -> 0000000000000002
773381:C 04 Dec 14:09:26.233 # (00007ffd61666ce3) -> 000000000042d59f
773381:C 04 Dec 14:09:26.233 # (00007ffd61666ce2) -> 00007ffd61666dd0
773381:C 04 Dec 14:09:26.233 # (00007ffd61666ce1) -> 00007ffd61666dc8
773381:C 04 Dec 14:09:26.233 # (00007ffd61666ce0) -> 00007f94bf8dc22e
------ FAST MEMORY TEST ------
*** Preparing to test memory region 725000 (94208 bytes)
*** Preparing to test memory region 1877000 (135168 bytes)
*** Preparing to test memory region 7f94be400000 (62914560 bytes)
*** Preparing to test memory region 7f94c21ff000 (10485760 bytes)
*** Preparing to test memory region 7f94c2c00000 (16777216 bytes)
*** Preparing to test memory region 7f94c3c00000 (2097152 bytes)
*** Preparing to test memory region 7f94d0e00000 (2097152 bytes)
*** Preparing to test memory region 7f94d144b000 (16384 bytes)
*** Preparing to test memory region 7f94d166b000 (16384 bytes)
*** Preparing to test memory region 7f94d1e11000 (16384 bytes)
.O.O.O.O.O.O.O.O.O.O
Fast memory test PASSED, however your memory can still be broken. Please run a memory test for several hours if possible.
------ DUMPING CODE AROUND EIP ------
Symbol: _serverAssert (base: 0x4589d0)
Module: redis-aof-rewrite 127.0.0.1:7003 [cluster] (base 0x400000)
$ xxd -r -p /tmp/dump.hex /tmp/dump.bin
$ objdump --adjust-vma=0x4589d0 -D -b binary -m i386:x86-64 /tmp/dump.bin
------
773381:C 04 Dec 14:09:26.485 # dump of function (hexdump of 239 bytes):
48895c24e848896c24f089d34c896424f84883ec184989fc4889f5e810ffffffbea5be4e00bf0300000031c0e84f9dfcff4d89e089d94889eabebebe4e00bf0300000031c0e8369dfcffbef8c44e00bf0300000031c04c8925fb1c2e0048892dfc1c2e00891dfe1c2e00e8119dfcffc60425ffffffff78488b1c24488b6c24084c8b6424104883c418c3660f1f44000048895c24d048896c24d84889fb4c896424e04c896c24e84c897424f04c897c24f84881ec680800004883fe040f86ae0000004889f54883ed040f84a1000000488d7c2410b90001000031c04531e44c8d7b054c8db42410080000f348abeb09
=== REDIS BUG REPORT END. Make sure to include from START to END. ===
OS:Linux version 4.18.0-372.9.1.el8.x86_64 Additional information
- OS distribution and version
- Steps to reproduce (if any)
Comment From: sundb
The Redis version(3.2.11) is too old that no longer being maintained. Perhaps you could consider upgrading to a new version, .e.g 6.x