=== REDIS BUG REPORT START: Cut & paste starting from here ===
12822:M 22 Aug 2022 20:34:52.231 # Redis 6.2.7 crashed by signal: 7, si_code: 128
12822:M 22 Aug 2022 20:34:52.231 # Accessing address: (nil)
12822:M 22 Aug 2022 20:34:52.231 # Crashed running the instruction at: 0x434d06
------ STACK TRACE ------
EIP:
/usr/local/redis/bin/redis-server 10.13.79.31:7005 [cluster](dictRehash+0x76)[0x434d06]
Backtrace:
/lib64/libpthread.so.0(+0xf630)[0x7fcab61dd630]
/usr/local/redis/bin/redis-server 10.13.79.31:7005 [cluster](dictRehash+0x76)[0x434d06]
/usr/local/redis/bin/redis-server 10.13.79.31:7005 [cluster](dictRehashMilliseconds+0xbb)[0x43507b]
/usr/local/redis/bin/redis-server 10.13.79.31:7005 [cluster](incrementallyRehash+0x42)[0x4376e2]
/usr/local/redis/bin/redis-server 10.13.79.31:7005 [cluster](databasesCron+0xf9)[0x437db9]
/usr/local/redis/bin/redis-server 10.13.79.31:7005 [cluster](serverCron+0x12a)[0x43b27a]
/usr/local/redis/bin/redis-server 10.13.79.31:7005 [cluster](aeProcessEvents+0xf9)[0x433439]
/usr/local/redis/bin/redis-server 10.13.79.31:7005 [cluster](aeMain+0x1d)[0x43384d]
/usr/local/redis/bin/redis-server 10.13.79.31:7005 [cluster](main+0x311)[0x42ffb1]
/lib64/libc.so.6(__libc_start_main+0xf5)[0x7fcab5e22555]
/usr/local/redis/bin/redis-server 10.13.79.31:7005 [cluster][0x430479]
------ REGISTERS ------
12822:M 22 Aug 2022 20:34:52.232 #
RAX:00000000005e0a20 RBX:00007fcab5a0b480
RCX:00007fcaa6dafec0 RDX:00007fcaa6dafec0
RDI:f4b0847d2220d8ac RSI:3cf2a100eab45f55
RBP:657263227b014c48 RSP:00007ffe252b89d0
R8 :313a72755f636361 R9 :00007fca7f6aff79
R10:0000000000000007 R11:5e443d60c968575e
R12:0000000000000372 R13:000000000000000a
R14:657263227b014c48 R15:00000a177fc395a1
RIP:0000000000434d06 EFL:0000000000010206
CSGSFS:002b000000000033
12822:M 22 Aug 2022 20:34:52.232 # (00007ffe252b89df) -> 0000000000437db9
12822:M 22 Aug 2022 20:34:52.232 # (00007ffe252b89de) -> 0000000000000010
12822:M 22 Aug 2022 20:34:52.232 # (00007ffe252b89dd) -> 00000000004376e2
12822:M 22 Aug 2022 20:34:52.232 # (00007ffe252b89dc) -> 0000000000000001
12822:M 22 Aug 2022 20:34:52.232 # (00007ffe252b89db) -> 0000000000000001
12822:M 22 Aug 2022 20:34:52.232 # (00007ffe252b89da) -> 0000015bf5fdc54e
12822:M 22 Aug 2022 20:34:52.232 # (00007ffe252b89d9) -> 0000000000000010
12822:M 22 Aug 2022 20:34:52.232 # (00007ffe252b89d8) -> 0000000000000000
12822:M 22 Aug 2022 20:34:52.232 # (00007ffe252b89d7) -> 0000000000038839
12822:M 22 Aug 2022 20:34:52.232 # (00007ffe252b89d6) -> 00000000630377ec
12822:M 22 Aug 2022 20:34:52.232 # (00007ffe252b89d5) -> 000000000043507b
12822:M 22 Aug 2022 20:34:52.232 # (00007ffe252b89d4) -> 00000182c58c72c7
12822:M 22 Aug 2022 20:34:52.232 # (00007ffe252b89d3) -> 20c49ba5e353f7cf
12822:M 22 Aug 2022 20:34:52.232 # (00007ffe252b89d2) -> 000000000000012c
12822:M 22 Aug 2022 20:34:52.232 # (00007ffe252b89d1) -> 0000000000000001
12822:M 22 Aug 2022 20:34:52.232 # (00007ffe252b89d0) -> 00007fcab5a0b480
------ INFO OUTPUT ------
# Server
redis_version:6.2.7
redis_git_sha1:00000000
redis_git_dirty:0
redis_build_id:5ecc1bf14fa293cf
redis_mode:cluster
os:Linux 4.19.188-10.el7.ucloud.x86_64 x86_64
arch_bits:64
monotonic_clock:POSIX clock_gettime
multiplexing_api:epoll
atomicvar_api:c11-builtin
gcc_version:9.3.1
process_id:12822
process_supervised:no
run_id:5b027b78823dd56f5e90c406259b66d1b64547f6
tcp_port:7005
server_time_usec:1661171692231101
uptime_in_seconds:2772768
uptime_in_days:32
hz:10
configured_hz:10
lru_clock:227308
executable:/usr/local/redis/bin/redis-server
config_file:/data/redis/redis-cluster/7005/redis_7005.conf
io_threads_active:0
# Clients
connected_clients:45
cluster_connections:18
maxclients:10000
client_recent_max_input_buffer:48
client_recent_max_output_buffer:0
blocked_clients:0
tracking_clients:0
clients_in_timeout_table:0
# Memory
used_memory:2175913768
used_memory_human:2.03G
used_memory_rss:2283061248
used_memory_rss_human:2.13G
used_memory_peak:2176507608
used_memory_peak_human:2.03G
used_memory_peak_perc:99.97%
used_memory_overhead:439843528
used_memory_startup:1494680
used_memory_dataset:1736070240
used_memory_dataset_perc:79.84%
allocator_allocated:2176101496
allocator_active:2240282624
allocator_resident:2283835392
total_system_memory:16537907200
total_system_memory_human:15.40G
used_memory_lua:32768
used_memory_lua_human:32.00K
used_memory_scripts:0
used_memory_scripts_human:0B
number_of_cached_scripts:0
maxmemory:0
maxmemory_human:0B
maxmemory_policy:volatile-lru
allocator_frag_ratio:1.03
allocator_frag_bytes:64181128
allocator_rss_ratio:1.02
allocator_rss_bytes:43552768
rss_overhead_ratio:1.00
rss_overhead_bytes:-774144
mem_fragmentation_ratio:1.05
mem_fragmentation_bytes:107067368
mem_not_counted_for_evict:3066
mem_replication_backlog:1048576
mem_clients_slaves:41024
mem_clients_normal:922592
mem_aof_buffer:3072
mem_allocator:jemalloc-5.1.0
active_defrag_running:0
lazyfree_pending_objects:0
lazyfreed_objects:0
# Persistence
loading:0
current_cow_size:0
current_cow_size_age:0
current_fork_perc:0.00
current_save_keys_processed:0
current_save_keys_total:0
rdb_changes_since_last_save:395105
rdb_bgsave_in_progress:0
rdb_last_save_time:1661171547
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:17
rdb_current_bgsave_time_sec:-1
rdb_last_cow_size:21032960
aof_enabled:1
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:18
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:ok
aof_last_write_status:ok
aof_last_cow_size:23949312
module_fork_in_progress:0
module_fork_last_cow_size:0
aof_current_size:1606414688
aof_base_size:1028132213
aof_pending_rewrite:0
aof_buffer_length:0
aof_rewrite_buffer_length:0
aof_pending_bio_fsync:0
aof_delayed_fsync:3
# Stats
total_connections_received:1203102
total_commands_processed:18202538320
instantaneous_ops_per_sec:8707
total_net_input_bytes:565656794727
total_net_output_bytes:1494480700750
instantaneous_input_kbps:262.47
instantaneous_output_kbps:677.66
rejected_connections:0
sync_full:0
sync_partial_ok:2
sync_partial_err:0
expired_keys:5834657
expired_stale_perc:0.45
expired_time_cap_reached_count:0
expire_cycle_cpu_milliseconds:249212
evicted_keys:0
keyspace_hits:2954491423
keyspace_misses:419477501
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:34841
total_forks:4947
migrate_cached_sockets:0
slave_expires_tracked_keys:0
active_defrag_hits:0
active_defrag_misses:0
active_defrag_key_hits:0
active_defrag_key_misses:0
tracking_total_keys:0
tracking_total_items:0
tracking_total_prefixes:0
unexpected_error_replies:0
total_error_replies:144
dump_payload_sanitizations:0
total_reads_processed:18203741443
total_writes_processed:29268186007
io_threaded_reads_processed:0
io_threaded_writes_processed:0
# Replication
role:master
connected_slaves:2
slave0:ip=10.13.115.123,port=7002,state=online,offset=433813088469,lag=1
slave1:ip=10.13.181.219,port=7008,state=online,offset=433813148730,lag=0
master_failover_state:no-failover
master_replid:ef3ef329099362c6d1c88121dcc97adff44f10ea
master_replid2:191bf83ec498a883a12984df6f116692a9239e27
master_repl_offset:433813182207
second_repl_offset:134610950877
repl_backlog_active:1
repl_backlog_size:1048576
repl_backlog_first_byte_offset:433812133632
repl_backlog_histlen:1048576
# CPU
used_cpu_sys:240984.432074
used_cpu_user:161829.023470
used_cpu_sys_children:4577.063196
used_cpu_user_children:54966.917717
used_cpu_sys_main_thread:240688.032062
used_cpu_user_main_thread:161782.168410
# Modules
# Commandstats
cmdstat_ping:calls=9099451684,usec=2621174026,usec_per_call=0.29,rejected_calls=16,failed_calls=0
cmdstat_dbsize:calls=16,usec=11,usec_per_call=0.69,rejected_calls=0,failed_calls=0
cmdstat_hdel:calls=537,usec=1786,usec_per_call=3.33,rejected_calls=0,failed_calls=0
cmdstat_info:calls=0,usec=0,usec_per_call=0.00,rejected_calls=21,failed_calls=0
cmdstat_cluster:calls=77,usec=3800,usec_per_call=49.35,rejected_calls=0,failed_calls=0
cmdstat_pexpire:calls=5,usec=5,usec_per_call=1.00,rejected_calls=0,failed_calls=0
cmdstat_hget:calls=79631968,usec=226297698,usec_per_call=2.84,rejected_calls=0,failed_calls=0
cmdstat_incr:calls=1405362003,usec=3920751689,usec_per_call=2.79,rejected_calls=0,failed_calls=0
cmdstat_command:calls=1,usec=686,usec_per_call=686.00,rejected_calls=0,failed_calls=0
cmdstat_expire:calls=1656648228,usec=2760193521,usec_per_call=1.67,rejected_calls=0,failed_calls=0
cmdstat_hset:calls=20113267,usec=49468821,usec_per_call=2.46,rejected_calls=0,failed_calls=0
cmdstat_select:calls=1,usec=2,usec_per_call=2.00,rejected_calls=0,failed_calls=0
cmdstat_hvals:calls=17829031,usec=58391150,usec_per_call=3.28,rejected_calls=0,failed_calls=0
cmdstat_del:calls=1299033225,usec=3823537081,usec_per_call=2.94,rejected_calls=0,failed_calls=0
cmdstat_replconf:calls=5514451,usec=5644393,usec_per_call=1.02,rejected_calls=0,failed_calls=0
cmdstat_setex:calls=7076939,usec=61812930,usec_per_call=8.73,rejected_calls=0,failed_calls=0
cmdstat_auth:calls=1202834,usec=4286905,usec_per_call=3.56,rejected_calls=0,failed_calls=0
cmdstat_host_:calls=0,usec=0,usec_per_call=0.00,rejected_calls=20,failed_calls=0
cmdstat_getset:calls=5,usec=24,usec_per_call=4.80,rejected_calls=0,failed_calls=0
cmdstat_psync:calls=2,usec=93,usec_per_call=46.50,rejected_calls=0,failed_calls=0
cmdstat_set:calls=1334166126,usec=8767352478,usec_per_call=6.57,rejected_calls=1,failed_calls=0
cmdstat_get:calls=3276507920,usec=7410328474,usec_per_call=2.26,rejected_calls=19,failed_calls=0
# Errorstats
errorstat_ERR:count=86
errorstat_MOVED:count=1
errorstat_NOAUTH:count=57
# Cluster
cluster_enabled:1
# Keyspace
db0:keys=4197395,expires=4194401,avg_ttl=4007735056333
------ CLIENT LIST OUTPUT ------
id=1203044 addr=10.13.41.219:16060 laddr=10.13.79.31:7005 fd=103 name= age=171 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=7 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1203047 addr=10.13.138.111:64572 laddr=10.13.79.31:7005 fd=106 name= age=171 idle=6 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1203050 addr=10.13.142.210:40926 laddr=10.13.79.31:7005 fd=109 name= age=171 idle=20 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1203051 addr=10.13.79.238:36000 laddr=10.13.79.31:7005 fd=110 name= age=171 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=37 addr=10.13.181.219:15387 laddr=10.13.79.31:7005 fd=37 name= age=2772587 idle=0 flags=S db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=replconf user=default redir=-1
id=1203091 addr=10.13.79.238:36300 laddr=10.13.79.31:7005 fd=51 name= age=33 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61464 events=r cmd=expire user=default redir=-1
id=1203092 addr=10.13.79.238:36302 laddr=10.13.79.31:7005 fd=53 name= age=33 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=del user=default redir=-1
id=1203080 addr=10.13.41.219:16230 laddr=10.13.79.31:7005 fd=58 name= age=66 idle=6 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1203097 addr=10.13.139.229:29686 laddr=10.13.79.31:7005 fd=61 name= age=26 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=del user=default redir=-1
id=1203101 addr=10.13.180.225:29616 laddr=10.13.79.31:7005 fd=15 name= age=2 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=auth user=default redir=-1
id=1203102 addr=10.13.180.225:29618 laddr=10.13.79.31:7005 fd=31 name= age=2 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=auth user=default redir=-1
id=1203103 addr=10.13.180.225:29620 laddr=10.13.79.31:7005 fd=32 name= age=2 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=auth user=default redir=-1
id=1203104 addr=10.13.180.225:29622 laddr=10.13.79.31:7005 fd=35 name= age=2 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=auth user=default redir=-1
id=1203011 addr=10.13.127.128:49846 laddr=10.13.79.31:7005 fd=30 name= age=175 idle=25 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1203089 addr=10.13.138.111:64936 laddr=10.13.79.31:7005 fd=40 name= age=36 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61464 events=r cmd=expire user=default redir=-1
id=1203090 addr=10.13.138.111:64938 laddr=10.13.79.31:7005 fd=50 name= age=36 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=del user=default redir=-1
id=1203076 addr=10.13.127.128:50062 laddr=10.13.79.31:7005 fd=29 name= age=92 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1202741 addr=10.13.142.210:39428 laddr=10.13.79.31:7005 fd=122 name= age=831 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61464 events=r cmd=expire user=default redir=-1
id=1203105 addr=10.13.180.225:29628 laddr=10.13.79.31:7005 fd=43 name= age=1 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=auth user=default redir=-1
id=1203106 addr=10.13.180.225:29630 laddr=10.13.79.31:7005 fd=46 name= age=1 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=incr user=default redir=-1
id=1203069 addr=10.13.138.111:64774 laddr=10.13.79.31:7005 fd=36 name= age=96 idle=6 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1203070 addr=10.13.138.111:64776 laddr=10.13.79.31:7005 fd=52 name= age=96 idle=6 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1203098 addr=10.13.127.128:50232 laddr=10.13.79.31:7005 fd=44 name= age=25 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61464 events=r cmd=expire user=default redir=-1
id=1203099 addr=10.13.127.128:50234 laddr=10.13.79.31:7005 fd=45 name= age=25 idle=6 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20528 events=r cmd=set user=default redir=-1
id=1203077 addr=10.13.139.229:29612 laddr=10.13.79.31:7005 fd=39 name= age=86 idle=26 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1203078 addr=10.13.139.229:29614 laddr=10.13.79.31:7005 fd=41 name= age=86 idle=26 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=36 addr=10.13.115.123:17503 laddr=10.13.79.31:7005 fd=27 name= age=2772587 idle=0 flags=S db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=replconf user=default redir=-1
id=1203088 addr=10.13.127.128:50178 laddr=10.13.79.31:7005 fd=42 name= age=55 idle=25 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1203093 addr=10.13.127.128:50224 laddr=10.13.79.31:7005 fd=7 name= age=32 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1203094 addr=10.13.127.128:50226 laddr=10.13.79.31:7005 fd=19 name= age=32 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1203095 addr=10.13.127.128:50228 laddr=10.13.79.31:7005 fd=23 name= age=32 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1203096 addr=10.13.127.128:50230 laddr=10.13.79.31:7005 fd=28 name= age=32 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=expire user=default redir=-1
id=1203084 addr=10.13.180.225:29438 laddr=10.13.79.31:7005 fd=38 name= age=62 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1203068 addr=10.13.41.219:16194 laddr=10.13.79.31:7005 fd=59 name= age=96 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=expire user=default redir=-1
id=1203026 addr=10.13.142.210:40922 laddr=10.13.79.31:7005 fd=84 name= age=171 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=hget user=default redir=-1
id=1203030 addr=10.13.142.210:40930 laddr=10.13.79.31:7005 fd=88 name= age=171 idle=20 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1203067 addr=10.13.142.210:41128 laddr=10.13.79.31:7005 fd=48 name= age=110 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61464 events=r cmd=expire user=default redir=-1
id=1203034 addr=10.13.139.229:29514 laddr=10.13.79.31:7005 fd=92 name= age=171 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=del user=default redir=-1
id=1203079 addr=10.13.127.128:50066 laddr=10.13.79.31:7005 fd=49 name= age=85 idle=25 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1203036 addr=10.13.139.229:29522 laddr=10.13.79.31:7005 fd=94 name= age=171 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=1203100 addr=10.13.41.219:16322 laddr=10.13.79.31:7005 fd=62 name= age=6 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=1203085 addr=10.13.180.225:29446 laddr=10.13.79.31:7005 fd=56 name= age=61 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61448 events=r cmd=ping user=default redir=-1
id=1203086 addr=10.13.180.225:29448 laddr=10.13.79.31:7005 fd=57 name= age=61 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61448 events=r cmd=ping user=default redir=-1
id=1203087 addr=10.13.180.225:29450 laddr=10.13.79.31:7005 fd=60 name= age=61 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61448 events=r cmd=ping user=default redir=-1
id=1203042 addr=10.13.41.219:16062 laddr=10.13.79.31:7005 fd=101 name= age=171 idle=6 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1203071 addr=10.13.79.238:36154 laddr=10.13.79.31:7005 fd=54 name= age=93 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1203072 addr=10.13.79.238:36156 laddr=10.13.79.31:7005 fd=55 name= age=93 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61464 events=r cmd=expire user=default redir=-1
------ MODULES INFO OUTPUT ------
------ FAST MEMORY TEST ------
12822:M 22 Aug 2022 20:34:52.233 # Bio thread for job type #0 terminated
12822:M 22 Aug 2022 20:34:52.233 # Bio thread for job type #1 terminated
12822:M 22 Aug 2022 20:34:52.233 # Bio thread for job type #2 terminated
*** Preparing to test memory region 5ec000 (2281472 bytes)
*** Preparing to test memory region 1f72000 (135168 bytes)
*** Preparing to test memory region 7fc9e0000000 (2013401088 bytes)
*** Preparing to test memory region 7fca5d400000 (12582912 bytes)
*** Preparing to test memory region 7fca5e200000 (10485760 bytes)
*** Preparing to test memory region 7fca5ec00000 (12582912 bytes)
*** Preparing to test memory region 7fca5fa00000 (10485760 bytes)
*** Preparing to test memory region 7fca60400000 (872415232 bytes)
*** Preparing to test memory region 7fca945b9000 (402653184 bytes)
*** Preparing to test memory region 7fcaac5ba000 (10485760 bytes)
*** Preparing to test memory region 7fcaacfbb000 (10485760 bytes)
*** Preparing to test memory region 7fcaad9bc000 (10485760 bytes)
*** Preparing to test memory region 7fcaae3bd000 (10485760 bytes)
*** Preparing to test memory region 7fcaaedbd000 (3145728 bytes)
*** Preparing to test memory region 7fcab5600000 (8388608 bytes)
*** Preparing to test memory region 7fcab61c9000 (20480 bytes)
*** Preparing to test memory region 7fcab63e6000 (16384 bytes)
*** Preparing to test memory region 7fcab6d0b000 (24576 bytes)
*** Preparing to test memory region 7fcab6d17000 (4096 bytes)
*** Preparing to test memory region 7fcab6d18000 (4096 bytes)
*** Preparing to test memory region 7fcab6d1b000 (4096 bytes)
.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O
Fast memory test PASSED, however your memory can still be broken. Please run a memory test for several hours if possible.
------ DUMPING CODE AROUND EIP ------
Symbol: dictRehash (base: 0x434c90)
Module: /usr/local/redis/bin/redis-server 10.13.79.31:7005 [cluster] (base 0x400000)
$ xxd -r -p /tmp/dump.hex /tmp/dump.bin
$ objdump --adjust-vma=0x434c90 -D -b binary -m i386:x86-64 /tmp/dump.bin
------
12822:M 22 Aug 2022 20:35:09.060 # dump of function (hexdump of 246 bytes):
415641554154448d24b6554501e45348837f50ff0f84d6000000488b47284889fb448d6eff85f60f84a70000004885c00f84de000000488b4350483943180f86bc000000488b5310eb18660f1f4400004883c001488943504183ec010f847e000000488b2cc24885ed74e50f1f440000488b034989ee488b6d10498b3eff10488b533048234340488d04c2488b10498956104c8930488b432848834348014883e801488943284885ed75c5488b5350488b4b1048c704d1000000004883c20148895350418d55ff4585ed74084189d5e959ffffff4885c0743b0f1f8000000000b8010000005b5d415c415d415ec366905b31c05d415c
=== REDIS BUG REPORT END. Make sure to include from START to END. ===
Please report the crash by opening an issue on github:
http://github.com/redis/redis/issues
Suspect RAM error? Use redis-server --test-memory to verify it.
Comment From: oranagra
@Gongyihui can you please provide some information on your platform and anything that can maybe help identify the issue or reproduce it? maybe a few lines from the log before to the crash would help, or a description of what you think could have triggered it.
Comment From: hui-QY
@Gongyihui can you please provide some information on your platform and anything that can maybe help identify the issue or reproduce it? maybe a few lines from the log before to the crash would help, or a description of what you think could have triggered it.
12822:M 22 Aug 2022 20:11:34.034 * 10000 changes in 600 seconds. Saving... 12822:M 22 Aug 2022 20:11:34.070 * Background saving started by pid 26406 26406:C 22 Aug 2022 20:11:51.324 * DB saved on disk 26406:C 22 Aug 2022 20:11:51.372 * RDB: 20 MB of memory used by copy-on-write 12822:M 22 Aug 2022 20:11:51.429 * Background saving terminated with success 12822:M 22 Aug 2022 20:21:52.012 * 10000 changes in 600 seconds. Saving... 12822:M 22 Aug 2022 20:21:52.047 * Background saving started by pid 27343 27343:C 22 Aug 2022 20:22:09.390 * DB saved on disk 27343:C 22 Aug 2022 20:22:09.440 * RDB: 19 MB of memory used by copy-on-write 12822:M 22 Aug 2022 20:22:09.513 * Background saving terminated with success 12822:M 22 Aug 2022 20:32:10.014 * 10000 changes in 600 seconds. Saving... 12822:M 22 Aug 2022 20:32:10.049 * Background saving started by pid 28322 28322:C 22 Aug 2022 20:32:27.382 * DB saved on disk 28322:C 22 Aug 2022 20:32:27.435 * RDB: 20 MB of memory used by copy-on-write 12822:M 22 Aug 2022 20:32:27.523 * Background saving terminated with success
=== REDIS BUG REPORT START: Cut & paste starting from here === 12822:M 22 Aug 2022 20:34:52.231 # Redis 6.2.7 crashed by signal: 7, si_code: 128 12822:M 22 Aug 2022 20:34:52.231 # Accessing address: (nil) 12822:M 22 Aug 2022 20:34:52.231 # Crashed running the instruction at: 0x434d06
------ STACK TRACE ------ EIP: /usr/local/redis/bin/redis-server 10.13.79.31:7005 cluster[0x434d06]
Comment From: hui-QY
I don't know the reason for the bug. Earlier you said that it may be caused by the use of the Bloom filter module, but now the third-party module is no longer used.
Comment From: oranagra
you mean https://github.com/redis/redis/issues/10995? i see the crash was in a completely different place, so if these issues are related, then it's probably a memory corruption issue. without being able to reproduce it, i don't think we'll be able to find it. how often does it reproduce? any chance you can catch it under valgrind (which will slow down redis dramatically)?
Comment From: hui-QY
you mean #10995? i see the crash was in a completely different place, so if these issues are related, then it's probably a memory corruption issue. without being able to reproduce it, i don't think we'll be able to find it. how often does it reproduce? any chance you can catch it under valgrind (which will slow down redis dramatically)?
It's been a month since the bloom filter was removed, and this is the first time this has happened. No .........
Comment From: hui-QY
you mean #10995? i see the crash was in a completely different place, so if these issues are related, then it's probably a memory corruption issue. without being able to reproduce it, i don't think we'll be able to find it. how often does it reproduce? any chance you can catch it under valgrind (which will slow down redis dramatically)?
3821:M 23 Aug 2022 22:10:17.894 * Starting automatic rewriting of AOF on 100% growth
3821:M 23 Aug 2022 22:10:17.933 * Background append only file rewriting started by pid 2769
3821:M 23 Aug 2022 22:10:36.222 * AOF rewrite child asks to stop sending diffs.
2769:C 23 Aug 2022 22:10:36.222 * Parent agreed to stop sending diffs. Finalizing AOF...
2769:C 23 Aug 2022 22:10:36.222 * Concatenating 2.82 MB of AOF diff received from parent.
2769:C 23 Aug 2022 22:10:36.228 * SYNC append only file rewrite performed
2769:C 23 Aug 2022 22:10:36.281 * AOF rewrite: 26 MB of memory used by copy-on-write
3821:M 23 Aug 2022 22:10:36.393 * Background AOF rewrite terminated with success
3821:M 23 Aug 2022 22:10:36.393 * Residual parent diff successfully flushed to the rewritten AOF (0.01 MB)
3821:M 23 Aug 2022 22:10:36.395 * Background AOF rewrite finished successfully
3821:M 23 Aug 2022 22:18:02.027 * 10000 changes in 600 seconds. Saving...
3821:M 23 Aug 2022 22:18:02.116 * Background saving started by pid 3118
3118:C 23 Aug 2022 22:18:19.350 * DB saved on disk
3118:C 23 Aug 2022 22:18:19.408 * RDB: 20 MB of memory used by copy-on-write
3821:M 23 Aug 2022 22:18:19.474 * Background saving terminated with success
3821:M 23 Aug 2022 22:28:20.096 * 10000 changes in 600 seconds. Saving...
3821:M 23 Aug 2022 22:28:20.148 * Background saving started by pid 3562
3562:C 23 Aug 2022 22:28:36.689 * DB saved on disk
3562:C 23 Aug 2022 22:28:36.741 * RDB: 20 MB of memory used by copy-on-write
3821:M 23 Aug 2022 22:28:36.801 * Background saving terminated with success
3821:M 23 Aug 2022 22:38:37.042 * 10000 changes in 600 seconds. Saving...
3821:M 23 Aug 2022 22:38:37.082 * Background saving started by pid 4047
4047:C 23 Aug 2022 22:38:54.709 * DB saved on disk
4047:C 23 Aug 2022 22:38:54.762 * RDB: 19 MB of memory used by copy-on-write
3821:M 23 Aug 2022 22:38:54.847 * Background saving terminated with success
3821:M 23 Aug 2022 22:48:55.040 * 10000 changes in 600 seconds. Saving...
3821:M 23 Aug 2022 22:48:55.076 * Background saving started by pid 4500
4500:C 23 Aug 2022 22:49:11.454 * DB saved on disk
4500:C 23 Aug 2022 22:49:11.502 * RDB: 19 MB of memory used by copy-on-write
3821:M 23 Aug 2022 22:49:11.629 * Background saving terminated with success
3821:M 23 Aug 2022 22:59:12.044 * 10000 changes in 600 seconds. Saving...
3821:M 23 Aug 2022 22:59:12.076 * Background saving started by pid 4956
=== REDIS BUG REPORT START: Cut & paste starting from here ===
3821:M 23 Aug 2022 22:59:23.622 # Redis 6.2.7 crashed by signal: 11, si_code: 1
3821:M 23 Aug 2022 22:59:23.622 # Accessing address: 0x7fed00003310
3821:M 23 Aug 2022 22:59:23.622 # Crashed running the instruction at: 0x43ba0d
------ STACK TRACE ------
EIP:
/usr/local/redis/bin/redis-server 10.13.115.123:7001 [cluster](processCommand+0x5d)[0x43ba0d]
Backtrace:
/lib64/libpthread.so.0(+0xf5d0)[0x7fee484645d0]
/usr/local/redis/bin/redis-server 10.13.115.123:7001 [cluster](processCommand+0x5d)[0x43ba0d]
/usr/local/redis/bin/redis-server 10.13.115.123:7001 [cluster](processCommandAndResetClient+0x1c)[0x44e04c]
/usr/local/redis/bin/redis-server 10.13.115.123:7001 [cluster](processInputBuffer+0xda)[0x45055a]
/usr/local/redis/bin/redis-server 10.13.115.123:7001 [cluster][0x4dc0ac]
/usr/local/redis/bin/redis-server 10.13.115.123:7001 [cluster](aeProcessEvents+0x29a)[0x4335da]
/usr/local/redis/bin/redis-server 10.13.115.123:7001 [cluster](aeMain+0x1d)[0x43384d]
/usr/local/redis/bin/redis-server 10.13.115.123:7001 [cluster](main+0x311)[0x42ffb1]
/lib64/libc.so.6(__libc_start_main+0xf5)[0x7fee480aa495]
/usr/local/redis/bin/redis-server 10.13.115.123:7001 [cluster][0x430479]
------ REGISTERS ------
3821:M 23 Aug 2022 22:59:23.623 #
RAX:00007fed00003308 RBX:0000000000000000
RCX:00007fedc0000000 RDX:0000000000000008
RDI:00007fee47c0f1e0 RSI:0000000000573620
RBP:0000000000000000 RSP:00007ffc86f4aae0
R8 :0000000000000008 R9 :00007fee481d6100
R10:0000000000000002 R11:00007fee482147c0
R12:0000000000000000 R13:0000000000000000
R14:0000000000000000 R15:00007fee3a5daa80
RIP:000000000043ba0d EFL:0000000000010202
CSGSFS:002b000000000033
3821:M 23 Aug 2022 22:59:23.623 # (00007ffc86f4aaef) -> 00007fee3a5daa80
3821:M 23 Aug 2022 22:59:23.623 # (00007ffc86f4aaee) -> 000000000000001b
3821:M 23 Aug 2022 22:59:23.623 # (00007ffc86f4aaed) -> 000000000044e04c
3821:M 23 Aug 2022 22:59:23.623 # (00007ffc86f4aaec) -> 0000000000000001
3821:M 23 Aug 2022 22:59:23.623 # (00007ffc86f4aaeb) -> 0000000000000000
3821:M 23 Aug 2022 22:59:23.623 # (00007ffc86f4aaea) -> 000000000000001b
3821:M 23 Aug 2022 22:59:23.623 # (00007ffc86f4aae9) -> 0000000000000000
3821:M 23 Aug 2022 22:59:23.623 # (00007ffc86f4aae8) -> 00007fee3a5daa80
3821:M 23 Aug 2022 22:59:23.623 # (00007ffc86f4aae7) -> 0000000000000000
3821:M 23 Aug 2022 22:59:23.623 # (00007ffc86f4aae6) -> 000000000000000a
3821:M 23 Aug 2022 22:59:23.623 # (00007ffc86f4aae5) -> 000000000044fdf6
3821:M 23 Aug 2022 22:59:23.623 # (00007ffc86f4aae4) -> 00007fee3a5f3905
3821:M 23 Aug 2022 22:59:23.623 # (00007ffc86f4aae3) -> 0000000000000008
3821:M 23 Aug 2022 22:59:23.623 # (00007ffc86f4aae2) -> 00007fee3a5daa80
3821:M 23 Aug 2022 22:59:23.623 # (00007ffc86f4aae1) -> 0000000000000002
3821:M 23 Aug 2022 22:59:23.623 # (00007ffc86f4aae0) -> 0000000000000000
------ INFO OUTPUT ------
# Server
redis_version:6.2.7
redis_git_sha1:00000000
redis_git_dirty:0
redis_build_id:afe525107e93beb2
redis_mode:cluster
os:Linux 4.19.188-10.el7.ucloud.x86_64 x86_64
arch_bits:64
monotonic_clock:POSIX clock_gettime
multiplexing_api:epoll
atomicvar_api:c11-builtin
gcc_version:9.3.1
process_id:3821
process_supervised:no
run_id:c367ca6931c3dd88b315cc80e183b1efedd081ac
tcp_port:7001
server_time_usec:1661266763622107
uptime_in_seconds:2891754
uptime_in_days:33
hz:10
configured_hz:10
lru_clock:322379
executable:/usr/local/redis/bin/redis-server
config_file:/data/redis/redis-cluster/7001/redis_7001.conf
io_threads_active:0
# Clients
connected_clients:47
cluster_connections:18
maxclients:10000
client_recent_max_input_buffer:48
client_recent_max_output_buffer:0
blocked_clients:0
tracking_clients:0
clients_in_timeout_table:0
# Memory
used_memory:2173777448
used_memory_human:2.02G
used_memory_rss:2284011520
used_memory_rss_human:2.13G
used_memory_peak:2207719624
used_memory_peak_human:2.06G
used_memory_peak_perc:98.46%
used_memory_overhead:410598912
used_memory_startup:1494680
used_memory_dataset:1763178536
used_memory_dataset_perc:81.17%
allocator_allocated:2173940480
allocator_active:2240016384
allocator_resident:2286501888
total_system_memory:16537907200
total_system_memory_human:15.40G
used_memory_lua:32768
used_memory_lua_human:32.00K
used_memory_scripts:0
used_memory_scripts_human:0B
number_of_cached_scripts:0
maxmemory:0
maxmemory_human:0B
maxmemory_policy:volatile-lru
allocator_frag_ratio:1.03
allocator_frag_bytes:66075904
allocator_rss_ratio:1.02
allocator_rss_bytes:46485504
rss_overhead_ratio:1.00
rss_overhead_bytes:-2490368
mem_fragmentation_ratio:1.05
mem_fragmentation_bytes:110194656
mem_not_counted_for_evict:3578
mem_replication_backlog:1048576
mem_clients_slaves:41024
mem_clients_normal:963584
mem_aof_buffer:3584
mem_allocator:jemalloc-5.1.0
active_defrag_running:0
lazyfree_pending_objects:0
lazyfreed_objects:0
# Persistence
loading:0
current_cow_size:13205504
current_cow_size_age:5
current_fork_perc:59.63
current_save_keys_processed:2542593
current_save_keys_total:4264116
rdb_changes_since_last_save:1763928
rdb_bgsave_in_progress:1
rdb_last_save_time:1661266151
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:16
rdb_current_bgsave_time_sec:11
rdb_last_cow_size:20398080
aof_enabled:1
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:19
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:ok
aof_last_write_status:ok
aof_last_cow_size:27381760
module_fork_in_progress:0
module_fork_last_cow_size:0
aof_current_size:1518331666
aof_base_size:1045616799
aof_pending_rewrite:0
aof_buffer_length:0
aof_rewrite_buffer_length:0
aof_pending_bio_fsync:0
aof_delayed_fsync:3
# Stats
total_connections_received:1099885
total_commands_processed:20439935811
instantaneous_ops_per_sec:9977
total_net_input_bytes:634623426757
total_net_output_bytes:1968485358528
instantaneous_input_kbps:302.93
instantaneous_output_kbps:816.14
rejected_connections:0
sync_full:6
sync_partial_ok:2
sync_partial_err:0
expired_keys:6041864
expired_stale_perc:1.12
expired_time_cap_reached_count:0
expire_cycle_cpu_milliseconds:286332
evicted_keys:0
keyspace_hits:3283571059
keyspace_misses:449841698
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:31527
total_forks:5194
migrate_cached_sockets:0
slave_expires_tracked_keys:0
active_defrag_hits:0
active_defrag_misses:0
active_defrag_key_hits:0
active_defrag_key_misses:0
tracking_total_keys:0
tracking_total_items:0
tracking_total_prefixes:0
unexpected_error_replies:0
total_error_replies:1187
dump_payload_sanitizations:0
total_reads_processed:20434501875
total_writes_processed:32886760246
io_threaded_reads_processed:0
io_threaded_writes_processed:0
# Replication
role:master
connected_slaves:2
slave0:ip=10.13.181.219,port=7007,state=online,offset=561393206943,lag=1
slave1:ip=10.13.72.193,port=7004,state=online,offset=561393179328,lag=1
master_failover_state:no-failover
master_replid:62bab7c067f315c5b520eec6c9f844064ca86684
master_replid2:54309d33a876c3a6cfe8e993e73b72d296bae4e5
master_repl_offset:561393298660
second_repl_offset:225563937451
repl_backlog_active:1
repl_backlog_size:1048576
repl_backlog_first_byte_offset:561392250085
repl_backlog_histlen:1048576
# CPU
used_cpu_sys:264701.871935
used_cpu_user:184308.473594
used_cpu_sys_children:4946.310166
used_cpu_user_children:59093.213840
used_cpu_sys_main_thread:264353.201250
used_cpu_user_main_thread:184292.414481
# Modules
# Commandstats
cmdstat_replconf:calls=5724900,usec=6468509,usec_per_call=1.13,rejected_calls=0,failed_calls=0
cmdstat_config:calls=14,usec=337,usec_per_call=24.07,rejected_calls=0,failed_calls=0
cmdstat_hset:calls=1545725,usec=20374500,usec_per_call=13.18,rejected_calls=0,failed_calls=0
cmdstat_info:calls=11,usec=286,usec_per_call=26.00,rejected_calls=23,failed_calls=0
cmdstat_ping:calls=10203607698,usec=2858956175,usec_per_call=0.28,rejected_calls=36,failed_calls=0
cmdstat_dbsize:calls=32,usec=19,usec_per_call=0.59,rejected_calls=0,failed_calls=0
cmdstat_psync:calls=8,usec=168494,usec_per_call=21061.75,rejected_calls=0,failed_calls=0
cmdstat_post:calls=0,usec=0,usec_per_call=0.00,rejected_calls=12,failed_calls=0
cmdstat_command:calls=4,usec=3829,usec_per_call=957.25,rejected_calls=1,failed_calls=0
cmdstat_pexpire:calls=18,usec=30,usec_per_call=1.67,rejected_calls=0,failed_calls=0
cmdstat_host_:calls=0,usec=0,usec_per_call=0.00,rejected_calls=165,failed_calls=0
cmdstat_setex:calls=7419222,usec=71753852,usec_per_call=9.67,rejected_calls=1,failed_calls=0
cmdstat_cluster:calls=329,usec=19836,usec_per_call=60.29,rejected_calls=3,failed_calls=1
cmdstat_hdel:calls=27244,usec=237602,usec_per_call=8.72,rejected_calls=0,failed_calls=0
cmdstat_hget:calls=21264041,usec=89126284,usec_per_call=4.19,rejected_calls=0,failed_calls=0
cmdstat_auth:calls=1099116,usec=4863758,usec_per_call=4.43,rejected_calls=1,failed_calls=0
cmdstat_hvals:calls=36282269,usec=2106053110,usec_per_call=58.05,rejected_calls=0,failed_calls=0
cmdstat_expire:calls=1889092444,usec=3364489666,usec_per_call=1.78,rejected_calls=0,failed_calls=0
cmdstat_del:calls=1505417869,usec=4769289929,usec_per_call=3.17,rejected_calls=0,failed_calls=0
cmdstat_incr:calls=1515722908,usec=4329686060,usec_per_call=2.86,rejected_calls=0,failed_calls=0
cmdstat_set:calls=1576865510,usec=10744998973,usec_per_call=6.81,rejected_calls=35,failed_calls=0
cmdstat_select:calls=2,usec=1,usec_per_call=0.50,rejected_calls=0,failed_calls=0
cmdstat_getset:calls=18,usec=128,usec_per_call=7.11,rejected_calls=0,failed_calls=0
cmdstat_get:calls=3675866429,usec=8696842591,usec_per_call=2.37,rejected_calls=206,failed_calls=0
# Errorstats
errorstat_CLUSTERDOWN:count=73
errorstat_ERR:count=874
errorstat_LOADING:count=22
errorstat_NOAUTH:count=218
# Cluster
cluster_enabled:1
# Keyspace
db0:keys=4264111,expires=4261054,avg_ttl=4192921435494
------ CLIENT LIST OUTPUT ------
id=1099862 addr=10.13.127.128:40662 laddr=10.13.115.123:7001 fd=74 name= age=74 idle=14 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1099855 addr=10.13.180.225:46952 laddr=10.13.115.123:7001 fd=12 name= age=90 idle=30 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1099856 addr=10.13.180.225:46954 laddr=10.13.115.123:7001 fd=16 name= age=90 idle=30 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1099877 addr=10.13.180.225:47112 laddr=10.13.115.123:7001 fd=14 name= age=30 idle=30 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=auth user=default redir=-1
id=1099878 addr=10.13.180.225:47114 laddr=10.13.115.123:7001 fd=28 name= age=30 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=expire user=default redir=-1
id=1099889 addr=10.13.79.238:58774 laddr=10.13.115.123:7001 fd=51 name= age=1 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61464 events=r cmd=expire user=default redir=-1
id=1099869 addr=10.13.142.210:12414 laddr=10.13.115.123:7001 fd=17 name= age=52 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=1099868 addr=10.13.180.225:47038 laddr=10.13.115.123:7001 fd=13 name= age=60 idle=30 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1099865 addr=10.13.127.128:40706 laddr=10.13.115.123:7001 fd=10 name= age=62 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=10763 addr=10.13.72.193:13567 laddr=10.13.115.123:7001 fd=81 name= age=2877479 idle=0 flags=S db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=replconf user=default redir=-1
id=1099866 addr=10.13.79.238:58646 laddr=10.13.115.123:7001 fd=24 name= age=61 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61464 events=r cmd=expire user=default redir=-1
id=1099873 addr=10.13.127.128:40736 laddr=10.13.115.123:7001 fd=7 name= age=32 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1099874 addr=10.13.127.128:40738 laddr=10.13.115.123:7001 fd=11 name= age=32 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1099876 addr=10.13.79.238:58692 laddr=10.13.115.123:7001 fd=61 name= age=31 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1099875 addr=10.13.127.128:40740 laddr=10.13.115.123:7001 fd=15 name= age=32 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61464 events=r cmd=expire user=default redir=-1
id=1099883 addr=10.13.127.128:40840 laddr=10.13.115.123:7001 fd=20 name= age=14 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=expire user=default redir=-1
id=1099884 addr=10.13.127.128:40842 laddr=10.13.115.123:7001 fd=36 name= age=14 idle=14 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=auth user=default redir=-1
id=1099885 addr=10.13.127.128:40844 laddr=10.13.115.123:7001 fd=41 name= age=14 idle=9 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=expire user=default redir=-1
id=1099867 addr=10.13.79.238:58648 laddr=10.13.115.123:7001 fd=58 name= age=61 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1099720 addr=10.13.142.210:11578 laddr=10.13.115.123:7001 fd=40 name= age=472 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=expire user=default redir=-1
id=1099840 addr=10.13.79.238:58518 laddr=10.13.115.123:7001 fd=34 name= age=121 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1099886 addr=10.13.41.219:23526 laddr=10.13.115.123:7001 fd=25 name= age=7 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=14 qbuf-free=40940 argv-mem=4 obl=0 oll=0 omem=0 tot-mem=61452 events=r cmd=set user=default redir=-1
id=1099887 addr=10.13.41.219:23528 laddr=10.13.115.123:7001 fd=49 name= age=7 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=1099863 addr=10.13.41.219:23432 laddr=10.13.115.123:7001 fd=27 name= age=67 idle=7 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1099881 addr=10.13.139.229:32600 laddr=10.13.115.123:7001 fd=18 name= age=17 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61464 events=r cmd=expire user=default redir=-1
id=1099882 addr=10.13.139.229:32602 laddr=10.13.115.123:7001 fd=31 name= age=17 idle=8 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=del user=default redir=-1
id=1099864 addr=10.13.41.219:23434 laddr=10.13.115.123:7001 fd=33 name= age=67 idle=7 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1099854 addr=10.13.127.128:40576 laddr=10.13.115.123:7001 fd=29 name= age=92 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1099888 addr=10.13.138.111:13292 laddr=10.13.115.123:7001 fd=75 name= age=4 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61464 events=r cmd=expire user=default redir=-1
id=1099870 addr=10.13.127.128:40730 laddr=10.13.115.123:7001 fd=39 name= age=44 idle=14 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=del user=default redir=-1
id=10762 addr=10.13.181.219:16255 laddr=10.13.115.123:7001 fd=55 name= age=2877479 idle=0 flags=S db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=replconf user=default redir=-1
id=1099857 addr=10.13.180.225:46956 laddr=10.13.115.123:7001 fd=30 name= age=87 idle=27 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1099858 addr=10.13.180.225:46958 laddr=10.13.115.123:7001 fd=60 name= age=87 idle=27 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=del user=default redir=-1
id=1099827 addr=10.13.138.111:12992 laddr=10.13.115.123:7001 fd=47 name= age=154 idle=4 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1099871 addr=10.13.138.111:13224 laddr=10.13.115.123:7001 fd=50 name= age=34 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=expire user=default redir=-1
id=1099872 addr=10.13.138.111:13226 laddr=10.13.115.123:7001 fd=52 name= age=34 idle=4 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1099859 addr=10.13.142.210:12330 laddr=10.13.115.123:7001 fd=72 name= age=82 idle=22 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1099823 addr=10.13.142.210:12168 laddr=10.13.115.123:7001 fd=45 name= age=172 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=1099844 addr=10.13.180.225:46882 laddr=10.13.115.123:7001 fd=32 name= age=117 idle=27 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1099824 addr=10.13.139.229:32388 laddr=10.13.115.123:7001 fd=46 name= age=167 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=1099846 addr=10.13.142.210:12296 laddr=10.13.115.123:7001 fd=59 name= age=112 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61464 events=r cmd=expire user=default redir=-1
id=1099879 addr=10.13.180.225:47124 laddr=10.13.115.123:7001 fd=35 name= age=27 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=1099880 addr=10.13.180.225:47126 laddr=10.13.115.123:7001 fd=44 name= age=27 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=incr user=default redir=-1
id=1099818 addr=10.13.41.219:23246 laddr=10.13.115.123:7001 fd=23 name= age=187 idle=7 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1099849 addr=10.13.127.128:40566 laddr=10.13.115.123:7001 fd=54 name= age=104 idle=14 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1099850 addr=10.13.138.111:13110 laddr=10.13.115.123:7001 fd=26 name= age=94 idle=4 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1099851 addr=10.13.138.111:13112 laddr=10.13.115.123:7001 fd=37 name= age=94 idle=4 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1099860 addr=10.13.139.229:32512 laddr=10.13.115.123:7001 fd=19 name= age=77 idle=17 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1099861 addr=10.13.139.229:32514 laddr=10.13.115.123:7001 fd=73 name= age=77 idle=17 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
------ CURRENT CLIENT INFO ------
id=1099886 addr=10.13.41.219:23526 laddr=10.13.115.123:7001 fd=25 name= age=7 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=14 qbuf-free=40940 argv-mem=4 obl=0 oll=0 omem=0 tot-mem=61452 events=r cmd=set user=default redir=-1
argv[0]: 'PING'
------ MODULES INFO OUTPUT ------
------ FAST MEMORY TEST ------
3821:M 23 Aug 2022 22:59:23.624 # Bio thread for job type #0 terminated
3821:M 23 Aug 2022 22:59:23.624 # Bio thread for job type #1 terminated
3821:M 23 Aug 2022 22:59:23.625 # Bio thread for job type #2 terminated
*** Preparing to test memory region 5ec000 (2281472 bytes)
*** Preparing to test memory region 23cf000 (135168 bytes)
*** Preparing to test memory region 7fed72600000 (2040664064 bytes)
*** Preparing to test memory region 7fedf0400000 (10485760 bytes)
*** Preparing to test memory region 7fedf0e00000 (2097152 bytes)
*** Preparing to test memory region 7fedf1200000 (10485760 bytes)
*** Preparing to test memory region 7fedf1c00000 (1243611136 bytes)
*** Preparing to test memory region 7fee3bfd2000 (41943040 bytes)
*** Preparing to test memory region 7fee3e7d3000 (10485760 bytes)
*** Preparing to test memory region 7fee3f1d4000 (10485760 bytes)
*** Preparing to test memory region 7fee3fbd5000 (10485760 bytes)
*** Preparing to test memory region 7fee405d6000 (10485760 bytes)
*** Preparing to test memory region 7fee40fd6000 (3145728 bytes)
*** Preparing to test memory region 7fee47800000 (8388608 bytes)
*** Preparing to test memory region 7fee48450000 (20480 bytes)
*** Preparing to test memory region 7fee4866d000 (16384 bytes)
*** Preparing to test memory region 7fee48f92000 (24576 bytes)
*** Preparing to test memory region 7fee48f9e000 (4096 bytes)
*** Preparing to test memory region 7fee48f9f000 (4096 bytes)
*** Preparing to test memory region 7fee48fa2000 (4096 bytes)
.O.O.4956:C 23 Aug 2022 22:59:28.760 * DB saved on disk
4956:C 23 Aug 2022 22:59:28.801 * RDB: 494 MB of memory used by copy-on-write
O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O
Fast memory test PASSED, however your memory can still be broken. Please run a memory test for several hours if possible.
------ DUMPING CODE AROUND EIP ------
Symbol: processCommand (base: 0x43b9b0)
Module: /usr/local/redis/bin/redis-server 10.13.115.123:7001 [cluster] (base 0x400000)
$ xxd -r -p /tmp/dump.hex /tmp/dump.bin
$ objdump --adjust-vma=0x43b9b0 -D -b binary -m i386:x86-64 /tmp/dump.bin
------
3821:M 23 Aug 2022 22:59:40.592 # dump of function (hexdump of 221 bytes):
41574989ff41564155415455534883ec38448b2d8c741b004585ed752c448b25f8661b004585e40f855e0b00008b2de5661b0085ed0f853c0b00008b1dd3661b0085db0f851a0b00004c89ffe8ef380800498b4750be20365700488b00488b68084889efe8a726ffff85c00f840f0a0000488b3d20661b004889eee8009dffff49894778498947704885c00f84570600008b5010418b4f4885d27e3439ca7430488b10be20f656004c89ff31c04531f6e86befffff4883c4384489f05b5d415c415d415e415fc3660f1f840000000000f7da39ca7fca488b50204989d1
=== REDIS BUG REPORT END. Make sure to include from START to END. ===
Please report the crash by opening an issue on github:
http://github.com/redis/redis/issues
Suspect RAM error? Use redis-server --test-memory to verify it.
Comment From: hui-QY
It happened again today o(╥﹏╥)o
Comment From: oranagra
any chance you can run it with valgrind (valgrind redis-server [args])?
or maybe use a build that has the address sanitizer enabled (make SANITIZER=address)?
Comment From: hui-QY
any chance you can run it with valgrind (
valgrind redis-server [args])? or maybe use a build that has the address sanitizer enabled (make SANITIZER=address)?
==2822== Memcheck, a memory error detector ==2822== Copyright (C) 2002-2017, and GNU GPL'd, by Julian Seward et al. ==2822== Using Valgrind-3.15.0 and LibVEX; rerun with -h for copyright info ==2822== Command: /usr/local/redis/bin/redis-server /usr/local/redis/etc/redis-game_6380.conf ==2822== ==2822== ==2822== HEAP SUMMARY: ==2822== in use at exit: 123 bytes in 4 blocks ==2822== total heap usage: 130 allocs, 126 frees, 16,471 bytes allocated ==2822== ==2822== LEAK SUMMARY: ==2822== definitely lost: 0 bytes in 0 blocks ==2822== indirectly lost: 0 bytes in 0 blocks ==2822== possibly lost: 0 bytes in 0 blocks ==2822== still reachable: 123 bytes in 4 blocks ==2822== suppressed: 0 bytes in 0 blocks ==2822== Reachable blocks (those to which a pointer was found) are not shown. ==2822== To see them, rerun with: --leak-check=full --show-leak-kinds=all ==2822== ==2822== For lists of detected and suppressed errors, rerun with: -s ==2822== ERROR SUMMARY: 0 errors from 0 contexts (suppressed: 0 from 0) [root@10-13-17-55 ~]# ==2823== Warning: set address range perms: large range [0x43400000, 0x57400000) (defined) ==2823== Warning: set address range perms: large range [0x59eaf000, 0x71eaf000) (defined) ==2823== Warning: set address range perms: large range [0x71eaf000, 0x8deaf000) (defined) ==2823== Warning: set address range perms: large range [0x8ea00000, 0xaea00000) (defined) ==2823== Warning: set address range perms: large range [0xaf600000, 0xd7600000) (defined) ==2823== Warning: set address range perms: large range [0xd7600000, 0x107600000) (defined) ==2823== Warning: set address range perms: large range [0x108400000, 0x140400000) (defined) ==2823== Warning: set address range perms: large range [0x141400000, 0x181400000) (defined) ==2823== Warning: set address range perms: large range [0x182800000, 0x1d2800000) (defined) ==2823== Warning: set address range perms: large range [0x1d2800000, 0x232800000) (defined) ==3529== Conditional jump or move depends on uninitialised value(s) ==3529== at 0x443E66: lzf_compress (lzf_c.c:153) ==3529== by 0x464118: rdbSaveLzfStringObject.part.0 (rdb.c:368) ==3529== by 0x4644EC: rdbSaveLzfStringObject (rdb.c:365) ==3529== by 0x4644EC: rdbSaveRawString (rdb.c:448) ==3529== by 0x46556E: rdbSaveObject (rdb.c:934) ==3529== by 0x465A30: rdbSaveKeyValuePair (rdb.c:1114) ==3529== by 0x4660D3: rdbSaveRio (rdb.c:1265) ==3529== by 0x4688FF: rdbSave (rdb.c:1381) ==3529== by 0x468C00: rdbSaveBackground (rdb.c:1437) ==3529== by 0x43B70C: serverCron (server.c:2175) ==3529== by 0x433438: processTimeEvents (ae.c:318) ==3529== by 0x433438: aeProcessEvents (ae.c:457) ==3529== by 0x43384C: aeMain (ae.c:487) ==3529== by 0x42FFB0: main (server.c:6456) ==3529== ==3529== Conditional jump or move depends on uninitialised value(s) ==3529== at 0x443E6B: lzf_compress (lzf_c.c:153) ==3529== by 0x464118: rdbSaveLzfStringObject.part.0 (rdb.c:368) ==3529== by 0x4644EC: rdbSaveLzfStringObject (rdb.c:365) ==3529== by 0x4644EC: rdbSaveRawString (rdb.c:448) ==3529== by 0x46556E: rdbSaveObject (rdb.c:934) ==3529== by 0x465A30: rdbSaveKeyValuePair (rdb.c:1114) ==3529== by 0x4660D3: rdbSaveRio (rdb.c:1265) ==3529== by 0x4688FF: rdbSave (rdb.c:1381) ==3529== by 0x468C00: rdbSaveBackground (rdb.c:1437) ==3529== by 0x43B70C: serverCron (server.c:2175) ==3529== by 0x433438: processTimeEvents (ae.c:318) ==3529== by 0x433438: aeProcessEvents (ae.c:457) ==3529== by 0x43384C: aeMain (ae.c:487) ==3529== by 0x42FFB0: main (server.c:6456) ==3529== ==3529== Use of uninitialised value of size 8 ==3529== at 0x443E6D: lzf_compress (lzf_c.c:154) ==3529== by 0x464118: rdbSaveLzfStringObject.part.0 (rdb.c:368) ==3529== by 0x4644EC: rdbSaveLzfStringObject (rdb.c:365) ==3529== by 0x4644EC: rdbSaveRawString (rdb.c:448) ==3529== by 0x46556E: rdbSaveObject (rdb.c:934) ==3529== by 0x465A30: rdbSaveKeyValuePair (rdb.c:1114) ==3529== by 0x4660D3: rdbSaveRio (rdb.c:1265) ==3529== by 0x4688FF: rdbSave (rdb.c:1381) ==3529== by 0x468C00: rdbSaveBackground (rdb.c:1437) ==3529== by 0x43B70C: serverCron (server.c:2175) ==3529== by 0x433438: processTimeEvents (ae.c:318) ==3529== by 0x433438: aeProcessEvents (ae.c:457) ==3529== by 0x43384C: aeMain (ae.c:487) ==3529== by 0x42FFB0: main (server.c:6456) ==3529== ==3529== Use of uninitialised value of size 8 ==3529== at 0x443E7B: lzf_compress (lzf_c.c:158) ==3529== by 0x464118: rdbSaveLzfStringObject.part.0 (rdb.c:368) ==3529== by 0x4644EC: rdbSaveLzfStringObject (rdb.c:365) ==3529== by 0x4644EC: rdbSaveRawString (rdb.c:448) ==3529== by 0x46556E: rdbSaveObject (rdb.c:934) ==3529== by 0x465A30: rdbSaveKeyValuePair (rdb.c:1114) ==3529== by 0x4660D3: rdbSaveRio (rdb.c:1265) ==3529== by 0x4688FF: rdbSave (rdb.c:1381) ==3529== by 0x468C00: rdbSaveBackground (rdb.c:1437) ==3529== by 0x43B70C: serverCron (server.c:2175) ==3529== by 0x433438: processTimeEvents (ae.c:318) ==3529== by 0x433438: aeProcessEvents (ae.c:457) ==3529== by 0x43384C: aeMain (ae.c:487) ==3529== by 0x42FFB0: main (server.c:6456) ==3529== ==3529== Conditional jump or move depends on uninitialised value(s) ==3529== at 0x443E66: lzf_compress (lzf_c.c:153) ==3529== by 0x464118: rdbSaveLzfStringObject.part.0 (rdb.c:368) ==3529== by 0x4644EC: rdbSaveLzfStringObject (rdb.c:365) ==3529== by 0x4644EC: rdbSaveRawString (rdb.c:448) ==3529== by 0x46532C: rdbSaveObject (rdb.c:811) ==3529== by 0x465A30: rdbSaveKeyValuePair (rdb.c:1114) ==3529== by 0x4660D3: rdbSaveRio (rdb.c:1265) ==3529== by 0x4688FF: rdbSave (rdb.c:1381) ==3529== by 0x468C00: rdbSaveBackground (rdb.c:1437) ==3529== by 0x43B70C: serverCron (server.c:2175) ==3529== by 0x433438: processTimeEvents (ae.c:318) ==3529== by 0x433438: aeProcessEvents (ae.c:457) ==3529== by 0x43384C: aeMain (ae.c:487) ==3529== by 0x42FFB0: main (server.c:6456) ==3529== ==3529== Conditional jump or move depends on uninitialised value(s) ==3529== at 0x443E6B: lzf_compress (lzf_c.c:153) ==3529== by 0x464118: rdbSaveLzfStringObject.part.0 (rdb.c:368) ==3529== by 0x4644EC: rdbSaveLzfStringObject (rdb.c:365) ==3529== by 0x4644EC: rdbSaveRawString (rdb.c:448) ==3529== by 0x46532C: rdbSaveObject (rdb.c:811) ==3529== by 0x465A30: rdbSaveKeyValuePair (rdb.c:1114) ==3529== by 0x4660D3: rdbSaveRio (rdb.c:1265) ==3529== by 0x4688FF: rdbSave (rdb.c:1381) ==3529== by 0x468C00: rdbSaveBackground (rdb.c:1437) ==3529== by 0x43B70C: serverCron (server.c:2175) ==3529== by 0x433438: processTimeEvents (ae.c:318) ==3529== by 0x433438: aeProcessEvents (ae.c:457) ==3529== by 0x43384C: aeMain (ae.c:487) ==3529== by 0x42FFB0: main (server.c:6456) ==3529== ==3529== Use of uninitialised value of size 8 ==3529== at 0x443E6D: lzf_compress (lzf_c.c:154) ==3529== by 0x464118: rdbSaveLzfStringObject.part.0 (rdb.c:368) ==3529== by 0x4644EC: rdbSaveLzfStringObject (rdb.c:365) ==3529== by 0x4644EC: rdbSaveRawString (rdb.c:448) ==3529== by 0x46532C: rdbSaveObject (rdb.c:811) ==3529== by 0x465A30: rdbSaveKeyValuePair (rdb.c:1114) ==3529== by 0x4660D3: rdbSaveRio (rdb.c:1265) ==3529== by 0x4688FF: rdbSave (rdb.c:1381) ==3529== by 0x468C00: rdbSaveBackground (rdb.c:1437) ==3529== by 0x43B70C: serverCron (server.c:2175) ==3529== by 0x433438: processTimeEvents (ae.c:318) ==3529== by 0x433438: aeProcessEvents (ae.c:457) ==3529== by 0x43384C: aeMain (ae.c:487) ==3529== by 0x42FFB0: main (server.c:6456) ==3529== ==3529== Use of uninitialised value of size 8 ==3529== at 0x443E7B: lzf_compress (lzf_c.c:158) ==3529== by 0x464118: rdbSaveLzfStringObject.part.0 (rdb.c:368) ==3529== by 0x4644EC: rdbSaveLzfStringObject (rdb.c:365) ==3529== by 0x4644EC: rdbSaveRawString (rdb.c:448) ==3529== by 0x46532C: rdbSaveObject (rdb.c:811) ==3529== by 0x465A30: rdbSaveKeyValuePair (rdb.c:1114) ==3529== by 0x4660D3: rdbSaveRio (rdb.c:1265) ==3529== by 0x4688FF: rdbSave (rdb.c:1381) ==3529== by 0x468C00: rdbSaveBackground (rdb.c:1437) ==3529== by 0x43B70C: serverCron (server.c:2175) ==3529== by 0x433438: processTimeEvents (ae.c:318) ==3529== by 0x433438: aeProcessEvents (ae.c:457) ==3529== by 0x43384C: aeMain (ae.c:487) ==3529== by 0x42FFB0: main (server.c:6456) ==3529== ==3529== Conditional jump or move depends on uninitialised value(s) ==3529== at 0x443E66: lzf_compress (lzf_c.c:153) ==3529== by 0x464118: rdbSaveLzfStringObject.part.0 (rdb.c:368) ==3529== by 0x4644EC: rdbSaveLzfStringObject (rdb.c:365) ==3529== by 0x4644EC: rdbSaveRawString (rdb.c:448) ==3529== by 0x465454: rdbSaveObject (rdb.c:874) ==3529== by 0x465A30: rdbSaveKeyValuePair (rdb.c:1114) ==3529== by 0x4660D3: rdbSaveRio (rdb.c:1265) ==3529== by 0x4688FF: rdbSave (rdb.c:1381) ==3529== by 0x468C00: rdbSaveBackground (rdb.c:1437) ==3529== by 0x43B70C: serverCron (server.c:2175) ==3529== by 0x433438: processTimeEvents (ae.c:318) ==3529== by 0x433438: aeProcessEvents (ae.c:457) ==3529== by 0x43384C: aeMain (ae.c:487) ==3529== by 0x42FFB0: main (server.c:6456) ==3529== ==3529== Conditional jump or move depends on uninitialised value(s) ==3529== at 0x443E6B: lzf_compress (lzf_c.c:153) ==3529== by 0x464118: rdbSaveLzfStringObject.part.0 (rdb.c:368) ==3529== by 0x4644EC: rdbSaveLzfStringObject (rdb.c:365) ==3529== by 0x4644EC: rdbSaveRawString (rdb.c:448) ==3529== by 0x465454: rdbSaveObject (rdb.c:874) ==3529== by 0x465A30: rdbSaveKeyValuePair (rdb.c:1114) ==3529== by 0x4660D3: rdbSaveRio (rdb.c:1265) ==3529== by 0x4688FF: rdbSave (rdb.c:1381) ==3529== by 0x468C00: rdbSaveBackground (rdb.c:1437) ==3529== by 0x43B70C: serverCron (server.c:2175) ==3529== by 0x433438: processTimeEvents (ae.c:318) ==3529== by 0x433438: aeProcessEvents (ae.c:457) ==3529== by 0x43384C: aeMain (ae.c:487) ==3529== by 0x42FFB0: main (server.c:6456) ==3529== ==3529== Use of uninitialised value of size 8 ==3529== at 0x443E6D: lzf_compress (lzf_c.c:154) ==3529== by 0x464118: rdbSaveLzfStringObject.part.0 (rdb.c:368) ==3529== by 0x4644EC: rdbSaveLzfStringObject (rdb.c:365) ==3529== by 0x4644EC: rdbSaveRawString (rdb.c:448) ==3529== by 0x465454: rdbSaveObject (rdb.c:874) ==3529== by 0x465A30: rdbSaveKeyValuePair (rdb.c:1114) ==3529== by 0x4660D3: rdbSaveRio (rdb.c:1265) ==3529== by 0x4688FF: rdbSave (rdb.c:1381) ==3529== by 0x468C00: rdbSaveBackground (rdb.c:1437) ==3529== by 0x43B70C: serverCron (server.c:2175) ==3529== by 0x433438: processTimeEvents (ae.c:318) ==3529== by 0x433438: aeProcessEvents (ae.c:457) ==3529== by 0x43384C: aeMain (ae.c:487) ==3529== by 0x42FFB0: main (server.c:6456) ==3529== ==3529== Use of uninitialised value of size 8 ==3529== at 0x443E7B: lzf_compress (lzf_c.c:158) ==3529== by 0x464118: rdbSaveLzfStringObject.part.0 (rdb.c:368) ==3529== by 0x4644EC: rdbSaveLzfStringObject (rdb.c:365) ==3529== by 0x4644EC: rdbSaveRawString (rdb.c:448) ==3529== by 0x465454: rdbSaveObject (rdb.c:874) ==3529== by 0x465A30: rdbSaveKeyValuePair (rdb.c:1114) ==3529== by 0x4660D3: rdbSaveRio (rdb.c:1265) ==3529== by 0x4688FF: rdbSave (rdb.c:1381) ==3529== by 0x468C00: rdbSaveBackground (rdb.c:1437) ==3529== by 0x43B70C: serverCron (server.c:2175) ==3529== by 0x433438: processTimeEvents (ae.c:318) ==3529== by 0x433438: aeProcessEvents (ae.c:457) ==3529== by 0x43384C: aeMain (ae.c:487) ==3529== by 0x42FFB0: main (server.c:6456) ==3529== ==3529== Conditional jump or move depends on uninitialised value(s) ==3529== at 0x443E66: lzf_compress (lzf_c.c:153) ==3529== by 0x464118: rdbSaveLzfStringObject.part.0 (rdb.c:368) ==3529== by 0x4644EC: rdbSaveLzfStringObject (rdb.c:365) ==3529== by 0x4644EC: rdbSaveRawString (rdb.c:448) ==3529== by 0x465A1C: rdbSaveKeyValuePair (rdb.c:1113) ==3529== by 0x4660D3: rdbSaveRio (rdb.c:1265) ==3529== by 0x4688FF: rdbSave (rdb.c:1381) ==3529== by 0x468C00: rdbSaveBackground (rdb.c:1437) ==3529== by 0x43B70C: serverCron (server.c:2175) ==3529== by 0x433438: processTimeEvents (ae.c:318) ==3529== by 0x433438: aeProcessEvents (ae.c:457) ==3529== by 0x43384C: aeMain (ae.c:487) ==3529== by 0x42FFB0: main (server.c:6456) ==3529== ==3529== Conditional jump or move depends on uninitialised value(s) ==3529== at 0x443E6B: lzf_compress (lzf_c.c:153) ==3529== by 0x464118: rdbSaveLzfStringObject.part.0 (rdb.c:368) ==3529== by 0x4644EC: rdbSaveLzfStringObject (rdb.c:365) ==3529== by 0x4644EC: rdbSaveRawString (rdb.c:448) ==3529== by 0x465A1C: rdbSaveKeyValuePair (rdb.c:1113) ==3529== by 0x4660D3: rdbSaveRio (rdb.c:1265) ==3529== by 0x4688FF: rdbSave (rdb.c:1381) ==3529== by 0x468C00: rdbSaveBackground (rdb.c:1437) ==3529== by 0x43B70C: serverCron (server.c:2175) ==3529== by 0x433438: processTimeEvents (ae.c:318) ==3529== by 0x433438: aeProcessEvents (ae.c:457) ==3529== by 0x43384C: aeMain (ae.c:487) ==3529== by 0x42FFB0: main (server.c:6456) ==3529== ==3529== Use of uninitialised value of size 8 ==3529== at 0x443E6D: lzf_compress (lzf_c.c:154) ==3529== by 0x464118: rdbSaveLzfStringObject.part.0 (rdb.c:368) ==3529== by 0x4644EC: rdbSaveLzfStringObject (rdb.c:365) ==3529== by 0x4644EC: rdbSaveRawString (rdb.c:448) ==3529== by 0x465A1C: rdbSaveKeyValuePair (rdb.c:1113) ==3529== by 0x4660D3: rdbSaveRio (rdb.c:1265) ==3529== by 0x4688FF: rdbSave (rdb.c:1381) ==3529== by 0x468C00: rdbSaveBackground (rdb.c:1437) ==3529== by 0x43B70C: serverCron (server.c:2175) ==3529== by 0x433438: processTimeEvents (ae.c:318) ==3529== by 0x433438: aeProcessEvents (ae.c:457) ==3529== by 0x43384C: aeMain (ae.c:487) ==3529== by 0x42FFB0: main (server.c:6456) ==3529== ==3529== Use of uninitialised value of size 8 ==3529== at 0x443E7B: lzf_compress (lzf_c.c:158) ==3529== by 0x464118: rdbSaveLzfStringObject.part.0 (rdb.c:368) ==3529== by 0x4644EC: rdbSaveLzfStringObject (rdb.c:365) ==3529== by 0x4644EC: rdbSaveRawString (rdb.c:448) ==3529== by 0x465A1C: rdbSaveKeyValuePair (rdb.c:1113) ==3529== by 0x4660D3: rdbSaveRio (rdb.c:1265) ==3529== by 0x4688FF: rdbSave (rdb.c:1381) ==3529== by 0x468C00: rdbSaveBackground (rdb.c:1437) ==3529== by 0x43B70C: serverCron (server.c:2175) ==3529== by 0x433438: processTimeEvents (ae.c:318) ==3529== by 0x433438: aeProcessEvents (ae.c:457) ==3529== by 0x43384C: aeMain (ae.c:487) ==3529== by 0x42FFB0: main (server.c:6456) ==3529== ==3529== ==3529== More than 10000000 total errors detected. I'm not reporting any more. ==3529== Final error counts will be inaccurate. Go fix your program! ==3529== Rerun with --error-limit=no to disable this cutoff. Note ==3529== that errors may occur in your program without prior warning from ==3529== Valgrind, because errors are no longer being displayed. ==3529== ==3529== ==3529== HEAP SUMMARY: ==3529== in use at exit: 34,327 bytes in 447 blocks ==3529== total heap usage: 771 allocs, 324 frees, 127,104 bytes allocated ==3529== ==3529== LEAK SUMMARY: ==3529== definitely lost: 0 bytes in 0 blocks ==3529== indirectly lost: 0 bytes in 0 blocks ==3529== possibly lost: 0 bytes in 0 blocks ==3529== still reachable: 34,327 bytes in 447 blocks ==3529== suppressed: 0 bytes in 0 blocks ==3529== Reachable blocks (those to which a pointer was found) are not shown. ==3529== To see them, rerun with: --leak-check=full --show-leak-kinds=all ==3529== ==3529== Use --track-origins=yes to see where uninitialised values come from ==3529== For lists of detected and suppressed errors, rerun with: -s ==3529== ERROR SUMMARY: 10000000 errors from 16 contexts (suppressed: 0 from 0)
This is a test I did with a single-machine version of redis instance, and it often has bugs
did not use make SANITIZER=addres
Comment From: oranagra
These lzf compression warnings are false positives (you can use the valgrind suppression file from Redis's src folder to silence them if they make a lot of noise).. Maybe you need to let it run longer..
Comment From: hui-QY
These lzf compression warnings are false positives (you can use the valgrind suppression file from Redis's src folder to silence them if they make a lot of noise).. Maybe you need to let it run longer..
ok
Comment From: zhipingu
These lzf compression warnings are false positives (you can use the valgrind suppression file from Redis's src folder to silence them if they make a lot of noise).. Maybe you need to let it run longer..
ok @Gongyihui what kind of os are you using? centos? I have encoutered similar problem with you. Would you tell me your email for contacting about this problem?
Comment From: hui-QY
These lzf compression warnings are false positives (you can use the valgrind suppression file from Redis's src folder to silence them if they make a lot of noise).. Maybe you need to let it run longer..
ok @Gongyihui what kind of os are you using? centos? I have encoutered similar problem with you. Would you tell me your email for contacting about this problem? The use of centos, however, did not solve this problem and migrated to the redis provided by the cloud vendor