=== REDIS BUG REPORT START: Cut & paste starting from here ===
17750:M 17 Jul 2022 15:45:17.314 # ------------------------------------------------
17750:M 17 Jul 2022 15:45:17.314 # !!! Software Failure. Press left mouse button to continue
17750:M 17 Jul 2022 15:45:17.314 # Guru Meditation: Unknown encoding type #object.c:533
------ STACK TRACE ------
Backtrace:
/usr/local/redis/bin/redis-server *:6380(getDecodedObject+0xb5)[0x456295]
/usr/local/redis/bin/redis-server *:6380(catAppendOnlyGenericCommand+0x70)[0x4818e0]
/usr/local/redis/bin/redis-server *:6380(catAppendOnlyExpireAtCommand+0x9f)[0x481acf]
/usr/local/redis/bin/redis-server *:6380(feedAppendOnlyFile+0xb5)[0x481bc5]
/usr/local/redis/bin/redis-server *:6380(propagate+0xa8)[0x43a0f8]
/usr/local/redis/bin/redis-server *:6380(call+0x445)[0x43a6e5]
/usr/local/redis/bin/redis-server *:6380(processCommand+0x603)[0x43bfb3]
/usr/local/redis/bin/redis-server *:6380(processCommandAndResetClient+0x1c)[0x44e04c]
/usr/local/redis/bin/redis-server *:6380(processInputBuffer+0xda)[0x45055a]
/usr/local/redis/bin/redis-server *:6380[0x4dc0ac]
/usr/local/redis/bin/redis-server *:6380(aeProcessEvents+0x29a)[0x4335da]
/usr/local/redis/bin/redis-server *:6380(aeMain+0x1d)[0x43384d]
/usr/local/redis/bin/redis-server *:6380(main+0x311)[0x42ffb1]
/lib64/libc.so.6(__libc_start_main+0xf5)[0x7f91fa5c1555]
/usr/local/redis/bin/redis-server *:6380[0x430479]
------ INFO OUTPUT ------
# Server
redis_version:6.2.7
redis_git_sha1:00000000
redis_git_dirty:0
redis_build_id:730396cb90846fce
redis_mode:standalone
os:Linux 4.19.188-10.el7.ucloud.x86_64 x86_64
arch_bits:64
monotonic_clock:POSIX clock_gettime
multiplexing_api:epoll
atomicvar_api:c11-builtin
gcc_version:9.3.1
process_id:17750
process_supervised:no
run_id:36826316e87d3d4fcd83d1949822fd003283786e
tcp_port:6380
server_time_usec:1658043917314777
uptime_in_seconds:928505
uptime_in_days:10
hz:10
configured_hz:10
lru_clock:13876749
executable:/usr/local/redis/bin/redis-server
config_file:/usr/local/redis/etc/redis-game_6380.conf
io_threads_active:0
# Clients
connected_clients:10
cluster_connections:0
maxclients:10000
client_recent_max_input_buffer:40
client_recent_max_output_buffer:0
blocked_clients:0
tracking_clients:0
clients_in_timeout_table:0
# Memory
used_memory:4726255312
used_memory_human:4.40G
used_memory_rss:4801019904
used_memory_rss_human:4.47G
used_memory_peak:4726448616
used_memory_peak_human:4.40G
used_memory_peak_perc:100.00%
used_memory_overhead:448806360
used_memory_startup:812096
used_memory_dataset:4277448952
used_memory_dataset_perc:90.52%
allocator_allocated:4726333264
allocator_active:4728483840
allocator_resident:4797272064
total_system_memory:67270676480
total_system_memory_human:62.65G
used_memory_lua:32768
used_memory_lua_human:32.00K
used_memory_scripts:0
used_memory_scripts_human:0B
number_of_cached_scripts:0
maxmemory:0
maxmemory_human:0B
maxmemory_policy:volatile-lru
allocator_frag_ratio:1.00
allocator_frag_bytes:2150576
allocator_rss_ratio:1.01
allocator_rss_bytes:68788224
rss_overhead_ratio:1.00
rss_overhead_bytes:3747840
mem_fragmentation_ratio:1.02
mem_fragmentation_bytes:74806320
mem_not_counted_for_evict:3066
mem_replication_backlog:1048576
mem_clients_slaves:20512
mem_clients_normal:205016
mem_aof_buffer:3072
mem_allocator:jemalloc-5.1.0
active_defrag_running:0
lazyfree_pending_objects:0
lazyfreed_objects:0
# Persistence
loading:0
current_cow_size:1413120
current_cow_size_age:6
current_fork_perc:11.69
current_save_keys_processed:571393
current_save_keys_total:4888228
rdb_changes_since_last_save:206899
rdb_bgsave_in_progress:1
rdb_last_save_time:1658043850
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:40
rdb_current_bgsave_time_sec:6
rdb_last_cow_size:203436032
aof_enabled:1
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:38
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:ok
aof_last_write_status:ok
aof_last_cow_size:267591680
module_fork_in_progress:0
module_fork_last_cow_size:0
aof_current_size:4786410437
aof_base_size:2415326022
aof_pending_rewrite:0
aof_buffer_length:0
aof_rewrite_buffer_length:0
aof_pending_bio_fsync:0
aof_delayed_fsync:0
# Stats
total_connections_received:88033
total_commands_processed:1537058739
instantaneous_ops_per_sec:5934
total_net_input_bytes:182525480718
total_net_output_bytes:561168018345
instantaneous_input_kbps:1767.97
instantaneous_output_kbps:2492.25
rejected_connections:0
sync_full:1
sync_partial_ok:0
sync_partial_err:0
expired_keys:98779
expired_stale_perc:0.05
expired_time_cap_reached_count:0
expire_cycle_cpu_milliseconds:76023
evicted_keys:0
keyspace_hits:551371501
keyspace_misses:62592619
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:69994
total_forks:11687
migrate_cached_sockets:0
slave_expires_tracked_keys:0
active_defrag_hits:0
active_defrag_misses:0
active_defrag_key_hits:0
active_defrag_key_misses:0
tracking_total_keys:0
tracking_total_items:0
tracking_total_prefixes:0
unexpected_error_replies:0
total_error_replies:39
dump_payload_sanitizations:0
total_reads_processed:1537146887
total_writes_processed:2421551177
io_threaded_reads_processed:0
io_threaded_writes_processed:0
# Replication
role:master
connected_slaves:1
slave0:ip=10.13.171.204,port=6380,state=online,offset=158869452958,lag=1
master_failover_state:no-failover
master_replid:0bbceac2aaa11225aec11ffd4c50fcdeff5eadb2
master_replid2:0000000000000000000000000000000000000000
master_repl_offset:158869619349
second_repl_offset:-1
repl_backlog_active:1
repl_backlog_size:1048576
repl_backlog_first_byte_offset:158868570774
repl_backlog_histlen:1048576
# CPU
used_cpu_sys:19183.463681
used_cpu_user:14773.179382
used_cpu_sys_children:13336.840931
used_cpu_user_children:174889.860482
used_cpu_sys_main_thread:19050.481504
used_cpu_user_main_thread:14757.067456
# Modules
# Commandstats
cmdstat_expire:calls=716380271,usec=1134582204,usec_per_call=1.58,rejected_calls=0,failed_calls=0
cmdstat_hset:calls=66369863,usec=450310764,usec_per_call=6.78,rejected_calls=0,failed_calls=0
cmdstat_psync:calls=1,usec=1987,usec_per_call=1987.00,rejected_calls=0,failed_calls=0
cmdstat_replconf:calls=922917,usec=1619288,usec_per_call=1.75,rejected_calls=0,failed_calls=0
cmdstat_keys:calls=1,usec=84,usec_per_call=84.00,rejected_calls=0,failed_calls=0
cmdstat_hdel:calls=1881732,usec=11769678,usec_per_call=6.25,rejected_calls=0,failed_calls=0
cmdstat_get:calls=305775809,usec=941714493,usec_per_call=3.08,rejected_calls=0,failed_calls=0
cmdstat_hget:calls=106104717,usec=439574206,usec_per_call=4.14,rejected_calls=0,failed_calls=0
cmdstat_command:calls=2,usec=937,usec_per_call=468.50,rejected_calls=0,failed_calls=0
cmdstat_incr:calls=15328011,usec=56078281,usec_per_call=3.66,rejected_calls=0,failed_calls=0
cmdstat_ping:calls=245512,usec=119107,usec_per_call=0.49,rejected_calls=7,failed_calls=0
cmdstat_setex:calls=20504,usec=138251,usec_per_call=6.74,rejected_calls=0,failed_calls=0
cmdstat_hvals:calls=202083585,usec=1299357654,usec_per_call=6.43,rejected_calls=0,failed_calls=0
cmdstat_auth:calls=88017,usec=329247,usec_per_call=3.74,rejected_calls=0,failed_calls=2
cmdstat_set:calls=110905355,usec=526766351,usec_per_call=4.75,rejected_calls=0,failed_calls=0
cmdstat_del:calls=10952443,usec=9292228,usec_per_call=0.85,rejected_calls=0,failed_calls=0
cmdstat_info:calls=0,usec=0,usec_per_call=0.00,rejected_calls=12,failed_calls=0
# Errorstats
errorstat_ERR:count=18
errorstat_NOAUTH:count=19
errorstat_WRONGPASS:count=2
# Cluster
cluster_enabled:0
# Keyspace
db0:keys=4888306,expires=4873630,avg_ttl=2246772591
------ CLIENT LIST OUTPUT ------
id=88024 addr=10.13.161.14:20130 laddr=10.13.17.55:6380 fd=8 name= age=230 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=52 qbuf-free=40902 argv-mem=29 obl=4 oll=0 omem=0 tot-mem=61493 events=r cmd=expire user=default redir=-1
id=88025 addr=10.13.161.14:20132 laddr=10.13.17.55:6380 fd=9 name= age=230 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=88030 addr=10.13.161.14:20184 laddr=10.13.17.55:6380 fd=22 name= age=107 idle=20 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=88032 addr=10.13.161.14:20188 laddr=10.13.17.55:6380 fd=24 name= age=107 idle=20 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=88015 addr=10.13.161.14:20058 laddr=10.13.17.55:6380 fd=19 name= age=380 idle=20 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=88028 addr=10.13.161.14:20160 laddr=10.13.17.55:6380 fd=11 name= age=170 idle=20 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=88012 addr=10.13.161.14:20014 laddr=10.13.17.55:6380 fd=13 name= age=440 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=4 addr=10.13.171.204:59380 laddr=10.13.17.55:6380 fd=10 name= age=928487 idle=0 flags=S db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=replconf user=default redir=-1
id=88033 addr=10.13.161.14:20228 laddr=10.13.17.55:6380 fd=12 name= age=20 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61464 events=r cmd=hget user=default redir=-1
id=88034 addr=10.13.161.14:20230 laddr=10.13.17.55:6380 fd=14 name= age=20 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=88035 addr=10.13.161.14:20232 laddr=10.13.17.55:6380 fd=15 name= age=20 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=expire user=default redir=-1
------ CURRENT CLIENT INFO ------
id=88024 addr=10.13.161.14:20130 laddr=10.13.17.55:6380 fd=8 name= age=230 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=52 qbuf-free=40902 argv-mem=29 obl=4 oll=0 omem=0 tot-mem=61493 events=r cmd=expire user=default redir=-1
argv[0]: 'EXPIRE'
argv[1]: 'aid_uid:11303214'
argv[2]: '2592000'
17750:M 17 Jul 2022 15:45:17.315 # key 'aid_uid:11303214' found in DB containing the following object:
17750:M 17 Jul 2022 15:45:17.315 # Object type: 0
17750:M 17 Jul 2022 15:45:17.315 # Object encoding: 1
17750:M 17 Jul 2022 15:45:17.315 # Object refcount: 1
------ MODULES INFO OUTPUT ------
------ FAST MEMORY TEST ------
17750:M 17 Jul 2022 15:45:17.316 # Bio thread for job type #0 terminated
17750:M 17 Jul 2022 15:45:17.316 # Bio thread for job type #1 terminated
17750:M 17 Jul 2022 15:45:17.317 # Bio thread for job type #2 terminated
*** Preparing to test memory region 5ec000 (2281472 bytes)
*** Preparing to test memory region 197a000 (135168 bytes)
*** Preparing to test memory region 7f9088a00000 (5664407552 bytes)
*** Preparing to test memory region 7f91da4ff000 (265289728 bytes)
*** Preparing to test memory region 7f91ea200000 (10485760 bytes)
*** Preparing to test memory region 7f91eac00000 (21106688 bytes)
*** Preparing to test memory region 7f91f0200000 (10485760 bytes)
*** Preparing to test memory region 7f91f0c00000 (2097152 bytes)
*** Preparing to test memory region 7f91f0eba000 (10485760 bytes)
*** Preparing to test memory region 7f91f18bb000 (10485760 bytes)
*** Preparing to test memory region 7f91f22bc000 (10485760 bytes)
*** Preparing to test memory region 7f91f2cbd000 (10485760 bytes)
*** Preparing to test memory region 7f91f9c00000 (8388608 bytes)
*** Preparing to test memory region 7f91fa968000 (20480 bytes)
*** Preparing to test memory region 7f91fab85000 (16384 bytes)
*** Preparing to test memory region 7f91fb4aa000 (24576 bytes)
*** Preparing to test memory region 7f91fb4b6000 (4096 bytes)
*** Preparing to test memory region 7f91fb4b7000 (4096 bytes)
*** Preparing to test memory region 7f91fb4ba000 (4096 bytes)
.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O
Fast memory test PASSED, however your memory can still be broken. Please run a memory test for several hours if possible.
=== REDIS BUG REPORT END. Make sure to include from START to END. ===
Please report the crash by opening an issue on github:
http://github.com/redis/redis/issues
Suspect RAM error? Use redis-server --test-memory to verify it.
Comment From: oranagra
@Gongyihui thank you for reporting. this crash seems very interesting but we can't yet explain what exactly happened there (other than guess some random memory corruption).
if you happen to be able to reproduce it, please share. preferably in private (email to redis@redis.io) since memory corruptions could sometimes have security implications.
Comment From: hui-QY
@Gongyihui谢谢你的报道。 这次崩溃看起来很有趣，但我们还不能解释那里到底发生了什么（除了猜测一些随机内存损坏）。
如果您碰巧能够复制它，请分享。 最好是私下（通过电子邮件发送给redis@redis.io），因为内存损坏有时可能会产生安全隐患。
Ok thank you
Comment From: hui-QY
@Gongyihui谢谢你的报道。 这次崩溃看起来很有趣，但我们还不能解释那里到底发生了什么（除了猜测一些随机内存损坏）。
如果您碰巧能够复制它，请分享。 最好是私下（通过电子邮件发送给redis@redis.io），因为内存损坏有时可能会产生安全隐患。
encountered a new bug. I have encountered a lot of bugs recently, and I am a little suspicious if we are using the wrong way. (╯︵╰)
Comment From: hui-QY
=== REDIS BUG REPORT START: Cut & paste starting from here ===
23082:M 18 Jul 2022 17:24:14.478 # === ASSERTION FAILED ===
23082:M 18 Jul 2022 17:24:14.478 # ==> dict.c:220 'd->ht[0].size > (unsigned long)d->rehashidx' is not true
------ STACK TRACE ------
Backtrace:
/usr/local/redis/bin/redis-server 10.13.79.31:7005 [cluster](dictRehash+0x114)[0x434da4]
/usr/local/redis/bin/redis-server 10.13.79.31:7005 [cluster](dictRehashMilliseconds+0xbb)[0x43507b]
/usr/local/redis/bin/redis-server 10.13.79.31:7005 [cluster](incrementallyRehash+0x42)[0x4376e2]
/usr/local/redis/bin/redis-server 10.13.79.31:7005 [cluster](databasesCron+0xf9)[0x437db9]
/usr/local/redis/bin/redis-server 10.13.79.31:7005 [cluster](serverCron+0x12a)[0x43b27a]
/usr/local/redis/bin/redis-server 10.13.79.31:7005 [cluster](aeProcessEvents+0xf9)[0x433439]
/usr/local/redis/bin/redis-server 10.13.79.31:7005 [cluster](aeMain+0x1d)[0x43384d]
/usr/local/redis/bin/redis-server 10.13.79.31:7005 [cluster](main+0x311)[0x42ffb1]
/lib64/libc.so.6(__libc_start_main+0xf5)[0x7fe4928fa555]
/usr/local/redis/bin/redis-server 10.13.79.31:7005 [cluster][0x430479]
------ INFO OUTPUT ------
# Server
redis_version:6.2.7
redis_git_sha1:00000000
redis_git_dirty:0
redis_build_id:5ecc1bf14fa293cf
redis_mode:cluster
os:Linux 4.19.188-10.el7.ucloud.x86_64 x86_64
arch_bits:64
monotonic_clock:POSIX clock_gettime
multiplexing_api:epoll
atomicvar_api:c11-builtin
gcc_version:9.3.1
process_id:23082
process_supervised:no
run_id:57d791f59fd84fc238eb2f64d29d95848a7a72ca
tcp_port:7005
server_time_usec:1658136254476111
uptime_in_seconds:1035765
uptime_in_days:11
hz:10
configured_hz:10
lru_clock:13969086
executable:/usr/local/redis/bin/redis-server
config_file:/data/redis/redis-cluster/7005/redis_7005.conf
io_threads_active:0
# Clients
connected_clients:46
cluster_connections:18
maxclients:10000
client_recent_max_input_buffer:48
client_recent_max_output_buffer:0
blocked_clients:0
tracking_clients:0
clients_in_timeout_table:0
# Memory
used_memory:1056319272
used_memory_human:1007.38M
used_memory_rss:1084391424
used_memory_rss_human:1.01G
used_memory_peak:1056693776
used_memory_peak_human:1007.74M
used_memory_peak_perc:99.96%
used_memory_overhead:221713608
used_memory_startup:1514448
used_memory_dataset:834605664
used_memory_dataset_perc:79.12%
allocator_allocated:1056471592
allocator_active:1060986880
allocator_resident:1085444096
total_system_memory:16537907200
total_system_memory_human:15.40G
used_memory_lua:32768
used_memory_lua_human:32.00K
used_memory_scripts:0
used_memory_scripts_human:0B
number_of_cached_scripts:0
maxmemory:0
maxmemory_human:0B
maxmemory_policy:volatile-lru
allocator_frag_ratio:1.00
allocator_frag_bytes:4515288
allocator_rss_ratio:1.02
allocator_rss_bytes:24457216
rss_overhead_ratio:1.00
rss_overhead_bytes:-1052672
mem_fragmentation_ratio:1.03
mem_fragmentation_bytes:28032872
mem_not_counted_for_evict:3066
mem_replication_backlog:1048576
mem_clients_slaves:41024
mem_clients_normal:943072
mem_aof_buffer:3072
mem_allocator:jemalloc-5.1.0
active_defrag_running:0
lazyfree_pending_objects:0
lazyfreed_objects:0
# Persistence
loading:0
current_cow_size:0
current_cow_size_age:0
current_fork_perc:0.00
current_save_keys_processed:0
current_save_keys_total:0
rdb_changes_since_last_save:564945
rdb_bgsave_in_progress:0
rdb_last_save_time:1658135794
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:8
rdb_current_bgsave_time_sec:-1
rdb_last_cow_size:12013568
aof_enabled:1
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:9
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:ok
aof_last_write_status:ok
aof_last_cow_size:12197888
module_fork_in_progress:0
module_fork_last_cow_size:0
aof_current_size:876144448
aof_base_size:495503033
aof_pending_rewrite:0
aof_buffer_length:46
aof_rewrite_buffer_length:0
aof_pending_bio_fsync:0
aof_delayed_fsync:0
# Stats
total_connections_received:428986
total_commands_processed:3316877087
instantaneous_ops_per_sec:5045
total_net_input_bytes:102701595656
total_net_output_bytes:266775441102
instantaneous_input_kbps:150.04
instantaneous_output_kbps:398.20
rejected_connections:0
sync_full:1
sync_partial_ok:2
sync_partial_err:1
expired_keys:4913454
expired_stale_perc:3.14
expired_time_cap_reached_count:0
expire_cycle_cpu_milliseconds:131328
evicted_keys:0
keyspace_hits:447170097
keyspace_misses:309766626
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:15356
total_forks:1850
migrate_cached_sockets:0
slave_expires_tracked_keys:0
active_defrag_hits:0
active_defrag_misses:0
active_defrag_key_hits:0
active_defrag_key_misses:0
tracking_total_keys:0
tracking_total_items:0
tracking_total_prefixes:0
unexpected_error_replies:0
total_error_replies:81
dump_payload_sanitizations:0
total_reads_processed:3317282814
total_writes_processed:5090134146
io_threaded_reads_processed:0
io_threaded_writes_processed:0
# Replication
role:master
connected_slaves:2
slave0:ip=10.13.181.219,port=7008,state=online,offset=114938477701,lag=1
slave1:ip=10.13.115.123,port=7002,state=online,offset=114938507443,lag=1
master_failover_state:no-failover
master_replid:6e83d31ced255ef81d565109bc193a4919effcce
master_replid2:68ee17099236ce55919d13c0530bbd31c511fe31
master_repl_offset:114938545271
second_repl_offset:65618755083
repl_backlog_active:1
repl_backlog_size:1048576
repl_backlog_first_byte_offset:114937496696
repl_backlog_histlen:1048576
# CPU
used_cpu_sys:44771.101916
used_cpu_user:31718.511113
used_cpu_sys_children:720.441449
used_cpu_user_children:9574.682672
used_cpu_sys_main_thread:44669.197560
used_cpu_user_main_thread:31706.498519
# Modules
module:name=bf,ver=20203,api=1,filters=0,usedby=[],using=[],options=[]
# Commandstats
cmdstat_replconf:calls=2055112,usec=2487599,usec_per_call=1.21,rejected_calls=0,failed_calls=0
cmdstat_expire:calls=272533730,usec=455044103,usec_per_call=1.67,rejected_calls=0,failed_calls=0
cmdstat_command:calls=2,usec=1776,usec_per_call=888.00,rejected_calls=0,failed_calls=0
cmdstat_host_:calls=0,usec=0,usec_per_call=0.00,rejected_calls=9,failed_calls=0
cmdstat_info:calls=0,usec=0,usec_per_call=0.00,rejected_calls=15,failed_calls=0
cmdstat_get:calls=730497487,usec=1565157876,usec_per_call=2.14,rejected_calls=12,failed_calls=0
cmdstat_hget:calls=24240512,usec=76134803,usec_per_call=3.14,rejected_calls=0,failed_calls=0
cmdstat_dbsize:calls=20,usec=19,usec_per_call=0.95,rejected_calls=0,failed_calls=0
cmdstat_select:calls=1,usec=2,usec_per_call=2.00,rejected_calls=0,failed_calls=0
cmdstat_hvals:calls=2198724,usec=8068660,usec_per_call=3.67,rejected_calls=0,failed_calls=0
cmdstat_del:calls=195827381,usec=553650154,usec_per_call=2.83,rejected_calls=0,failed_calls=0
cmdstat_hdel:calls=5908,usec=8656,usec_per_call=1.47,rejected_calls=0,failed_calls=0
cmdstat_hset:calls=5133551,usec=14018859,usec_per_call=2.73,rejected_calls=0,failed_calls=0
cmdstat_set:calls=215309586,usec=1436977022,usec_per_call=6.67,rejected_calls=0,failed_calls=0
cmdstat_psync:calls=3,usec=9103,usec_per_call=3034.33,rejected_calls=0,failed_calls=0
cmdstat_incr:calls=208842324,usec=570888020,usec_per_call=2.73,rejected_calls=0,failed_calls=0
cmdstat_auth:calls=428854,usec=1557959,usec_per_call=3.63,rejected_calls=0,failed_calls=0
cmdstat_cluster:calls=49,usec=2731,usec_per_call=55.73,rejected_calls=1,failed_calls=0
cmdstat_setex:calls=2438892,usec=19919032,usec_per_call=8.17,rejected_calls=0,failed_calls=0
cmdstat_ping:calls=1657364951,usec=534560033,usec_per_call=0.32,rejected_calls=9,failed_calls=0
# Errorstats
errorstat_ERR:count=47
errorstat_LOADING:count=1
errorstat_NOAUTH:count=33
# Cluster
cluster_enabled:1
# Keyspace
db0:keys=2098602,expires=2097219,avg_ttl=1731283111023
------ CLIENT LIST OUTPUT ------
id=428969 addr=10.13.142.210:36992 laddr=10.13.79.31:7005 fd=55 name= age=59 idle=6 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=428970 addr=10.13.142.210:36994 laddr=10.13.79.31:7005 fd=58 name= age=59 idle=29 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=996 addr=10.13.181.219:26063 laddr=10.13.79.31:7005 fd=27 name= age=1034483 idle=0 flags=S db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=46 oll=0 omem=0 tot-mem=20512 events=r cmd=replconf user=default redir=-1
id=428966 addr=10.13.180.225:62206 laddr=10.13.79.31:7005 fd=31 name= age=62 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=428961 addr=10.13.127.128:61012 laddr=10.13.79.31:7005 fd=15 name= age=88 idle=28 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=428908 addr=10.13.139.229:58376 laddr=10.13.79.31:7005 fd=47 name= age=239 idle=29 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=428963 addr=10.13.180.225:62164 laddr=10.13.79.31:7005 fd=30 name= age=71 idle=11 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=428980 addr=10.13.41.219:24560 laddr=10.13.79.31:7005 fd=49 name= age=37 idle=7 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=428975 addr=10.13.138.111:35810 laddr=10.13.79.31:7005 fd=34 name= age=52 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61464 events=r cmd=expire user=default redir=-1
id=428976 addr=10.13.138.111:35812 laddr=10.13.79.31:7005 fd=43 name= age=52 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=hget user=default redir=-1
id=428977 addr=10.13.138.111:35814 laddr=10.13.79.31:7005 fd=67 name= age=52 idle=18 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=hget user=default redir=-1
id=428984 addr=10.13.127.128:61206 laddr=10.13.79.31:7005 fd=24 name= age=28 idle=12 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=expire user=default redir=-1
id=428894 addr=10.13.41.219:24254 laddr=10.13.79.31:7005 fd=33 name= age=277 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61464 events=r cmd=expire user=default redir=-1
id=428854 addr=10.13.142.210:36564 laddr=10.13.79.31:7005 fd=54 name= age=389 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=incr user=default redir=-1
id=428785 addr=10.13.41.219:23870 laddr=10.13.79.31:7005 fd=63 name= age=577 idle=7 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=428949 addr=10.13.142.210:36910 laddr=10.13.79.31:7005 fd=39 name= age=119 idle=29 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=428946 addr=10.13.180.225:62010 laddr=10.13.79.31:7005 fd=62 name= age=122 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=428972 addr=10.13.127.128:61070 laddr=10.13.79.31:7005 fd=10 name= age=58 idle=28 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=428973 addr=10.13.127.128:61072 laddr=10.13.79.31:7005 fd=12 name= age=58 idle=28 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=428974 addr=10.13.127.128:61074 laddr=10.13.79.31:7005 fd=38 name= age=58 idle=28 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=428885 addr=10.13.142.210:36668 laddr=10.13.79.31:7005 fd=51 name= age=299 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=428987 addr=10.13.127.128:61246 laddr=10.13.79.31:7005 fd=35 name= age=7 idle=7 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=auth user=default redir=-1
id=428988 addr=10.13.127.128:61248 laddr=10.13.79.31:7005 fd=37 name= age=7 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=428989 addr=10.13.127.128:61250 laddr=10.13.79.31:7005 fd=61 name= age=7 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61464 events=r cmd=expire user=default redir=-1
id=428954 addr=10.13.138.111:35696 laddr=10.13.79.31:7005 fd=22 name= age=112 idle=22 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=428955 addr=10.13.138.111:35698 laddr=10.13.79.31:7005 fd=59 name= age=112 idle=22 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=428967 addr=10.13.79.238:40114 laddr=10.13.79.31:7005 fd=36 name= age=59 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=hget user=default redir=-1
id=428968 addr=10.13.79.238:40116 laddr=10.13.79.31:7005 fd=45 name= age=59 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=7 oll=0 omem=0 tot-mem=61448 events=r cmd=ping user=default redir=-1
id=428960 addr=10.13.139.229:58568 laddr=10.13.79.31:7005 fd=71 name= age=89 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61464 events=r cmd=expire user=default redir=-1
id=428985 addr=10.13.180.225:62368 laddr=10.13.79.31:7005 fd=13 name= age=11 idle=11 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=auth user=default redir=-1
id=428986 addr=10.13.180.225:62370 laddr=10.13.79.31:7005 fd=21 name= age=11 idle=11 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=auth user=default redir=-1
id=428928 addr=10.13.139.229:58462 laddr=10.13.79.31:7005 fd=57 name= age=179 idle=29 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=428919 addr=10.13.79.238:39832 laddr=10.13.79.31:7005 fd=70 name= age=209 idle=12 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=hget user=default redir=-1
id=428944 addr=10.13.41.219:24458 laddr=10.13.79.31:7005 fd=48 name= age=127 idle=7 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=428959 addr=10.13.180.225:62128 laddr=10.13.79.31:7005 fd=42 name= age=92 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=428971 addr=10.13.139.229:58614 laddr=10.13.79.31:7005 fd=32 name= age=59 idle=16 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=expire user=default redir=-1
id=428964 addr=10.13.127.128:61046 laddr=10.13.79.31:7005 fd=40 name= age=67 idle=7 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=428983 addr=10.13.139.229:58648 laddr=10.13.79.31:7005 fd=65 name= age=29 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=428978 addr=10.13.180.225:62284 laddr=10.13.79.31:7005 fd=7 name= age=41 idle=11 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=428979 addr=10.13.180.225:62286 laddr=10.13.79.31:7005 fd=19 name= age=41 idle=11 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=428965 addr=10.13.127.128:61048 laddr=10.13.79.31:7005 fd=44 name= age=67 idle=7 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=1094 addr=10.13.115.123:21807 laddr=10.13.79.31:7005 fd=74 name= age=1034216 idle=0 flags=S db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=46 oll=0 omem=0 tot-mem=61464 events=r cmd=replconf user=default redir=-1
id=428947 addr=10.13.79.238:40002 laddr=10.13.79.31:7005 fd=41 name= age=119 idle=29 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=428948 addr=10.13.79.238:40004 laddr=10.13.79.31:7005 fd=50 name= age=119 idle=29 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=428958 addr=10.13.41.219:24488 laddr=10.13.79.31:7005 fd=46 name= age=97 idle=7 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=428981 addr=10.13.180.225:62326 laddr=10.13.79.31:7005 fd=28 name= age=32 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61464 events=r cmd=expire user=default redir=-1
id=428990 addr=10.13.41.219:24614 laddr=10.13.79.31:7005 fd=72 name= age=7 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=del user=default redir=-1
id=428982 addr=10.13.180.225:62328 laddr=10.13.79.31:7005 fd=64 name= age=32 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61464 events=r cmd=expire user=default redir=-1
------ MODULES INFO OUTPUT ------
------ FAST MEMORY TEST ------
23082:M 18 Jul 2022 17:24:14.479 # Bio thread for job type #0 terminated
23082:M 18 Jul 2022 17:24:14.479 # Bio thread for job type #1 terminated
23082:M 18 Jul 2022 17:24:14.479 # Bio thread for job type #2 terminated
*** Preparing to test memory region 5ec000 (2281472 bytes)
*** Preparing to test memory region 27b2000 (135168 bytes)
*** Preparing to test memory region 7fe420000000 (1006768128 bytes)
*** Preparing to test memory region 7fe460000000 (10485760 bytes)
*** Preparing to test memory region 7fe460c00000 (10485760 bytes)
*** Preparing to test memory region 7fe461600000 (2097152 bytes)
*** Preparing to test memory region 7fe461a00000 (10485760 bytes)
*** Preparing to test memory region 7fe462400000 (494927872 bytes)
*** Preparing to test memory region 7fe47fda6000 (150994944 bytes)
*** Preparing to test memory region 7fe488da7000 (10485760 bytes)
*** Preparing to test memory region 7fe4897a8000 (10485760 bytes)
*** Preparing to test memory region 7fe48a1a9000 (10485760 bytes)
*** Preparing to test memory region 7fe48abaa000 (10485760 bytes)
*** Preparing to test memory region 7fe48b7bd000 (3145728 bytes)
*** Preparing to test memory region 7fe492000000 (8388608 bytes)
*** Preparing to test memory region 7fe492ca1000 (20480 bytes)
*** Preparing to test memory region 7fe492ebe000 (16384 bytes)
*** Preparing to test memory region 7fe4937e3000 (24576 bytes)
*** Preparing to test memory region 7fe4937ef000 (4096 bytes)
*** Preparing to test memory region 7fe4937f0000 (4096 bytes)
*** Preparing to test memory region 7fe4937f3000 (4096 bytes)
.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O
Fast memory test PASSED, however your memory can still be broken. Please run a memory test for several hours if possible.
=== REDIS BUG REPORT END. Make sure to include from START to END. ===
Please report the crash by opening an issue on github:
http://github.com/redis/redis/issues
Suspect RAM error? Use redis-server --test-memory to verify it.
Comment From: hui-QY
Upgraded from 5.0.14 to 6.2.7
Comment From: oranagra
ok, that last crash looks similar to the one mentioned in the top of #10905 (different version) and i now see that you commented on that issue (reporting another crash in an older version). it's really odd that you experience all of these, i suspect some memory corruption.
few quick / random questions: 1. are you by any chance using docker on Apple M1 or any other ARM based machine? 2. is your hardware using ECC memory?
Comment From: oranagra
ohh, in your last post i see this:
# Modules
module:name=bf,ver=20203,api=1,filters=0,usedby=[],using=[],options=[]
what's that? did you load that intentionally or maybe you're under some attack? obviously a buggy module can corrupt the memory and cause the issues you're experiencing.
Comment From: oranagra
i don't see any BF. commands in the command stats, so it might not be bloom filter, but i also don't see any MODULE LOAD commands in the command stats, so i assume it was loaded on purpose from the config file and unused?
what i do see though is cmdstat_host_, which looks like some kind of attack (see http://benmmurphy.github.io/blog/2015/06/04/redis-eval-lua-sandbox-escape/)
Comment From: hui-QY
好的，这一次突然崩溃与#10905 顶部提到的类似（不同版本） ，我现在很高兴看到您对问题发表了评论（报告旧版本中的第二次崩溃）。估计，我怀疑一些内存损坏。
几个/经常的问题：
- 您是否有机会在 Apple M1 或任何其他基于 ARM 的机器上使用 docker？
- 您的硬件是否使用 ECC 内存？
1 There are no such machines 2 I need to confirm with the cloud vendor to reply to you
好的，最后一次崩溃看起来与#10905顶部提到的类似（不同版本） ，我现在看到您对这个问题发表了评论（报告旧版本中的另一次崩溃）。 你经历所有这些真的很奇怪，我怀疑一些内存损坏。
几个快速/随机的问题：
- 您是否有机会在 Apple M1 或任何其他基于 ARM 的机器上使用 docker？
- 您的硬件是否使用 ECC 内存？
ok, that last crash looks similar to the one mentioned in the top of #10905 (different version) and i now see that you commented on that issue (reporting another crash in an older version). it's really odd that you experience all of these, i suspect some memory corruption.
few quick / random questions:
- are you by any chance using docker on Apple M1 or any other ARM based machine?
- is your hardware using ECC memory?
ok, that last crash looks similar to the one mentioned in the top of #10905 (different version) and i now see that you commented on that issue (reporting another crash in an older version). it's really odd that you experience all of these, i suspect some memory corruption.
few quick / random questions:
- are you by any chance using docker on Apple M1 or any other ARM based machine?
- is your hardware using ECC memory?
1 There are no such machines 2 I need to confirm with the cloud vendor to reply to you
Comment From: hui-QY
哦，在你的上一篇文章中，我看到了这个：
```
Modules
module:name=bf,ver=20203,api=1,filters=0,usedby=[],using=[],options=[] ```
那是什么？你是故意加载的还是你受到了一些攻击？ 显然，有缺陷的模块会损坏内存并导致您遇到的问题。
Bloom filter module loaded, but haven't used it yet
loadmodule /opt/app/RedisBloom-2.2.3/redisbloom.so
Comment From: zhipingu
@Gongyihui 您好，我遇到了类似的问题，能不能加个联系方式？