28689:M 31 Dec 2022 11:05:02.729 - Accepted 10.13.142.210:57626
28689:M 31 Dec 2022 11:05:05.680 - DB 0: 8968650 keys (8389383 volatile) in 16777216 slots HT.
28689:M 31 Dec 2022 11:05:10.786 - DB 0: 8968684 keys (8389415 volatile) in 16777216 slots HT.
28689:M 31 Dec 2022 11:05:15.892 - DB 0: 8968711 keys (8389440 volatile) in 16777216 slots HT.
28689:M 31 Dec 2022 11:05:21.004 - DB 0: 8968737 keys (8389464 volatile) in 16777216 slots HT.
28689:M 31 Dec 2022 11:05:25.060 - Accepted 10.13.79.238:35360
28689:M 31 Dec 2022 11:05:25.060 - Accepted 10.13.79.238:35362
28689:M 31 Dec 2022 11:05:25.060 - Accepted 10.13.79.238:35364
28689:M 31 Dec 2022 11:05:25.358 - Accepted 10.13.127.128:30862
28689:M 31 Dec 2022 11:05:25.358 - Accepted 10.13.127.128:30864
28689:M 31 Dec 2022 11:05:25.358 - Accepted 10.13.127.128:30866
28689:M 31 Dec 2022 11:05:26.109 - DB 0: 8968767 keys (8389492 volatile) in 16777216 slots HT.
28689:M 31 Dec 2022 11:05:29.072 * 10000 changes in 600 seconds. Saving...
28689:M 31 Dec 2022 11:05:29.137 * Background saving started by pid 7647
28689:M 31 Dec 2022 11:05:29.137 - Accepted 10.13.139.229:24160
28689:M 31 Dec 2022 11:05:29.137 - Accepted 10.13.139.229:24162
28689:M 31 Dec 2022 11:05:29.137 - Accepted 10.13.139.229:24164
28689:M 31 Dec 2022 11:05:29.137 - Accepted 10.13.165.58:54600
28689:M 31 Dec 2022 11:05:29.137 - Accepted 10.13.139.229:24166
28689:M 31 Dec 2022 11:05:29.137 - Accepted 10.13.165.58:54602
28689:M 31 Dec 2022 11:05:29.137 - Accepted 10.13.142.210:57764
7647:C 31 Dec 2022 11:05:29.225 - RDB: 5 MB of memory used by copy-on-write
28689:M 31 Dec 2022 11:05:31.247 - DB 0: 8968796 keys (8389521 volatile) in 16777216 slots HT.
=== REDIS BUG REPORT START: Cut & paste starting from here ===
7647:C 31 Dec 2022 11:05:35.641 # === ASSERTION FAILED ===
7647:C 31 Dec 2022 11:05:35.641 # ==> dict.c:220 'd->ht[0].size > (unsigned long)d->rehashidx' is not true
------ STACK TRACE ------
Backtrace:
redis-rdb-bgsave 10.13.79.31:7005 [cluster](dictRehash+0x114)[0x434da4]
redis-rdb-bgsave 10.13.79.31:7005 [cluster](dictFind+0xc2)[0x435722]
redis-rdb-bgsave 10.13.79.31:7005 [cluster](getExpire+0x21)[0x459bf1]
redis-rdb-bgsave 10.13.79.31:7005 [cluster](rdbSaveRio+0x211)[0x4660c1]
redis-rdb-bgsave 10.13.79.31:7005 [cluster](rdbSave+0x90)[0x468900]
redis-rdb-bgsave 10.13.79.31:7005 [cluster](rdbSaveBackground+0xc1)[0x468c01]
redis-rdb-bgsave 10.13.79.31:7005 [cluster](serverCron+0x5bd)[0x43b70d]
redis-rdb-bgsave 10.13.79.31:7005 [cluster](aeProcessEvents+0xf9)[0x433439]
redis-rdb-bgsave 10.13.79.31:7005 [cluster](aeMain+0x1d)[0x43384d]
redis-rdb-bgsave 10.13.79.31:7005 [cluster](main+0x311)[0x42ffb1]
/lib64/libc.so.6(__libc_start_main+0xf5)[0x7ff310ba8555]
redis-rdb-bgsave 10.13.79.31:7005 [cluster][0x430479]
------ INFO OUTPUT ------
# Server
redis_version:6.2.7
redis_git_sha1:00000000
redis_git_dirty:0
redis_build_id:5ecc1bf14fa293cf
redis_mode:cluster
os:Linux 4.19.188-10.el7.ucloud.x86_64 x86_64
arch_bits:64
monotonic_clock:POSIX clock_gettime
multiplexing_api:epoll
atomicvar_api:c11-builtin
gcc_version:9.3.1
process_id:7647
process_supervised:no
run_id:db55b8277267405c876a457ea08b6231b39e2dbc
tcp_port:7005
server_time_usec:1672455929070320
uptime_in_seconds:11284163
uptime_in_days:130
hz:10
configured_hz:10
lru_clock:11511545
executable:/usr/local/redis/bin/redis-server
config_file:/data/redis/redis-cluster/7005/redis_7005.conf
io_threads_active:0
# Clients
connected_clients:72
cluster_connections:18
maxclients:10000
client_recent_max_input_buffer:48
client_recent_max_output_buffer:0
blocked_clients:0
tracking_clients:0
clients_in_timeout_table:0
# Memory
used_memory:3934950320
used_memory_human:3.66G
used_memory_rss:4096077824
used_memory_rss_human:3.81G
used_memory_peak:3943154032
used_memory_peak_human:3.67G
used_memory_peak_perc:99.79%
used_memory_overhead:899706568
used_memory_startup:1494744
used_memory_dataset:3035243752
used_memory_dataset_perc:77.16%
allocator_allocated:3935143688
allocator_active:4034244608
allocator_resident:4119138304
total_system_memory:16537907200
total_system_memory_human:15.40G
used_memory_lua:32768
used_memory_lua_human:32.00K
used_memory_scripts:0
used_memory_scripts_human:0B
number_of_cached_scripts:0
maxmemory:0
maxmemory_human:0B
maxmemory_policy:volatile-lru
allocator_frag_ratio:1.03
allocator_frag_bytes:99100920
allocator_rss_ratio:1.02
allocator_rss_bytes:84893696
rss_overhead_ratio:0.99
rss_overhead_bytes:-23060480
mem_fragmentation_ratio:1.04
mem_fragmentation_bytes:161047408
mem_not_counted_for_evict:2554
mem_replication_backlog:1048576
mem_clients_slaves:41024
mem_clients_normal:1476088
mem_aof_buffer:2560
mem_allocator:jemalloc-5.1.0
active_defrag_running:0
lazyfree_pending_objects:0
lazyfreed_objects:0
# Persistence
loading:0
current_cow_size:0
current_cow_size_age:0
current_fork_perc:0.00
current_save_keys_processed:0
current_save_keys_total:0
rdb_changes_since_last_save:960819
rdb_bgsave_in_progress:0
rdb_last_save_time:1672455328
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:32
rdb_current_bgsave_time_sec:-1
rdb_last_cow_size:122814464
aof_enabled:1
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:33
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:ok
aof_last_write_status:ok
aof_last_cow_size:119205888
module_fork_in_progress:0
module_fork_last_cow_size:0
aof_current_size:2873518351
aof_base_size:1851045525
aof_pending_rewrite:0
aof_buffer_length:0
aof_rewrite_buffer_length:0
aof_pending_bio_fsync:0
aof_delayed_fsync:10
# Stats
total_connections_received:5625527
total_commands_processed:72610121113
instantaneous_ops_per_sec:4546
total_net_input_bytes:2380917227557
total_net_output_bytes:7705099536332
instantaneous_input_kbps:184.99
instantaneous_output_kbps:601.39
rejected_connections:0
sync_full:19
sync_partial_ok:2
sync_partial_err:0
expired_keys:13970372
expired_stale_perc:0.13
expired_time_cap_reached_count:0
expire_cycle_cpu_milliseconds:937293
evicted_keys:0
keyspace_hits:12341430839
keyspace_misses:762960676
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:67017
total_forks:19295
migrate_cached_sockets:0
slave_expires_tracked_keys:0
active_defrag_hits:0
active_defrag_misses:0
active_defrag_key_hits:0
active_defrag_key_misses:0
tracking_total_keys:0
tracking_total_items:0
tracking_total_prefixes:0
unexpected_error_replies:0
total_error_replies:4001
dump_payload_sanitizations:0
total_reads_processed:72615651855
total_writes_processed:135561082379
io_threaded_reads_processed:0
io_threaded_writes_processed:0
# Replication
role:master
connected_slaves:2
slave0:ip=10.13.181.219,port=7008,state=online,offset=1772849357888,lag=7
slave1:ip=10.13.115.123,port=7002,state=online,offset=1772849377951,lag=6
master_failover_state:no-failover
master_replid:cb56b60427717af7d024392a371541b6f4464a6e
master_replid2:0903e5c1b42b863e14a6957d264c972492dfdd6e
master_repl_offset:1772849382283
second_repl_offset:433908752382
repl_backlog_active:1
repl_backlog_size:1048576
repl_backlog_first_byte_offset:1772848333708
repl_backlog_histlen:1048576
# CPU
used_cpu_sys:0.723422
used_cpu_user:5.700332
used_cpu_sys_children:0.000000
used_cpu_user_children:0.000000
used_cpu_sys_main_thread:0.723422
used_cpu_user_main_thread:5.700332
# Modules
# Commandstats
cmdstat_host_:calls=0,usec=0,usec_per_call=0.00,rejected_calls=745,failed_calls=0
cmdstat_eval:calls=0,usec=0,usec_per_call=0.00,rejected_calls=3,failed_calls=0
cmdstat_info:calls=745274,usec=22062792,usec_per_call=29.60,rejected_calls=104,failed_calls=0
cmdstat_select:calls=1,usec=1,usec_per_call=1.00,rejected_calls=0,failed_calls=0
cmdstat_dbsize:calls=17,usec=11,usec_per_call=0.65,rejected_calls=0,failed_calls=0
cmdstat_command:calls=5,usec=3832,usec_per_call=766.40,rejected_calls=0,failed_calls=0
cmdstat_auth:calls=5624451,usec=19085618,usec_per_call=3.39,rejected_calls=0,failed_calls=989
cmdstat_hset:calls=275945435,usec=563749575,usec_per_call=2.04,rejected_calls=0,failed_calls=0
cmdstat_pexpire:calls=37,usec=73,usec_per_call=1.97,rejected_calls=0,failed_calls=0
cmdstat_setex:calls=34019365,usec=299550173,usec_per_call=8.81,rejected_calls=5,failed_calls=0
cmdstat_cluster:calls=513,usec=19171,usec_per_call=37.37,rejected_calls=0,failed_calls=0
cmdstat_post:calls=0,usec=0,usec_per_call=0.00,rejected_calls=4,failed_calls=0
cmdstat_get:calls=12222548563,usec=29146842935,usec_per_call=2.38,rejected_calls=861,failed_calls=1
cmdstat_hvals:calls=214945533,usec=536377294,usec_per_call=2.50,rejected_calls=1,failed_calls=0
cmdstat_replconf:calls=29894489,usec=29603113,usec_per_call=0.99,rejected_calls=0,failed_calls=0
cmdstat_getset:calls=43,usec=227,usec_per_call=5.28,rejected_calls=0,failed_calls=0
cmdstat_expire:calls=8556668281,usec=14304537499,usec_per_call=1.67,rejected_calls=0,failed_calls=0
cmdstat_hget:calls=666897376,usec=1759429909,usec_per_call=2.64,rejected_calls=2,failed_calls=0
cmdstat_set:calls=5204333406,usec=31473249147,usec_per_call=6.05,rejected_calls=37,failed_calls=0
cmdstat_config:calls=10,usec=123,usec_per_call=12.30,rejected_calls=0,failed_calls=0
cmdstat_psync:calls=21,usec=540138,usec_per_call=25720.86,rejected_calls=0,failed_calls=0
cmdstat_del:calls=4503837724,usec=12831984852,usec_per_call=2.85,rejected_calls=0,failed_calls=0
cmdstat_incr:calls=4601414685,usec=11938105458,usec_per_call=2.59,rejected_calls=0,failed_calls=0
cmdstat_ping:calls=36293106298,usec=10214151305,usec_per_call=0.28,rejected_calls=196,failed_calls=0
cmdstat_hdel:calls=139586,usec=1190683,usec_per_call=8.53,rejected_calls=0,failed_calls=0
# Errorstats
errorstat_CLUSTERDOWN:count=139
errorstat_ERR:count=1815
errorstat_LOADING:count=112
errorstat_MOVED:count=5
errorstat_NOAUTH:count=940
errorstat_WRONGPASS:count=989
errorstat_WRONGTYPE:count=1
# Cluster
cluster_enabled:1
# Keyspace
db0:keys=8968779,expires=8389504,avg_ttl=1782583116423
------ CLIENT LIST OUTPUT ------
id=5625370 addr=10.13.127.128:30258 laddr=10.13.79.31:7005 fd=31 name= age=139 idle=19 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625365 addr=10.13.142.210:57226 laddr=10.13.79.31:7005 fd=46 name= age=161 idle=15 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625309 addr=10.13.139.229:22924 laddr=10.13.79.31:7005 fd=171 name= age=263 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=7 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=774 addr=10.13.115.123:18585 laddr=10.13.79.31:7005 fd=10 name= age=11283301 idle=0 flags=S db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=replconf user=default redir=-1
id=5624970 addr=10.13.142.210:55774 laddr=10.13.79.31:7005 fd=73 name= age=633 idle=15 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625408 addr=?:0 laddr=10.13.79.31:7005 fd=55 name= age=27 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=5625429 addr=?:0 laddr=10.13.79.31:7005 fd=93 name= age=27 idle=24 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625433 addr=10.13.165.58:54546 laddr=10.13.79.31:7005 fd=97 name= age=27 idle=24 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625458 addr=10.13.139.229:24068 laddr=10.13.79.31:7005 fd=125 name= age=27 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=get user=default redir=-1
id=5625463 addr=10.13.165.58:54534 laddr=10.13.79.31:7005 fd=132 name= age=27 idle=24 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625465 addr=10.13.165.58:54542 laddr=10.13.79.31:7005 fd=134 name= age=27 idle=24 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625466 addr=10.13.139.229:24084 laddr=10.13.79.31:7005 fd=135 name= age=27 idle=19 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625472 addr=10.13.139.229:24070 laddr=10.13.79.31:7005 fd=141 name= age=27 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=5625477 addr=?:0 laddr=10.13.79.31:7005 fd=146 name= age=27 idle=19 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625482 addr=10.13.41.219:51456 laddr=10.13.79.31:7005 fd=151 name= age=27 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61464 events=r cmd=expire user=default redir=-1
id=5625485 addr=10.13.165.58:54536 laddr=10.13.79.31:7005 fd=154 name= age=27 idle=24 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625489 addr=?:0 laddr=10.13.79.31:7005 fd=161 name= age=27 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61464 events=r cmd=expire user=default redir=-1
id=5625490 addr=10.13.138.111:29794 laddr=10.13.79.31:7005 fd=162 name= age=27 idle=16 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625492 addr=10.13.138.111:29802 laddr=10.13.79.31:7005 fd=164 name= age=27 idle=16 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625495 addr=10.13.138.111:29786 laddr=10.13.79.31:7005 fd=168 name= age=27 idle=4 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=expire user=default redir=-1
id=5625499 addr=10.13.41.219:51488 laddr=10.13.79.31:7005 fd=174 name= age=27 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625502 addr=10.13.138.111:29818 laddr=10.13.79.31:7005 fd=177 name= age=27 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61464 events=r cmd=expire user=default redir=-1
id=5625503 addr=10.13.142.210:57622 laddr=10.13.79.31:7005 fd=178 name= age=27 idle=15 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625505 addr=10.13.142.210:57624 laddr=10.13.79.31:7005 fd=180 name= age=27 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61464 events=r cmd=expire user=default redir=-1
id=5625506 addr=10.13.139.229:24044 laddr=10.13.79.31:7005 fd=181 name= age=27 idle=19 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625524 addr=10.13.127.128:30756 laddr=10.13.79.31:7005 fd=199 name= age=27 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=del user=default redir=-1
id=5625509 addr=10.13.139.229:24060 laddr=10.13.79.31:7005 fd=184 name= age=27 idle=19 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625512 addr=?:0 laddr=10.13.79.31:7005 fd=187 name= age=27 idle=24 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625513 addr=10.13.41.219:51468 laddr=10.13.79.31:7005 fd=188 name= age=27 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625516 addr=10.13.142.210:57602 laddr=10.13.79.31:7005 fd=191 name= age=27 idle=4 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=expire user=default redir=-1
id=5625517 addr=10.13.41.219:51476 laddr=10.13.79.31:7005 fd=192 name= age=27 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=expire user=default redir=-1
id=5625518 addr=10.13.41.219:51484 laddr=10.13.79.31:7005 fd=193 name= age=27 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625521 addr=10.13.138.111:29814 laddr=10.13.79.31:7005 fd=196 name= age=27 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61464 events=r cmd=expire user=default redir=-1
id=5625523 addr=10.13.127.128:30754 laddr=10.13.79.31:7005 fd=198 name= age=27 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61464 events=r cmd=hget user=default redir=-1
id=5625529 addr=10.13.127.128:30862 laddr=10.13.79.31:7005 fd=15 name= age=4 idle=4 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=auth user=default redir=-1
id=5625530 addr=10.13.127.128:30864 laddr=10.13.79.31:7005 fd=16 name= age=4 idle=4 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=auth user=default redir=-1
id=5625531 addr=10.13.127.128:30866 laddr=10.13.79.31:7005 fd=21 name= age=4 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=hvals user=default redir=-1
id=5625384 addr=10.13.127.128:30516 laddr=10.13.79.31:7005 fd=18 name= age=79 idle=19 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625385 addr=10.13.127.128:30518 laddr=10.13.79.31:7005 fd=19 name= age=79 idle=19 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625388 addr=10.13.79.238:35002 laddr=10.13.79.31:7005 fd=33 name= age=77 idle=17 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625386 addr=10.13.127.128:30520 laddr=10.13.79.31:7005 fd=26 name= age=79 idle=19 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625395 addr=10.13.127.128:30600 laddr=10.13.79.31:7005 fd=22 name= age=64 idle=4 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625193 addr=10.13.142.210:56706 laddr=10.13.79.31:7005 fd=37 name= age=324 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=expire user=default redir=-1
id=5625360 addr=10.13.138.111:29180 laddr=10.13.79.31:7005 fd=35 name= age=162 idle=16 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625361 addr=10.13.138.111:29182 laddr=10.13.79.31:7005 fd=40 name= age=162 idle=16 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625362 addr=10.13.138.111:29184 laddr=10.13.79.31:7005 fd=41 name= age=162 idle=16 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=775 addr=10.13.181.219:33587 laddr=10.13.79.31:7005 fd=57 name= age=11283301 idle=0 flags=S db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61464 events=r cmd=replconf user=default redir=-1
id=5625405 addr=10.13.127.128:30734 laddr=10.13.79.31:7005 fd=24 name= age=34 idle=4 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625398 addr=10.13.79.238:35148 laddr=10.13.79.31:7005 fd=14 name= age=47 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61464 events=r cmd=hget user=default redir=-1
id=5625399 addr=10.13.79.238:35150 laddr=10.13.79.31:7005 fd=28 name= age=47 idle=17 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5624987 addr=10.13.41.219:49766 laddr=10.13.79.31:7005 fd=91 name= age=628 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625392 addr=10.13.79.238:35096 laddr=10.13.79.31:7005 fd=20 name= age=64 idle=4 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625378 addr=10.13.165.58:54278 laddr=10.13.79.31:7005 fd=39 name= age=114 idle=24 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625526 addr=10.13.79.238:35360 laddr=10.13.79.31:7005 fd=11 name= age=4 idle=4 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=auth user=default redir=-1
id=5625527 addr=10.13.79.238:35362 laddr=10.13.79.31:7005 fd=12 name= age=4 idle=4 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=auth user=default redir=-1
id=5625528 addr=10.13.79.238:35364 laddr=10.13.79.31:7005 fd=25 name= age=4 idle=4 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=auth user=default redir=-1
id=5625379 addr=10.13.165.58:54280 laddr=10.13.79.31:7005 fd=47 name= age=114 idle=7 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=expire user=default redir=-1
id=5625396 addr=10.13.165.58:54444 laddr=10.13.79.31:7005 fd=29 name= age=54 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=5625397 addr=10.13.165.58:54446 laddr=10.13.79.31:7005 fd=36 name= age=54 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=get user=default redir=-1
id=5625247 addr=10.13.138.111:28604 laddr=10.13.79.31:7005 fd=109 name= age=263 idle=15 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=expire user=default redir=-1
id=5625257 addr=10.13.41.219:50754 laddr=10.13.79.31:7005 fd=119 name= age=263 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625404 addr=10.13.79.238:35186 laddr=10.13.79.31:7005 fd=23 name= age=34 idle=4 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625259 addr=10.13.41.219:50762 laddr=10.13.79.31:7005 fd=121 name= age=263 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61464 events=r cmd=expire user=default redir=-1
id=5625264 addr=10.13.139.229:22936 laddr=10.13.79.31:7005 fd=126 name= age=263 idle=19 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625267 addr=10.13.41.219:50770 laddr=10.13.79.31:7005 fd=129 name= age=263 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625294 addr=10.13.41.219:50750 laddr=10.13.79.31:7005 fd=156 name= age=263 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625296 addr=10.13.138.111:28632 laddr=10.13.79.31:7005 fd=158 name= age=263 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=expire user=default redir=-1
id=5625303 addr=10.13.142.210:56888 laddr=10.13.79.31:7005 fd=165 name= age=263 idle=15 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625363 addr=10.13.142.210:57220 laddr=10.13.79.31:7005 fd=44 name= age=161 idle=15 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625364 addr=10.13.142.210:57224 laddr=10.13.79.31:7005 fd=45 name= age=161 idle=15 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625401 addr=10.13.139.229:23966 laddr=10.13.79.31:7005 fd=42 name= age=46 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=40954 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61456 events=r cmd=hvals user=default redir=-1
id=5625369 addr=10.13.127.128:30256 laddr=10.13.79.31:7005 fd=30 name= age=139 idle=19 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625380 addr=10.13.79.238:34898 laddr=10.13.79.31:7005 fd=13 name= age=107 idle=17 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default redir=-1
id=5625381 addr=10.13.79.238:34900 laddr=10.13.79.31:7005 fd=17 name= age=107 idle=12 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=hget user=default redir=-1
------ MODULES INFO OUTPUT ------
------ FAST MEMORY TEST ------
*** Preparing to test memory region 5ec000 (2281472 bytes)
*** Preparing to test memory region 258e000 (135168 bytes)
*** Preparing to test memory region 7ff175c00000 (4064415744 bytes)
*** Preparing to test memory region 7ff26c200000 (14680064 bytes)
*** Preparing to test memory region 7ff26d200000 (10485760 bytes)
*** Preparing to test memory region 7ff26dc00000 (2097152 bytes)
*** Preparing to test memory region 7ff26e000000 (10485760 bytes)
*** Preparing to test memory region 7ff26ea00000 (2371878912 bytes)
*** Preparing to test memory region 7ff2fc1b9000 (184549376 bytes)
*** Preparing to test memory region 7ff3071ba000 (10485760 bytes)
*** Preparing to test memory region 7ff307bbb000 (10485760 bytes)
*** Preparing to test memory region 7ff3085bc000 (10485760 bytes)
*** Preparing to test memory region 7ff308fbd000 (10485760 bytes)
*** Preparing to test memory region 7ff3099bd000 (3145728 bytes)
*** Preparing to test memory region 7ff310200000 (8388608 bytes)
*** Preparing to test memory region 7ff310f4f000 (20480 bytes)
*** Preparing to test memory region 7ff31116c000 (16384 bytes)
*** Preparing to test memory region 7ff311a92000 (20480 bytes)
*** Preparing to test memory region 7ff311a9c000 (8192 bytes)
*** Preparing to test memory region 7ff311a9e000 (4096 bytes)
*** Preparing to test memory region 7ff311aa1000 (4096 bytes)
.O.O.28689:M 31 Dec 2022 11:05:36.273 - DB 0: 8968819 keys (8389542 volatile) in 16777216 slots HT.
28689:M 31 Dec 2022 11:05:41.294 - DB 0: 8968846 keys (8389567 volatile) in 16777216 slots HT.
28689:M 31 Dec 2022 11:05:42.914 - Accepted 10.13.79.238:35440
28689:M 31 Dec 2022 11:05:46.316 - DB 0: 8968871 keys (8389591 volatile) in 16777216 slots HT.
28689:M 31 Dec 2022 11:05:51.344 - DB 0: 8968897 keys (8389614 volatile) in 16777216 slots HT.
28689:M 31 Dec 2022 11:05:55.061 - Accepted 10.13.79.238:35468
28689:M 31 Dec 2022 11:05:55.360 - Accepted 10.13.127.128:31016
28689:M 31 Dec 2022 11:05:56.365 - DB 0: 8968930 keys (8389644 volatile) in 16777216 slots HT.
O.O.O.O.O.28689:M 31 Dec 2022 11:06:01.386 - DB 0: 8968952 keys (8389665 volatile) in 16777216 slots HT.
28689:M 31 Dec 2022 11:06:06.410 - DB 0: 8968974 keys (8389686 volatile) in 16777216 slots HT.
O.O.O.O.O.28689:M 31 Dec 2022 11:06:10.724 - Accepted 10.13.127.128:31044
28689:M 31 Dec 2022 11:06:10.724 - Accepted 10.13.127.128:31046
28689:M 31 Dec 2022 11:06:10.724 - Accepted 10.13.127.128:31048
28689:M 31 Dec 2022 11:06:10.835 # Background saving terminated by signal 9
28689:M 31 Dec 2022 11:06:10.842 - Accepted 10.13.41.219:51686
28689:M 31 Dec 2022 11:06:10.842 - Accepted 10.13.41.219:51688
28689:M 31 Dec 2022 11:06:10.842 - Accepted 10.13.41.219:51690
28689:M 31 Dec 2022 11:06:10.843 - Accepted 10.13.41.219:51692
28689:M 31 Dec 2022 11:06:10.843 - Accepted 10.13.41.219:51694
28689:M 31 Dec 2022 11:06:10.843 - Accepted 10.13.41.219:51696
28689:M 31 Dec 2022 11:06:10.844 - Accepted 10.13.41.219:51698
28689:M 31 Dec 2022 11:06:10.845 - Accepted 10.13.139.229:24320
28689:M 31 Dec 2022 11:06:10.845 - Accepted 10.13.139.229:24324
28689:M 31 Dec 2022 11:06:10.845 - Accepted 10.13.139.229:24322
28689:M 31 Dec 2022 11:06:10.845 - Accepted 10.13.139.229:24326
28689:M 31 Dec 2022 11:06:10.846 - Accepted 10.13.138.111:30102
28689:M 31 Dec 2022 11:06:10.846 - Accepted 10.13.165.58:54746
Comment From: hui-QY
Can you help look at this bug?
Comment From: oranagra
Is that a vanilla build of redis? did you build it yourself or download from somewhere? Is this happen to be in a docker on Apple M1?
Comment From: oranagra
note to self: other than the assertion / crash, it's also wrong that for some reason we do dict rehashing from the fork child (causing CoW damage and wasting CPU cycles)
Comment From: hui-QY
Is that a vanilla build of redis? did you build it yourself or download from somewhere? Is this happen to be in a docker on Apple M1?
Download from the official website It's AMD processors
Comment From: oranagra
there are no binaries on the official website.. so i guess you downloaded sources and built them...
Comment From: hui-QY
there are no binaries on the official website.. so i guess you downloaded sources and built them...
Download from https://download.redis.io/releases/redis-6.2.8.tar.gz url, the version at that time was 6.2.7
Comment From: oranagra
do you happen to have a way to reproduce it? btw, the process that crashed is the child process creating persistence. so it means the parent is still alive. this seems slightly like a memory corruption issues, in which case i can expect the parent process to crash too at some point. if you have more information on any of that, please post.
Comment From: hui-QY
At present, there is no way to reproduce, and it was solved by restarting this node at that time
Comment From: oranagra
for now, without additional info, or a way to produce it, i don't see anyway we can proceed here.