=== REDIS BUG REPORT START: Cut & paste starting from here ===
3801:M 16 Jan 2024 23:15:28.668 # Object encoding: 0
3801:M 16 Jan 2024 23:15:28.668 # Object refcount: 1
3801:M 16 Jan 2024 23:15:28.668 # Object raw string len: 46
3801:M 16 Jan 2024 23:15:28.668 # Object raw string content: "a11bingoplusmps1jl_USER_GAME_BALANCE_CACHE_KEY"
3801:M 16 Jan 2024 23:15:28.668 # === ASSERTION FAILED ===
3801:M 16 Jan 2024 23:15:28.668 # ==> db.c:1101 'dictFind(db->dict,key->ptr) != NULL' is not true
3801:M 16 Jan 2024 23:15:28.668 # (forcing SIGSEGV to print the bug report.)
3801:M 16 Jan 2024 23:15:28.668 # Redis 5.0.7 crashed by signal: 11
3801:M 16 Jan 2024 23:15:28.668 # Crashed running the instruction at: 0x46f3ea
3801:M 16 Jan 2024 23:15:28.668 # Accessing address: 0xffffffffffffffff
3801:M 16 Jan 2024 23:15:28.668 # Failed assertion: dictFind(db->dict,key->ptr) != NULL (db.c:1101)
------ STACK TRACE ------
EIP:
/usr/local/redis-cluster/bin/redis-server 10.192.168.110:6379 [cluster](_serverAssert+0x6a)[0x46f3ea]
Backtrace:
/usr/local/redis-cluster/bin/redis-server 10.192.168.110:6379 [cluster](logStackTrace+0x29)[0x4715c9]
/usr/local/redis-cluster/bin/redis-server 10.192.168.110:6379 [cluster](sigsegvHandler+0xac)[0x471c6c]
/lib64/libpthread.so.0(+0xf630)[0x7f1c70245630]
/usr/local/redis-cluster/bin/redis-server 10.192.168.110:6379 [cluster](_serverAssert+0x6a)[0x46f3ea]
/usr/local/redis-cluster/bin/redis-server 10.192.168.110:6379 [cluster](getExpire+0x76)[0x4462d6]
/usr/local/redis-cluster/bin/redis-server 10.192.168.110:6379 [cluster](keyIsExpired+0x6)[0x446376]
/usr/local/redis-cluster/bin/redis-server 10.192.168.110:6379 [cluster](expireIfNeeded+0x11)[0x446ff1]
/usr/local/redis-cluster/bin/redis-server 10.192.168.110:6379 [cluster](lookupKeyWrite+0x11)[0x4472c1]
/usr/local/redis-cluster/bin/redis-server 10.192.168.110:6379 [cluster](setKey+0x12)[0x447342]
/usr/local/redis-cluster/bin/redis-server 10.192.168.110:6379 [cluster](setGenericCommand+0x98)[0x453048]
/usr/local/redis-cluster/bin/redis-server 10.192.168.110:6379 [cluster](setexCommand+0x48)[0x4533e8]
/usr/local/redis-cluster/bin/redis-server 10.192.168.110:6379 [cluster](call+0x9b)[0x430c0b]
/usr/local/redis-cluster/bin/redis-server 10.192.168.110:6379 [cluster](processCommand+0x33f)[0x431eaf]
/usr/local/redis-cluster/bin/redis-server 10.192.168.110:6379 [cluster](processInputBuffer+0x175)[0x440be5]
/usr/local/redis-cluster/bin/redis-server 10.192.168.110:6379 [cluster](aeProcessEvents+0x2a0)[0x42b030]
/usr/local/redis-cluster/bin/redis-server 10.192.168.110:6379 [cluster](aeMain+0x2b)[0x42b2fb]
/usr/local/redis-cluster/bin/redis-server 10.192.168.110:6379 [cluster](main+0x4c0)[0x4281a0]
/lib64/libc.so.6(__libc_start_main+0xf5)[0x7f1c6fe8a555]
/usr/local/redis-cluster/bin/redis-server 10.192.168.110:6379 [cluster][0x4283fa]
------ INFO OUTPUT ------
# Server
redis_version:5.0.7
redis_git_sha1:00000000
redis_git_dirty:0
redis_build_id:4bf8cbd677c898fd
redis_mode:cluster
os:Linux 5.13.9-1.el7.elrepo.x86_64 x86_64
arch_bits:64
multiplexing_api:epoll
atomicvar_api:atomic-builtin
gcc_version:4.8.5
process_id:3801
run_id:3b9c4ae5ca8d54ea5ed13119202be85093e8698f
tcp_port:6379
uptime_in_seconds:7831
uptime_in_days:0
hz:10
configured_hz:10
lru_clock:10948112
executable:/usr/local/redis-cluster/bin/redis-server
config_file:/usr/local/redis-cluster/conf/redis.conf
# Clients
connected_clients:1136
client_recent_max_input_buffer:212853
client_recent_max_output_buffer:151648
blocked_clients:0
# Memory
used_memory:9383009688
used_memory_human:8.74G
used_memory_rss:9790894080
used_memory_rss_human:9.12G
used_memory_peak:10850468568
used_memory_peak_human:10.11G
used_memory_peak_perc:86.48%
used_memory_overhead:1885663084
used_memory_startup:6820928
used_memory_dataset:7497346604
used_memory_dataset_perc:79.96%
allocator_allocated:9384272192
allocator_active:9603088384
allocator_resident:9763696640
total_system_memory:67443118080
total_system_memory_human:62.81G
used_memory_lua:58368
used_memory_lua_human:57.00K
used_memory_scripts:5792
used_memory_scripts_human:5.66K
number_of_cached_scripts:6
maxmemory:31138512896
maxmemory_human:29.00G
maxmemory_policy:volatile-lru
allocator_frag_ratio:1.02
allocator_frag_bytes:218816192
allocator_rss_ratio:1.02
allocator_rss_bytes:160608256
rss_overhead_ratio:1.00
rss_overhead_bytes:27197440
mem_fragmentation_ratio:1.04
mem_fragmentation_bytes:407247864
mem_not_counted_for_evict:0
mem_replication_backlog:1048576
mem_clients_slaves:49694
mem_clients_normal:24575934
mem_aof_buffer:0
mem_allocator:jemalloc-5.1.0
active_defrag_running:0
lazyfree_pending_objects:0
# Persistence
loading:0
rdb_changes_since_last_save:204822
rdb_bgsave_in_progress:1
rdb_last_save_time:1705446774
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:89
rdb_current_bgsave_time_sec:93
rdb_last_cow_size:981446656
aof_enabled:0
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:-1
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:ok
aof_last_write_status:ok
aof_last_cow_size:0
# Stats
total_connections_received:51528
total_commands_processed:40619768
instantaneous_ops_per_sec:5097
total_net_input_bytes:38550800830
total_net_output_bytes:409991261705
instantaneous_input_kbps:3574.66
instantaneous_output_kbps:79212.42
rejected_connections:0
sync_full:1
sync_partial_ok:0
sync_partial_err:1
expired_keys:869031
expired_stale_perc:21.31
expired_time_cap_reached_count:0
evicted_keys:0
keyspace_hits:24142677
keyspace_misses:9177066
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:262963
migrate_cached_sockets:0
slave_expires_tracked_keys:0
active_defrag_hits:0
active_defrag_misses:0
active_defrag_key_hits:0
active_defrag_key_misses:0
# Replication
role:master
connected_slaves:1
slave0:ip=10.192.168.10,port=6379,state=online,offset=6618468739616,lag=0
master_replid:02b2ffabd478278fe85bbda84f4895cf26ccd5f9
master_replid2:bc4e041e7ff90bf8ec6854f17d73bfd066c690a4
master_repl_offset:6618468885009
second_repl_offset:6593887229785
repl_backlog_active:1
repl_backlog_size:1048576
repl_backlog_first_byte_offset:6618467836434
repl_backlog_histlen:1048576
# CPU
used_cpu_sys:894.270956
used_cpu_user:811.458485
used_cpu_sys_children:384.419806
used_cpu_user_children:1780.582258
# Commandstats
cmdstat_zrem:calls=57217,usec=114711,usec_per_call=2.00
cmdstat_pttl:calls=254720,usec=336486,usec_per_call=1.32
cmdstat_getset:calls=2,usec=28,usec_per_call=14.00
cmdstat_smembers:calls=423762,usec=3863162,usec_per_call=9.12
cmdstat_cluster:calls=57411,usec=13815306,usec_per_call=240.64
cmdstat_evalsha:calls=21893,usec=1167352,usec_per_call=53.32
cmdstat_rpush:calls=1,usec=28,usec_per_call=28.00
cmdstat_zcard:calls=20430,usec=53512,usec_per_call=2.62
cmdstat_setex:calls=1820633,usec=27730292,usec_per_call=15.23
cmdstat_hmset:calls=514700,usec=14321507,usec_per_call=27.82
cmdstat_pexpire:calls=629899,usec=1212997,usec_per_call=1.93
cmdstat_del:calls=1257530,usec=20075684,usec_per_call=15.96
cmdstat_multi:calls=29098,usec=3268,usec_per_call=0.11
cmdstat_zadd:calls=14104,usec=8747955,usec_per_call=620.25
cmdstat_hset:calls=126079,usec=2215756,usec_per_call=17.57
cmdstat_hdel:calls=57714,usec=141220,usec_per_call=2.45
cmdstat_zrangebyscore:calls=50,usec=476,usec_per_call=9.52
cmdstat_rpop:calls=610,usec=1189,usec_per_call=1.95
cmdstat_zscore:calls=327,usec=3549,usec_per_call=10.85
cmdstat_get:calls=11679839,usec=35019081,usec_per_call=3.00
cmdstat_client:calls=42552,usec=47833,usec_per_call=1.12
cmdstat_expire:calls=5,usec=63,usec_per_call=12.60
cmdstat_select:calls=1,usec=8,usec_per_call=8.00
cmdstat_ping:calls=756879,usec=392108,usec_per_call=0.52
cmdstat_incrby:calls=24829,usec=383602,usec_per_call=15.45
cmdstat_sadd:calls=285963,usec=401809,usec_per_call=1.41
cmdstat_zremrangebyrank:calls=20206,usec=3670254,usec_per_call=181.64
cmdstat_zrange:calls=815907,usec=93071168,usec_per_call=114.07
cmdstat_eval:calls=114432,usec=7155527,usec_per_call=62.53
cmdstat_lpush:calls=4,usec=132,usec_per_call=33.00
cmdstat_lpop:calls=57217,usec=27230,usec_per_call=0.48
cmdstat_ttl:calls=147,usec=124,usec_per_call=0.84
cmdstat_sscan:calls=2949524,usec=25520884,usec_per_call=8.65
cmdstat_incr:calls=98730,usec=216386,usec_per_call=2.19
cmdstat_sismember:calls=114804,usec=97000,usec_per_call=0.84
cmdstat_dbsize:calls=1,usec=1,usec_per_call=1.00
cmdstat_srem:calls=2341,usec=16111,usec_per_call=6.88
cmdstat_zremrangebyscore:calls=32,usec=390,usec_per_call=12.19
cmdstat_hgetall:calls=1659854,usec=20509186,usec_per_call=12.36
cmdstat_auth:calls=59690,usec=63191,usec_per_call=1.06
cmdstat_mget:calls=9585742,usec=34489406,usec_per_call=3.60
cmdstat_psync:calls=1,usec=122,usec_per_call=122.00
cmdstat_hexists:calls=57220,usec=77175,usec_per_call=1.35
cmdstat_set:calls=827250,usec=16916536,usec_per_call=20.45
cmdstat_replconf:calls=135727,usec=109003,usec_per_call=0.80
cmdstat_info:calls=47081,usec=21688788,usec_per_call=460.67
cmdstat_readonly:calls=3702,usec=489,usec_per_call=0.13
cmdstat_hget:calls=136666,usec=379129,usec_per_call=2.77
cmdstat_unlink:calls=26871,usec=293074,usec_per_call=10.91
cmdstat_hincrby:calls=69273,usec=223137,usec_per_call=3.22
cmdstat_exists:calls=5378923,usec=4792072,usec_per_call=0.89
cmdstat_wait:calls=109114,usec=99857,usec_per_call=0.92
cmdstat_hmget:calls=66957,usec=471368,usec_per_call=7.04
cmdstat_publish:calls=2,usec=61,usec_per_call=30.50
cmdstat_exec:calls=29098,usec=505908,usec_per_call=17.39
cmdstat_append:calls=5356,usec=26767,usec_per_call=5.00
cmdstat_lindex:calls=171648,usec=220814,usec_per_call=1.29
# Cluster
cluster_enabled:1
# Keyspace
db0:keys=20636899,expires=20450637,avg_ttl=659452518
------ CLIENT LIST OUTPUT ------
id=13454 addr=10.192.22.21:20062 fd=1525 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13455 addr=10.192.22.21:16950 fd=1526 name= age=6042 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13458 addr=10.192.22.21:45408 fd=1529 name= age=6042 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13460 addr=10.192.22.21:52024 fd=1531 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13461 addr=10.192.22.21:59986 fd=1532 name= age=6042 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13464 addr=10.192.22.21:23082 fd=1535 name= age=6042 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13467 addr=10.192.22.21:2384 fd=1538 name= age=6042 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13474 addr=10.192.22.9:35904 fd=40 name= age=6042 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get
id=13186 addr=10.192.22.165:8477 fd=395 name= age=6042 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=del
id=13191 addr=10.192.22.51:17167 fd=405 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13193 addr=10.192.22.51:51378 fd=408 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=14774 addr=10.192.22.151:15205 fd=58 name= age=6012 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=hgetall
id=15710 addr=10.192.22.182:47599 fd=15 name= age=5887 idle=15 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=pexpire
id=13196 addr=10.192.22.165:27843 fd=412 name= age=6042 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=del
id=13197 addr=10.192.22.165:44871 fd=413 name= age=6042 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=del
id=13202 addr=10.192.22.165:62170 fd=418 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=15695 addr=10.192.22.47:2881 fd=14 name= age=5889 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=set
id=15696 addr=10.192.22.169:24206 fd=18 name= age=5889 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=set
id=13241 addr=10.192.22.36:26530 fd=890 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13242 addr=10.192.22.15:6689 fd=892 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=18858 addr=10.192.22.60:11622 fd=41 name= age=5508 idle=3 flags=r db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=18859 addr=10.192.22.100:46427 fd=46 name= age=5508 idle=3 flags=r db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13247 addr=10.192.22.36:15556 fd=904 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13248 addr=10.192.22.36:29682 fd=905 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13249 addr=10.192.22.36:51742 fd=908 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13252 addr=10.192.22.15:31109 fd=911 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13253 addr=10.192.22.15:2081 fd=914 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13255 addr=10.192.22.15:26858 fd=919 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13256 addr=10.192.22.36:52358 fd=921 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13257 addr=10.192.22.36:21663 fd=923 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13264 addr=10.192.22.15:25423 fd=1408 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13265 addr=10.192.22.15:35373 fd=1409 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13266 addr=10.192.22.15:3585 fd=1410 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13267 addr=10.192.22.15:31479 fd=1411 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13271 addr=10.192.22.36:27302 fd=1415 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13272 addr=10.192.22.36:7748 fd=1416 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13276 addr=10.192.22.36:35594 fd=1420 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13279 addr=10.192.22.36:60096 fd=1423 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13280 addr=10.192.22.15:24191 fd=1424 name= age=6042 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=del
id=13282 addr=10.192.22.15:62597 fd=1426 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13284 addr=10.192.22.15:40426 fd=1428 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13285 addr=10.192.22.15:36463 fd=1429 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13287 addr=10.192.22.36:10038 fd=1431 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13288 addr=10.192.22.36:11718 fd=1432 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13291 addr=10.192.22.36:14698 fd=1435 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13292 addr=10.192.22.36:18694 fd=1436 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13293 addr=10.192.22.15:49939 fd=1437 name= age=6042 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=del
id=14262 addr=10.192.22.22:13319 fd=1076 name= age=6035 idle=5 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=14263 addr=10.192.22.22:17251 fd=1886 name= age=6035 idle=5 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=14264 addr=10.192.22.22:14556 fd=1887 name= age=6035 idle=5 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=14265 addr=10.192.22.22:46730 fd=1888 name= age=6035 idle=5 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=14266 addr=10.192.22.171:8709 fd=1889 name= age=6035 idle=5 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=14267 addr=10.192.22.22:15370 fd=1890 name= age=6035 idle=5 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=14268 addr=10.192.22.22:21402 fd=1891 name= age=6035 idle=5 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=14269 addr=10.192.22.171:37542 fd=1892 name= age=6035 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=wait
id=14270 addr=10.192.22.171:64886 fd=1893 name= age=6035 idle=5 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=14271 addr=10.192.22.171:56407 fd=1894 name= age=6035 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=set
id=14272 addr=10.192.22.22:54830 fd=1895 name= age=6035 idle=5 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=27677 addr=10.192.21.37:46306 fd=43 name= age=4021 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=hgetall
id=13429 addr=10.192.22.21:20399 fd=891 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13430 addr=10.192.22.21:51704 fd=893 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13431 addr=10.192.22.21:22298 fd=895 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13432 addr=10.192.22.21:37687 fd=897 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13433 addr=10.192.22.21:24476 fd=898 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13435 addr=10.192.22.21:40557 fd=902 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13437 addr=10.192.22.21:30675 fd=906 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13439 addr=10.192.22.21:17476 fd=912 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13441 addr=10.192.22.21:63177 fd=916 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13443 addr=10.192.22.21:63391 fd=918 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13445 addr=10.192.22.21:8653 fd=922 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13447 addr=10.192.22.21:18357 fd=926 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13449 addr=10.192.22.21:51359 fd=1520 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
id=13451 addr=10.192.22.21:39916 fd=1522 name= age=6042 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=ping
------ CURRENT CLIENT INFO ------
id=12376 addr=10.192.22.15:38989 fd=1051 name= age=6076 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=336 qbuf-free=32432 obl=0 oll=0 omem=0 events=r cmd=setex
argv[0]: 'SETEX'
argv[1]: 'a11appleplusmps1jl_USER_GAME_BALANCE_CACHE_KEY'
argv[2]: '2592000'
argv[3]: '{"@class":"com.alibaba.fastjson.JSONObject","hasBalance":"1","platform":{"@class":"com.alibaba.fastjson.JSONObject","a11104":{"@class":"com.alibaba.fastjson.JSONObject","balance":
"0.5","gameKind":"5"}},"timestamp":["java.lang.Long",1705446928664]}'
3801:M 16 Jan 2024 23:15:28.678 # key 'a11bingoplusmps1jl_USER_GAME_BALANCE_CACHE_KEY' found in DB containing the following object:
3801:M 16 Jan 2024 23:15:28.678 # Object type: 0
3801:M 16 Jan 2024 23:15:28.678 # Object encoding: 0
3801:M 16 Jan 2024 23:15:28.678 # Object refcount: 1
3801:M 16 Jan 2024 23:15:28.678 # Object raw string len: 247
3801:M 16 Jan 2024 23:15:28.679 # Object raw string content: "{\"@class\":\"com.alibaba.fastjson.JSONObject\",\"hasBalance\":\"1\",\"platform\":{\"@class\":\"com.alibaba.fastjson.JSONObject
\",\"a11104\":{\"@class\":\"com.alibaba.fastjson.JSONObject\",\"balance\":\"0.5\",\"gameKind\":\"5\"}},\"timestamp\":[\"java.lang.Long\",1705446928662]}"
------ REGISTERS ------
3801:M 16 Jan 2024 23:15:28.679 #
RAX:0000000000000000 RBX:000000000000044d
RCX:00000000027bb370 RDX:00007f1c7022f7b8
RDI:00007f1c7022f760 RSI:0000000000000000
RBP:000000000053890e RSP:00007fff1508a620
R8 :0000000000000001 R9 :00007f1c70d75f80
R10:7562206568742074 R11:0000000000000206
R12:0000000000535ae8 R13:0000000000000000
R14:00007f1bd23387c0 R15:0000000000000000
RIP:000000000046f3ea EFL:0000000000010202
CSGSFS:002b000000000033
3801:M 16 Jan 2024 23:15:28.679 # (00007fff1508a62f) -> 00007f1c6fa1a800
3801:M 16 Jan 2024 23:15:28.679 # (00007fff1508a62e) -> 0000000000000000
3801:M 16 Jan 2024 23:15:28.679 # (00007fff1508a62d) -> 00000000004472c1
3801:M 16 Jan 2024 23:15:28.679 # (00007fff1508a62c) -> 00007f1b21febe10
3801:M 16 Jan 2024 23:15:28.679 # (00007fff1508a62b) -> 00007f1c6fa1a800
3801:M 16 Jan 2024 23:15:28.679 # (00007fff1508a62a) -> 00007f1b42cb8610
3801:M 16 Jan 2024 23:15:28.679 # (00007fff1508a629) -> 0000000000446ff1
3801:M 16 Jan 2024 23:15:28.679 # (00007fff1508a628) -> 00007f1c6fa1a800
3801:M 16 Jan 2024 23:15:28.679 # (00007fff1508a627) -> 0000000000446376
3801:M 16 Jan 2024 23:15:28.679 # (00007fff1508a626) -> 00007f1bd23387c0
3801:M 16 Jan 2024 23:15:28.679 # (00007fff1508a625) -> 00007f1b21febe10
3801:M 16 Jan 2024 23:15:28.679 # (00007fff1508a624) -> 00007f1c6fa1a800
------ FAST MEMORY TEST ------
3801:M 16 Jan 2024 23:15:28.679 # Bio thread for job type #0 terminated
3801:M 16 Jan 2024 23:15:28.680 # Bio thread for job type #1 terminated
3801:M 16 Jan 2024 23:15:28.680 # Bio thread for job type #2 terminated
*** Preparing to test memory region 78f000 (2252800 bytes)
*** Preparing to test memory region 27ab000 (135168 bytes)
*** Preparing to test memory region 7f1986400000 (11620319232 bytes)
*** Preparing to test memory region 7f1c3afbb000 (738197504 bytes)
*** Preparing to test memory region 7f1c66fbc000 (8388608 bytes)
*** Preparing to test memory region 7f1c677bd000 (8388608 bytes)
*** Preparing to test memory region 7f1c67fbe000 (8388608 bytes)
*** Preparing to test memory region 7f1c687be000 (9437184 bytes)
*** Preparing to test memory region 7f1c6f600000 (8388608 bytes)
*** Preparing to test memory region 7f1c70231000 (20480 bytes)
*** Preparing to test memory region 7f1c7044e000 (16384 bytes)
*** Preparing to test memory region 7f1c70d74000 (20480 bytes)
*** Preparing to test memory region 7f1c70d7f000 (4096 bytes)
*** Preparing to test memory region 7f1c70d80000 (4096 bytes)
*** Preparing to test memory region 7f1c70d83000 (4096 bytes)
.O.O.29554:C 16 Jan 2024 23:15:28.882 * DB saved on disk
29554:C 16 Jan 2024 23:15:29.153 * RDB: 937 MB of memory used by copy-on-write
O.O.O.O.O.O.O.O.O.O.O.O.O
Fast memory test PASSED, however your memory can still be broken. Please run a memory test for several hours if possible.
------ DUMPING CODE AROUND EIP ------
Symbol: _serverAssert (base: 0x46f380)
Module: /usr/local/redis-cluster/bin/redis-server 10.192.168.110:6379 [cluster] (base 0x400000)
$ xxd -r -p /tmp/dump.hex /tmp/dump.bin
$ objdump --adjust-vma=0x46f380 -D -b binary -m i386:x86-64 /tmp/dump.bin
------
3801:M 16 Jan 2024 23:16:13.419 # dump of function (hexdump of 234 bytes):
41548b05241f32004989fc554889f585c05389d37505e8f5fdffffbe6ee05300bf0300000031c0e8e4f2fbff4d89e089d94889eabe87e05300bf0300000031c0e8cbf2fbffbe08d05300bf0300000031c04c8925c01e320048892dc11e320
0891dc31e3200e8a6f2fbffc60425ffffffff785b5d415cc3660f1f84000000000041544989fc55534883c4808b159b1e320085d20f84e700000031c0be38d05300bf03000000e866f2fbff418b9424a000000031c0bea2e05300bf030000
0031ed31dbe849f2fbff418b54240831c0beb5e05300bf03000000e833f2fbff418b54244031c0bec5e05300bf
=== REDIS BUG REPORT END. Make sure to include from START to END. ===
Please report the crash by opening an issue on github:
http://github.com/antirez/redis/issues
Suspect RAM error? Use redis-server --test-memory to verify it.
30861:C 16 Jan 2024 23:22:36.207 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
30861:C 16 Jan 2024 23:22:36.207 # Redis version=5.0.7, bits=64, commit=00000000, modified=0, pid=30861, just started
30861:C 16 Jan 2024 23:22:36.207 # Configuration loaded
30862:M 16 Jan 2024 23:22:36.208 * Increased maximum number of open files to 100032 (it was originally set to 65535).
30862:M 16 Jan 2024 23:22:36.212 * Node configuration loaded, I'm dfb7127a87a8e2d349e7ea919df4b7783263c22e
30862:M 16 Jan 2024 23:22:36.212 * Running mode=cluster, port=6379.
30862:M 16 Jan 2024 23:22:36.213 # Server initialized
30862:M 16 Jan 2024 23:22:36.213 # WARNING you have Transparent Huge Pages (THP) support enabled in your kernel. This will create latency and memory usage issues with Redis. To fix this iss
ue run the command 'echo never > /sys/kernel/mm/transparent_hugepage/enabled' as root, and add it to your /etc/rc.local in order to retain the setting after a reboot. Redis must be restarte
d after THP is disabled.
30862:M 16 Jan 2024 23:23:40.207 * DB loaded from disk: 63.994 seconds
30862:M 16 Jan 2024 23:23:40.207 * Ready to accept connections
30862:M 16 Jan 2024 23:23:40.210 # Configuration change detected. Reconfiguring myself as a replica of eba22d65b844ef980cc061c31fc6a103f1f6179c
30862:S 16 Jan 2024 23:23:40.210 * Before turning into a replica, using my master parameters to synthesize a cached master: I may be able to synchronize with the new master with just a part
ial transfer.
Comment From: bluebiubluebiu
redis_version:5.0.7 redis_mode:cluster os:Linux 5.13.9-1.el7.elrepo.x86_64 x86_64 gcc_version:4.8.5 linux-server: cpu 64c mem 64G redis-mem-limit: 29G
Comment From: enjoy-binbin
Weird. We also specifically removed this assertion in #12177.