Crash report
311691:M 19 Jul 10:25:25.310 # Background saving terminated by signal 11
311691:M 19 Jul 10:25:31.014 * 1 changes in 900 seconds. Saving...
311691:M 19 Jul 10:25:31.015 * Background saving started by pid 3762376
3762376:C 19 Jul 10:25:31.018 * DB saved on disk
3762376:C 19 Jul 10:25:31.018 * RDB: 2 MB of memory used by copy-on-write
311691:M 19 Jul 10:25:31.115 * Background saving terminated with success
=== REDIS BUG REPORT START: Cut & paste starting from here ===
311691:M 19 Jul 10:28:56.963 # === ASSERTION FAILED OBJECT CONTEXT ===
311691:M 19 Jul 10:28:56.963 # Object type: 0
311691:M 19 Jul 10:28:56.963 # Object encoding: 8
311691:M 19 Jul 10:28:56.963 # Object refcount: 1
311691:M 19 Jul 10:28:56.963 # Object raw string len: 35
311691:M 19 Jul 10:28:56.963 # Object raw string content: "user_1161152998606789_cloud_id_info"
311691:M 19 Jul 10:28:56.963 # === ASSERTION FAILED ===
311691:M 19 Jul 10:28:56.963 # ==> db.c:868 'dictFind(db->dict,key->ptr) != NULL' is not true
311691:M 19 Jul 10:28:56.963 # (forcing SIGSEGV to print the bug report.)
311691:M 19 Jul 10:28:56.963 # Redis 3.2.4 crashed by signal: 11
311691:M 19 Jul 10:28:56.963 # Accessing address: 0xffffffffffffffff
311691:M 19 Jul 10:28:56.964 # Failed assertion: dictFind(db->dict,key->ptr) != NULL (db.c:868)
------ STACK TRACE ------
/home/kookserver/redis/bin/redis-server 0.0.0.0:63790(logStackTrace+0x50)[0x462910]
------ INFO OUTPUT ------
# Server
redis_version:3.2.4
redis_git_sha1:00000000
redis_git_dirty:0
redis_build_id:f06888ced81f3930
redis_mode:standalone
os:Linux 4.19.90-17.ky10.aarch64 aarch64
arch_bits:64
multiplexing_api:epoll
gcc_version:5.4.0
process_id:311691
run_id:4014956573f9a415d9530a0fb52d5e39afd11057
tcp_port:63790
uptime_in_seconds:247313
uptime_in_days:2
hz:10
lru_clock:16049000
executable:/home/kookserver/redis/bin/redis-server
config_file:/home/kookserver/redis/etc/redis.conf
# Clients
connected_clients:3
client_longest_output_list:0
client_biggest_input_buf:0
blocked_clients:0
# Memory
used_memory:2873584
used_memory_human:2.74M
used_memory_rss:9699328
used_memory_rss_human:9.25M
used_memory_peak:4879136
used_memory_peak_human:4.65M
total_system_memory:273689739264
total_system_memory_human:254.89G
used_memory_lua:37888
used_memory_lua_human:37.00K
maxmemory:0
maxmemory_human:0B
maxmemory_policy:noeviction
mem_fragmentation_ratio:3.38
mem_allocator:jemalloc-4.0.3
# Persistence
loading:0
rdb_changes_since_last_save:13
rdb_bgsave_in_progress:0
rdb_last_save_time:1626661531
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:0
rdb_current_bgsave_time_sec:-1
aof_enabled:0
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:-1
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:ok
aof_last_write_status:ok
# Stats
total_connections_received:709787
total_commands_processed:2028355
instantaneous_ops_per_sec:6
total_net_input_bytes:76637264
total_net_output_bytes:46693496
instantaneous_input_kbps:0.21
instantaneous_output_kbps:0.03
rejected_connections:0
sync_full:0
sync_partial_ok:0
sync_partial_err:0
expired_keys:9983
evicted_keys:0
keyspace_hits:92877
keyspace_misses:1243856
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:214
migrate_cached_sockets:0
# Replication
role:master
connected_slaves:0
master_repl_offset:0
repl_backlog_active:0
repl_backlog_size:1048576
repl_backlog_first_byte_offset:0
repl_backlog_histlen:0
# CPU
used_cpu_sys:112.54
used_cpu_user:74.11
used_cpu_sys_children:344.23
used_cpu_user_children:3741.68
# Commandstats
cmdstat_get:calls=771979,usec=1241333,usec_per_call=1.61
cmdstat_set:calls=8586,usec=27148,usec_per_call=3.16
cmdstat_setex:calls=2460,usec=11512,usec_per_call=4.68
cmdstat_del:calls=6397,usec=7004,usec_per_call=1.09
cmdstat_incr:calls=234,usec=937,usec_per_call=4.00
cmdstat_mget:calls=8839,usec=30543,usec_per_call=3.46
cmdstat_lpush:calls=755,usec=3262,usec_per_call=4.32
cmdstat_rpop:calls=18081,usec=40673,usec_per_call=2.25
cmdstat_lpop:calls=1230,usec=1131,usec_per_call=0.92
cmdstat_llen:calls=515132,usec=451803,usec_per_call=0.88
cmdstat_sadd:calls=11,usec=33,usec_per_call=3.00
cmdstat_zadd:calls=3236,usec=24069,usec_per_call=7.44
cmdstat_zrange:calls=10,usec=13,usec_per_call=1.30
cmdstat_hget:calls=2,usec=2,usec_per_call=1.00
cmdstat_select:calls=691307,usec=822086,usec_per_call=1.19
cmdstat_expire:calls=22,usec=99,usec_per_call=4.50
cmdstat_ttl:calls=71,usec=182,usec_per_call=2.56
cmdstat_config:calls=1,usec=7,usec_per_call=7.00
cmdstat_command:calls=2,usec=911,usec_per_call=455.50
# Cluster
cluster_enabled:0
# Keyspace
db0:keys=2602,expires=2298,avg_ttl=212721240
db1:keys=17,expires=5,avg_ttl=2347257717
db2:keys=14,expires=4,avg_ttl=2296649039
db3:keys=19,expires=5,avg_ttl=2273085176
db4:keys=18,expires=4,avg_ttl=2343561638
db5:keys=15,expires=4,avg_ttl=2437089339
db6:keys=25,expires=7,avg_ttl=2275926638
db7:keys=16,expires=3,avg_ttl=2411884366
db8:keys=25,expires=8,avg_ttl=1745642452
db9:keys=14,expires=3,avg_ttl=2412334940
db10:keys=23,expires=3,avg_ttl=2347739224
db11:keys=13,expires=3,avg_ttl=2300156961
db12:keys=14,expires=2,avg_ttl=2477957852
db13:keys=12,expires=3,avg_ttl=2296784428
db14:keys=9,expires=1,avg_ttl=2349961100
db15:keys=315,expires=25,avg_ttl=6592608140
hash_init_value: 1627120110
------ CLIENT LIST OUTPUT ------
id=3727 addr=127.0.0.1:37660 fd=13 name= age=246576 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=llen
id=709657 addr=127.0.0.1:15552 fd=5 name= age=52 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=rpop
id=709788 addr=127.0.0.1:16558 fd=6 name= age=0 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get
------ CURRENT CLIENT INFO ------
id=709788 addr=127.0.0.1:16558 fd=6 name= age=0 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get
argv[0]: 'GET'
argv[1]: 'user_1161152998606789_cloud_id_info'
------ REGISTERS ------
Comment From: oranagra
@UnderTreeTech this looks like a dup of #3892 however, i can't figure out which commit solved it, possibly Antirez was referring to ed7e33105 which is about unaligned access, and i don't see how it can cause that assertion. i understand you can reproduce this, can you please try to upgrade to a more recent version? preferably this can be redis 6.2.x, but even 5.0.x would be enough (the first release that includes that fix)
Comment From: UnderTreeTech
@oranagra Yet there is another crash, I don't know if it's same as the previous one.
Crash report
3790411:M 07 Jul 12:50:06.364 # Background saving terminated by signal 11
3790411:M 07 Jul 12:50:12.070 * 1 changes in 900 seconds. Saving...
3790411:M 07 Jul 12:50:12.070 * Background saving started by pid 1883553
=== REDIS BUG REPORT START: Cut & paste starting from here ===
1883553:C 07 Jul 12:50:12.075 # Redis 3.2.4 crashed by signal: 11
1883553:C 07 Jul 12:50:12.075 # Accessing address: 0xffffffffffffffff
1883553:C 07 Jul 12:50:12.075 # Failed assertion: <no assertion failed> (<no file>:0)
------ STACK TRACE ------
redis-rdb-bgsave 0.0.0.0:63790(logStackTrace+0x50)[0x462910]
------ INFO OUTPUT ------
# Server
redis_version:3.2.4
redis_git_sha1:00000000
redis_git_dirty:0
redis_build_id:f06888ced81f3930
redis_mode:standalone
os:Linux 4.19.90-17.ky10.aarch64 aarch64
arch_bits:64
multiplexing_api:epoll
gcc_version:5.4.0
process_id:1883553
run_id:614d8791a759b6501bd8a8eed527e41d82f84692
tcp_port:63790
uptime_in_seconds:177589
uptime_in_days:2
hz:10
lru_clock:15020676
executable:/home/kookserver/redis/bin/redis-server
config_file:/home/kookserver/redis/etc/redis.conf
# Clients
connected_clients:2
client_longest_output_list:0
client_biggest_input_buf:0
blocked_clients:0
# Memory
used_memory:2279832
used_memory_human:2.17M
used_memory_rss:9699328
used_memory_rss_human:9.25M
used_memory_peak:3775592
used_memory_peak_human:3.60M
total_system_memory:273689739264
total_system_memory_human:254.89G
used_memory_lua:37888
used_memory_lua_human:37.00K
maxmemory:0
maxmemory_human:0B
maxmemory_policy:noeviction
mem_fragmentation_ratio:4.25
mem_allocator:jemalloc-4.0.3
# Persistence
loading:0
rdb_changes_since_last_save:963
rdb_bgsave_in_progress:0
rdb_last_save_time:1625623781
rdb_last_bgsave_status:err
rdb_last_bgsave_time_sec:0
rdb_current_bgsave_time_sec:-1
aof_enabled:0
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:-1
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:ok
aof_last_write_status:ok
# Stats
total_connections_received:572907
total_commands_processed:1764259
instantaneous_ops_per_sec:5
total_net_input_bytes:77480078
total_net_output_bytes:142867610
instantaneous_input_kbps:0.18
instantaneous_output_kbps:0.03
rejected_connections:0
sync_full:0
sync_partial_ok:0
sync_partial_err:0
expired_keys:4629
evicted_keys:0
keyspace_hits:232531
keyspace_misses:979558
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:155
migrate_cached_sockets:0
# Replication
role:master
connected_slaves:0
master_repl_offset:0
repl_backlog_active:0
repl_backlog_size:1048576
repl_backlog_first_byte_offset:0
repl_backlog_histlen:0
# CPU
used_cpu_sys:0.00
used_cpu_user:0.00
used_cpu_sys_children:0.00
used_cpu_user_children:0.00
# Commandstats
cmdstat_get:calls=723966,usec=1318101,usec_per_call=1.82
cmdstat_set:calls=20527,usec=69335,usec_per_call=3.38
cmdstat_setex:calls=7423,usec=35178,usec_per_call=4.74
cmdstat_del:calls=22351,usec=36273,usec_per_call=1.62
cmdstat_incr:calls=1160,usec=2568,usec_per_call=2.21
cmdstat_mget:calls=19713,usec=76203,usec_per_call=3.87
cmdstat_lpush:calls=702,usec=4574,usec_per_call=6.52
cmdstat_rpop:calls=41102,usec=100347,usec_per_call=2.44
cmdstat_lpop:calls=2870,usec=2728,usec_per_call=0.95
cmdstat_llen:calls=372861,usec=410927,usec_per_call=1.10
cmdstat_sadd:calls=8,usec=37,usec_per_call=4.62
cmdstat_smembers:calls=420,usec=205,usec_per_call=0.49
cmdstat_zadd:calls=6816,usec=61951,usec_per_call=9.09
cmdstat_zrange:calls=64,usec=82,usec_per_call=1.28
cmdstat_select:calls=543076,usec=697528,usec_per_call=1.28
cmdstat_expire:calls=48,usec=226,usec_per_call=4.71
cmdstat_keys:calls=1,usec=2858,usec_per_call=2858.00
cmdstat_bgsave:calls=1,usec=257,usec_per_call=257.00
cmdstat_ttl:calls=1137,usec=2027,usec_per_call=1.78
cmdstat_config:calls=1,usec=6,usec_per_call=6.00
cmdstat_command:calls=12,usec=5850,usec_per_call=487.50
# Cluster
cluster_enabled:0
# Keyspace
db0:keys=4000,expires=3876,avg_ttl=110122322
db1:keys=10,expires=3,avg_ttl=2080292614
db2:keys=7,expires=3,avg_ttl=2269308100
db3:keys=4,expires=1,avg_ttl=2588190100
db4:keys=2,expires=1,avg_ttl=2492399750
db6:keys=8,expires=4,avg_ttl=2168892702
db7:keys=10,expires=4,avg_ttl=2432485973
db8:keys=12,expires=6,avg_ttl=2247515100
db9:keys=5,expires=2,avg_ttl=2556855355
db10:keys=15,expires=7,avg_ttl=2130602887
db11:keys=12,expires=4,avg_ttl=2407688042
db12:keys=15,expires=5,avg_ttl=2184908560
db13:keys=17,expires=8,avg_ttl=2148599533
db14:keys=7,expires=2,avg_ttl=2282269898
db15:keys=175,expires=22,avg_ttl=5853379431
hash_init_value: 1625186169
------ CLIENT LIST OUTPUT ------
id=13 addr=127.0.0.1:6422 fd=5 name= age=177584 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=llen
id=572892 addr=127.0.0.1:49834 fd=6 name= age=8 idle=3 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=rpop
------ REGISTERS ------
Comment From: oranagra
could this be due to the kernel bug mention in #8124? if not, it could still be related to the the unaligned access thing, although i would expect a SIGBUS rather than SIGSEGV. anyway, thanks for sharing, but i'd still like to try to reproduce this on a newer version.