The system： os:Linux 4.14.209-ltsi-altera-g4eb80fd7d5db-dirty armv7l arch_bits:32
Crash report
Paste the complete crash log between the quotes below. Please include a few lines from the log preceding the crash report to provide some context.
=== REDIS BUG REPORT START: Cut & paste starting from here ===
1577:M 27 Apr 2023 06:10:04.179 # Redis 6.2.6 crashed by signal: 11, si_code: 1
1577:M 27 Apr 2023 06:10:04.179 # Accessing address: 0x28fa
1577:M 27 Apr 2023 06:10:04.179 # Crashed running the instruction at: 0xb54a4
------ STACK TRACE ------
EIP:
/sbin/redis-server(moduleFireServerEvent+0x1c)[0xb54a4]
Backtrace:
------ REGISTERS ------
1577:M 27 Apr 2023 06:10:04.185 #
R10:0000000000000019 R9 :0000000000000000
R8 :00000000beec5628 R7 :00000000beec5628
R6 :0000000000132c30 R5 :0000000000000000
R4 :0000000000000008 R3 :00000000beec5628
R2 :0000000000000000 R1 :0000000000000000
R0 :00000000000028e6 EC :0000000000000017
fp: 000000000018a1d0 ip:000000000000efb0
pc:00000000000b54a4 sp:00000000beec54e8
cpsr:0000000060010010 fault_address:00000000000028fa
1577:M 27 Apr 2023 06:10:04.185 # (beec54f7) -> 00046c8c
1577:M 27 Apr 2023 06:10:04.185 # (beec54f6) -> 0019b220
1577:M 27 Apr 2023 06:10:04.185 # (beec54f5) -> 0019b220
1577:M 27 Apr 2023 06:10:04.185 # (beec54f4) -> 00000000
1577:M 27 Apr 2023 06:10:04.185 # (beec54f3) -> 0014b2b0
1577:M 27 Apr 2023 06:10:04.185 # (beec54f2) -> b6eb5000
1577:M 27 Apr 2023 06:10:04.185 # (beec54f1) -> 00000002
1577:M 27 Apr 2023 06:10:04.185 # (beec54f0) -> 00000000
1577:M 27 Apr 2023 06:10:04.185 # (beec54ef) -> 00000000
1577:M 27 Apr 2023 06:10:04.185 # (beec54ee) -> 00000000
1577:M 27 Apr 2023 06:10:04.185 # (beec54ed) -> 000296fc
1577:M 27 Apr 2023 06:10:04.185 # (beec54ec) -> 0019b220
1577:M 27 Apr 2023 06:10:04.185 # (beec54eb) -> 0014b120
1577:M 27 Apr 2023 06:10:04.185 # (beec54ea) -> 00000000
1577:M 27 Apr 2023 06:10:04.185 # (beec54e9) -> 0003b698
1577:M 27 Apr 2023 06:10:04.185 # (beec54e8) -> 0000000c
------ INFO OUTPUT ------
# Server
redis_version:6.2.6
redis_git_sha1:b58ffd86
redis_git_dirty:1
redis_build_id:92a34b4bc5e1f9fc
redis_mode:standalone
os:Linux 4.14.209-ltsi-altera-g4eb80fd7d5db-dirty armv7l
arch_bits:32
multiplexing_api:epoll
atomicvar_api:atomic-builtin
gcc_version:4.8.3
process_id:1577
process_supervised:no
run_id:68fa76d466baa0c43c269f6d015eb83e53ce414e
tcp_port:0
server_time_usec:1682547003994724
uptime_in_seconds:202
uptime_in_days:0
hz:10
configured_hz:10
lru_clock:4825403
executable:/sbin/redis-server
config_file:/etc/kvdb/kvdb_0.conf
io_threads_active:0
# Clients
connected_clients:1
cluster_connections:0
maxclients:10000
client_recent_max_input_buffer:32
client_recent_max_output_buffer:0
blocked_clients:0
tracking_clients:0
clients_in_timeout_table:0
# Memory
used_memory:637416
used_memory_human:622.48K
used_memory_rss:2162688
used_memory_rss_human:2.06M
used_memory_peak:668672
used_memory_peak_human:653.00K
used_memory_peak_perc:95.33%
used_memory_overhead:635532
used_memory_startup:618660
used_memory_dataset:1884
used_memory_dataset_perc:10.04%
allocator_allocated:635788
allocator_active:2135040
allocator_resident:2135040
total_system_memory:519962624
total_system_memory_human:495.88M
used_memory_lua:27648
used_memory_lua_human:27.00K
used_memory_scripts:0
used_memory_scripts_human:0B
number_of_cached_scripts:0
maxmemory:3221225472
maxmemory_human:3.00G
maxmemory_policy:noeviction
allocator_frag_ratio:3.36
allocator_frag_bytes:1499252
allocator_rss_ratio:1.00
allocator_rss_bytes:0
rss_overhead_ratio:1.01
rss_overhead_bytes:27648
mem_fragmentation_ratio:3.40
mem_fragmentation_bytes:1526900
mem_not_counted_for_evict:8
mem_replication_backlog:0
mem_clients_slaves:0
mem_clients_normal:16860
mem_aof_buffer:12
mem_allocator:libc
active_defrag_running:0
lazyfree_pending_objects:0
lazyfreed_objects:0
# Persistence
loading:0
current_cow_size:0
current_cow_size_age:0
current_fork_perc:0.00
current_save_keys_processed:0
current_save_keys_total:0
rdb_changes_since_last_save:0
rdb_bgsave_in_progress:0
rdb_last_save_time:1682546801
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:-1
rdb_current_bgsave_time_sec:-1
rdb_last_cow_size:0
aof_enabled:1
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:-1
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:ok
aof_last_write_status:ok
aof_last_cow_size:0
module_fork_in_progress:0
module_fork_last_cow_size:0
aof_current_size:0
aof_base_size:0
aof_pending_rewrite:0
aof_buffer_length:0
aof_rewrite_buffer_length:0
aof_pending_bio_fsync:0
aof_delayed_fsync:0
# Stats
total_connections_received:1
total_commands_processed:295
instantaneous_ops_per_sec:0
total_net_input_bytes:15001
total_net_output_bytes:1181
instantaneous_input_kbps:0.00
instantaneous_output_kbps:0.00
rejected_connections:0
sync_full:0
sync_partial_ok:0
sync_partial_err:0
expired_keys:0
expired_stale_perc:0.00
expired_time_cap_reached_count:0
expire_cycle_cpu_milliseconds:12
evicted_keys:0
keyspace_hits:0
keyspace_misses:294
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:0
total_forks:0
migrate_cached_sockets:0
slave_expires_tracked_keys:0
active_defrag_hits:0
active_defrag_misses:0
active_defrag_key_hits:0
active_defrag_key_misses:0
tracking_total_keys:0
tracking_total_items:0
tracking_total_prefixes:0
unexpected_error_replies:0
total_error_replies:0
dump_payload_sanitizations:0
total_reads_processed:295
total_writes_processed:295
io_threaded_reads_processed:0
io_threaded_writes_processed:0
# Replication
role:master
connected_slaves:0
master_failover_state:no-failover
master_replid:71912a442ea1540472c99bf40cb6b429f50c50ca
master_replid2:0000000000000000000000000000000000000000
master_repl_offset:0
second_repl_offset:-1
repl_backlog_active:0
repl_backlog_size:1048576
repl_backlog_first_byte_offset:0
repl_backlog_histlen:0
# CPU
used_cpu_sys:0.482229
used_cpu_user:0.117617
used_cpu_sys_children:0.000000
used_cpu_user_children:0.000000
used_cpu_sys_main_thread:0.482003
used_cpu_user_main_thread:0.117561
# Modules
# Commandstats
cmdstat_lrange:calls=294,usec=2932,usec_per_call=9.97,rejected_calls=0,failed_calls=0
cmdstat_select:calls=1,usec=1096,usec_per_call=1096.00,rejected_calls=0,failed_calls=0
# Errorstats
# Cluster
cluster_enabled:0
# Keyspace
------ CLIENT LIST OUTPUT ------
id=3 addr=/run/.5gnr/app_data/kvdb/kvdb_0.sock:0 laddr=/run/.5gnr/app_data/kvdb/kvdb_0.sock:0 fd=8 name= age=177 idle=177 flags=U db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=16860 events=r cmd=lrange user=default redir=-1
------ MODULES INFO OUTPUT ------
------ FAST MEMORY TEST ------
1577:M 27 Apr 2023 06:10:04.189 # Bio thread for job type #0 terminated
1577:M 27 Apr 2023 06:10:04.189 # Bio thread for job type #1 terminated
1577:M 27 Apr 2023 06:10:04.189 # Bio thread for job type #2 terminated
*** Preparing to test memory region 12d000 (512000 bytes)
*** Preparing to test memory region b558b000 (8384512 bytes)
*** Preparing to test memory region b5d8b000 (8384512 bytes)
*** Preparing to test memory region b658b000 (8716288 bytes)
*** Preparing to test memory region b6eb6000 (12288 bytes)
*** Preparing to test memory region b6ed2000 (8192 bytes)
*** Preparing to test memory region b6edf000 (4096 bytes)
*** Preparing to test memory region b6f88000 (8192 bytes)
*** Preparing to test memory region b6f8c000 (12288 bytes)
.O.O.O.O.O.O.O.O.O
Fast memory test PASSED, however your memory can still be broken. Please run a memory test for several hours if possible.
------ DUMPING CODE AROUND EIP ------
Symbol: moduleFireServerEvent (base: 0xb5488)
Module: /sbin/redis-server (base 0x8000)
$ xxd -r -p /tmp/dump.hex /tmp/dump.bin
$ objdump --adjust-vma=0xb5488 -D -b binary -m i386:x86-64 /tmp/dump.bin
------
1577:M 27 Apr 2023 06:10:07.133 # dump of function (hexdump of 156 bytes):
b0cf0ee3f04f2de913c040e30040a0e10380a0e141df4de200009ce5143090e5000053e30100001a41df8de2f08fbde898ac0be318bd01e30150a0e10290a0e128108de20020a0e30aa040e313b040e31c208de5fed0fdeb0220c4e30530a0e1f022cde128008de203d1fdeb000050e3ecffff0a086090e5d820c6e1050053e104005201f6ffff1a70008de20010a0e34020a0e3e0ccfdeb003096e5
=== REDIS BUG REPORT END. Make sure to include from START to END. ===
Please report the crash by opening an issue on github:
http://github.com/redis/redis/issues
Suspect RAM error? Use redis-server --test-memory to verify it.
Comment From: bugwz
@mark6661 I suggest you add some gdb debugging records.
Comment From: oranagra
there's not much to work with here (rather empty stack trace). @mark6661 can you please describe anything that can help. maybe mention if you did anything just before the crash that could have caused it? maybe post the last few log lines before the actual crash? anything special about that deployment (other than the fact it runs on ARM? are you using any modules?
p.s. i see:
redis_git_sha1:b58ffd86
redis_git_dirty:1
both are an indication that this is not a vanilla redis (we don't have b58ffd86), please describe where you got it and how you built it.