Crash report
Paste the complete crash log between the quotes below. Please include a few lines from the log preceding the crash report to provide some context.
=== REDIS BUG REPORT START: Cut & paste starting from here ===
22:S 25 Oct 2022 04:51:19.149 # ------------------------------------------------
22:S 25 Oct 2022 04:51:19.150 # !!! Software Failure. Press left mouse button to continue
22:S 25 Oct 2022 04:51:19.150 # Guru Meditation: Unknown list encoding type #object.c:291
22:S 25 Oct 2022 04:51:19.150 # (forcing SIGSEGV in order to print the stack trace)
22:S 25 Oct 2022 04:51:19.150 # ------------------------------------------------
22:S 25 Oct 2022 04:51:19.150 # Redis 6.0.9 crashed by signal: 11, si_code: 1
22:S 25 Oct 2022 04:51:19.150 # Crashed running the instruction at: 0x4762c3
22:S 25 Oct 2022 04:51:19.150 # Accessing address: 0xffffffffffffffff
22:S 25 Oct 2022 04:51:19.150 # Failed assertion: <no assertion failed> (<no file>:0)
------ STACK TRACE ------
EIP:
/opt/app/redis/sbin/redis-server *:6379(_serverPanic+0x113)[0x4762c3]
Backtrace:
/opt/app/redis/sbin/redis-server *:6379(logStackTrace+0x2e)[0x4785fe]
/opt/app/redis/sbin/redis-server *:6379(sigsegvHandler+0xb8)[0x478cd8]
/lib64/libpthread.so.0(+0xf100)[0x7fa911452100]
/opt/app/redis/sbin/redis-server *:6379(_serverPanic+0x113)[0x4762c3]
/opt/app/redis/sbin/redis-server *:6379(freeListObject+0x2a)[0x44a87a]
/opt/app/redis/sbin/redis-server *:6379(decrRefCount+0x8d)[0x44aa7d]
/opt/app/redis/sbin/redis-server *:6379(lazyfreeFreeObjectFromBioThread+0x9)[0x4a0cd9]
/opt/app/redis/sbin/redis-server *:6379(bioProcessBackgroundJobs+0x110)[0x48baa0]
/lib64/libpthread.so.0(+0x7dc5)[0x7fa91144adc5]
/lib64/libc.so.6(clone+0x6d)[0x7fa911177ced]
------ INFO OUTPUT ------
# Server
redis_version:6.0.9
xredis_version:2.0.1
redis_git_sha1:2beb363c
redis_git_dirty:1
redis_build_id:dc09fce1abc17a4d
redis_mode:standalone
os:Linux 4.19.118-2.el7.centos.x86_64 x86_64
arch_bits:64
multiplexing_api:epoll
atomicvar_api:atomic-builtin
gcc_version:9.3.1
process_id:22
run_id:337027ff5d6d1bc399a57c7f60f3d174816c4790
tcp_port:6379
uptime_in_seconds:668048
uptime_in_days:7
hz:100
configured_hz:100
lru_clock:5700295
executable:/opt/app/redis/sbin/redis-server
config_file:/opt/app/redis/data/etc/redis.conf
io_threads_active:0
# Clients
connected_clients:14
client_recent_max_input_buffer:163840
client_recent_max_output_buffer:40984
blocked_clients:0
tracking_clients:0
clients_in_timeout_table:0
# Memory
used_memory:2874135408
used_memory_human:2.68G
used_memory_rss:3013541888
used_memory_rss_human:2.81G
used_memory_peak:2886913816
used_memory_peak_human:2.69G
used_memory_peak_perc:99.56%
used_memory_overhead:952635648
used_memory_startup:1343240
used_memory_dataset:1921499760
used_memory_dataset_perc:66.89%
allocator_allocated:2874403640
allocator_active:2901512192
allocator_resident:2935455744
total_system_memory:133065682944
total_system_memory_human:123.93G
used_memory_lua:37888
used_memory_lua_human:37.00K
used_memory_scripts:0
used_memory_scripts_human:0B
number_of_cached_scripts:0
maxmemory:7516192768
maxmemory_human:7.00G
maxmemory_policy:volatile-lru
allocator_frag_ratio:1.01
allocator_frag_bytes:27108552
allocator_rss_ratio:1.01
allocator_rss_bytes:33943552
rss_overhead_ratio:1.03
rss_overhead_bytes:78086144
mem_fragmentation_ratio:1.05
mem_fragmentation_bytes:139367720
mem_not_counted_for_evict:0
mem_replication_backlog:536870912
mem_clients_slaves:0
mem_clients_normal:287024
mem_aof_buffer:0
mem_allocator:jemalloc-5.1.0
active_defrag_running:0
lazyfree_pending_objects:1
# Persistence
loading:0
rdb_changes_since_last_save:554808731
rdb_bgsave_in_progress:0
rdb_last_save_time:1665976631
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:-1
rdb_current_bgsave_time_sec:-1
rdb_last_cow_size:0
aof_enabled:0
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:-1
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:ok
aof_last_write_status:ok
aof_last_cow_size:0
module_fork_in_progress:0
module_fork_last_cow_size:0
# Stats
total_connections_received:72832
total_commands_processed:555716728
instantaneous_ops_per_sec:1185
total_net_input_bytes:451171494675
total_net_output_bytes:102693131215
instantaneous_input_kbps:852.23
instantaneous_output_kbps:112.63
rejected_connections:0
sync_full:0
sync_partial_ok:0
sync_partial_err:0
expired_keys:0
expired_stale_perc:0.00
expired_time_cap_reached_count:0
expire_cycle_cpu_milliseconds:0
evicted_keys:0
keyspace_hits:47247242
keyspace_misses:1496691
pubsub_channels:4
pubsub_patterns:0
latest_fork_usec:0
migrate_cached_sockets:0
slave_expires_tracked_keys:0
active_defrag_hits:0
active_defrag_misses:0
active_defrag_key_hits:0
active_defrag_key_misses:0
tracking_total_keys:0
tracking_total_items:0
tracking_total_prefixes:0
unexpected_error_replies:0
total_reads_processed:311137150
total_writes_processed:37810479
io_threaded_reads_processed:0
io_threaded_writes_processed:0
# Replication
role:slave
master_host:10.29.236.146
master_port:6402
master_link_status:up
master_last_io_seconds_ago:0
master_sync_in_progress:0
slave_repl_offset:45285087364450
slave_priority:100
slave_read_only:1
connected_slaves:0
master_replid:3557deddd2c8fd93674904e139bd84be3efb69f5
master_replid2:0000000000000000000000000000000000000000
master_repl_offset:45285087364450
second_repl_offset:-1
repl_backlog_active:1
repl_backlog_size:536870912
repl_backlog_first_byte_offset:45284550493539
repl_backlog_histlen:536870912
# CPU
used_cpu_sys:5077.947617
used_cpu_user:4452.566178
used_cpu_sys_children:0.000000
used_cpu_user_children:0.000000
# Modules
# Commandstats
cmdstat_role:calls=133598,usec=304191,usec_per_call=2.28
cmdstat_mget:calls=32925902,usec=135727952,usec_per_call=4.12
cmdstat_slowlog:calls=16706,usec=23925,usec_per_call=1.43
cmdstat_xslaveof:calls=9,usec=555,usec_per_call=61.67
cmdstat_slaveof:calls=1,usec=39,usec_per_call=39.00
cmdstat_info:calls=61850,usec=1813766,usec_per_call=29.33
cmdstat_select:calls=201675,usec=123977,usec_per_call=0.61
cmdstat_publish:calls=2631734,usec=8490037,usec_per_call=3.23
cmdstat_expire:calls=267331024,usec=197335684,usec_per_call=0.74
cmdstat_subscribe:calls=128,usec=457,usec_per_call=3.57
cmdstat_dbsize:calls=11224,usec=6025,usec_per_call=0.54
cmdstat_unlink:calls=24129789,usec=67756235,usec_per_call=2.81
cmdstat_config:calls=4950,usec=172742,usec_per_call=34.90
cmdstat_set:calls=24273068,usec=52272364,usec_per_call=2.15
cmdstat_client:calls=8891,usec=131413,usec_per_call=14.78
cmdstat_ping:calls=1150346,usec=504495,usec_per_call=0.44
cmdstat_command:calls=44536,usec=25062271,usec_per_call=562.74
cmdstat_mset:calls=202791297,usec=592935740,usec_per_call=2.92
# Cluster
cluster_enabled:0
# Keyspace
db0:keys=4374511,expires=4372346,avg_ttl=0
------ CLIENT LIST OUTPUT ------
id=12943 addr=10.29.193.61:39890 fd=14 name= age=543807 idle=1 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=subscribe user=default
id=72831 addr=10.31.246.49:54932 fd=12 name=credis age=52 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=mget user=default
id=12958 addr=10.29.193.62:36682 fd=13 name= age=543680 idle=0 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=subscribe user=default
id=12955 addr=10.29.193.61:41156 fd=10 name= age=543727 idle=2 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=subscribe user=default
id=72833 addr=10.31.245.15:44324 fd=21 name=credis age=28 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=mget user=default
id=72725 addr=10.31.244.79:40796 fd=8 name=credis age=980 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20512 events=r cmd=mget user=default
id=21303 addr=10.29.193.62:59710 fd=11 name= age=465565 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default
id=17334 addr=10.29.231.228:46358 fd=19 name= age=502374 idle=2 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=role user=default
id=26 addr=10.29.236.146:6402 fd=9 name= age=667994 idle=0 flags=M db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=61488 events=r cmd=set user=(superuser)
id=21208 addr=10.29.193.62:58948 fd=20 name= age=466446 idle=1 flags=P db=0 sub=1 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20504 events=r cmd=subscribe user=default
id=72805 addr=10.31.246.49:35134 fd=17 name=credis age=302 idle=8 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default
id=36314 addr=10.29.193.62:37802 fd=15 name= age=329634 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default
id=21274 addr=10.29.193.62:59394 fd=18 name= age=465826 idle=1 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default
id=72799 addr=10.31.245.15:52400 fd=16 name=credis age=355 idle=12 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 argv-mem=0 obl=0 oll=0 omem=0 tot-mem=20496 events=r cmd=ping user=default
------ REGISTERS ------
22:S 25 Oct 2022 04:51:19.152 #
RAX:0000000000000000 RBX:0000000000000123
RCX:00007fa8140008b0 RDX:fffffffffffff000
RDI:0000000000020000 RSI:00007fa8140008b0
RBP:00007fa895a94f90 RSP:00007fa90f7fb400
R8 :0000000000020751 R9 :00007fa90f7fd700
R10:0000000000000030 R11:0000000000000206
R12:000000000055b6ca R13:00000000007c7160
R14:00000000007c70c0 R15:00007fa8c3009328
RIP:00000000004762c3 EFL:0000000000010206
CSGSFS:002b000000000033
22:S 25 Oct 2022 04:51:19.152 # (00007fa90f7fb40f) -> 0000000000000000
22:S 25 Oct 2022 04:51:19.152 # (00007fa90f7fb40e) -> 0000000000000000
22:S 25 Oct 2022 04:51:19.152 # (00007fa90f7fb40d) -> 0000000000000000
22:S 25 Oct 2022 04:51:19.152 # (00007fa90f7fb40c) -> 0000000000000000
22:S 25 Oct 2022 04:51:19.152 # (00007fa90f7fb40b) -> 0000000000000000
22:S 25 Oct 2022 04:51:19.152 # (00007fa90f7fb40a) -> 0000000000000000
22:S 25 Oct 2022 04:51:19.152 # (00007fa90f7fb409) -> 0000000000000000
22:S 25 Oct 2022 04:51:19.152 # (00007fa90f7fb408) -> 0000000000000000
22:S 25 Oct 2022 04:51:19.152 # (00007fa90f7fb407) -> 0000000000006570
22:S 25 Oct 2022 04:51:19.152 # (00007fa90f7fb406) -> 797420676e69646f
22:S 25 Oct 2022 04:51:19.152 # (00007fa90f7fb405) -> 636e65207473696c
22:S 25 Oct 2022 04:51:19.152 # (00007fa90f7fb404) -> 206e776f6e6b6e55
22:S 25 Oct 2022 04:51:19.152 # (00007fa90f7fb403) -> 00007fa90f7fb520
22:S 25 Oct 2022 04:51:19.152 # (00007fa90f7fb402) -> 00007fa90f7fb5f0
22:S 25 Oct 2022 04:51:19.152 # (00007fa90f7fb401) -> 0000003000000018
22:S 25 Oct 2022 04:51:19.152 # (00007fa90f7fb400) -> 0000000000000000
------ MODULES INFO OUTPUT ------
------ FAST MEMORY TEST ------
22:S 25 Oct 2022 04:51:19.152 # main thread terminated
22:S 25 Oct 2022 04:51:19.152 # Bio thread for job type #0 terminated
22:S 25 Oct 2022 04:51:19.152 # Bio thread for job type #1 terminated
Fast memory test PASSED, however your memory can still be broken. Please run a memory test for several hours if possible.
------ DUMPING CODE AROUND EIP ------
Symbol: _serverPanic (base: 0x4761b0)
Module: /opt/app/redis/sbin/redis-server *:6379 (base 0x400000)
$ xxd -r -p /tmp/dump.hex /tmp/dump.bin
$ objdump --adjust-vma=0x4761b0 -D -b binary -m i386:x86-64 /tmp/dump.bin
------
22:S 25 Oct 2022 04:51:19.153 # dump of function (hexdump of 403 bytes):
41544989fc5389f34881ecd801000048898c24380100004c898424400100004c898c244801000084c074400f298424500100000f298c24600100000f299424700100000f299c24800100000f29a424900100000f29ac24a00100000f29b424b00100000f29bc24c0010000488d4c2408be00010000488d8424f0010000c7442408180000004889442410488d7c2420488d842420010000c744240c300000004889442418e8073dfbff8b059d73350085c0747dbee83c5600bf0300000031c0e82cc9fbffbe203d5600bf0300000031c0e81bc9fbff4189d84c89e1488d542420bed6555600bf0300000031c0e8ffc8fbffbe603d5600bf0300000031c0e8eec8fbffbee83c5600bf0300000031c0e8ddc8fbffc60425ffffffff784881c4d80100005b415cc3662e0f1f840000000000e84bf5ffffe979ffffff660f1f440000415741564989f641554989fd41544989cc554889d5ba04000000534889ef4881ece80200000fb601488d74241483e00f0fc889442414e825f6ffff4c89ef4c89f6e81a7ffdff4989c5410fb6042489c283e20f
=== REDIS BUG REPORT END. Make sure to include from START to END. ===
Please report the crash by opening an issue on github:
http://github.com/redis/redis/issues
Suspect RAM error? Use redis-server --test-memory to verify it.
Additional information
- 4.19.118-2.el7.centos.x86_64
- Steps to reproduce (if any)
Comment From: oranagra
xredis_version:2.0.1
what's xredis? you should probably put this crash report there (some modified version of redis, not this one)