running fresh instance of redis server with version 6.0 rc2 I played a lot with ACL commands, ACL users and used MONITOR command
here is the terminal commands that I used: crash1 crash2
crash1: `27660:C 18 Mar 2020 20:21:37.040 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo 27660:C 18 Mar 2020 20:21:37.040 # Redis version=5.9.102, bits=64, commit=00000000, modified=0, pid=27660, just started 27660:C 18 Mar 2020 20:21:37.040 # Warning: no config file specified, using the default config. In order to specify a config file use /root/redis-6.0-rc2/src/redis-server /path/to/redis.conf 27660:M 18 Mar 2020 20:21:37.041 * Increased maximum number of open files to 10032 (it was originally set to 1024). 27660:M 18 Mar 2020 20:21:37.041 * Running mode=standalone, port=6379. 27660:M 18 Mar 2020 20:21:37.041 # Server initialized 27660:M 18 Mar 2020 20:21:37.041 * Loading RDB produced by version 5.9.101 27660:M 18 Mar 2020 20:21:37.041 * RDB age 19345 seconds 27660:M 18 Mar 2020 20:21:37.041 * RDB memory usage when created 0.75 Mb 27660:M 18 Mar 2020 20:21:37.041 * DB loaded from disk: 0.000 seconds 27660:M 18 Mar 2020 20:21:37.041 * Ready to accept connections 27660:M 18 Mar 2020 20:32:46.645 * Background saving started by pid 27717 27717:C 18 Mar 2020 20:32:46.647 * DB saved on disk 27717:C 18 Mar 2020 20:32:46.648 * RDB: 0 MB of memory used by copy-on-write 27660:M 18 Mar 2020 20:32:46.659 * Background saving terminated with success 27660:M 18 Mar 2020 20:41:09.661 # Error accepting a client connection: Success (conn: fd=-1) 27660:M 18 Mar 2020 20:41:17.145 # Error accepting a client connection: Success (conn: fd=-1) 27660:M 18 Mar 2020 21:18:57.676 # Error accepting a client connection: Success (conn: fd=-1) 27660:M 18 Mar 2020 21:19:02.339 # Error accepting a client connection: Success (conn: fd=-1)
=== REDIS BUG REPORT START: Cut & paste starting from here ===
27660:M 18 Mar 2020 21:22:56.455 # Redis 5.9.102 crashed by signal: 11
27660:M 18 Mar 2020 21:22:56.455 # Crashed running the instruction at: 0x4ed547
27660:M 18 Mar 2020 21:22:56.455 # Accessing address: 0x7fdbec14096c
27660:M 18 Mar 2020 21:22:56.455 # Failed assertion:
------ STACK TRACE ------ EIP: 0x4ed547 is in je_free (include/jemalloc/internal/tcache_inlines.h:203). Backtrace: 0x476ea5 is in logStackTrace (debug.c:1252). 0x477669 is in sigsegvHandler (debug.c:1427). /lib/x86_64-linux-gnu/libpthread.so.0(+0x11390)[0x7fc3eb608390] 0x4ed547 is in je_free (include/jemalloc/internal/tcache_inlines.h:203). 0x42af97 is in listDelNode (adlist.c:178). 0x4423ca is in writeToClient (networking.c:777). 0x4426e2 is in handleClientsWithPendingWrites (networking.c:1330). 0x4476d6 is in handleClientsWithPendingWritesUsingThreads (networking.c:2902). 0x43185d is in beforeSleep (server.c:2146). 0x42e1ee is in aeMain (ae.c:523). 0x42a933 is in main (server.c:5072). 0x20830 is in __libc_start_main (../csu/libc-start.c:325). /root/redis-6.0-rc2/src/redis-server *:6379(_start+0x29)[0x42abf9]
------ INFO OUTPUT ------
Server
redis_version:5.9.102 redis_git_sha1:00000000 redis_git_dirty:0 redis_build_id:a7b54f881d9cdc40 redis_mode:standalone os:Linux 4.4.0-1099-aws x86_64 arch_bits:64 multiplexing_api:epoll atomicvar_api:atomic-builtin gcc_version:5.4.0 process_id:27660 run_id:02d63a5a13d563b348c0888d0690e4b858380168 tcp_port:6379 uptime_in_seconds:3679 uptime_in_days:0 hz:10 configured_hz:10 lru_clock:7508272 executable:/root/redis-6.0-rc2/src/redis-server config_file:
Clients
connected_clients:1 client_recent_max_input_buffer:2 client_recent_max_output_buffer:0 blocked_clients:0 tracking_clients:0
Memory
used_memory:8714384 used_memory_human:8.31M used_memory_rss:5304320 used_memory_rss_human:5.06M used_memory_peak:8714384 used_memory_peak_human:8.31M used_memory_peak_perc:988.55% used_memory_overhead:8787358 used_memory_startup:802424 used_memory_dataset:18446744073709478642 used_memory_dataset_perc:233150118625280.00% allocator_allocated:1094832 allocator_active:1433600 allocator_resident:4141056 total_system_memory:7841435648 total_system_memory_human:7.30G used_memory_lua:37888 used_memory_lua_human:37.00K used_memory_scripts:0 used_memory_scripts_human:0B number_of_cached_scripts:0 maxmemory:0 maxmemory_human:0B maxmemory_policy:noeviction allocator_frag_ratio:1.31 allocator_frag_bytes:338768 allocator_rss_ratio:2.89 allocator_rss_bytes:2707456 rss_overhead_ratio:1.28 rss_overhead_bytes:1163264 mem_fragmentation_ratio:7.20 mem_fragmentation_bytes:4567936 mem_not_counted_for_evict:0 mem_replication_backlog:0 mem_clients_slaves:0 mem_clients_normal:7984790 mem_aof_buffer:0 mem_allocator:jemalloc-5.1.0 active_defrag_running:0 lazyfree_pending_objects:0
Persistence
loading:0 rdb_changes_since_last_save:5 rdb_bgsave_in_progress:0 rdb_last_save_time:1584563566 rdb_last_bgsave_status:ok rdb_last_bgsave_time_sec:0 rdb_current_bgsave_time_sec:-1 rdb_last_cow_size:176128 aof_enabled:0 aof_rewrite_in_progress:0 aof_rewrite_scheduled:0 aof_last_rewrite_time_sec:-1 aof_current_rewrite_time_sec:-1 aof_last_bgrewrite_status:ok aof_last_write_status:ok aof_last_cow_size:0 module_fork_in_progress:0 module_fork_last_cow_size:0
Stats
total_connections_received:7 total_commands_processed:50 instantaneous_ops_per_sec:0 total_net_input_bytes:2756 total_net_output_bytes:122869 instantaneous_input_kbps:0.00 instantaneous_output_kbps:0.00 rejected_connections:4 sync_full:0 sync_partial_ok:0 sync_partial_err:0 expired_keys:0 expired_stale_perc:0.00 expired_time_cap_reached_count:0 expire_cycle_cpu_milliseconds:37 evicted_keys:0 keyspace_hits:1 keyspace_misses:0 pubsub_channels:0 pubsub_patterns:0 latest_fork_usec:179 migrate_cached_sockets:0 slave_expires_tracked_keys:0 active_defrag_hits:0 active_defrag_misses:0 active_defrag_key_hits:0 active_defrag_key_misses:0 tracking_total_keys:0 tracking_total_items:0
Replication
role:master connected_slaves:0 master_replid:bb4b7850c8ca474d0294ede7c4815a7b24af5c98 master_replid2:0000000000000000000000000000000000000000 master_repl_offset:0 second_repl_offset:-1 repl_backlog_active:0 repl_backlog_size:1048576 repl_backlog_first_byte_offset:0 repl_backlog_histlen:0
CPU
used_cpu_sys:0.904000 used_cpu_user:1.512000 used_cpu_sys_children:0.000000 used_cpu_user_children:0.000000
Modules
Commandstats
cmdstat_bgsave:calls=1,usec=233,usec_per_call=233.00 cmdstat_auth:calls=11,usec=92,usec_per_call=8.36 cmdstat_monitor:calls=1,usec=1,usec_per_call=1.00 cmdstat_acl:calls=23,usec=1751,usec_per_call=76.13 cmdstat_hget:calls=1,usec=6,usec_per_call=6.00 cmdstat_config:calls=1,usec=49,usec_per_call=49.00 cmdstat_hincrby:calls=5,usec=39,usec_per_call=7.80 cmdstat_command:calls=7,usec=9687,usec_per_call=1383.86
Cluster
cluster_enabled:0
Keyspace
db0:keys=2,expires=0,avg_ttl=0
------ CLIENT LIST OUTPUT ------ id=14 addr=127.0.0.1:58088 fd=8 name= age=0 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=387 omem=7935040 events=r cmd=command user=default
------ REGISTERS ------ 27660:M 18 Mar 2020 21:22:56.456 # RAX:0000000000000000 RBX:00007fc3ec140730 RCX:00007fc3c0000000 RDX:00007fc3eb000900 RDI:00000017fffffc58 RSI:00007fc3ec140848 RBP:00007fc3e8187ac0 RSP:00007ffcc712f8b0 R8 :0000000000000030 R9 :0000000000000030 R10:0000000000000000 R11:0000000000000000 R12:00000000ffffffd9 R13:00007fc3ec1408f0 R14:00007fdbec140388 R15:00007fc3ec140758 RIP:00000000004ed547 EFL:0000000000010202 CSGSFS:0000000000000033 27660:M 18 Mar 2020 21:22:56.456 # (00007ffcc712f8bf) -> 00007fc3eaf1cecc 27660:M 18 Mar 2020 21:22:56.456 # (00007ffcc712f8be) -> 000000005e729130 27660:M 18 Mar 2020 21:22:56.456 # (00007ffcc712f8bd) -> 00000000004423ca 27660:M 18 Mar 2020 21:22:56.456 # (00007ffcc712f8bc) -> 0000000000000040 27660:M 18 Mar 2020 21:22:56.456 # (00007ffcc712f8bb) -> 000000000000031c 27660:M 18 Mar 2020 21:22:56.456 # (00007ffcc712f8ba) -> 00000000000003e8 27660:M 18 Mar 2020 21:22:56.456 # (00007ffcc712f8b9) -> 000000000042af97 27660:M 18 Mar 2020 21:22:56.456 # (00007ffcc712f8b8) -> 00007fc3e8187ac0 27660:M 18 Mar 2020 21:22:56.456 # (00007ffcc712f8b7) -> 0000000000000000 27660:M 18 Mar 2020 21:22:56.456 # (00007ffcc712f8b6) -> 00007fc3eaf1cc80 27660:M 18 Mar 2020 21:22:56.456 # (00007ffcc712f8b5) -> 0000000000000000 27660:M 18 Mar 2020 21:22:56.456 # (00007ffcc712f8b4) -> 00007fc3eae0f9c0 27660:M 18 Mar 2020 21:22:56.456 # (00007ffcc712f8b3) -> 00007fc3eae52c88 27660:M 18 Mar 2020 21:22:56.456 # (00007ffcc712f8b2) -> 00007fc3eae15100 27660:M 18 Mar 2020 21:22:56.456 # (00007ffcc712f8b1) -> 00007fc3eaf1cc80 27660:M 18 Mar 2020 21:22:56.456 # (00007ffcc712f8b0) -> 0000000000000008
------ MODULES INFO OUTPUT ------
------ FAST MEMORY TEST ------ 27660:M 18 Mar 2020 21:22:56.456 # Bio thread for job type #0 terminated 27660:M 18 Mar 2020 21:22:56.456 # Bio thread for job type #1 terminated 27660:M 18 Mar 2020 21:22:56.456 # Bio thread for job type #2 terminated *** Preparing to test memory region 7cb000 (2260992 bytes) *** Preparing to test memory region 10a0000 (135168 bytes) *** Preparing to test memory region 7fc3e80fc000 (9437184 bytes) *** Preparing to test memory region 7fc3e89fd000 (8388608 bytes) *** Preparing to test memory region 7fc3e91fe000 (8388608 bytes) *** Preparing to test memory region 7fc3e99ff000 (8388608 bytes) *** Preparing to test memory region 7fc3ea200000 (8388608 bytes) *** Preparing to test memory region 7fc3eaa00000 (8388608 bytes) *** Preparing to test memory region 7fc3eb5f3000 (16384 bytes) *** Preparing to test memory region 7fc3eb810000 (16384 bytes) *** Preparing to test memory region 7fc3ec140000 (24576 bytes) *** Preparing to test memory region 7fc3ec150000 (4096 bytes) .O.O.O.O.O.O.O.O.O.O.O.O Fast memory test PASSED, however your memory can still be broken. Please run a memory test for several hours if possible.
------ DUMPING CODE AROUND EIP ------ Symbol: je_free (base: 0x4ed200) Module: /root/redis-6.0-rc2/src/redis-server *:6379 (base 0x400000) $ xxd -r -p /tmp/dump.hex /tmp/dump.bin $ objdump --adjust-vma=0x4ed200 -D -b binary -m i386:x86-64 /tmp/dump.bin
27660:M 18 Mar 2020 21:22:56.623 # dump of function (hexdump of 967 bytes): 4885ff0f84fd000000415741564155415455534889fd4883ec18488b05d73d2d004889c36448031c2500000000648038000f85d90000004989ec4989ee4c8dabc001000049c1ec1a4981e6000000c04c8d7b284181e4f00000004901dc4d8b5424284d39d60f85c50100004889e848c1e80925f8ff1f0049034424304c8b104d89d349c1eb304489d8488b14c5c0a55800480153184183e2010f84d90100004c8d0c40488b0dfe4f500049c1e1034e8d240b458b8424d4010000463b04990f843c0200004c8d14404183c0014d63f04a8d3cd349c1e603488bb7e0010000448987d40100004c29f648892e83abc8010000010f88d80100004883c4185b5d415c415d415e415ff3c30f1f8400000000004889dfbe01000000e883ab06008038004889c30f840effffff807803000f85a8020000807801004c8da0c0010000ba000000004c0f44e24989ed4989ee4c8d7b2849c1ed1a4981e6000000c04181e5f00000004901dd4d8b45284d39c60f85260200004889e848c1e80925f8ff1f0049034530488b304989f183e60149c1e9304889f14489c8488b34c5c0a55800480173184d85e40f84d50100004885c90f842f020000803d4cec2d00000f852b030000488d34404c8b35dc4e500048c1e6034d8d2c34458b4514473b048e0f84e30200004c8d0c404183c0014d63f84b8d0ccc49c1e703488b5120448941144c29fa48892a41836c2408010f89e9feffff498d7c2408e8179bffff84c00f84d7feffff4c89e6e9be0000000f1f80000000004c3bb3280100000f850c0200004c8b8b300100004c8993280100004889e8498b4c243048c1e80925f8ff1f004c01c848898b300100004d897424284d894c2430e907feffff0f1f00443b1d194e50000f82ab0000004d8b6c24284d39ee0f85a702000048c1ed0981e5f8ff1f004889e84903442430488b304883c4184889df5b5d415c415d415e415f48c1e61048c1fe104883e6fee9c62d0400660f1f440000488dbbc8010000e8549affff84c00f8414feffff4c89ee4883c4184889df5b5d415c415d415e415fe9a37806000f1f004b8d540d1041d1f84489d94c89ee4889df48890424e876640600458b8424d4010000488b0424e999fdffff0f1f440000458d63d9488b156d4d50004b8d3c6448c1e7034c8d343b418b8ee4050000423b0c9a0f84250200004f8d1c6483c1014c63f94e8d04db49c1e703498bb0f0050000418988e40500004c29fee968fdffff4883c4184889ee4889df5b5d415c415d415e415fe997abffff4c3bb3280100000f85fb010000488b93300100004c8983280100004889e84d8b453048c1e80925f8ff1f004801d0 Function at 0x557ea0 is je_tsd_fetch_slow Function at 0x46f886 is freeFakeClientArgv Function at 0x46f963 is rioWriteBulkObject Function at 0x553990 is je_tcache_bin_flush_small Function at 0x46facb is rewriteListObject
=== REDIS BUG REPORT END. Make sure to include from START to END. ===
Please report the crash by opening an issue on github:
http://github.com/antirez/redis/issues
Suspect RAM error? Use redis-server --test-memory to verify it. `
and crash2: `27883:C 18 Mar 2020 21:23:48.365 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo 27883:C 18 Mar 2020 21:23:48.365 # Redis version=5.9.102, bits=64, commit=00000000, modified=0, pid=27883, just started 27883:C 18 Mar 2020 21:23:48.365 # Warning: no config file specified, using the default config. In order to specify a config file use /root/redis-6.0-rc2/src/redis-server /path/to/redis.conf 27883:M 18 Mar 2020 21:23:48.365 * Increased maximum number of open files to 10032 (it was originally set to 1024). 27883:M 18 Mar 2020 21:23:48.366 * Running mode=standalone, port=6379. 27883:M 18 Mar 2020 21:23:48.366 # Server initialized 27883:M 18 Mar 2020 21:23:48.366 * Loading RDB produced by version 5.9.102 27883:M 18 Mar 2020 21:23:48.366 * RDB age 3062 seconds 27883:M 18 Mar 2020 21:23:48.366 * RDB memory usage when created 0.84 Mb 27883:M 18 Mar 2020 21:23:48.366 * DB loaded from disk: 0.000 seconds 27883:M 18 Mar 2020 21:23:48.366 * Ready to accept connections 27883:M 18 Mar 2020 21:28:49.454 # Error accepting a client connection: Success (conn: fd=-1)
=== REDIS BUG REPORT START: Cut & paste starting from here ===
27883:M 18 Mar 2020 21:30:45.308 # Redis 5.9.102 crashed by signal: 11
27883:M 18 Mar 2020 21:30:45.308 # Crashed running the instruction at: 0x443961
27883:M 18 Mar 2020 21:30:45.308 # Accessing address: (nil)
27883:M 18 Mar 2020 21:30:45.308 # Failed assertion:
------ STACK TRACE ------ EIP: 0x443961 is in _addReplyProtoToList (networking.c:264).
Backtrace: 0x476ea5 is in logStackTrace (debug.c:1252). 0x477669 is in sigsegvHandler (debug.c:1427). /lib/x86_64-linux-gnu/libpthread.so.0(+0x11390)[0x7f4e7dc3d390] 0x443961 is in _addReplyProtoToList (networking.c:264). 0x443ad8 is in addReply (networking.c:261). 0x45063c is in replicationFeedMonitors (replication.c:370). 0x434a45 is in call (server.c:3194). 0x434f97 is in processCommand (server.c:3570). 0x442950 is in processCommandAndResetClient (networking.c:1664). 0x446a4d is in processInputBuffer (networking.c:1759). 0x446d92 is in readQueryFromClient (networking.c:1867). 0x4c1f92 is in connSocketEventHandler (connhelpers.h:77). 0x42dfd5 is in aeProcessEvents (ae.c:470). 0x42e1fb is in aeMain (ae.c:520). 0x42a933 is in main (server.c:5072). 0x20830 is in __libc_start_main (../csu/libc-start.c:325).
------ INFO OUTPUT ------
Server
redis_version:5.9.102 redis_git_sha1:00000000 redis_git_dirty:0 redis_build_id:a7b54f881d9cdc40 redis_mode:standalone os:Linux 4.4.0-1099-aws x86_64 arch_bits:64 multiplexing_api:epoll atomicvar_api:atomic-builtin gcc_version:5.4.0 process_id:27883 run_id:213a4d0361f5e172209b73548812536c6211c681 tcp_port:6379 uptime_in_seconds:417 uptime_in_days:0 hz:10 configured_hz:10 lru_clock:7508741 executable:/root/redis-6.0-rc2/src/redis-server config_file:
Clients
connected_clients:2 client_recent_max_input_buffer:2 client_recent_max_output_buffer:6384976003417785088 blocked_clients:0 tracking_clients:0
Memory
used_memory:869800 used_memory_human:849.41K used_memory_rss:5251072 used_memory_rss_human:5.01M used_memory_peak:869800 used_memory_peak_human:849.41K used_memory_peak_perc:100.20% used_memory_overhead:6384976003418654384 used_memory_startup:802424 used_memory_dataset:12061768070291767032 used_memory_dataset_perc:17902173161521152.00% allocator_allocated:1240760 allocator_active:1544192 allocator_resident:4108288 total_system_memory:7841435648 total_system_memory_human:7.30G used_memory_lua:37888 used_memory_lua_human:37.00K used_memory_scripts:0 used_memory_scripts_human:0B number_of_cached_scripts:0 maxmemory:0 maxmemory_human:0B maxmemory_policy:noeviction allocator_frag_ratio:1.24 allocator_frag_bytes:303432 allocator_rss_ratio:2.66 allocator_rss_bytes:2564096 rss_overhead_ratio:1.28 rss_overhead_bytes:1142784 mem_fragmentation_ratio:6.35 mem_fragmentation_bytes:4423976 mem_not_counted_for_evict:0 mem_replication_backlog:0 mem_clients_slaves:0 mem_clients_normal:6384976003417851816 mem_aof_buffer:0 mem_allocator:jemalloc-5.1.0 active_defrag_running:0 lazyfree_pending_objects:0
Persistence
loading:0 rdb_changes_since_last_save:1 rdb_bgsave_in_progress:0 rdb_last_save_time:1584566628 rdb_last_bgsave_status:ok rdb_last_bgsave_time_sec:-1 rdb_current_bgsave_time_sec:-1 rdb_last_cow_size:0 aof_enabled:0 aof_rewrite_in_progress:0 aof_rewrite_scheduled:0 aof_last_rewrite_time_sec:-1 aof_current_rewrite_time_sec:-1 aof_last_bgrewrite_status:ok aof_last_write_status:ok aof_last_cow_size:0 module_fork_in_progress:0 module_fork_last_cow_size:0
Stats
total_connections_received:5 total_commands_processed:16 instantaneous_ops_per_sec:0 total_net_input_bytes:616 total_net_output_bytes:38017 instantaneous_input_kbps:0.00 instantaneous_output_kbps:0.00 rejected_connections:1 sync_full:0 sync_partial_ok:0 sync_partial_err:0 expired_keys:0 expired_stale_perc:0.00 expired_time_cap_reached_count:0 expire_cycle_cpu_milliseconds:4 evicted_keys:0 keyspace_hits:2 keyspace_misses:0 pubsub_channels:0 pubsub_patterns:0 latest_fork_usec:0 migrate_cached_sockets:0 slave_expires_tracked_keys:0 active_defrag_hits:0 active_defrag_misses:0 active_defrag_key_hits:0 active_defrag_key_misses:0 tracking_total_keys:0 tracking_total_items:0
Replication
role:master connected_slaves:0 master_replid:3e10513f55828fff173d00e2fec5c164929dbeac master_replid2:0000000000000000000000000000000000000000 master_repl_offset:0 second_repl_offset:-1 repl_backlog_active:0 repl_backlog_size:1048576 repl_backlog_first_byte_offset:0 repl_backlog_histlen:0
CPU
used_cpu_sys:0.272000 used_cpu_user:0.000000 used_cpu_sys_children:0.000000 used_cpu_user_children:0.000000
Modules
Commandstats
cmdstat_get:calls=2,usec=8,usec_per_call=4.00 cmdstat_command:calls=2,usec=2823,usec_per_call=1411.50 cmdstat_set:calls=1,usec=5,usec_per_call=5.00 cmdstat_auth:calls=3,usec=13,usec_per_call=4.33 cmdstat_monitor:calls=1,usec=1,usec_per_call=1.00 cmdstat_acl:calls=7,usec=349,usec_per_call=49.86
Cluster
cluster_enabled:0
Keyspace
db0:keys=2,expires=0,avg_ttl=0
------ CLIENT LIST OUTPUT ------ id=7 addr=127.0.0.1:58102 fd=8 name= age=123 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=27 qbuf-free=32741 obl=0 oll=0 omem=0 events=r cmd=set user=default id=9 addr=127.0.0.1:58104 fd=9 name= age=107 idle=107 flags=O db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=monitor user=default
------ CURRENT CLIENT INFO ------ id=7 addr=127.0.0.1:58102 fd=8 name= age=123 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=27 qbuf-free=32741 obl=0 oll=0 omem=0 events=r cmd=set user=default argv[0]: 'set' argv[1]: 'a' argv[2]: 'a'
------ REGISTERS ------ 27883:M 18 Mar 2020 21:30:45.309 # RAX:332e353430373635 RBX:00007f4e7a978b40 RCX:0000000000000000 RDX:0000000000000036 RDI:00007f4e7a978b40 RSI:00007f4e7d40d643 RBP:0000000000000036 RSP:00007ffd55424940 R8 :0000000000000000 R9 :0000000000000003 R10:0000000000000020 R11:0000000000000078 R12:0000000000000003 R13:00007f4e7a978b40 R14:00007f4e7d40d643 R15:00007f4e7d40fb73 RIP:0000000000443961 EFL:0000000000010206 CSGSFS:0000000000000033 27883:M 18 Mar 2020 21:30:45.309 # (00007ffd5542494f) -> 000000000045063c 27883:M 18 Mar 2020 21:30:45.309 # (00007ffd5542494e) -> 0000000000000002 27883:M 18 Mar 2020 21:30:45.309 # (00007ffd5542494d) -> 00007f4e7d477bd0 27883:M 18 Mar 2020 21:30:45.309 # (00007ffd5542494c) -> 0000000000000003 27883:M 18 Mar 2020 21:30:45.309 # (00007ffd5542494b) -> a7a843d65e78a200 27883:M 18 Mar 2020 21:30:45.309 # (00007ffd5542494a) -> 0000000000000000 27883:M 18 Mar 2020 21:30:45.309 # (00007ffd55424949) -> 0000000000000003 27883:M 18 Mar 2020 21:30:45.309 # (00007ffd55424948) -> 00007f4e7d40fb73 27883:M 18 Mar 2020 21:30:45.309 # (00007ffd55424947) -> 000000000043c016 27883:M 18 Mar 2020 21:30:45.309 # (00007ffd55424946) -> 00007f4e7d477bd0 27883:M 18 Mar 2020 21:30:45.309 # (00007ffd55424945) -> 0000000000443ad8 27883:M 18 Mar 2020 21:30:45.309 # (00007ffd55424944) -> 00007f4e7d40f330 27883:M 18 Mar 2020 21:30:45.309 # (00007ffd55424943) -> 00007f4e7aff8b40 27883:M 18 Mar 2020 21:30:45.309 # (00007ffd55424942) -> 0000000000000003 27883:M 18 Mar 2020 21:30:45.309 # (00007ffd55424941) -> 00007f4e7d477bd0 27883:M 18 Mar 2020 21:30:45.309 # (00007ffd55424940) -> 00007f4e7a978b40
------ MODULES INFO OUTPUT ------
------ FAST MEMORY TEST ------ 27883:M 18 Mar 2020 21:30:45.309 # Bio thread for job type #0 terminated 27883:M 18 Mar 2020 21:30:45.309 # Bio thread for job type #1 terminated 27883:M 18 Mar 2020 21:30:45.309 # Bio thread for job type #2 terminated *** Preparing to test memory region 7cb000 (2260992 bytes) *** Preparing to test memory region 15d0000 (135168 bytes) *** Preparing to test memory region 7f4e7a6fc000 (9437184 bytes) *** Preparing to test memory region 7f4e7affd000 (8388608 bytes) *** Preparing to test memory region 7f4e7b7fe000 (8388608 bytes) *** Preparing to test memory region 7f4e7bfff000 (8388608 bytes) *** Preparing to test memory region 7f4e7c800000 (8388608 bytes) *** Preparing to test memory region 7f4e7d000000 (8388608 bytes) *** Preparing to test memory region 7f4e7dc28000 (16384 bytes) *** Preparing to test memory region 7f4e7de45000 (16384 bytes) *** Preparing to test memory region 7f4e7e775000 (24576 bytes) *** Preparing to test memory region 7f4e7e785000 (4096 bytes) .O.O.O.O.O.O.O.O.O.O.O.O Fast memory test PASSED, however your memory can still be broken. Please run a memory test for several hours if possible.
------ DUMPING CODE AROUND EIP ------ Symbol: (null) (base: (nil)) Module: /root/redis-6.0-rc2/src/redis-server *:6379 (base 0x400000) $ xxd -r -p /tmp/dump.hex /tmp/dump.bin $ objdump --adjust-vma=(nil) -D -b binary -m i386:x86-64 /tmp/dump.bin
=== REDIS BUG REPORT END. Make sure to include from START to END. ===
Please report the crash by opening an issue on github:
http://github.com/antirez/redis/issues
Suspect RAM error? Use redis-server --test-memory to verify it. `
Comment From: antirez
Ping @yossigo again. I don't think it has anything to do with ACLs.
Comment From: alon-redis
@antirez @yossigo - I have scenario that recreates this quite easily. here are the steps:
- create fresh redis server 6.0 rc2
- run those commands:
- acl list
- acl setuser alon on ~* +@string >alon
- auth alon alon
- set alon a
- exit
- connect again and send: acl setuser alon on ~* +@string +@admin >alon
- leave the connection open
- leave the laptop open till it goes to sleep mode
- try to open connection to the redis server again:
root@ip-172-31-27-85:~# redis-cli ^C root@ip-172-31-27-85:~# redis-cli 127.0.0.1:6379> acl info Could not connect to Redis at 127.0.0.1:6379: Connection refused not connected> root@ip-172-31-27-85:~# - redis will crash:
`=== REDIS BUG REPORT START: Cut & paste starting from here ===
12497:M 20 Mar 2020 07:46:00.220 # Redis 5.9.102 crashed by signal: 11
12497:M 20 Mar 2020 07:46:00.220 # Crashed running the instruction at: 0x4ed547
12497:M 20 Mar 2020 07:46:00.220 # Accessing address: 0x7f6cc77bc96c
12497:M 20 Mar 2020 07:46:00.220 # Failed assertion:
( :0)
------ STACK TRACE ------ EIP: 0x4ed547 is in je_free (include/jemalloc/internal/tcache_inlines.h:203).
Backtrace: 0x476ea5 is in logStackTrace (debug.c:1252). 0x477669 is in sigsegvHandler (debug.c:1427). /lib/x86_64-linux-gnu/libpthread.so.0(+0x11390)[0x7f54c6c84390] 0x4ed547 is in je_free (include/jemalloc/internal/tcache_inlines.h:203). 0x42af97 is in listDelNode (adlist.c:178). 0x44254a is in writeToClient (networking.c:1248). 0x4426e2 is in handleClientsWithPendingWrites (networking.c:1330). 0x4476d6 is in handleClientsWithPendingWritesUsingThreads (networking.c:2902). 0x43185d is in beforeSleep (server.c:2146). 0x42e1ee is in aeMain (ae.c:523). 0x42a933 is in main (server.c:5072). 0x20830 is in __libc_start_main (../csu/libc-start.c:325).
------ INFO OUTPUT ------
Server
redis_version:5.9.102 redis_git_sha1:00000000 redis_git_dirty:0 redis_build_id:a7b54f881d9cdc40 redis_mode:standalone os:Linux 4.4.0-1099-aws x86_64 arch_bits:64 multiplexing_api:epoll atomicvar_api:atomic-builtin gcc_version:5.4.0 process_id:12497 run_id:aba19140ce0edb99f7ea2b195bbb7f346e3dd790 tcp_port:6379 uptime_in_seconds:5526 uptime_in_days:0 hz:10 configured_hz:10 lru_clock:7632056 executable:/root/redis-6.0-rc2/src/redis-server config_file:
Clients
connected_clients:1 client_recent_max_input_buffer:2 client_recent_max_output_buffer:0 blocked_clients:0 tracking_clients:0
Memory
used_memory:8801200 used_memory_human:8.39M used_memory_rss:5251072 used_memory_rss_human:5.01M used_memory_peak:8801200 used_memory_peak_human:8.39M used_memory_peak_perc:1017.52% used_memory_overhead:8807870 used_memory_startup:802424 used_memory_dataset:18446744073709544946 used_memory_dataset_perc:230619577581568.00% allocator_allocated:1130632 allocator_active:1449984 allocator_resident:4083712 total_system_memory:7841435648 total_system_memory_human:7.30G used_memory_lua:37888 used_memory_lua_human:37.00K used_memory_scripts:0 used_memory_scripts_human:0B number_of_cached_scripts:0 maxmemory:0 maxmemory_human:0B maxmemory_policy:noeviction allocator_frag_ratio:1.28 allocator_frag_bytes:319352 allocator_rss_ratio:2.82 allocator_rss_bytes:2633728 rss_overhead_ratio:1.29 rss_overhead_bytes:1167360 mem_fragmentation_ratio:6.71 mem_fragmentation_bytes:4468880 mem_not_counted_for_evict:0 mem_replication_backlog:0 mem_clients_slaves:0 mem_clients_normal:8005342 mem_aof_buffer:0 mem_allocator:jemalloc-5.1.0 active_defrag_running:0 lazyfree_pending_objects:0
Persistence
loading:0 rdb_changes_since_last_save:0 rdb_bgsave_in_progress:0 rdb_last_save_time:1584688435 rdb_last_bgsave_status:ok rdb_last_bgsave_time_sec:0 rdb_current_bgsave_time_sec:-1 rdb_last_cow_size:151552 aof_enabled:0 aof_rewrite_in_progress:0 aof_rewrite_scheduled:0 aof_last_rewrite_time_sec:-1 aof_current_rewrite_time_sec:-1 aof_last_bgrewrite_status:ok aof_last_write_status:ok aof_last_cow_size:0 module_fork_in_progress:0 module_fork_last_cow_size:0
Stats
total_connections_received:4 total_commands_processed:10 instantaneous_ops_per_sec:0 total_net_input_bytes:345 total_net_output_bytes:54926 instantaneous_input_kbps:0.00 instantaneous_output_kbps:0.00 rejected_connections:1 sync_full:0 sync_partial_ok:0 sync_partial_err:0 expired_keys:0 expired_stale_perc:0.00 expired_time_cap_reached_count:0 expire_cycle_cpu_milliseconds:58 evicted_keys:0 keyspace_hits:1 keyspace_misses:0 pubsub_channels:0 pubsub_patterns:0 latest_fork_usec:288 migrate_cached_sockets:0 slave_expires_tracked_keys:0 active_defrag_hits:0 active_defrag_misses:0 active_defrag_key_hits:0 active_defrag_key_misses:0 tracking_total_keys:0 tracking_total_items:0
Replication
role:master connected_slaves:0 master_replid:0b6a4aae6b7884048847b8ddc9b24a11c4ca67e6 master_replid2:0000000000000000000000000000000000000000 master_repl_offset:0 second_repl_offset:-1 repl_backlog_active:0 repl_backlog_size:1048576 repl_backlog_first_byte_offset:0 repl_backlog_histlen:0
CPU
used_cpu_sys:1.876000 used_cpu_user:1.840000 used_cpu_sys_children:0.000000 used_cpu_user_children:0.000000
Modules
Commandstats
cmdstat_set:calls=1,usec=5,usec_per_call=5.00 cmdstat_get:calls=1,usec=4,usec_per_call=4.00 cmdstat_command:calls=4,usec=5840,usec_per_call=1460.00 cmdstat_auth:calls=1,usec=10,usec_per_call=10.00 cmdstat_acl:calls=3,usec=151,usec_per_call=50.33
Cluster
cluster_enabled:0
Keyspace
db0:keys=1,expires=0,avg_ttl=0
------ CLIENT LIST OUTPUT ------ id=8 addr=127.0.0.1:38678 fd=8 name= age=0 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=389 omem=7955592 events=r cmd=command user=default
------ REGISTERS ------ 12497:M 20 Mar 2020 07:46:00.221 # RAX:0000000000000000 RBX:00007f54c77bc730 RCX:00007f54c0000000 RDX:00007f54c6600900 RDI:00000017fffffc58 RSI:00007f54c77bc788 RBP:00007f54c3973480 RSP:00007ffc64399960 R8 :0000000000000034 R9 :0000000000000030 R10:0000000000000000 R11:0000000000000000 R12:00000000ffffffd9 R13:00007f54c77bc8f0 R14:00007f6cc77bc388 R15:00007f54c77bc758 RIP:00000000004ed547 EFL:0000000000010202 CSGSFS:ffff000000000033 12497:M 20 Mar 2020 07:46:00.221 # (00007ffc6439996f) -> 00007f54c651d04c 12497:M 20 Mar 2020 07:46:00.221 # (00007ffc6439996e) -> 000000005e7474b8 12497:M 20 Mar 2020 07:46:00.221 # (00007ffc6439996d) -> 000000000044254a 12497:M 20 Mar 2020 07:46:00.221 # (00007ffc6439996c) -> 0000000000000032 12497:M 20 Mar 2020 07:46:00.221 # (00007ffc6439996b) -> 00000000000002c5 12497:M 20 Mar 2020 07:46:00.221 # (00007ffc6439996a) -> 00000000000003e8 12497:M 20 Mar 2020 07:46:00.221 # (00007ffc64399969) -> 000000000042af97 12497:M 20 Mar 2020 07:46:00.221 # (00007ffc64399968) -> 00007f54c3973480 12497:M 20 Mar 2020 07:46:00.221 # (00007ffc64399967) -> 0000000000000032 12497:M 20 Mar 2020 07:46:00.221 # (00007ffc64399966) -> 00007f54c651ce00 12497:M 20 Mar 2020 07:46:00.221 # (00007ffc64399965) -> 0000000000000000 12497:M 20 Mar 2020 07:46:00.221 # (00007ffc64399964) -> 00007f54c640f9c0 12497:M 20 Mar 2020 07:46:00.221 # (00007ffc64399963) -> 00007f54c3ff8930 12497:M 20 Mar 2020 07:46:00.221 # (00007ffc64399962) -> 00007f54c6415140 12497:M 20 Mar 2020 07:46:00.221 # (00007ffc64399961) -> 00007f54c651ce00 12497:M 20 Mar 2020 07:46:00.221 # (00007ffc64399960) -> 0000000000000008
------ MODULES INFO OUTPUT ------
------ FAST MEMORY TEST ------ 12497:M 20 Mar 2020 07:46:00.221 # Bio thread for job type #0 terminated 12497:M 20 Mar 2020 07:46:00.221 # Bio thread for job type #1 terminated 12497:M 20 Mar 2020 07:46:00.221 # Bio thread for job type #2 terminated *** Preparing to test memory region 7cb000 (2260992 bytes) *** Preparing to test memory region 2399000 (135168 bytes) *** Preparing to test memory region 7f54c36fc000 (9437184 bytes) *** Preparing to test memory region 7f54c3ffd000 (8388608 bytes) *** Preparing to test memory region 7f54c47fe000 (8388608 bytes) *** Preparing to test memory region 7f54c4fff000 (8388608 bytes) *** Preparing to test memory region 7f54c5800000 (8388608 bytes) *** Preparing to test memory region 7f54c6000000 (8388608 bytes) *** Preparing to test memory region 7f54c6c6f000 (16384 bytes) *** Preparing to test memory region 7f54c6e8c000 (16384 bytes) *** Preparing to test memory region 7f54c77bc000 (24576 bytes) *** Preparing to test memory region 7f54c77cc000 (4096 bytes) .O.O.O.O.O.O.O.O.O.O.O.O Fast memory test PASSED, however your memory can still be broken. Please run a memory test for several hours if possible.
------ DUMPING CODE AROUND EIP ------ Symbol: je_free (base: 0x4ed200) Module: /root/redis-6.0-rc2/src/redis-server *:6379 (base 0x400000) $ xxd -r -p /tmp/dump.hex /tmp/dump.bin $ objdump --adjust-vma=0x4ed200 -D -b binary -m i386:x86-64 /tmp/dump.bin
12497:M 20 Mar 2020 07:46:00.387 # dump of function (hexdump of 967 bytes): 4885ff0f84fd000000415741564155415455534889fd4883ec18488b05d73d2d004889c36448031c2500000000648038000f85d90000004989ec4989ee4c8dabc001000049c1ec1a4981e6000000c04c8d7b284181e4f00000004901dc4d8b5424284d39d60f85c50100004889e848c1e80925f8ff1f0049034424304c8b104d89d349c1eb304489d8488b14c5c0a55800480153184183e2010f84d90100004c8d0c40488b0dfe4f500049c1e1034e8d240b458b8424d4010000463b04990f843c0200004c8d14404183c0014d63f04a8d3cd349c1e603488bb7e0010000448987d40100004c29f648892e83abc8010000010f88d80100004883c4185b5d415c415d415e415ff3c30f1f8400000000004889dfbe01000000e883ab06008038004889c30f840effffff807803000f85a8020000807801004c8da0c0010000ba000000004c0f44e24989ed4989ee4c8d7b2849c1ed1a4981e6000000c04181e5f00000004901dd4d8b45284d39c60f85260200004889e848c1e80925f8ff1f0049034530488b304989f183e60149c1e9304889f14489c8488b34c5c0a55800480173184d85e40f84d50100004885c90f842f020000803d4cec2d00000f852b030000488d34404c8b35dc4e500048c1e6034d8d2c34458b4514473b048e0f84e30200004c8d0c404183c0014d63f84b8d0ccc49c1e703488b5120448941144c29fa48892a41836c2408010f89e9feffff498d7c2408e8179bffff84c00f84d7feffff4c89e6e9be0000000f1f80000000004c3bb3280100000f850c0200004c8b8b300100004c8993280100004889e8498b4c243048c1e80925f8ff1f004c01c848898b300100004d897424284d894c2430e907feffff0f1f00443b1d194e50000f82ab0000004d8b6c24284d39ee0f85a702000048c1ed0981e5f8ff1f004889e84903442430488b304883c4184889df5b5d415c415d415e415f48c1e61048c1fe104883e6fee9c62d0400660f1f440000488dbbc8010000e8549affff84c00f8414feffff4c89ee4883c4184889df5b5d415c415d415e415fe9a37806000f1f004b8d540d1041d1f84489d94c89ee4889df48890424e876640600458b8424d4010000488b0424e999fdffff0f1f440000458d63d9488b156d4d50004b8d3c6448c1e7034c8d343b418b8ee4050000423b0c9a0f84250200004f8d1c6483c1014c63f94e8d04db49c1e703498bb0f0050000418988e40500004c29fee968fdffff4883c4184889ee4889df5b5d415c415d415e415fe997abffff4c3bb3280100000f85fb010000488b93300100004c8983280100004889e84d8b453048c1e80925f8ff1f004801d0 Function at 0x557ea0 is je_tsd_fetch_slow Function at 0x46f886 is freeFakeClientArgv Function at 0x46f963 is rioWriteBulkObject Function at 0x553990 is je_tcache_bin_flush_small Function at 0x46facb is rewriteListObject
=== REDIS BUG REPORT END. Make sure to include from START to END. ===
Please report the crash by opening an issue on github:
http://github.com/antirez/redis/issues
Suspect RAM error? Use redis-server --test-memory to verify it.
`
Comment From: antirez
Hi @alon-redis, please can you check if in the logs there is always an "accept" error? Also could you check if the same happens if instead of using ACL commands, you just do PING, and then close the laptop and so forth? Thanks.
Comment From: antirez
Another very useful thing is if you could try with "git bisect" to find the commit where it happened.
Comment From: antirez
An even more obvious action would be the following btw: if @yossigo could provide just a quick fix for the connection bug, or even one that introduces a leak but removes the invalid memory access, so we can be sure this is due to that.
Comment From: alon-redis
@antirez - I managed to reproduce it w/o ACL command
the actions:
- create fresh redis server 6.0rc2 and run:
root@ip-172-31-27-85:~# redis-cli
127.0.0.1:6379> get a
(nil)
127.0.0.1:6379> info server
127.0.0.1:6379> get alon
"a"
127.0.0.1:6379> acl list
1) "user default on nopass ~* +@all"
127.0.0.1:6379>
- leave the laptop till it goes to sleep mode
- try to open connection thru redis-cli after an hour
in all the recreations I saw this line in the logs:
Error accepting a client connection: Success (conn: fd=-1)
the crash log:
`
=== REDIS BUG REPORT START: Cut & paste starting from here ===
23283:M 21 Mar 2020 15:47:37.859 # Redis 5.9.102 crashed by signal: 11
23283:M 21 Mar 2020 15:47:37.859 # Crashed running the instruction at: 0x554583
23283:M 21 Mar 2020 15:47:37.859 # Accessing address: (nil)
23283:M 21 Mar 2020 15:47:37.859 # Failed assertion:
------ STACK TRACE ------ EIP: 0x554583 is in je_tcache_bin_flush_large (include/jemalloc/internal/atomic.h:55).
Backtrace: 0x476ea5 is in logStackTrace (debug.c:1252). 0x477669 is in sigsegvHandler (debug.c:1427). /lib/x86_64-linux-gnu/libpthread.so.0(+0x11390)[0x7f99a80d7390] 0x554583 is in je_tcache_bin_flush_large (include/jemalloc/internal/atomic.h:55). 0x4ed795 is in je_free (include/jemalloc/internal/tcache_inlines.h:204). 0x42af97 is in listDelNode (adlist.c:178). 0x44254a is in writeToClient (networking.c:1248). 0x4426e2 is in handleClientsWithPendingWrites (networking.c:1330). 0x4476d6 is in handleClientsWithPendingWritesUsingThreads (networking.c:2902). 0x43185d is in beforeSleep (server.c:2146). 0x42e1ee is in aeMain (ae.c:523). 0x42a933 is in main (server.c:5072). 0x20830 is in __libc_start_main (../csu/libc-start.c:325).
------ INFO OUTPUT ------
Server
redis_version:5.9.102 redis_git_sha1:00000000 redis_git_dirty:0 redis_build_id:a7b54f881d9cdc40 redis_mode:standalone os:Linux 4.4.0-1099-aws x86_64 arch_bits:64 multiplexing_api:epoll atomicvar_api:atomic-builtin gcc_version:5.4.0 process_id:23283 run_id:821ba261eeb01f07286d0eebe54dfd9591d8447d tcp_port:6379 uptime_in_seconds:8003 uptime_in_days:0 hz:10 configured_hz:10 lru_clock:7747353 executable:/root/redis-6.0-rc2/src/redis-server config_file:
Clients
connected_clients:1 client_recent_max_input_buffer:2 client_recent_max_output_buffer:0 blocked_clients:0 tracking_clients:0
Memory
used_memory:7057904 used_memory_human:6.73M used_memory_rss:5279744 used_memory_rss_human:5.04M used_memory_peak:7057904 used_memory_peak_human:6.73M used_memory_peak_perc:816.45% used_memory_overhead:7065030 used_memory_startup:802424 used_memory_dataset:18446744073709544490 used_memory_dataset_perc:294889333981184.00% allocator_allocated:1129136 allocator_active:1449984 allocator_resident:4083712 total_system_memory:7841435648 total_system_memory_human:7.30G used_memory_lua:37888 used_memory_lua_human:37.00K used_memory_scripts:0 used_memory_scripts_human:0B number_of_cached_scripts:0 maxmemory:0 maxmemory_human:0B maxmemory_policy:noeviction allocator_frag_ratio:1.28 allocator_frag_bytes:320848 allocator_rss_ratio:2.82 allocator_rss_bytes:2633728 rss_overhead_ratio:1.29 rss_overhead_bytes:1196032 mem_fragmentation_ratio:6.75 mem_fragmentation_bytes:4498008 mem_not_counted_for_evict:0 mem_replication_backlog:0 mem_clients_slaves:0 mem_clients_normal:6262502 mem_aof_buffer:0 mem_allocator:jemalloc-5.1.0 active_defrag_running:0 lazyfree_pending_objects:0
Persistence
loading:0 rdb_changes_since_last_save:0 rdb_bgsave_in_progress:0 rdb_last_save_time:1584797654 rdb_last_bgsave_status:ok rdb_last_bgsave_time_sec:-1 rdb_current_bgsave_time_sec:-1 rdb_last_cow_size:0 aof_enabled:0 aof_rewrite_in_progress:0 aof_rewrite_scheduled:0 aof_last_rewrite_time_sec:-1 aof_current_rewrite_time_sec:-1 aof_last_bgrewrite_status:ok aof_last_write_status:ok aof_last_cow_size:0 module_fork_in_progress:0 module_fork_last_cow_size:0
Stats
total_connections_received:4 total_commands_processed:9 instantaneous_ops_per_sec:0 total_net_input_bytes:183 total_net_output_bytes:55453 instantaneous_input_kbps:0.00 instantaneous_output_kbps:0.00 rejected_connections:1 sync_full:0 sync_partial_ok:0 sync_partial_err:0 expired_keys:0 expired_stale_perc:0.00 expired_time_cap_reached_count:0 expire_cycle_cpu_milliseconds:85 evicted_keys:0 keyspace_hits:1 keyspace_misses:1 pubsub_channels:0 pubsub_patterns:0 latest_fork_usec:0 migrate_cached_sockets:0 slave_expires_tracked_keys:0 active_defrag_hits:0 active_defrag_misses:0 active_defrag_key_hits:0 active_defrag_key_misses:0 tracking_total_keys:0 tracking_total_items:0
Replication
role:master connected_slaves:0 master_replid:b38ae8e1adb904f7a9e3cb515022c23798ff0ea7 master_replid2:0000000000000000000000000000000000000000 master_repl_offset:0 second_repl_offset:-1 repl_backlog_active:0 repl_backlog_size:1048576 repl_backlog_first_byte_offset:0 repl_backlog_histlen:0
CPU
used_cpu_sys:2.300000 used_cpu_user:3.416000 used_cpu_sys_children:0.000000 used_cpu_user_children:0.000000
Modules
Commandstats
cmdstat_command:calls=4,usec=6624,usec_per_call=1656.00 cmdstat_acl:calls=2,usec=171,usec_per_call=85.50 cmdstat_get:calls=2,usec=6,usec_per_call=3.00 cmdstat_info:calls=1,usec=38,usec_per_call=38.00
Cluster
cluster_enabled:0
Keyspace
db0:keys=1,expires=0,avg_ttl=0
------ CLIENT LIST OUTPUT ------ id=8 addr=127.0.0.1:38916 fd=8 name= age=0 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=304 omem=6212752 events=r cmd=command user=default
------ REGISTERS ------ 23283:M 21 Mar 2020 15:47:37.860 # RAX:0000000000000000 RBX:00007ffd380a56b0 RCX:00007f99a7a66300 RDX:00007f99a8c0f7b8 RDI:00007f99a78079a0 RSI:00007f9980000000 RBP:00007ffd380a5910 RSP:00007ffd380a56b0 R8 :00007f99a8c0f758 R9 :0000000000000009 R10:00007f99a8c0f758 R11:00007f99a8c0fd28 R12:0000000000000009 R13:000000000000000a R14:00007ffd380a56b0 R15:00007f99a8c0fd28 RIP:0000000000554583 EFL:0000000000010202 CSGSFS:0000000000000033 23283:M 21 Mar 2020 15:47:37.860 # (00007ffd380a56bf) -> 00007ffd00000009 23283:M 21 Mar 2020 15:47:37.860 # (00007ffd380a56be) -> 0000000000000028 23283:M 21 Mar 2020 15:47:37.860 # (00007ffd380a56bd) -> 0000000a00444c0e 23283:M 21 Mar 2020 15:47:37.860 # (00007ffd380a56bc) -> 0000000000000020 23283:M 21 Mar 2020 15:47:37.860 # (00007ffd380a56bb) -> 00007f99a53f8af8 23283:M 21 Mar 2020 15:47:37.860 # (00007ffd380a56ba) -> 00007f99a791cf40 23283:M 21 Mar 2020 15:47:37.860 # (00007ffd380a56b9) -> 00007f99a7a66300 23283:M 21 Mar 2020 15:47:37.860 # (00007ffd380a56b8) -> 00007f99a7a66280 23283:M 21 Mar 2020 15:47:37.860 # (00007ffd380a56b7) -> 00007f99a7a66200 23283:M 21 Mar 2020 15:47:37.860 # (00007ffd380a56b6) -> 00007f99a7a66180 23283:M 21 Mar 2020 15:47:37.860 # (00007ffd380a56b5) -> 00007f99a7a66100 23283:M 21 Mar 2020 15:47:37.860 # (00007ffd380a56b4) -> 00007f99a7a66080 23283:M 21 Mar 2020 15:47:37.860 # (00007ffd380a56b3) -> 00007f99a7a66000 23283:M 21 Mar 2020 15:47:37.860 # (00007ffd380a56b2) -> 00007f99a7a65f80 23283:M 21 Mar 2020 15:47:37.860 # (00007ffd380a56b1) -> 00007f99a7a65f00 23283:M 21 Mar 2020 15:47:37.860 # (00007ffd380a56b0) -> 0000000000000000
------ MODULES INFO OUTPUT ------
------ FAST MEMORY TEST ------ 23283:M 21 Mar 2020 15:47:37.860 # Bio thread for job type #0 terminated 23283:M 21 Mar 2020 15:47:37.860 # Bio thread for job type #1 terminated 23283:M 21 Mar 2020 15:47:37.860 # Bio thread for job type #2 terminated *** Preparing to test memory region 7cb000 (2260992 bytes) *** Preparing to test memory region 1115000 (135168 bytes) *** Preparing to test memory region 7f99a4afc000 (9437184 bytes) *** Preparing to test memory region 7f99a53fd000 (8388608 bytes) *** Preparing to test memory region 7f99a5bfe000 (8388608 bytes) *** Preparing to test memory region 7f99a63ff000 (8388608 bytes) *** Preparing to test memory region 7f99a6c00000 (8388608 bytes) *** Preparing to test memory region 7f99a7400000 (8388608 bytes) *** Preparing to test memory region 7f99a80c2000 (16384 bytes) *** Preparing to test memory region 7f99a82df000 (16384 bytes) *** Preparing to test memory region 7f99a8c0f000 (24576 bytes) *** Preparing to test memory region 7f99a8c1f000 (4096 bytes) .O.O.O.O.O.O.O.O.O.O.O.O Fast memory test PASSED, however your memory can still be broken. Please run a memory test for several hours if possible.
------ DUMPING CODE AROUND EIP ------ Symbol: je_tcache_bin_flush_large (base: 0x5543a0) Module: /root/redis-6.0-rc2/src/redis-server *:6379 (base 0x400000) $ xxd -r -p /tmp/dump.hex /tmp/dump.bin $ objdump --adjust-vma=0x5543a0 -D -b binary -m i386:x86-64 /tmp/dump.bin
23283:M 21 Mar 2020 15:47:38.031 # dump of function (hexdump of 611 bytes): 5589c84889e541574156415541544989f5534881ecd8010000448b5e04899510feffff898d0cfeffff4889bd38feffff64488b0c252800000048894dc831c94129c3498b88e80300004489da488d1cd51600000048898d20feffff48c1eb0448c1e3044829dc4585db0f84fe070000458d4bff4989f84c8d9540feffff4983c0284885ff44899d14feffff4a8d44cc084d0f45d04d89eb44898d18feffff4989e649c7c7f8ffffff4d89d44989c54889a500feffff4889fbeb5c660f1f4400004889ca4889c848c1ea1a4825000000c081e2f00000004c01e2488b324839f0756f48c1e90981e1f8ff1f004889c848034208488b084983c6084983ef0848c1e11048c1f9104883e1fe49894ef84d39f50f848a000000498b7b104885db4a8b0c3f759d488dbd40feffff4c899d28feffff48898d30feffffe88337feff4c8b9d28feffff488b8d30feffffe970ffffff498bbc24000100004839f80f85440700004d8b8c24080100004989b4240001000048c1e9094c8b520881e1f8ff1f004d89942408010000488902498d04094c894a08e95bffffff660f1f840000000000448ba514feffff448bbd10feffff488b9d00feffffc68514feffff004589e5448ba518feffff4183ef2749c1e7054989de4c89bd00feffff4d89df0f1f440000498b06488b1081e2ff0f00004c8b1cd5c0387e00498dbb501c0000498d9b101c00004c899d30feffff4889bd28feffffe81b5dedff85c04c8b8530feffff0f8574030000498380481c000001488bb538feffff493bb0401c0000740f498380381c0000014989b0401c0000498b364b8d54e6084183e4034c8b0e4181e1ff0f00004e8b Function at 0x537c60 is je_rtree_ctx_data_init
=== REDIS BUG REPORT END. Make sure to include from START to END. ===
Please report the crash by opening an issue on github:
http://github.com/antirez/redis/issues
Suspect RAM error? Use redis-server --test-memory to verify it. `
Comment From: yossigo
@alon-redis can you see if this still happens with #7018? Thanks!
Comment From: alon-redis
@yossigo - I'm on it. so far I couldn't recreate it, but I need more time to be sure.
Comment From: alon-redis
@yossigo - I couldn't recreate the crash on #7018
Comment From: antirez
Thanks, closing.