=== REDIS BUG REPORT START: Cut & paste starting from here ===
31088:M 21 Jun 15:44:44.359 # ------------------------------------------------
31088:M 21 Jun 15:44:44.359 # !!! Software Failure. Press left mouse button to continue
31088:M 21 Jun 15:44:44.359 # Guru Meditation: Redis aborting for OUT OF MEMORY #server.c:3589
31088:M 21 Jun 15:44:44.359 # (forcing SIGSEGV in order to print the stack trace)
31088:M 21 Jun 15:44:44.359 # ------------------------------------------------
31088:M 21 Jun 15:44:44.359 # Redis 4.0.10 crashed by signal: 11
31088:M 21 Jun 15:44:44.359 # Crashed running the instruction at: 0x466d87
31088:M 21 Jun 15:44:44.359 # Accessing address: 0xffffffffffffffff
31088:M 21 Jun 15:44:44.359 # Failed assertion: <no assertion failed> (<no file>:0)
------ STACK TRACE ------
EIP:
src/redis-server 127.0.0.1:21369(_serverPanic+0x117)[0x466d87]
Backtrace:
src/redis-server 127.0.0.1:21369(logStackTrace+0x29)[0x4687a9]
src/redis-server 127.0.0.1:21369(sigsegvHandler+0xac)[0x468e4c]
/lib64/libpthread.so.0(+0xf6d0)[0x7fd4cc2e76d0]
src/redis-server 127.0.0.1:21369(_serverPanic+0x117)[0x466d87]
src/redis-server 127.0.0.1:21369(redisOutOfMemoryHandler+0x2e)[0x429e8e]
src/redis-server 127.0.0.1:21369(zmalloc+0x49)[0x432a19]
src/redis-server 127.0.0.1:21369(createReplicationBacklog+0x1a)[0x4425ca]
src/redis-server 127.0.0.1:21369(syncCommand+0x248)[0x445fa8]
src/redis-server 127.0.0.1:21369(call+0x9e)[0x42c02e]
src/redis-server 127.0.0.1:21369(processCommand+0x367)[0x42c6d7]
src/redis-server 127.0.0.1:21369(processInputBuffer+0x105)[0x43b735]
src/redis-server 127.0.0.1:21369(aeProcessEvents+0x2a0)[0x426770]
src/redis-server 127.0.0.1:21369(aeMain+0x2b)[0x426a3b]
src/redis-server 127.0.0.1:21369(main+0x49f)[0x42383f]
/lib64/libc.so.6(__libc_start_main+0xf5)[0x7fd4cbf2d445]
src/redis-server 127.0.0.1:21369[0x423b32]
------ INFO OUTPUT ------
# Server
redis_version:4.0.10
redis_git_sha1:00000000
redis_git_dirty:0
redis_build_id:eaaef38c9773dcb8
redis_mode:standalone
os:Linux 3.10.0-862.3.3.el7.x86_64 x86_64
arch_bits:64
multiplexing_api:epoll
atomicvar_api:atomic-builtin
gcc_version:4.8.5
process_id:31088
run_id:912ffb26820392e5df509223fca01eed6fdf5ba8
tcp_port:21369
uptime_in_seconds:4
uptime_in_days:0
hz:10
lru_clock:2840428
executable:/mega/infra/redis/redis-4.0.10/src/redis-server
config_file:/mega/infra/redis/redis-4.0.10/./tests/tmp/redis.conf.29275.16
# Clients
connected_clients:3
client_longest_output_list:0
client_biggest_input_buf:0
blocked_clients:0
# Memory
used_memory:1010720
used_memory_human:987.03K
used_memory_rss:2588672
used_memory_rss_human:2.47M
used_memory_peak:1010720
used_memory_peak_human:987.03K
used_memory_peak_perc:106.76%
used_memory_overhead:956540
used_memory_startup:786664
used_memory_dataset:54180
used_memory_dataset_perc:24.18%
total_system_memory:511336448
total_system_memory_human:487.65M
used_memory_lua:37888
used_memory_lua_human:37.00K
maxmemory:0
maxmemory_human:0B
maxmemory_policy:noeviction
mem_fragmentation_ratio:2.56
mem_allocator:jemalloc-4.0.3
active_defrag_running:0
lazyfree_pending_objects:0
# Persistence
loading:0
rdb_changes_since_last_save:192
rdb_bgsave_in_progress:0
rdb_last_save_time:1529567080
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:-1
rdb_current_bgsave_time_sec:-1
rdb_last_cow_size:0
aof_enabled:0
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:-1
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:ok
aof_last_write_status:ok
aof_last_cow_size:0
# Stats
total_connections_received:5
total_commands_processed:628
instantaneous_ops_per_sec:361
total_net_input_bytes:43968
total_net_output_bytes:5639
instantaneous_input_kbps:25.00
instantaneous_output_kbps:3.22
rejected_connections:0
sync_full:1
sync_partial_ok:0
sync_partial_err:1
expired_keys:0
expired_stale_perc:0.00
expired_time_cap_reached_count:0
evicted_keys:0
keyspace_hits:171
keyspace_misses:156
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:0
migrate_cached_sockets:0
slave_expires_tracked_keys:0
active_defrag_hits:0
active_defrag_misses:0
active_defrag_key_hits:0
active_defrag_key_misses:0
# Replication
role:master
connected_slaves:1
slave0:ip=127.0.0.1,port=21370,state=wait_bgsave,offset=0,lag=0
master_replid:d686af9c54d3cb0949fc2ba864909f2643a25189
master_replid2:0000000000000000000000000000000000000000
master_repl_offset:0
second_repl_offset:-1
repl_backlog_active:0
repl_backlog_size:100000000
repl_backlog_first_byte_offset:0
repl_backlog_histlen:0
# CPU
used_cpu_sys:0.02
used_cpu_user:0.01
used_cpu_sys_children:0.00
used_cpu_user_children:0.00
# Commandstats
cmdstat_hdel:calls=11,usec=49,usec_per_call=4.45
cmdstat_randomkey:calls=55,usec=115,usec_per_call=2.09
cmdstat_sinterstore:calls=3,usec=48,usec_per_call=16.00
cmdstat_sadd:calls=25,usec=98,usec_per_call=3.92
cmdstat_replconf:calls=2,usec=1,usec_per_call=0.50
cmdstat_sunionstore:calls=3,usec=20,usec_per_call=6.67
cmdstat_config:calls=4,usec=22,usec_per_call=5.50
cmdstat_zunionstore:calls=5,usec=119,usec_per_call=23.80
cmdstat_zrem:calls=9,usec=58,usec_per_call=6.44
cmdstat_ping:calls=2,usec=1,usec_per_call=0.50
cmdstat_zadd:calls=44,usec=429,usec_per_call=9.75
cmdstat_rpush:calls=3,usec=10,usec_per_call=3.33
cmdstat_lrem:calls=6,usec=34,usec_per_call=5.67
cmdstat_zinterstore:calls=4,usec=33,usec_per_call=8.25
cmdstat_sdiffstore:calls=1,usec=6,usec_per_call=6.00
cmdstat_set:calls=16,usec=68,usec_per_call=4.25
cmdstat_hset:calls=27,usec=135,usec_per_call=5.00
cmdstat_srem:calls=4,usec=21,usec_per_call=5.25
cmdstat_del:calls=19,usec=18,usec_per_call=0.95
cmdstat_lpush:calls=42,usec=234,usec_per_call=5.57
cmdstat_lpop:calls=7,usec=41,usec_per_call=5.86
cmdstat_select:calls=3,usec=5,usec_per_call=1.67
cmdstat_rpop:calls=6,usec=34,usec_per_call=5.67
cmdstat_type:calls=327,usec=379,usec_per_call=1.16
# Cluster
cluster_enabled:0
# Keyspace
db9:keys=63,expires=0,avg_ttl=0
db11:keys=21,expires=0,avg_ttl=0
------ CLIENT LIST OUTPUT ------
id=4 addr=127.0.0.1:43966 fd=7 name= age=3 idle=1 flags=N db=9 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=config
id=5 addr=127.0.0.1:44018 fd=8 name= age=1 idle=0 flags=N db=9 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=type
id=6 addr=127.0.0.1:44022 fd=9 name= age=0 idle=0 flags=N db=11 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=type
id=7 addr=127.0.0.1:36694 fd=10 name= age=0 idle=0 flags=S db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=psync
------ CURRENT CLIENT INFO ------
id=7 addr=127.0.0.1:36694 fd=10 name= age=0 idle=0 flags=S db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=psync
argv[0]: 'PSYNC'
argv[1]: 'cc76458055bef36677f393556c21d31bc8de1d8b'
argv[2]: '1'
------ REGISTERS ------
31088:M 21 Jun 15:44:44.360 #
RAX:0000000000000000 RBX:00000000004f28d5
RCX:ffffffffffffffff RDX:0000000000000000
RDI:0000000000000000 RSI:00007fd4cc2d3a00
RBP:0000000000000e05 RSP:00007ffd28727d20
R8 :00007fd4ccc0f780 R9 :00007fd4cbf5816d
R10:2d2d2d2d2d2d2d2d R11:0000000000000000
R12:0000000000000000 R13:00007fd4c5435140
R14:0000000000000000 R15:000000000000000f
RIP:0000000000466d87 EFL:0000000000010202
CSGSFS:ffff000000000033
31088:M 21 Jun 15:44:44.360 # (00007ffd28727d2f) -> 00007fd4cbc00188
31088:M 21 Jun 15:44:44.360 # (00007ffd28727d2e) -> 0000000006000000
31088:M 21 Jun 15:44:44.360 # (00007ffd28727d2d) -> 00007ffd28727df0
31088:M 21 Jun 15:44:44.360 # (00007ffd28727d2c) -> 00007ffd28727e80
31088:M 21 Jun 15:44:44.360 # (00007ffd28727d2b) -> 0000000000200000
31088:M 21 Jun 15:44:44.360 # (00007ffd28727d2a) -> 0000000006000000
31088:M 21 Jun 15:44:44.360 # (00007ffd28727d29) -> 00000000004d386e
31088:M 21 Jun 15:44:44.360 # (00007ffd28727d28) -> 00007fd4cbc00100
31088:M 21 Jun 15:44:44.360 # (00007ffd28727d27) -> 59524f4d454d2046
31088:M 21 Jun 15:44:44.360 # (00007ffd28727d26) -> 4f2054554f20726f
31088:M 21 Jun 15:44:44.360 # (00007ffd28727d25) -> 6620676e6974726f
31088:M 21 Jun 15:44:44.360 # (00007ffd28727d24) -> 6261207369646552
31088:M 21 Jun 15:44:44.360 # (00007ffd28727d23) -> 00007ffd28727e40
31088:M 21 Jun 15:44:44.360 # (00007ffd28727d22) -> 00007ffd28727f10
31088:M 21 Jun 15:44:44.360 # (00007ffd28727d21) -> 0000003000000018
31088:M 21 Jun 15:44:44.360 # (00007ffd28727d20) -> 0000000006000000
------ FAST MEMORY TEST ------
31088:M 21 Jun 15:44:44.360 # Bio thread for job type #0 terminated
31088:M 21 Jun 15:44:44.360 # Bio thread for job type #1 terminated
31088:M 21 Jun 15:44:44.360 # Bio thread for job type #2 terminated
*** Preparing to test memory region 744000 (98304 bytes)
*** Preparing to test memory region 1546000 (135168 bytes)
*** Preparing to test memory region 7fd4c3bfe000 (8388608 bytes)
*** Preparing to test memory region 7fd4c43ff000 (8388608 bytes)
*** Preparing to test memory region 7fd4c4c00000 (10485760 bytes)
*** Preparing to test memory region 7fd4cbc00000 (2097152 bytes)
*** Preparing to test memory region 7fd4cc2d3000 (20480 bytes)
*** Preparing to test memory region 7fd4cc4f0000 (16384 bytes)
*** Preparing to test memory region 7fd4ccc0f000 (16384 bytes)
*** Preparing to test memory region 7fd4ccc18000 (12288 bytes)
*** Preparing to test memory region 7fd4ccc1d000 (4096 bytes)
.O.O.O.O.O.O.O.O.O.O.O
Fast memory test PASSED, however your memory can still be broken. Please run a memory test for several hours if possible.
------ DUMPING CODE AROUND EIP ------
Symbol: _serverPanic (base: 0x466c70)
Module: src/redis-server 127.0.0.1:21369 (base 0x400000)
$ xxd -r -p /tmp/dump.hex /tmp/dump.bin
$ objdump --adjust-vma=0x466c70 -D -b binary -m i386:x86-64 /tmp/dump.bin
------
31088:M 21 Jun 15:44:46.403 # dump of function (hexdump of 407 bytes):
5589f5534889fb4881ecd801000084c048898c24380100004c898424400100004c898c244801000074400f298424500100000f298c24600100000f299424700100000f299c24800100000f29a424900100000f29ac24a00100000f29b424b00100000f29bc24c0010000488d8424f0010000488d4c2408488d7c2420be000100004889442410488d842420010000c744240818000000c744240c300000004889442418e8f8abfbff8b05d6f72d0085c07505e8f9f8ffffbec0015000bf0300000031c0e84830fcffbef8015000bf0300000031c0e83730fcff488d5424204189e84889d9bed0115000bf0300000031c0e81b30fcffbe38025000bf0300000031c0e80a30fcffbec0015000bf0300000031c0e8f92ffcffc60425ffffffff784881c4d80100005b5dc30f1f8000000000415741564155415455534881ec4801000048c7070000000048c7470800000000c74710000000008b054bf22d0048897c241885c00f8ee108000048c744242800000000c7442424000000004c8db42494000000eb1e0f1f0083442424014883442428388b442424
Function at 0x429d80 is serverLog
=== REDIS BUG REPORT END. Make sure to include from START to END. ===
Comment From: yoav-steinberg
@wardenlym Does this still happen? Can you check which test causes the failure: run ./runtest and provide the output.
Can you recheck with an updated version?