i'm installing redis in ec2 i got this , please have look into this.
[ok]: maxmemory - policy volatile-random should only remove volatile keys. I/O error reading reply while executing "{}$r del $k" ("uplevel" body line 2) invoked from within "uplevel 1 [lindex $args $path]" (procedure "randpath" line 3) invoked from within "randpath { {}$r set $k $v } { {}$r lpush $k $v } { {}$r sadd $k $v ..." (procedure "createComplexDataset" line 30) invoked from within "createComplexDataset $r $ops" (procedure "bg_complex_data" line 4) invoked from within "bg_complex_data [lindex $argv 0] [lindex $argv 1] [lindex $argv 2] [lindex $argv 3]" (file "tests/helpers/bg_complex_data.tcl" line 10)I/O error reading reply while executing "{}$r srem $k $v" ("uplevel" body line 1) invoked from within "uplevel 1 [lindex $args $path]" (procedure "randpath" line 3) invoked from within "randpath {{}$r sadd $k $v} {{}$r srem $k $v} { set otherset [findKeyWithType {}$r set] if..." (procedure "createComplexDataset" line 54) invoked from within "createComplexDataset $r $ops" (procedure "bg_complex_data" line 4) invoked from within "bg_complex_data [lindex $argv 0] [lindex $argv 1] [lindex $argv 2] [lindex $argv 3]" (file "tests/helpers/bg_complex_data.tcl" line 10)I/O error reading reply while executing "{}$r lpop $k" ("uplevel" body line 1) invoked from within "uplevel 1 [lindex $args $path]" (procedure "randpath" line 3) invoked from within "randpath {{}$r lpush $k $v} {{}$r rpush $k $v} {{}$r lrem $k 0 $v} {{}$r rpop $k} {{}$r lpop $k}" (procedure "createComplexDataset" line 51) invoked from within "createComplexDataset $r $ops" (procedure "bg_complex_data" line 4) invoked from within "bg_complex_data [lindex $argv 0] [lindex $argv 1] [lindex $argv 2] [lindex $argv 3]" (file "tests/helpers/bg_complex_data.tcl" line 10)
[ok]: maxmemory - policy volatile-ttl should only remove volatile keys.
[err]: Slave should be able to synchronize with the master in tests/integration/replication-psync.tcl Replication not started.
Logged warnings (pid 17152): (none)
Logged warnings (pid 17143):
=== REDIS BUG REPORT START: Cut & paste starting from here ===
17143:M 26 Jul 12:42:35.930 # ------------------------------------------------
17143:M 26 Jul 12:42:35.930 # !!! Software Failure. Press left mouse button to continue
17143:M 26 Jul 12:42:35.930 # Guru Meditation: Redis aborting for OUT OF MEMORY #server.c:3589
17143:M 26 Jul 12:42:35.930 # (forcing SIGSEGV in order to print the stack trace)
17143:M 26 Jul 12:42:35.930 # ------------------------------------------------
17143:M 26 Jul 12:42:35.930 # Redis 4.0.10 crashed by signal: 11
17143:M 26 Jul 12:42:35.930 # Crashed running the instruction at: 0x46a117
17143:M 26 Jul 12:42:35.930 # Accessing address: 0xffffffffffffffff
17143:M 26 Jul 12:42:35.930 # Failed assertion:
------ STACK TRACE ------ EIP: src/redis-server 127.0.0.1:21379(_serverPanic+0x137)[0x46a117]
Backtrace: src/redis-server 127.0.0.1:21379(logStackTrace+0x45)[0x46bd05] src/redis-server 127.0.0.1:21379(sigsegvHandler+0xb9)[0x46c4c9] /lib/x86_64-linux-gnu/libpthread.so.0(+0x11390)[0x7f65f2623390] src/redis-server 127.0.0.1:21379(_serverPanic+0x137)[0x46a117] src/redis-server 127.0.0.1:21379(redisOutOfMemoryHandler+0x2e)[0x429afe] src/redis-server 127.0.0.1:21379(zmalloc+0x49)[0x432df9] src/redis-server 127.0.0.1:21379(createReplicationBacklog+0x1a)[0x443c3a] src/redis-server 127.0.0.1:21379(syncCommand+0x278)[0x4478b8] src/redis-server 127.0.0.1:21379(call+0xa6)[0x42be96] src/redis-server 127.0.0.1:21379(processCommand+0x3a7)[0x42c597] src/redis-server 127.0.0.1:21379(processInputBuffer+0x105)[0x43c2a5] src/redis-server 127.0.0.1:21379(aeProcessEvents+0x36d)[0x425e1d] src/redis-server 127.0.0.1:21379(aeMain+0x2b)[0x42604b] src/redis-server 127.0.0.1:21379(main+0x4a6)[0x422b66] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0)[0x7f65f2268830] src/redis-server 127.0.0.1:21379(_start+0x29)[0x422e69]
------ INFO OUTPUT ------
Server
redis_version:4.0.10 redis_git_sha1:00000000 redis_git_dirty:0 redis_build_id:192039833e041ed8 redis_mode:standalone os:Linux 4.4.0-1062-aws x86_64 arch_bits:64 multiplexing_api:epoll atomicvar_api:atomic-builtin gcc_version:5.4.0 process_id:17143 run_id:a8715766bce69e5ecaae6fb169bd3cb1caa8a6b1 tcp_port:21379 uptime_in_seconds:1 uptime_in_days:0 hz:10 lru_clock:5882299 executable:/tmp/redis-stable/src/redis-server config_file:/tmp/redis-stable/./tests/tmp/redis.conf.15232.36
Clients
connected_clients:4 client_longest_output_list:0 client_biggest_input_buf:0 blocked_clients:0
Memory
used_memory:1076320 used_memory_human:1.03M used_memory_rss:4538368 used_memory_rss_human:4.33M used_memory_peak:1076320 used_memory_peak_human:1.03M used_memory_peak_perc:102.11% used_memory_overhead:981766 used_memory_startup:786648 used_memory_dataset:94554 used_memory_dataset_perc:32.64% total_system_memory:510394368 total_system_memory_human:486.75M used_memory_lua:37888 used_memory_lua_human:37.00K maxmemory:0 maxmemory_human:0B maxmemory_policy:noeviction mem_fragmentation_ratio:4.22 mem_allocator:jemalloc-4.0.3 active_defrag_running:0 lazyfree_pending_objects:0
Persistence
loading:0 rdb_changes_since_last_save:591 rdb_bgsave_in_progress:0 rdb_last_save_time:1532608954 rdb_last_bgsave_status:ok rdb_last_bgsave_time_sec:-1 rdb_current_bgsave_time_sec:-1 rdb_last_cow_size:0 aof_enabled:0 aof_rewrite_in_progress:0 aof_rewrite_scheduled:0 aof_last_rewrite_time_sec:-1 aof_current_rewrite_time_sec:-1 aof_last_bgrewrite_status:ok aof_last_write_status:ok aof_last_cow_size:0
Stats
total_connections_received:6 total_commands_processed:1889 instantaneous_ops_per_sec:1161 total_net_input_bytes:147298 total_net_output_bytes:19046 instantaneous_input_kbps:88.83 instantaneous_output_kbps:11.51 rejected_connections:0 sync_full:1 sync_partial_ok:0 sync_partial_err:1 expired_keys:0 expired_stale_perc:0.00 expired_time_cap_reached_count:0 evicted_keys:0 keyspace_hits:509 keyspace_misses:499 pubsub_channels:0 pubsub_patterns:0 latest_fork_usec:0 migrate_cached_sockets:0 slave_expires_tracked_keys:0 active_defrag_hits:0 active_defrag_misses:0 active_defrag_key_hits:0 active_defrag_key_misses:0
Replication
role:master connected_slaves:1 slave0:ip=127.0.0.1,port=21380,state=wait_bgsave,offset=0,lag=0 master_replid:4f9a5180e60373dbde6ebb6ab10506b1c4602256 master_replid2:0000000000000000000000000000000000000000 master_repl_offset:0 second_repl_offset:-1 repl_backlog_active:0 repl_backlog_size:100000000 repl_backlog_first_byte_offset:0 repl_backlog_histlen:0
CPU
used_cpu_sys:0.02 used_cpu_user:0.03 used_cpu_sys_children:0.00 used_cpu_user_children:0.00
Commandstats
cmdstat_sinterstore:calls=3,usec=14,usec_per_call=4.67 cmdstat_srem:calls=28,usec=126,usec_per_call=4.50 cmdstat_sadd:calls=89,usec=296,usec_per_call=3.33 cmdstat_sdiffstore:calls=6,usec=27,usec_per_call=4.50 cmdstat_rpop:calls=18,usec=92,usec_per_call=5.11 cmdstat_type:calls=1008,usec=1287,usec_per_call=1.28 cmdstat_zadd:calls=92,usec=671,usec_per_call=7.29 cmdstat_ping:calls=2,usec=1,usec_per_call=0.50 cmdstat_hdel:calls=42,usec=192,usec_per_call=4.57 cmdstat_replconf:calls=2,usec=2,usec_per_call=1.00 cmdstat_config:calls=4,usec=16,usec_per_call=4.00 cmdstat_hset:calls=114,usec=489,usec_per_call=4.29 cmdstat_lrem:calls=16,usec=85,usec_per_call=5.31 cmdstat_zinterstore:calls=11,usec=87,usec_per_call=7.91 cmdstat_lpop:calls=14,usec=74,usec_per_call=5.29 cmdstat_zrem:calls=25,usec=121,usec_per_call=4.84 cmdstat_randomkey:calls=154,usec=268,usec_per_call=1.74 cmdstat_set:calls=62,usec=237,usec_per_call=3.82 cmdstat_sunionstore:calls=5,usec=31,usec_per_call=6.20 cmdstat_lpush:calls=90,usec=388,usec_per_call=4.31 cmdstat_del:calls=72,usec=85,usec_per_call=1.18 cmdstat_rpush:calls=16,usec=57,usec_per_call=3.56 cmdstat_select:calls=4,usec=4,usec_per_call=1.00 cmdstat_zunionstore:calls=12,usec=149,usec_per_call=12.42
Cluster
cluster_enabled:0
Keyspace
db9:keys=85,expires=0,avg_ttl=0 db11:keys=68,expires=0,avg_ttl=0 db12:keys=83,expires=0,avg_ttl=0
------ CLIENT LIST OUTPUT ------ id=4 addr=127.0.0.1:46029 fd=7 name= age=1 idle=0 flags=N db=9 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=config id=5 addr=127.0.0.1:40796 fd=8 name= age=0 idle=0 flags=N db=9 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=type id=6 addr=127.0.0.1:40071 fd=9 name= age=0 idle=0 flags=N db=11 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=type id=7 addr=127.0.0.1:46434 fd=10 name= age=0 idle=0 flags=N db=12 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=type id=8 addr=127.0.0.1:33176 fd=11 name= age=0 idle=0 flags=S db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=psync
------ CURRENT CLIENT INFO ------ id=8 addr=127.0.0.1:33176 fd=11 name= age=0 idle=0 flags=S db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=psync argv[0]: 'PSYNC' argv[1]: 'ff0740cefa778b90a2254c03d672e583fed59297' argv[2]: '1'
------ REGISTERS ------ 17143:M 26 Jul 12:42:35.931 # RAX:0000000000000000 RBX:00000000005086a1 RCX:00007f65f233f2dd RDX:0000000000000000 RDI:0000000000000000 RSI:00007f65f260e780 RBP:0000000000000e05 RSP:00007ffdda97a450 R8 :00007f65f260e780 R9 :00007f65f2f53780 R10:0000000000000030 R11:0000000000000000 R12:0000000000000000 R13:0000000000000000 R14:000571e65465d58c R15:000000000000000f RIP:000000000046a117 EFL:0000000000010202 CSGSFS:0000000000000033 17143:M 26 Jul 12:42:35.931 # (00007ffdda97a45f) -> 00007f65f2000180 17143:M 26 Jul 12:42:35.931 # (00007ffdda97a45e) -> 00007f65f2000188 17143:M 26 Jul 12:42:35.931 # (00007ffdda97a45d) -> 00007ffdda97a530 17143:M 26 Jul 12:42:35.931 # (00007ffdda97a45c) -> 00007ffdda97a5c7 17143:M 26 Jul 12:42:35.931 # (00007ffdda97a45b) -> 4b99c0577a6b6100 17143:M 26 Jul 12:42:35.931 # (00007ffdda97a45a) -> 0000000006000000 17143:M 26 Jul 12:42:35.931 # (00007ffdda97a459) -> 00000000004de5ef 17143:M 26 Jul 12:42:35.931 # (00007ffdda97a458) -> 00007f65f2000100 17143:M 26 Jul 12:42:35.931 # (00007ffdda97a457) -> 59524f4d454d2046 17143:M 26 Jul 12:42:35.931 # (00007ffdda97a456) -> 4f2054554f20726f 17143:M 26 Jul 12:42:35.931 # (00007ffdda97a455) -> 6620676e6974726f 17143:M 26 Jul 12:42:35.931 # (00007ffdda97a454) -> 6261207369646552 17143:M 26 Jul 12:42:35.931 # (00007ffdda97a453) -> 00007ffdda97a580 17143:M 26 Jul 12:42:35.931 # (00007ffdda97a452) -> 00007ffdda97a650 17143:M 26 Jul 12:42:35.931 # (00007ffdda97a451) -> 0000003000000018 17143:M 26 Jul 12:42:35.931 # (00007ffdda97a450) -> 0000000006000000
------ FAST MEMORY TEST ------ 17143:M 26 Jul 12:42:35.932 # Bio thread for job type #0 terminated 17143:M 26 Jul 12:42:35.932 # Bio thread for job type #1 terminated 17143:M 26 Jul 12:42:35.932 # Bio thread for job type #2 terminated *** Preparing to test memory region 75a000 (98304 bytes) *** Preparing to test memory region b98000 (135168 bytes) *** Preparing to test memory region 7f65f05fe000 (8388608 bytes) *** Preparing to test memory region 7f65f0dff000 (8388608 bytes) *** Preparing to test memory region 7f65f1600000 (12582912 bytes) *** Preparing to test memory region 7f65f260e000 (16384 bytes) *** Preparing to test memory region 7f65f282b000 (16384 bytes) *** Preparing to test memory region 7f65f2f53000 (20480 bytes) *** Preparing to test memory region 7f65f2f63000 (4096 bytes) .O.O.O.O.O.O.O.O.O Fast memory test PASSED, however your memory can still be broken. Please run a memory test for several hours if possible.
------ DUMPING CODE AROUND EIP ------ Symbol: _serverPanic (base: 0x469fe0) Module: src/redis-server 127.0.0.1:21379 (base 0x400000) $ xxd -r -p /tmp/dump.hex /tmp/dump.bin $ objdump --adjust-vma=0x469fe0 -D -b binary -m i386:x86-64 /tmp/dump.bin
17143:M 26 Jul 12:42:37.551 # dump of function (hexdump of 439 bytes): 555389f54889fb4881ece801000084c048898c24480100004c898424500100004c898c245801000074400f298424600100000f298c24700100000f299424800100000f299c24900100000f29a424a00100000f29ac24b00100000f29b424c00100000f29bc24d001000064488b042528000000488984242801000031c0488d8424000200004c8d4c2408488d7c24204989d0b900010000ba010000004889442410488d842430010000be00010000c744240818000000c744240c300000004889442418e89880fbff8b0566232f0085c07505e809f8ffff31c0bea05b5100bf03000000e8f8f8fbff31c0bed85b5100bf03000000e8e7f8fbff488d5424204189e84889d931c0be926d5100bf03000000e8cbf8fbff31c0be185c5100bf03000000e8baf8fbff31c0bea05b5100bf03000000e8a9f8fbffc60425ffffffff78488b842428010000644833042528000000750a4881c4e80100005b5dc3e8ff79fbff0f1f440000662e0f1f840000000000415741564155415455534881ec9801000048c7070000000048c7470800000000c74710000000008b05bb1d2f0064488b0c252800000048898c248801000031c948897c241085c0 Function at 0x4299c0 is serverLog
=== REDIS BUG REPORT END. Make sure to include from START to END. ===
Please report the crash by opening an issue on github:
http://github.com/antirez/redis/issues
Suspect RAM error? Use redis-server --test-memory to verify it.
[exception]: Executing test client: I/O error reading reply. I/O error reading reply while executing "wait_for_condition 50 1000 { [$master dbsize] > 100 } else { fail "Can't detect write load fro..." ("uplevel" body line 2) invoked from within "uplevel 1 $code" (procedure "test" line 29) invoked from within "test {Detect write load to master} { wait_for_condition 50 1000 { [$master dbsize] > 100 } else { ..." ("uplevel" body line 28) invoked from within "uplevel 1 $code " (procedure "start_server" line 3) invoked from within "start_server {} {
set master [srv -1 client]
set master_host [srv -1 host]
set master_port [srv -1 port]
..."
("uplevel" body line 2)
invoked from within
"uplevel 1 $code " (procedure "start_server" line 3) invoked from within "start_server {tags {"repl"}} { start_server {} {
set master [srv -1 client]
set master_host [srv -1 host]
..."
(procedure "test_psync" line 2)
invoked from within
"test_psync {ok after delay} 3 100000000 3600 3 { assert {[s -1 sync_partial_ok] > 0} } $diskless 1" ("foreach" body line 13) invoked from within "foreach diskless {no yes} { test_psync {no reconnection, just sync} 6 1000000 3600 0 { } $diskless 0
test_psync {ok psync} 6 100000000 36..."
(file "tests/integration/replication-psync.tcl" line 109)
invoked from within
"source $path" (procedure "execute_tests" line 4) invoked from within "execute_tests $data" (procedure "test_client_main" line 10) invoked from within "test_client_main $::test_server_port " Killing still running Redis server 15255 Killing still running Redis server 15257 Killing still running Redis server 15859 Killing still running Redis server 15879 Killing still running Redis server 15922 Killing still running Redis server 15931 Killing still running Redis server 15941 Killing still running Redis server 16104 Killing still running Redis server 16113 Killing still running Redis server 16362 Killing still running Redis server 16372 Killing still running Redis server 16598 Killing still running Redis server 16666 Killing still running Redis server 16730 Killing still running Redis server 16773 Killing still running Redis server 16812 Killing still running Redis server 16828 Killing still running Redis server 16837 Killing still running Redis server 16847 Killing still running Redis server 17143 Makefile:242: recipe for target 'test' failed make[1]: *** [test] Error 1 make[1]: Leaving directory '/tmp/redis-stable/src' Makefile:6: recipe for target 'test' failed make: *** [test] Error 2
Comment From: yoav-steinberg
This looks like some allocator error. Since this is old I'm inclined to close it. Does this reproduce? marking to be closed.