Hey there, two of our Redis 5.0.0 cluster nodes crashed. Opening a bug report with the crash logs as instructed in redis-server.log.
Crash log 1:
=== REDIS BUG REPORT START: Cut & paste starting from here ===
28174:S 13 Dec 2018 10:17:20.948 # Redis 5.0.0 crashed by signal: 11
28174:S 13 Dec 2018 10:17:20.948 # Crashed running the instruction at: 0x51914a
28174:S 13 Dec 2018 10:17:20.948 # Accessing address: 0x30
28174:S 13 Dec 2018 10:17:20.948 # Failed assertion: <no assertion failed> (<no file>:0)
------ STACK TRACE ------
EIP:
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster](je_extent_heap_remove+0x8ea)[0x51914a]
Backtrace:
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster](logStackTrace+0x45)[0x473435]
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster](sigsegvHandler+0xb9)[0x473bf9]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x11390)[0x7efe1bd67390]
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster](je_extent_heap_remove+0x8ea)[0x51914a]
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster][0x5192ff]
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster][0x5197c7]
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster][0x519c03]
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster][0x4e1af7]
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster][0x4e1f03]
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster][0x4e239f]
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster](je_tcache_bin_flush_small+0x5c7)[0x543117]
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster](je_tcache_event_hard+0x4f)[0x543faf]
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster](raxRecursiveFree+0x7f)[0x4a954f]
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster](raxRecursiveFree+0x62)[0x4a9532]
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster](raxRecursiveFree+0x62)[0x4a9532]
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster](raxRecursiveFree+0x62)[0x4a9532]
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster](raxRecursiveFree+0x62)[0x4a9532]
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster](raxRecursiveFree+0x62)[0x4a9532]
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster](raxRecursiveFree+0x62)[0x4a9532]
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster](raxRecursiveFree+0x62)[0x4a9532]
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster](raxRecursiveFree+0x62)[0x4a9532]
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster](raxRecursiveFree+0x62)[0x4a9532]
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster](raxRecursiveFree+0x62)[0x4a9532]
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster](raxRecursiveFree+0x62)[0x4a9532]
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster](raxFreeWithCallback+0xf)[0x4a959f]
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster](slotToKeyFlush+0x14)[0x448064]
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster](emptyDb+0xf5)[0x448195]
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster](readSyncBulkPayload+0x260)[0x44a220]
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster](aeProcessEvents+0x36d)[0x4297fd]
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster](aeMain+0x2b)[0x429a2b]
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster](main+0x4ae)[0x4265de]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0)[0x7efe1b9ac830]
/usr/local/bin/redis-server 10.240.103.179:6379 [cluster](_start+0x29)[0x426849]
------ INFO OUTPUT ------
# Server
redis_version:5.0.0
redis_git_sha1:00000000
redis_git_dirty:0
redis_build_id:f78e4aabca64f722
redis_mode:cluster
os:Linux 4.8.0-54-generic x86_64
arch_bits:64
multiplexing_api:epoll
atomicvar_api:atomic-builtin
gcc_version:5.4.0
process_id:28174
run_id:5a0bd5a94df5a57b3901db70976a805522fe2f01
tcp_port:6379
uptime_in_seconds:677055
uptime_in_days:7
hz:10
configured_hz:10
lru_clock:1166899
executable:/usr/local/bin/redis-server
config_file:/etc/redis/redis.conf
# Clients
connected_clients:62
client_recent_max_input_buffer:4
client_recent_max_output_buffer:0
blocked_clients:0
# Memory
used_memory:85147280
used_memory_human:81.20M
used_memory_rss:53308485632
used_memory_rss_human:49.65G
used_memory_peak:54095872672
used_memory_peak_human:50.38G
used_memory_peak_perc:0.16%
used_memory_overhead:2505950
used_memory_startup:1457280
used_memory_dataset:82641330
used_memory_dataset_perc:98.75%
allocator_allocated:52084885800
allocator_active:52085481472
allocator_resident:52933935104
total_system_memory:109837619200
total_system_memory_human:102.29G
used_memory_lua:37888
used_memory_lua_human:37.00K
used_memory_scripts:0
used_memory_scripts_human:0B
number_of_cached_scripts:0
maxmemory:93361012736
maxmemory_human:86.95G
maxmemory_policy:volatile-lru
allocator_frag_ratio:1.00
allocator_frag_bytes:595672
allocator_rss_ratio:1.02
allocator_rss_bytes:848453632
rss_overhead_ratio:1.01
rss_overhead_bytes:374550528
mem_fragmentation_ratio:1.02
mem_fragmentation_bytes:1223763328
mem_not_counted_for_evict:0
mem_replication_backlog:0
mem_clients_slaves:0
mem_clients_normal:1048670
mem_aof_buffer:0
mem_allocator:jemalloc-5.1.0
active_defrag_running:0
lazyfree_pending_objects:0
# Persistence
loading:0
rdb_changes_since_last_save:6256769
rdb_bgsave_in_progress:0
rdb_last_save_time:1544068132
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:770
rdb_current_bgsave_time_sec:-1
rdb_last_cow_size:8325595136
aof_enabled:0
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:745
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:ok
aof_last_write_status:ok
aof_last_cow_size:64348160
# Stats
total_connections_received:135692
total_commands_processed:55439367
instantaneous_ops_per_sec:0
total_net_input_bytes:278779482657
total_net_output_bytes:72894560082
instantaneous_input_kbps:147405.91
instantaneous_output_kbps:2.20
rejected_connections:0
sync_full:2
sync_partial_ok:0
sync_partial_err:1
expired_keys:3664044
expired_stale_perc:3.65
expired_time_cap_reached_count:0
evicted_keys:0
keyspace_hits:59557209
keyspace_misses:32280995
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:1194078
migrate_cached_sockets:0
slave_expires_tracked_keys:0
active_defrag_hits:0
active_defrag_misses:0
active_defrag_key_hits:0
active_defrag_key_misses:0
# Replication
role:slave
master_host:10.240.103.173
master_port:6379
master_link_status:down
master_last_io_seconds_ago:-1
master_sync_in_progress:1
slave_repl_offset:1
master_sync_left_bytes:0
master_sync_last_io_seconds_ago:0
master_link_down_since_seconds:1093
slave_priority:100
slave_read_only:1
connected_slaves:0
master_replid:4fe24cbad30a1810eda646a96f0af2b791324ae6
master_replid2:0000000000000000000000000000000000000000
master_repl_offset:10704210334
second_repl_offset:-1
repl_backlog_active:0
repl_backlog_size:1048576
repl_backlog_first_byte_offset:10704210335
repl_backlog_histlen:0
# CPU
used_cpu_sys:5083.084000
used_cpu_user:22120.248000
used_cpu_sys_children:673.008000
used_cpu_user_children:4180.540000
# Commandstats
cmdstat_restore-asking:calls=23146397,usec=460779961,usec_per_call=19.91
cmdstat_config:calls=4,usec=24881,usec_per_call=6220.25
cmdstat_set:calls=6250958,usec=1200183558,usec_per_call=192.00
cmdstat_select:calls=1465284,usec=1965960,usec_per_call=1.34
cmdstat_cluster:calls=2109502,usec=70888298,usec_per_call=33.60
cmdstat_replconf:calls=591385,usec=1544940,usec_per_call=2.61
cmdstat_migrate:calls=3730710,usec=4253515356,usec_per_call=1140.14
cmdstat_command:calls=9,usec=489735,usec_per_call=54415.00
cmdstat_del:calls=5811,usec=411201,usec_per_call=70.76
cmdstat_psync:calls=2,usec=2132254,usec_per_call=1066127.00
cmdstat_get:calls=18071503,usec=2822994350,usec_per_call=156.21
cmdstat_dbsize:calls=5,usec=16,usec_per_call=3.20
cmdstat_ping:calls=79,usec=13,usec_per_call=0.16
cmdstat_info:calls=67718,usec=18154537,usec_per_call=268.09
# Cluster
cluster_enabled:1
# Keyspace
------ CLIENT LIST OUTPUT ------
id=134784 addr=10.240.2.142:51014 fd=17 name= age=8675 idle=8665 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=134785 addr=10.240.2.142:51012 fd=19 name= age=8675 idle=8665 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=134764 addr=10.240.2.142:49748 fd=623 name= age=8693 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=134783 addr=10.240.24.153:38780 fd=14 name= age=8675 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=134782 addr=10.240.24.187:53968 fd=13 name= age=8676 idle=8665 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=134765 addr=10.240.2.142:49746 fd=624 name= age=8693 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=134766 addr=10.240.2.142:49752 fd=625 name= age=8693 idle=8665 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=134773 addr=10.240.24.188:44758 fd=24 name= age=8686 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=134826 addr=10.240.2.144:41828 fd=87 name= age=8673 idle=8665 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=set
id=134770 addr=10.240.24.189:54398 fd=16 name= age=8690 idle=8665 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=134775 addr=10.240.24.153:37868 fd=26 name= age=8684 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=set
id=134774 addr=10.240.2.144:40460 fd=25 name= age=8685 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=134778 addr=10.240.24.153:38164 fd=33 name= age=8680 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=134780 addr=10.240.2.144:41100 fd=46 name= age=8678 idle=8665 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=set
id=134777 addr=10.240.24.188:44870 fd=27 name= age=8681 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=107795 addr=10.240.2.144:60434 fd=21 name= age=137962 idle=137962 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=NULL
id=134779 addr=10.240.2.144:41038 fd=45 name= age=8678 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=set
id=134787 addr=10.240.24.187:54152 fd=48 name= age=8673 idle=8668 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=134788 addr=10.240.24.153:39008 fd=49 name= age=8673 idle=8665 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=134789 addr=10.240.24.187:54156 fd=50 name= age=8673 idle=8668 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=134790 addr=10.240.24.153:39010 fd=51 name= age=8673 idle=8665 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=134791 addr=10.240.24.189:55028 fd=52 name= age=8673 idle=8665 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=134792 addr=10.240.24.153:39012 fd=54 name= age=8673 idle=8665 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=134793 addr=10.240.24.153:39014 fd=55 name= age=8673 idle=8671 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=134794 addr=10.240.24.153:39016 fd=56 name= age=8673 idle=8665 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=134795 addr=10.240.24.187:54158 fd=57 name= age=8673 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=134796 addr=10.240.2.144:41668 fd=58 name= age=8673 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=134797 addr=10.240.24.153:39020 fd=59 name= age=8673 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=134798 addr=10.240.24.187:54160 fd=60 name= age=8673 idle=8671 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=set
id=134799 addr=10.240.24.153:39022 fd=61 name= age=8673 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=134800 addr=10.240.24.187:54162 fd=62 name= age=8673 idle=8665 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=set
id=134801 addr=10.240.2.144:41674 fd=63 name= age=8673 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=134802 addr=10.240.24.153:39028 fd=64 name= age=8673 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=134803 addr=10.240.2.144:41676 fd=65 name= age=8673 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=134804 addr=10.240.24.188:45270 fd=66 name= age=8673 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=134805 addr=10.240.2.142:51174 fd=67 name= age=8673 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=134806 addr=10.240.2.142:51176 fd=68 name= age=8673 idle=8665 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=set
id=134807 addr=10.240.24.188:45272 fd=69 name= age=8673 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=134808 addr=10.240.24.188:45274 fd=70 name= age=8673 idle=8665 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=134809 addr=10.240.2.142:51178 fd=71 name= age=8673 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=134810 addr=10.240.24.153:39034 fd=72 name= age=8673 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=134828 addr=10.240.24.189:55234 fd=89 name= age=8671 idle=8666 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=134811 addr=10.240.2.142:51180 fd=73 name= age=8673 idle=8665 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=134812 addr=10.240.24.153:39036 fd=74 name= age=8673 idle=8671 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=set
id=134813 addr=10.240.2.144:41680 fd=75 name= age=8673 idle=8665 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=134814 addr=10.240.24.153:39038 fd=76 name= age=8673 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=134815 addr=10.240.2.142:51182 fd=77 name= age=8673 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=134816 addr=10.240.24.188:45276 fd=78 name= age=8673 idle=8665 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=134817 addr=10.240.2.144:41684 fd=79 name= age=8673 idle=8665 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=134818 addr=10.240.2.142:51184 fd=80 name= age=8673 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=134819 addr=10.240.24.153:39040 fd=81 name= age=8673 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=134825 addr=10.240.2.142:51186 fd=88 name= age=8673 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=set
id=134820 addr=10.240.24.188:45278 fd=82 name= age=8673 idle=8665 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=134821 addr=10.240.24.153:39042 fd=83 name= age=8673 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=134822 addr=10.240.2.144:41686 fd=84 name= age=8673 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=134823 addr=10.240.24.187:54164 fd=85 name= age=8673 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=134824 addr=10.240.2.144:41688 fd=86 name= age=8673 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=134781 addr=10.240.24.189:54760 fd=47 name= age=8677 idle=8666 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=134786 addr=10.240.24.188:45168 fd=20 name= age=8675 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=134755 addr=10.240.24.187:53536 fd=614 name= age=8693 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=134772 addr=10.240.2.144:40282 fd=23 name= age=8688 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=set
id=134771 addr=10.240.24.153:37634 fd=18 name= age=8689 idle=8673 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
------ REGISTERS ------
28174:S 13 Dec 2018 10:17:23.434 #
RAX:000000000000a001 RBX:00007ef7e5093ec0
RCX:000000000000000d RDX:7000000000000000
RDI:0000000000000000 RSI:00007ef7e5093ec0
RBP:000000000000b000 RSP:00007fff984747a0
R8 :000000000000a000 R9 :0000000000000008
R10:000000000000afff R11:0000000000000000
R12:0000000000000000 R13:00007ef9cffba040
R14:0000000000000015 R15:0000000000000009
RIP:000000000051914a EFL:0000000000010246
CSGSFS:002b000000000033
28174:S 13 Dec 2018 10:17:23.434 # (00007fff984747af) -> 00007fff98474ae0
28174:S 13 Dec 2018 10:17:23.434 # (00007fff984747ae) -> 00007efe1b603438
28174:S 13 Dec 2018 10:17:23.434 # (00007fff984747ad) -> 00007efe1c8a0758
28174:S 13 Dec 2018 10:17:23.434 # (00007fff984747ac) -> 00007efe1b6009c0
28174:S 13 Dec 2018 10:17:23.434 # (00007fff984747ab) -> 00000000005197c7
28174:S 13 Dec 2018 10:17:23.434 # (00007fff984747aa) -> 00007ef7e5093ec0
28174:S 13 Dec 2018 10:17:23.434 # (00007fff984747a9) -> c4ceb9fe1a85ec53
28174:S 13 Dec 2018 10:17:23.434 # (00007fff984747a8) -> 0000000000000001
28174:S 13 Dec 2018 10:17:23.434 # (00007fff984747a7) -> 00007efe1c8a0730
28174:S 13 Dec 2018 10:17:23.434 # (00007fff984747a6) -> 00007ef7e5093e40
28174:S 13 Dec 2018 10:17:23.434 # (00007fff984747a5) -> 00007efe1b6033f8
28174:S 13 Dec 2018 10:17:23.434 # (00007fff984747a4) -> 00000000005192ff
28174:S 13 Dec 2018 10:17:23.434 # (00007fff984747a3) -> 0000000000000009
28174:S 13 Dec 2018 10:17:23.434 # (00007fff984747a2) -> 00007efe1b6033f8
28174:S 13 Dec 2018 10:17:23.434 # (00007fff984747a1) -> 000000000000b000
28174:S 13 Dec 2018 10:17:23.434 # (00007fff984747a0) -> 00007ef7e5093ec0
------ FAST MEMORY TEST ------
28174:S 13 Dec 2018 10:17:23.435 # Bio thread for job type #0 terminated
28174:S 13 Dec 2018 10:17:23.436 # Bio thread for job type #1 terminated
28174:S 13 Dec 2018 10:17:23.436 # Bio thread for job type #2 terminated
*** Preparing to test memory region 7ac000 (2248704 bytes)
*** Preparing to test memory region b48000 (135168 bytes)
*** Preparing to test memory region 7eeec5600000 (65093500928 bytes)
*** Preparing to test memory region 7efded4fd000 (738197504 bytes)
*** Preparing to test memory region 7efe194fe000 (8388608 bytes)
*** Preparing to test memory region 7efe19cff000 (8388608 bytes)
*** Preparing to test memory region 7efe1a500000 (8388608 bytes)
*** Preparing to test memory region 7efe1ad00000 (11534336 bytes)
*** Preparing to test memory region 7efe1bd52000 (16384 bytes)
*** Preparing to test memory region 7efe1bf6f000 (16384 bytes)
*** Preparing to test memory region 7efe1c8a0000 (24576 bytes)
*** Preparing to test memory region 7efe1c8af000 (4096 bytes)
.O.O.O.O.O.O.O.O.O.O.O.O
Fast memory test PASSED, however your memory can still be broken. Please run a memory test for several hours if possible.
------ DUMPING CODE AROUND EIP ------
Symbol: je_extent_heap_remove (base: 0x518860)
Module: /usr/local/bin/redis-server 10.240.103.179:6379 [cluster] (base 0x400000)
$ xxd -r -p /tmp/dump.hex /tmp/dump.bin
$ objdump --adjust-vma=0x518860 -D -b binary -m i386:x86-64 /tmp/dump.bin
------
28174:S 13 Dec 2018 10:21:57.671 # dump of function (hexdump of 2410 bytes):
4155415455534c8b1f4939f30f84d60200004c8b66284d85e44d89e3740b493b7424380f8487040000488b7e384885ff0f84b0080000488b6f304531e44885ed0f84a2040000488b55304885d2740848c7422800000000488b1f4c8b450031c048c747280000000048c747300000000048c745280000000048c745300000000048c1eb2449c1e8244c39c3410f92c50f97c0450fb6cd4429c8751a4c8b5708488b4d0831c04939ca410f92c30f97c0410fb6db29d883f8ff0f84020200004c8b453848896f284d85c04c89473074044989782848897d384885d20f84300400004889ebeb2f0f1f004d8b42384c8952284d85c04c894230740449895028498952384885c94c8953300f846b0800004889ca4c89d34c8b52304d85d20f849f000000498b4a304885c9740848c74128000000004c8b0a498b0231ff48c742280000000048c742300000000049c742280000000049c742300000000049c1e92448c1e8244939c1410f92c3400f97c7450fb6c34429c7751b4c8b6a084d8b4a0831ff4d39cd0f92c0400f97c7440fb6d84429df83ffff0f854effffff4c8b6a38498952284d85ed4d896a3074044d8955284c8952384989d2e946ffffff0f1f44000048895330488b45304885c0753ee936030000660f1f4400004c8b4838488945284d85c94c894d307404498969284885db488968384889c70f849000000048897a30488b43304889dd4889fa4c8b5500488b0831ff488b583048c745300000000048c740300000000049c1ea2448c1e9244939ca410f92c1400f97c7450fb6d94429df751b4c8b6d084c8b400831ff4d39c5410f92c2400f97c7410fb6ca29cf83ffff0f8570ffffff4c8b5d38488968284d85db4c8958307404498943284885db488945384889ef0f8570ffffff4d85e40f844b0200004c89672849897c24384c8b66304c896730488b76304885f6740448897e285b5d415c415dc30f1f4400004c8b6f3848897d284d85ed4c896d30740449896d2848896f384889fde9f6fdffff0f1f8000000000498b43384885c00f84d40500004d8b43304d85c00f841f06000049c7433000000000498b483049c743280000000049c74028000000004885c90f840d060000488b51304885d2740848c74228000000004d8b204c8b1131c049c740280000000049c740300000000048c741280000000048c74130000000004c89e34d89d148c1eb2449c1e9244c39cb400f92c50f97c0440fb6ed4429e8751a4d8b6808488b690831c04939ed410f92c50f97c0410fb6ed29e883f8ff0f84740100004c8b6138498948284d85e44d89603074054d894424284c8941384885d20f84790500004889cdeb300f1f40004c8b6838488942284d85ed4c896a30740449895528488950384885db488945300f849d0500004889da4889c5488b42304885c00f8437010000488b58304885db740848c74328000000004c8b2a4c8b084531c048c742280000000048c742300000000048c740280000000048c740300000000049c1ed2449c1e9244d39cd410f92c4410f97c0450fb6d44529d0751d4c8b6a084c8b48084531c04d39cd410f92c4410f97c0450fb6d44529d04183f8ff0f854affffff4c8b4a38488950284d85c94c894830740449894128488942384889d0e942ffffff660f1f840000000000488b7e384885ff0f85c40400004c8b46304d85c04d8943380f84e6fdffff4d8958284c8b5e284d8958285b5d415c415dc34c8b5e280f1f004c895f28488b6e284885ed0f84a6fdffff48897d30e99dfdffff660f1f4400004889efe97dfdffff4889eae9acfcffff4d8b50384c8941284d85d24c895130740449894a28498948384989d94d89e24c89c1e97ffeffff904c8b11488955304d89d149c1e924488b41304885c07540e9bb0000000f1f40004c8b5038488941284d85d24c895130740449894a28488948384989c04885ed0f849b0000004c8942304c8b55004889e9488b45304c89c24c8b0849c1ea244531c0488b683048c741300000000048c740300000000049c1e9244d39ca0f92c3410f97c0440fb6e34529e0751d4c8b6908488b58084531c04939dd410f92c4410f97c0450fb6ec4529e84183f8ff0f856dffffff4c8b4938488948284d85c94c894830740449894128488941384d89d14989c8e965ffffff4989c8660f1f440000498b2b31c048c1ed244c39cd0f92c30f97c0440fb6e34429e0751a4d8b6b084d8b480831c04d39cd410f92c20f97c0410fb6ca29c883f8ff0f84a2020000498b50384d8943284885d24989533074044c895a284d39d84d8958384c89070f858ff9ffff498b48304885c90f849c020000488b51304885d2740848c74228000000004d8b084c8b1931c049c740280000000049c740300000000048c741280000000048c741300000000049c1e92449c1eb244d39d9400f92c50f97c0440fb6e54429e0751b498b5808488b710831c04839f3410f92c50f97c0450fb6d54429d083f8ff0f84400200004c8b4938498948284d85c94d89483074044d8941284c8941384885d20f843f0200004989cbeb2c488b453848896a284885c048894230740448895028488955384d85e449896b300f841c0200004c89e24989eb488b6a304885ed0f849b0000004c8b65304d85e4740949c744242800000000488b1a4c8b450031f648c742280000000048c742300000000048c745280000000048c745300000000048c1eb2449c1e8244c39c30f92c0400f97c6440fb6e84429ee751b4c8b52084c8b4d0831f64d39ca0f92c3400f97c6440fb6c34429c683feff0f854dffffff4c8b6a38488955284d85ed4c896d30740449896d2848896a384889d5e945ffffff49895330488b41304885c0753ce9140100000f1f004c8b6038488941284d85e44c896130740549894c2428488948384989c04d85db0f84ee0000004c894230498b43304c89d94c89c2488b294c8b2031f64c8b583048c741300000000048c740300000000048c1ed2449c1ec244c39e5410f92c2400f97c6450fb6ca4429ce751b488b59084c8b680831f64c39eb410f92c0400f97c6410fb6e829ee83feff0f8570ffffff4c8b5138488948284d85d24c895030740449894228488941384989c8e96cffffff4d8b4b304d85c94c890f0f84dbf9ffff49c7412800000000e9cef9ffff4c8b6e304d896b304c8b46304d85c00f85dbfbffffe9b4f9ffff4d8b53384d8958284d85d24d89503074044d8942284d8943384c891fe962fdffff4989c0e95afdffff4989c84c8907e980f9ffff4d8b0849c1e924e9e0fcffff4889cae906fcffff4d8b58384c8941284d85db4c895930740449894b28498948384c89c1e9b8fdffff48
=== REDIS BUG REPORT END. Make sure to include from START to END. ===
Crash log 2:
=== REDIS BUG REPORT START: Cut & paste starting from here ===
29055:S 13 Dec 2018 00:36:50.477 # Redis 5.0.0 crashed by signal: 11
29055:S 13 Dec 2018 00:36:50.478 # Crashed running the instruction at: 0x4a8bf2
29055:S 13 Dec 2018 00:36:50.478 # Accessing address: (nil)
29055:S 13 Dec 2018 00:36:50.478 # Failed assertion: <no assertion failed> (<no file>:0)
------ STACK TRACE ------
EIP:
/usr/local/bin/redis-server 10.240.103.178:6379 [cluster](raxGenericInsert+0x292)[0x4a8bf2]
Backtrace:
/usr/local/bin/redis-server 10.240.103.178:6379 [cluster](logStackTrace+0x45)[0x473435]
/usr/local/bin/redis-server 10.240.103.178:6379 [cluster](sigsegvHandler+0xb9)[0x473bf9]
/lib/x86_64-linux-gnu/libpthread.so.0(+0x11390)[0x7f2871916390]
/usr/local/bin/redis-server 10.240.103.178:6379 [cluster](raxGenericInsert+0x292)[0x4a8bf2]
/usr/local/bin/redis-server 10.240.103.178:6379 [cluster](slotToKeyUpdateKey+0xec)[0x4469dc]
/usr/local/bin/redis-server 10.240.103.178:6379 [cluster](rdbLoadRio+0x20a)[0x4526ea]
/usr/local/bin/redis-server 10.240.103.178:6379 [cluster](rdbLoad+0x4b)[0x452d9b]
/usr/local/bin/redis-server 10.240.103.178:6379 [cluster](readSyncBulkPayload+0x2e5)[0x44a2a5]
/usr/local/bin/redis-server 10.240.103.178:6379 [cluster](aeProcessEvents+0x36d)[0x4297fd]
/usr/local/bin/redis-server 10.240.103.178:6379 [cluster](aeMain+0x2b)[0x429a2b]
/usr/local/bin/redis-server 10.240.103.178:6379 [cluster](main+0x4ae)[0x4265de]
/lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf0)[0x7f287155b830]
/usr/local/bin/redis-server 10.240.103.178:6379 [cluster](_start+0x29)[0x426849]
------ INFO OUTPUT ------
# Server
redis_version:5.0.0
redis_git_sha1:00000000
redis_git_dirty:0
redis_build_id:ead42832fce42987
redis_mode:cluster
os:Linux 4.8.0-54-generic x86_64
arch_bits:64
multiplexing_api:epoll
atomicvar_api:atomic-builtin
gcc_version:5.4.0
process_id:29055
run_id:e66438464dbc2f592536e1ab2751e2e2b853bdf6
tcp_port:6379
uptime_in_seconds:642459
uptime_in_days:7
hz:10
configured_hz:10
lru_clock:1132038
executable:/usr/local/bin/redis-server
config_file:/etc/redis/redis.conf
# Clients
connected_clients:96
client_recent_max_input_buffer:4
client_recent_max_output_buffer:0
blocked_clients:0
# Memory
used_memory:6956276216
used_memory_human:6.48G
used_memory_rss:54112346112
used_memory_rss_human:50.40G
used_memory_peak:54228527376
used_memory_peak_human:50.50G
used_memory_peak_perc:12.83%
used_memory_overhead:751762090
used_memory_startup:1457280
used_memory_dataset:6204514126
used_memory_dataset_perc:89.21%
allocator_allocated:53078400304
allocator_active:53079154688
allocator_resident:53933473792
total_system_memory:109837619200
total_system_memory_human:102.29G
used_memory_lua:37888
used_memory_lua_human:37.00K
used_memory_scripts:0
used_memory_scripts_human:0B
number_of_cached_scripts:0
maxmemory:93361012736
maxmemory_human:86.95G
maxmemory_policy:volatile-lru
allocator_frag_ratio:1.00
allocator_frag_bytes:754384
allocator_rss_ratio:1.02
allocator_rss_bytes:854319104
rss_overhead_ratio:1.00
rss_overhead_bytes:178872320
mem_fragmentation_ratio:1.02
mem_fragmentation_bytes:1034108328
mem_not_counted_for_evict:0
mem_replication_backlog:0
mem_clients_slaves:0
mem_clients_normal:1623746
mem_aof_buffer:0
mem_allocator:jemalloc-5.1.0
active_defrag_running:0
lazyfree_pending_objects:0
# Persistence
loading:1
rdb_changes_since_last_save:6029936
rdb_bgsave_in_progress:0
rdb_last_save_time:1544068118
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:764
rdb_current_bgsave_time_sec:-1
rdb_last_cow_size:9088843776
aof_enabled:0
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:748
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:ok
aof_last_write_status:ok
aof_last_cow_size:18591744
loading_start_time:1544636154
loading_total_bytes:45916247884
loading_loaded_bytes:5540674851
loading_loaded_perc:12.07
loading_eta_seconds:408
# Stats
total_connections_received:129626
total_commands_processed:54963718
instantaneous_ops_per_sec:0
total_net_input_bytes:604482689346
total_net_output_bytes:72266941205
instantaneous_input_kbps:122787.96
instantaneous_output_kbps:1.85
rejected_connections:0
sync_full:2
sync_partial_ok:0
sync_partial_err:1
expired_keys:3351552
expired_stale_perc:2.85
expired_time_cap_reached_count:0
evicted_keys:0
keyspace_hits:60760821
keyspace_misses:32845911
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:1713031
migrate_cached_sockets:0
slave_expires_tracked_keys:0
active_defrag_hits:0
active_defrag_misses:0
active_defrag_key_hits:0
active_defrag_key_misses:0
# Replication
role:slave
master_host:10.240.103.172
master_port:6379
master_link_status:down
master_last_io_seconds_ago:-1
master_sync_in_progress:1
slave_repl_offset:1
master_sync_left_bytes:0
master_sync_last_io_seconds_ago:300
master_link_down_since_seconds:1500
slave_priority:100
slave_read_only:1
connected_slaves:0
master_replid:7887066c17252f985450f98001aa5763679b276a
master_replid2:0000000000000000000000000000000000000000
master_repl_offset:10563050119
second_repl_offset:-1
repl_backlog_active:0
repl_backlog_size:1048576
repl_backlog_first_byte_offset:10563050120
repl_backlog_histlen:0
# CPU
used_cpu_sys:5908.820000
used_cpu_user:26048.292000
used_cpu_sys_children:1293.632000
used_cpu_user_children:8593.576000
# Commandstats
cmdstat_psync:calls=2,usec=2366548,usec_per_call=1183274.00
cmdstat_info:calls=64259,usec=16536716,usec_per_call=257.34
cmdstat_del:calls=21382,usec=1544934,usec_per_call=72.25
cmdstat_replconf:calls=541374,usec=1337179,usec_per_call=2.47
cmdstat_get:calls=17340262,usec=2624527037,usec_per_call=151.35
cmdstat_config:calls=4,usec=546,usec_per_call=136.50
cmdstat_restore-asking:calls=23528840,usec=555647010,usec_per_call=23.62
cmdstat_command:calls=1,usec=50647,usec_per_call=50647.00
cmdstat_set:calls=6008554,usec=1123418297,usec_per_call=186.97
cmdstat_migrate:calls=3854229,usec=4046624118,usec_per_call=1049.92
cmdstat_select:calls=1507151,usec=1513186,usec_per_call=1.00
cmdstat_cluster:calls=2097402,usec=83461543,usec_per_call=39.79
cmdstat_ping:calls=253,usec=59,usec_per_call=0.23
cmdstat_dbsize:calls=5,usec=19,usec_per_call=3.80
# Cluster
cluster_enabled:1
# Keyspace
db0:keys=3309534,expires=3309533,avg_ttl=1398043889
------ CLIENT LIST OUTPUT ------
id=127270 addr=10.240.24.187:50376 fd=61 name= age=23534 idle=23524 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=set
id=127188 addr=10.240.24.153:55178 fd=186 name= age=23534 idle=23530 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127190 addr=10.240.24.153:55180 fd=188 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=127192 addr=10.240.24.153:55182 fd=190 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127197 addr=10.240.24.153:55184 fd=28 name= age=23534 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127199 addr=10.240.24.153:55186 fd=32 name= age=23534 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127200 addr=10.240.24.153:55188 fd=33 name= age=23534 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127201 addr=10.240.24.153:55190 fd=47 name= age=23534 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127202 addr=10.240.24.153:55192 fd=48 name= age=23534 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127203 addr=10.240.24.153:55194 fd=49 name= age=23534 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127204 addr=10.240.24.153:55196 fd=51 name= age=23534 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127205 addr=10.240.24.153:55198 fd=55 name= age=23534 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=127206 addr=10.240.24.153:55200 fd=57 name= age=23534 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127207 addr=10.240.24.153:55202 fd=62 name= age=23534 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127210 addr=10.240.24.153:55204 fd=68 name= age=23534 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=127211 addr=10.240.24.153:55206 fd=69 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=127212 addr=10.240.24.153:55208 fd=70 name= age=23534 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127213 addr=10.240.24.153:55210 fd=72 name= age=23534 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127274 addr=10.240.24.188:57324 fd=65 name= age=23533 idle=23525 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127021 addr=10.240.24.188:55944 fd=26 name= age=23565 idle=23529 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=127042 addr=10.240.24.153:52682 fd=54 name= age=23556 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127044 addr=10.240.24.153:52686 fd=56 name= age=23556 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=127086 addr=10.240.24.153:53802 fd=98 name= age=23548 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127083 addr=10.240.24.189:60360 fd=95 name= age=23548 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127088 addr=10.240.24.188:56762 fd=100 name= age=23547 idle=23529 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127090 addr=10.240.24.187:49860 fd=102 name= age=23546 idle=23527 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=set
id=127091 addr=10.240.24.187:49858 fd=103 name= age=23546 idle=23524 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=109778 addr=10.240.24.188:58414 fd=23 name= age=101844 idle=101844 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=NULL
id=127032 addr=10.240.24.189:59566 fd=13 name= age=23558 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=127093 addr=10.240.24.153:54686 fd=27 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127094 addr=10.240.24.153:54684 fd=43 name= age=23534 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127095 addr=10.240.24.153:54688 fd=46 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=127271 addr=10.240.24.189:60890 fd=29 name= age=23533 idle=23524 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=127272 addr=10.240.24.189:60892 fd=30 name= age=23533 idle=23530 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127273 addr=10.240.24.188:57304 fd=45 name= age=23533 idle=23524 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=set
id=127096 addr=10.240.24.153:54692 fd=50 name= age=23534 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127097 addr=10.240.24.153:54710 fd=53 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=127098 addr=10.240.24.153:54712 fd=58 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=127099 addr=10.240.24.153:54722 fd=64 name= age=23534 idle=23529 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=set
id=127100 addr=10.240.24.153:54738 fd=66 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=127101 addr=10.240.24.153:54740 fd=80 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127102 addr=10.240.24.153:54756 fd=93 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127103 addr=10.240.24.153:54760 fd=94 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=127104 addr=10.240.24.153:54788 fd=97 name= age=23534 idle=23530 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=127105 addr=10.240.24.153:54790 fd=99 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=127106 addr=10.240.24.153:54828 fd=104 name= age=23534 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127107 addr=10.240.24.153:54834 fd=105 name= age=23534 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127108 addr=10.240.24.153:54846 fd=106 name= age=23534 idle=23530 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127109 addr=10.240.24.153:54848 fd=107 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127110 addr=10.240.24.153:54856 fd=108 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127111 addr=10.240.24.153:54858 fd=109 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=127112 addr=10.240.24.153:54866 fd=110 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=127113 addr=10.240.24.153:54868 fd=111 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127114 addr=10.240.24.153:54876 fd=112 name= age=23534 idle=23527 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=127115 addr=10.240.24.153:54890 fd=113 name= age=23534 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127116 addr=10.240.24.153:54904 fd=114 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127117 addr=10.240.24.153:54948 fd=115 name= age=23534 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127118 addr=10.240.24.153:54946 fd=116 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127119 addr=10.240.24.153:54956 fd=117 name= age=23534 idle=23525 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127120 addr=10.240.24.153:54964 fd=118 name= age=23534 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=127121 addr=10.240.24.153:54966 fd=119 name= age=23534 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=128838 addr=10.240.2.142:44248 fd=14 name= age=7977 idle=7977 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127122 addr=10.240.24.153:54978 fd=120 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=127123 addr=10.240.24.153:54982 fd=121 name= age=23534 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127124 addr=10.240.24.153:54988 fd=122 name= age=23534 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127125 addr=10.240.24.153:54996 fd=123 name= age=23534 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127126 addr=10.240.24.153:54998 fd=124 name= age=23534 idle=23530 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127127 addr=10.240.24.153:55004 fd=125 name= age=23534 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127128 addr=10.240.24.153:55020 fd=126 name= age=23534 idle=23530 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=127129 addr=10.240.24.153:55034 fd=127 name= age=23534 idle=23530 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127130 addr=10.240.24.153:55046 fd=128 name= age=23534 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127131 addr=10.240.24.153:55104 fd=129 name= age=23534 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=127136 addr=10.240.24.153:55124 fd=134 name= age=23534 idle=23530 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127140 addr=10.240.24.153:55130 fd=138 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=set
id=127144 addr=10.240.24.153:55136 fd=142 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=127145 addr=10.240.24.153:55138 fd=143 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127146 addr=10.240.24.153:55140 fd=144 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127152 addr=10.240.24.153:55144 fd=150 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=127160 addr=10.240.24.153:55146 fd=158 name= age=23534 idle=23530 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127162 addr=10.240.24.153:55148 fd=160 name= age=23534 idle=23534 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127164 addr=10.240.24.153:55150 fd=162 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127165 addr=10.240.24.153:55152 fd=163 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=127166 addr=10.240.24.153:55154 fd=164 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127167 addr=10.240.24.153:55156 fd=165 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=127168 addr=10.240.24.153:55158 fd=166 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127170 addr=10.240.24.153:55160 fd=168 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127175 addr=10.240.24.153:55162 fd=173 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=127176 addr=10.240.24.153:55164 fd=174 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127177 addr=10.240.24.153:55166 fd=175 name= age=23534 idle=23527 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127179 addr=10.240.24.153:55168 fd=177 name= age=23534 idle=23524 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=127180 addr=10.240.24.153:55170 fd=178 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=127181 addr=10.240.24.153:55172 fd=179 name= age=23534 idle=23530 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127184 addr=10.240.24.153:55174 fd=182 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127186 addr=10.240.24.153:55176 fd=184 name= age=23534 idle=23533 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
id=127268 addr=10.240.24.188:57266 fd=42 name= age=23534 idle=23526 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=get
id=127269 addr=10.240.24.189:60842 fd=59 name= age=23534 idle=23524 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=cluster
------ REGISTERS ------
29055:S 13 Dec 2018 00:36:50.490 #
RAX:0000000013c907c4 RBX:00007f26f6999908
RCX:0000000013c8fc0f RDX:0000000000000bb0
RDI:00007f26e2d09144 RSI:0000000000000079
RBP:0000000000000008 RSP:00007fff09e2f110
R8 :0000000000000000 R9 :0000000000000001
R10:00007fff09e2f1d0 R11:0000000013c8fc0f
R12:0000000000000011 R13:eb164d9e6ac8b5ba
R14:0000000000000016 R15:00007f2871028588
RIP:00000000004a8bf2 EFL:0000000000010202
CSGSFS:002b000000000033
29055:S 13 Dec 2018 00:36:50.491 # (00007fff09e2f11f) -> 00007fff09e2f1d0
29055:S 13 Dec 2018 00:36:50.491 # (00007fff09e2f11e) -> 00007f287100b370
29055:S 13 Dec 2018 00:36:50.491 # (00007fff09e2f11d) -> b924852c2c639a00
29055:S 13 Dec 2018 00:36:50.491 # (00007fff09e2f11c) -> 0000000000000018
29055:S 13 Dec 2018 00:36:50.491 # (00007fff09e2f11b) -> 00007f26811328c1
29055:S 13 Dec 2018 00:36:50.491 # (00007fff09e2f11a) -> 00000168209684c4
29055:S 13 Dec 2018 00:36:50.491 # (00007fff09e2f119) -> b924852c2c639a00
29055:S 13 Dec 2018 00:36:50.491 # (00007fff09e2f118) -> 0000000001ff0fb0
29055:S 13 Dec 2018 00:36:50.491 # (00007fff09e2f117) -> b924852c2c639a00
29055:S 13 Dec 2018 00:36:50.491 # (00007fff09e2f116) -> 00000000000006e1
29055:S 13 Dec 2018 00:36:50.491 # (00007fff09e2f115) -> 0000000020bc5170
29055:S 13 Dec 2018 00:36:50.491 # (00007fff09e2f114) -> 00007f2680ed8cc0
29055:S 13 Dec 2018 00:36:50.491 # (00007fff09e2f113) -> 000000000044e86d
29055:S 13 Dec 2018 00:36:50.491 # (00007fff09e2f112) -> 0000000000000000
29055:S 13 Dec 2018 00:36:50.491 # (00007fff09e2f111) -> 00007fff09e2f710
29055:S 13 Dec 2018 00:36:50.491 # (00007fff09e2f110) -> 00000000000006e1
------ FAST MEMORY TEST ------
29055:S 13 Dec 2018 00:36:50.491 # Bio thread for job type #0 terminated
29055:S 13 Dec 2018 00:36:50.491 # Bio thread for job type #1 terminated
29055:S 13 Dec 2018 00:36:50.492 # Bio thread for job type #2 terminated
*** Preparing to test memory region 7ac000 (2248704 bytes)
*** Preparing to test memory region 1fe4000 (135168 bytes)
*** Preparing to test memory region 7f191b200000 (64623738880 bytes)
*** Preparing to test memory region 7f28270fd000 (1207959552 bytes)
*** Preparing to test memory region 7f286f0fe000 (8388608 bytes)
*** Preparing to test memory region 7f286f8ff000 (8388608 bytes)
*** Preparing to test memory region 7f2870100000 (8388608 bytes)
*** Preparing to test memory region 7f2870900000 (11534336 bytes)
*** Preparing to test memory region 7f2871901000 (16384 bytes)
*** Preparing to test memory region 7f2871b1e000 (16384 bytes)
*** Preparing to test memory region 7f287244f000 (24576 bytes)
*** Preparing to test memory region 7f287245e000 (4096 bytes)
.O.O.O.O.O.O.O.O.O.O.O.O
Fast memory test PASSED, however your memory can still be broken. Please run a memory test for several hours if possible.
------ DUMPING CODE AROUND EIP ------
Symbol: raxGenericInsert (base: 0x4a8960)
Module: /usr/local/bin/redis-server 10.240.103.178:6379 [cluster] (base 0x400000)
$ xxd -r -p /tmp/dump.hex /tmp/dump.bin
$ objdump --adjust-vma=0x4a8960 -D -b binary -m i386:x86-64 /tmp/dump.bin
------
29055:S 13 Dec 2018 00:40:57.075 # dump of function (hexdump of 786 bytes):
415741564989ff415541544989f255534989d64889fb4883ec784c8b2f64488b042528000000488944246831c048894c241041f74500f8ffffff0f848e0a00004885d20f84850a00004531e40f1f4000410fb67500498d7d0440f6c6040f85c5010000458b5d0041c1eb034489d94885c9742f430fb61422413a55040f844c03000031c0eb13662e0f1f8400000000003814070f84170300004883c0014839c875ee4d39e60f845d0300004d39e60f86080100004c89ed4c89542408e9a60000000f1f80000000004c89f04c29e04883f8010f849c000000483dffffff1f41bdffffff1f488d4c24584c0f46e8488b4424084889ef4c89ea4a8d3420e8dff2ffff4885c00f84c80200004889038b10bb080000000fb608488b6c2458c1ea0389d683c20448f7da488d3cf50000000083e207f6c104480f44df83e10380f9010f94c14d01ec49834710010fb6c948c1e103488d740efc4801f24801d34829cb4801c34d39f4734df74500f8ffffff0f8454ffffff488b442408488d4c2460488d5424584889ef420fb63420e850efffff4885c00f84390200004983c40148890349834710014d39f4488b5c2460488b6c245872b34c8b5424084989ed488b7424104c89ef4c89542408e8f2edffff4885c04889c54c8b5424080f84fb010000f6000175054983470801488b7424104889efe82aeeffff48892bb801000000488b5c24686448331c25280000000f85f00800004883c4785b5d415c415d415e415fc30f1f8000000000418b4d00c1e90389ca4885d20f84c00100004d39e60f86b70100004b8d0422450fb65d0431ed44381875660f1f4400004883c5014983c4014839ea76104d39e6760b440fb61c2844381c2f74e34839ea753f8d410448f7d883e0074801d031d24801d0488d1c074c8b2b41f74500f8ffffff74094d39e60f87abfdffff410fb6750089f083e00484c00f84ebfdffff31ed4d39e60f84d3010000418b450083e603c1e8038d500489c148f7da83e207488d540a0831c94080fe010f94c1488d14ca0f8471050000498b7415fc29e8bf1000000083e801489848897424284863f548894424184889742408
=== REDIS BUG REPORT END. Make sure to include from START to END. ===
Comment From: antirez
Hello @roychen25, thank you for sending this bug reports. It looks like something related to the keys -> hash slot mapping. AFAIK I never saw something like that before with the latest version of the radix tree implementation, yet it is possible that it only happens when a lot of keys are inserted into the radix tree, or the memory violation could be caused by something else.
I'll investigate this issue with care, please if possible send me your redis-server executable, the same that generated the above crashes. Thank you. The investigation may take time, so please be patient, eventually I'll update this issue.
Comment From: antirez
@roychen25 Forgot to ask another thing. Please could you tell me how your key names look like? That is, a few items from the RANDOMKEY output. Thanks!
Comment From: antirez
@roychen25 Oh wait! There is something much more valuable you can send me! I just saw that one of the crashes happened while the server was loading the data:
-
Do you happen to have the file that made it crashing? It looks like the master was sending such file to a replica in the crashlog 2. This is very important, we could fix such an hard bug immediately with such a file that is able to replicate the crash.
-
If you have any RDB file from the master, have you tried to spin a new instance, loading such RDB file, and then calling "FLUSHALL" to see if it crashes?
Look I don't want to stress you, but given that you see this happening, and apparently this happens with a given set of keys that you have in memory, if you are able to capture this state to make the bug reproducible is a huge big bingo 🎆
Comment From: rlchn
@antirez Sorry, I didn't see your reply until now. My apologies for the delay.
I have emailed you a Dropbox shared folder link with the redis-server executables.
Sample key names from RANDOMKEY:
"geocode:2e68e5df3624"
"geocode:2e698c8c288c"
"geocode:2e69ec703034"
"geocode:2e69c401e5e4"
"geocode:2e3b747866dc"
"geocode:2e3b75d382a4"
"geocode:2e7a50fc10d4"
"geocode:2e69f25d75cc"
"geocode:32879880701c"
"geocode:2e6ee286b94c"
I am not sure that I will be able to send you the dump.rdb file the master was sending to the replica, as it contains sensitive business data that I don't think I can share.
I will test if spinning up a new instance loading the RDB file from the master, and then running FLUSHALL causes a crash.
Thank you very much!
Comment From: antirez
Thanks! Even if you can't share the RDB with me even if you have one RDB file they can locally reproduce the issue would already be a great help, as you could collect more state about the crash allowing us to fix the bug much easily. Note that in order to reproduce the bug all it's needed is the key names in the order they appear in the RDB file, there is no need to have the data itself. Thanks
On Mon, Dec 17, 2018, 04:52 Roy Chen <notifications@github.com wrote:
@antirez https://github.com/antirez Sorry, I didn't see your reply until now. My apologies for the delay.
I have emailed you a Dropbox shared folder link with the redis-server executables.
Sample key names from RANDOMKEY:
"geocode:2e68e5df3624" "geocode:2e698c8c288c" "geocode:2e69ec703034" "geocode:2e69c401e5e4" "geocode:2e3b747866dc" "geocode:2e3b75d382a4" "geocode:2e7a50fc10d4" "geocode:2e69f25d75cc" "geocode:32879880701c" "geocode:2e6ee286b94c"
I am not sure that I will be able to send you the dump.rdb file the master was sending to the replica, as it contains sensitive business data that I don't think I can share.
I will test if spinning up a new instance loading the RDB file from the master, and then running FLUSHALL causes a crash.
Thank you very much!
— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/antirez/redis/issues/5693#issuecomment-447715092, or mute the thread https://github.com/notifications/unsubscribe-auth/AAEAYICzVa0eeZtXNUbmsUQl2ygTybQ_ks5u5xT5gaJpZM4ZRHHo .
Comment From: antirez
@roychen25 P.S. if you didn't already, it would be super useful if you could run a memory test against those machines that crashed, especially if they are using non memory corrected memory modules. Thanks! I implemented a new fuzz test in the rax library that attempts to simulate your use case, unfortunately I was not able to trigger the bug so far. Many things are possible:
- That in order to trigger the bug we need to insert the keys in a very special way/order. In that case, if you find an RDB file that can reproduce the bug, we could extract the keys.
- Maybe the radix tree is actually ok, but there is some other bug that causes a heap corruption.
- There could be a problem with the hardware, however you reported the crash in two different hosts... So it is not very likely, yet a memory test could be great.
- There could be a problem in Jemalloc 5.1.
Comment From: rlchn
@antirez Unfortunately we were not able to reproduce the crash by copying the dump.rdb to a new Redis instance, loading it up, and then running flushall.
We'll look into running memory tests on the two machines where the crash happened.
Comment From: rlchn
@antirez we had a couple more instances of Redis nodes crashing when they were syncing from their master nodes. The logs indicate the crash happened when a FLUSHALL was performed on the node, prior to loading the synced data from the master.
I ran redis-server --test-memory 5324 (we have 52 GB RAM on these boxes) for 2 boxes, no errors were seen.
We copied the dump.rdb files to our test server and tried loading them and running FLUSHALL, but the crash was not reproduced.
We also tried adding another test server as a slave to the original test server, and letting the data replicate from master to slave. No crash was observed when the slave was flushing data before loading the synced data from master.
I'm not sure how else we can troubleshoot this now. If there is anything we can do, please let us know.
Comment From: antirez
Hello Roy, unfortunately these kind of issues are very hard to track, so the process consists of slowly capturing more information until what the cause could be is found.
The bug is obscure, it was never reported in the past if not in a single instance even if many run Redis Cluster, and back when it was reported there was actually an issue. Moreover in parallel with your tests I ran many stress testers simulating the same conditions with very big keyspaces without results.
I will understand if you abandon the investigation because it's slow and time consuming, however unfortunately it's unlikely I'll be able to fix it without assistance of folks that can trigger the bug.
I've a couple of points to go forward:
-
Have you configured Redis to flush the dataset in the background thread? It's not the default but can be enabled.
-
May you try to run a real bootloader memory test?
-
Is the issue only happening with slaves? Never in a master? That may indicate that some slave Redis Cluster operation may corrupt memory.
-
Would be conceivable for you to compile Redis with address sanitizer and connect a slave with this setup with the sole scope of waiting it to crash? We would get much more info this way.
-
Would be conceivable for you to also do step 4 but instead of address sanitizer just compile Redis with "make distclean; make MALLOC=libc" in order to see if this would be stable forever? That is, let's check if the issue could be jemalloc.
-
May you collect as many crash report as possible? It's interesting if they always happen in raxFree or raxInsert.
-
When the issue happens with raxInsert (a single time so far), it could be more interested to collect the RDB file and retry with the exact file that made the instance crashing on loading. If we can't reproduce this way there are two options: the hardware has some issue or alternatively the memory was corrupted before loading and we are just seeing the effect when we allocate more.
Sorry it's a mess to track such problems. I'll completely understand if you don't have the time to dig more and thank you a lot for the time spent so far.
On Wed, Dec 19, 2018, 06:56 Roy Chen <notifications@github.com wrote:
@antirez https://github.com/antirez we had a couple more instances of Redis nodes crashing when they were syncing from their master nodes. The logs indicate the crash happened when a FLUSHALL was performed on the node, prior to loading the synced data from the master.
I ran redis-server --test-memory 5324 (we have 52 GB RAM on these boxes) for 2 boxes, no errors were seen.
We copied the dump.rdb files to our test server and tried loading them and running FLUSHALL, but the crash was not reproduced.
We also tried adding another test server as a slave to the original test server, and letting the data replicate from master to slave. No crash was observed when the slave was flushing data before loading the synced data from master.
I'm not sure how else we can troubleshoot this now. If there is anything we can do, please let us know.
— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub https://github.com/antirez/redis/issues/5693#issuecomment-448478649, or mute the thread https://github.com/notifications/unsubscribe-auth/AAEAYHrbovCK36vgKmTwUWauiKrMKW7Oks5u6dUTgaJpZM4ZRHHo .
Comment From: rlchn
Hey antirez, no worries. Thank you very much for all your help so far too.
So far we haven't seen any nodes crashing again. I'll work on this whenever I have some free time and get back to you.
Comment From: rlchn
@antirez I'm revisiting this issue to try to reproduce the crashes. We're still seeing them when a cluster slave node attempts to flush data after receiving a dump file from its master during a full sync.
Unfortunately the crashes are intermittent and I can't seem to narrow down what's actually causing them.
I'm setting up a test cluster to try to reproduce. Can you please point me to any documentation regarding building Redis with address sanitizer? I wasn't able to find anything by Googling, checking the docs here, or on Stack Overflow. I tried reading src/Makefile but couldn't see any options there.
Comment From: antirez
Hello @roychen25, I just tried to compile Redis with Address Sanitizer, that's what I did:
- apt-get install libasan4 libasan4-dbg
- make distclean
- make MALLOC="libc" CFLAGS="-fsanitize=address" LDFLAGS="-fsanitize=address"
Thanks for your help!
Comment From: antirez
Note that I'm very interested in tracking such bug, so ping me if you need anything for the testing and/or debugging the issue.
Comment From: rlchn
Okay, thank you! :)
Comment From: rlchn
Running apt-get install libasan4 libasan4-dbg returns an error saying the packages can't be found.
I checked my /etc/apt/sources.list and I believe I'm using the default package repositories for Ubuntu 16.04.2 LTS.
Not sure if this is the right Address Sanitizer, but https://github.com/google/sanitizers/wiki/AddressSanitizer says that it's included in gcc from version 4.8, and I have gcc version 5.4.0 on my VMs.
In any case, make MALLOC="libc" CFLAGS="-fsanitize=address" LDFLAGS="-fsanitize=address" succeeded, so I think it worked? Let me know if I did something wrong.
Comment From: antirez
Yep @roychen25 it just worked, the libraries are not necessarily needed :-)
Comment From: antirez
Note that is critical to do "make distclean" before.
Comment From: rlchn
@antirez just wanted to update you on what I've done so far.
I have a test Redis cluster with 3 master nodes and 3 slave nodes (6 in total), each node has 52 GB memory.
On each of those nodes, I've run make distclean and make MALLOC="libc" CFLAGS="-fsanitize=address" LDFLAGS="-fsanitize=address".
I've copied a dump.rdb from one of my production cluster nodes (this cluster has 6 master and 6 slave nodes, and the dump file is ~40 GB in size) to each of the nodes in the test cluster, and then restarted Redis on each node to load the dump file.
I am not exactly sure what I did then, there was some connection lost events between master/slave nodes, and when I ran a cluster fix to fix the cluster (since the data wasn't originally from this cluster), I managed to get the 3 slave nodes to crash when flushing old data.
I am honestly not sure if what I did was correct, or if we can even assign any causality to the cluster fix operation, since I never actually ran that on my production cluster and we still see crashes in the slave nodes.
In any case, I've uploaded the latest crash logs to my Dropbox folder, along with the redis.conf used on each of the test cluster nodes (just in case). I've emailed you the link again. Please let me know if you can see anything in them that might help me to focus my efforts.
I'll be trying other operations (e.g. manual failover to force a full sync between master and slave) to see if I can reproduce the crash reliably.
Thank you once again for all your help!
Comment From: antirez
Thanks @roychen25, looking at the crash log, but I want to tell that the fact that you managed to reproduce the crash in a different environment so quickly is a great indication that you may get to the point you have fixed steps to reproduce the crash. Once you have such fixed steps, if I can access the environment you can use, I can continue from there and fix the problem. Thanks!
Comment From: antirez
@roychen25 I've a few questions:
- Do you still have this RDB file that generated the crash?
- After you passed the RDB file there, did you write anything on the cluster or it was just the data of the old one?
I think the RDB file could be used in order to reproduce the crash in a more or less consistent way. I understand the RDB file contains critical information for your business and you can't share it with me, right? Thanks.
Comment From: antirez
@roychen25 I read the crash logs, I've some idea about what I could scrutinize inside the source code to find for hints, but it's a long shot. Probably it's just an artifact due to the fact you moved the cluster to the dev environment, however I see that before the crash there is always a node address updating operation: if there is a bug in that code, maybe Redis is poking around the memory damaging memory areas that are later freed.
Comment From: antirez
@roychen25 please try this: in a standalone instance configured with the cluster enabled:
- Start Redis with that RDB file.
- Wait for the loading to finish.
- Call FLUSHALL
- If no crash was observed, try again a few times.
Comment From: rlchn
@roychen25 I've a few questions:
- Do you still have this RDB file that generated the crash?
- After you passed the RDB file there, did you write anything on the cluster or it was just the data of the old one?
I think the RDB file could be used in order to reproduce the crash in a more or less consistent way. I understand the RDB file contains critical information for your business and you can't share it with me, right? Thanks.
I still have the RDB file, and after I started each node in the test cluster with that RDB file, I didn't write anything to the cluster. The only changes to the cluster's data would be the keys expiring (all the keys have an expiry of max 30 days).
Unfortunately I don't think I can share that file with you :( But I will check anyway if it's okay.
@roychen25 please try this: in a standalone instance configured with the cluster enabled:
- Start Redis with that RDB file.
- Wait for the loading to finish.
- Call FLUSHALL
- If no crash was observed, try again a few times.
Sounds good, I'll get around to this tomorrow and let you know the results. Thank you once again!
Comment From: antirez
Thank you @roychen25! Please note that if you are able to send me the RDB file, I can use a very strict policy: I receive the RDB file encrypted, I use it for testing without ever checking what is inside, and later I follow a procedure of secure removal. All the testing happening in an isolated machine in order to ensure no leaks. I understand if you can't but just to let you know that in the past this worked according to a strict procedure. Cheers!
Comment From: antirez
Wait a moment I got an idea 💡 I can send you a patch for Redis that loads the RDB file replacing all the content of the keys with a "foobar" string. I think that what makes it crashing is not the content of the keys, but the key names in a given exact sequence. Then you could "SAVE" the resulting RDB, producing an RDB file that has the key names as you have but only "foobar" as values.
Comment From: antirez
We'll be not sure of course that this will be able to trigger the bug, but it's possible and likely in the case the RDB file keys sequence is the problem (triggering a bug in the radix tree).
Comment From: rlchn
Wait a moment I got an idea 💡 I can send you a patch for Redis that loads the RDB file replacing all the content of the keys with a "foobar" string. I think that what makes it crashing is not the content of the keys, but the key names in a given exact sequence. Then you could "SAVE" the resulting RDB, producing an RDB file that has the key names as you have but only "foobar" as values.
This sounds like a good idea, please let me know how I can get that patch from you and how to apply it :)
Comment From: antirez
Cool @roychen25! The patch is just the following two lines :-)
diff --git a/src/rdb.c b/src/rdb.c
index 47555101..c2a1fd15 100644
--- a/src/rdb.c
+++ b/src/rdb.c
@@ -2007,6 +2007,9 @@ int rdbLoadRio(rio *rdb, rdbSaveInfo *rsi, int loading_aof) {
if ((key = rdbLoadStringObject(rdb)) == NULL) goto eoferr;
/* Read value */
if ((val = rdbLoadObject(type,rdb)) == NULL) goto eoferr;
+ /* Discard the value and just use "0" as value. */
+ decrRefCount(val);
+ val = createStringObjectFromLongLongForValue(0);
/* Check if the key already expired. This function is used when loading
* an RDB file from disk, either at startup, or when an RDB was
* received from the master. In the latter case, the master is
Comment From: rlchn
@roychen25 please try this: in a standalone instance configured with the cluster enabled:
- Start Redis with that RDB file.
- Wait for the loading to finish.
- Call FLUSHALL
- If no crash was observed, try again a few times.
I've tried this process 5 times each for a default build of Redis (using jemalloc, I believe), and another build using make distclean and make MALLOC="libc" CFLAGS="-fsanitize=address" LDFLAGS="-fsanitize=address".
No crashes were observed when running FLUSHALL.
Comment From: rlchn
@roychen25 please try this: in a standalone instance configured with the cluster enabled:
- Start Redis with that RDB file.
- Wait for the loading to finish.
- Call FLUSHALL
- If no crash was observed, try again a few times.
I've tried this process 5 times each for a default build of Redis (using
jemalloc, I believe), and another build usingmake distcleanandmake MALLOC="libc" CFLAGS="-fsanitize=address" LDFLAGS="-fsanitize=address".No crashes were observed when running
FLUSHALL.
I just realized I made a very silly mistake - after running make MALLOC="libc" CFLAGS="-fsanitize=address" LDFLAGS="-fsanitize=address" I forgot to run make install - I think I was using the wrong redis-server executable in this test. I will repeat them and get back to you.
Comment From: rlchn
@antirez I've uploaded the sanitized dump file to the shared Dropbox folder. Let me know if that's not correct. :)
Comment From: antirez
Thank you @roychen25! Only problem with dropbox is that I've a free account and there is no space for such file. Could you please instead send me a dropbox link to that specific file so that I can download it? Thanks
Comment From: antirez
@roychen25 talked too early, maybe the RDB is fine actually! It's composed of ~ 10 million of keys, right? Thanks.
Comment From: rlchn
@antirez yes, that's right, it has ~10 million keys. Since the values are all 0 it's only about 770 MB in size.
Comment From: antirez
@roychen25 I noticed something: the libc bug reports you sent me are all actually about jemalloc, something went wrong when you tried to compile Redis with libc malloc IMHO. It is very important to exclude Jemalloc from the loop, because it may have issues as well. With the following steps you can have a libc-malloc build:
- make distclean
- make MALLOC=libc
You can later verify with the "INFO" command that it's a libc malloc build.
If I check the bug reports under the libc directory you shared I see instead:
mem_allocator:jemalloc-5.1.0
It is possible that once you switch to libc malloc you'll no longer see any crash.
Comment From: rlchn
@roychen25 I noticed something: the libc bug reports you sent me are all actually about jemalloc, something went wrong when you tried to compile Redis with libc malloc IMHO. It is very important to exclude Jemalloc from the loop, because it may have issues as well. With the following steps you can have a libc-malloc build:
- make distclean
- make MALLOC=libc
You can later verify with the "INFO" command that it's a libc malloc build.
If I check the bug reports under the libc directory you shared I see instead:
mem_allocator:jemalloc-5.1.0It is possible that once you switch to libc malloc you'll no longer see any crash.
@antirez Yes, I realized my silly mistake - I did a libc malloc build but forgot to replace the redis-server binaries with the newly-built one. I will make sure my test cluster and standalone instance are all using libc and then repeat my tests.
Thank you!
Comment From: rlchn
@roychen25 please try this: in a standalone instance configured with the cluster enabled:
- Start Redis with that RDB file.
- Wait for the loading to finish.
- Call FLUSHALL
- If no crash was observed, try again a few times.
@antirez I've repeated this test with a standalone Redis instance using libc. I've run it about 10 times, no crashes were seen. I'm not sure what conclusions we can draw from this, but it would seem the crash only happens during a master -> slave sync.
Comment From: rlchn
@antirez I've uploaded 3 new crash logs from a Redis node built using libc to the shared Dropbox folder.
The behavior is different though - this is a master node crashing when running bgsave to sync to its slave.
In fact, it looks like this master node is now stuck in a infinite bgsave -> terminate bgsave with signal 11 -> back to bgsave loop.
Here's what I was doing to the test cluster (all nodes built with libc):
-
Start a script that I wrote to get 10,000 random key / values from the cluster, then write a new random key with a randomly chosen value (that I grabbed from the cluster before) 1,000,000 times to the cluster.
-
While the script is running, restart the Redis service on each master node. This forces the slave nodes to failover and become masters.
-
The script fails after a while because of a CLUSTERDOWN error. Restart the script. 1,000,000 new keys get written to the cluster.
-
The Redis service finishes restarting on the 3 nodes, and a full sync happens from masters to slaves.
bgsaveis started for the full sync. -
Observe the crash on one of the master nodes when running
bgsave. (All other nodes behave normally).
I am not sure if this crash is related to the ones we saw earlier (when flushing the DB on a slave node) though.
Please let me know what other information you need.
Comment From: rlchn
I wanted to save the data on the master node that kept crashing, but since it couldn't bgsave, I thought I might try a bgrewriteaof - which also failed with a crash. I've also uploaded that crash log to the Dropbox folder.
Comment From: rlchn
Hey there @antirez, I just wanted to check in to see if there was anything else I could provide to help debug this. Thanks!
Comment From: antirez
@roychen25 Hello, thanks for the update, one week ago I tried several time to crash Redis without results, using the RDB file as starting point, however I see that here you write:
Start a script that I wrote to get 10,000 random key / values from the cluster, then write a new random key with a randomly chosen value (that I grabbed from the cluster before) 1,000,000 times to the cluster.
You mean that now you are even able to crash Redis Cluster without starting with a dataset, but with empty cluster and just writing new data? That would be a big step forward towards reproducibility.
In that case, would you please tell me how I could reproduce your environment to end with very similar setup? My aim is to have a setup like yours where such crashes happen. We could copy your configuration files in my setup, or I can give you direct access to the instances: whatever it works. Oh another thing, in your experiments you are using multiple hosts right? You are not running Redis the different masters and replicas in a single host if I understand correctly.
Today I'll analyze your new crash logs and report here back. Thanks!
Comment From: rlchn
Hi @antirez,
You mean that now you are even able to crash Redis Cluster without starting with a dataset, but with empty cluster and just writing new data? That would be a big step forward towards reproducibility.
Actually, that's not quite correct. There was production data in my test cluster. Here's what I did:
- I setup a cluster with 3 master nodes (built with libc), as per the Redis cluster tutorial.
- I copied the RDB file from one of my production cluster nodes (this is the RDB file that I've been using all this while, the one that I sanitized and sent to you to show you the key names) to the 3 master nodes.
- I did a cluster fix for the 3 master nodes.
- I added 3 slaves nodes to the test cluster.
- I then ran a script that I wrote to get 10,000 random key / values from the test cluster, then write a new random key with a randomly chosen value (that I grabbed from the cluster before) 1,000,000 times to the test cluster.
- Now, I'm unable to reproduce the original crash (during a
FLUSHALLon the slave node, on a full sync from master to slave). - However, I now have a master node that consistently crashes whenever it tries to
bgsaveorbgaofrewrite(I put those latest crash logs in the Dropbox folder).
In that case, would you please tell me how I could reproduce your environment to end with very similar setup? My aim is to have a setup like yours where such crashes happen. We could copy your configuration files in my setup, or I can give you direct access to the instances: whatever it works. Oh another thing, in your experiments you are using multiple hosts right? You are not running Redis the different masters and replicas in a single host if I understand correctly.
The redis.conf file I'm using is in the Dropbox folder too, and yes, I'm using multiple hosts - each cluster node is a separate VM.
I'm starting to think that the crashes are also related to the data in the RDB file, instead of only the keys. Please let me know if you think that's reasonable. If you feel that's the case too, I will ask for permission to share the full RDB file.
Thank you once again!
Comment From: rlchn
Hey there @antirez, I just wanted to check in to see if there was anything else I could share to help debug this. Thanks!
Comment From: antirez
Hello @roychen25 thank you for pinging me, I was traveling and this is my first day of work. I'll back at the issue starting from tomorrow and I'll report back. Sorry for this delay, unfortunately I was too busy with setting up things to show at the conference and end of this month I'll be in SF for Redis Conf, but now I've a week where I can focus on reproducing. Thanks! Please tell me any additional thing you discover if any. Cheers.
Comment From: antirez
Just another thing, in case I fail to reproduce, it would be super important to understand if you are able to reproduce it using the sanitized RDB file that you sent me.
Comment From: rlchn
No worries @antirez, I know you have other responsibilities, thank you so much for all your help so far.
Let me see if I can reproduce this using the sanitized RDB file. Thanks!
Comment From: Adel-Magebinary
=== REDIS BUG REPORT START: Cut & paste starting from here ===
1:M 26 Apr 2019 05:16:13.031 # Redis 5.0.4 crashed by signal: 11
1:M 26 Apr 2019 05:16:13.031 # Crashed running the instruction at: 0x7fffeee3766b
1:M 26 Apr 2019 05:16:13.031 # Accessing address: (nil)
1:M 26 Apr 2019 05:16:13.031 # Failed assertion:
------ STACK TRACE ------ EIP: redis-server *:6379(dictSdsKeyCompare+0x2b)[0x7fffeee3766b]
Backtrace: redis-server :6379(logStackTrace+0x37)[0x7fffeee7df87] redis-server :6379(sigsegvHandler+0xb0)[0x7fffeee7e6b0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x110e0)[0x7fffeda110e0] redis-server :6379(dictSdsKeyCompare+0x2b)[0x7fffeee3766b] redis-server :6379(dictAddRaw+0xa5)[0x7fffeee364f5] redis-server :6379(dictAdd+0x11)[0x7fffeee36661] redis-server :6379(dbAdd+0x25)[0x7fffeee51965] redis-server :6379(setKey+0x5d)[0x7fffeee51e3d] redis-server :6379(setGenericCommand+0xa4)[0x7fffeee5e174] redis-server :6379(setCommand+0xfa)[0x7fffeee5e38a] redis-server :6379(call+0xa7)[0x7fffeee3a6a7] redis-server :6379(processCommand+0x35f)[0x7fffeee3ad5f] redis-server :6379(processInputBuffer+0x185)[0x7fffeee4ae35] redis-server :6379(aeProcessEvents+0x2a0)[0x7fffeee34870] redis-server :6379(aeMain+0x2b)[0x7fffeee34b0b] redis-server :6379(main+0x4d3)[0x7fffeee31803] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0x7fffed6202e1] redis-server :6379(_start+0x2a)[0x7fffeee31a6a]
------ INFO OUTPUT ------
Server
redis_version:5.0.4 redis_git_sha1:00000000 redis_git_dirty:0 redis_build_id:c6d7e1572d62bb79 redis_mode:standalone os:Linux 3.13.0 x86_64 arch_bits:64 multiplexing_api:epoll atomicvar_api:atomic-builtin gcc_version:6.3.0 process_id:1 run_id:7b09a2cffd2c5b60a441dac2f569bb1bef1d5089 tcp_port:6379 uptime_in_seconds:3661 uptime_in_days:0 hz:10 configured_hz:10 lru_clock:12751901 executable:/data/redis-server config_file:
Clients
connected_clients:500 client_recent_max_input_buffer:2 client_recent_max_output_buffer:0 blocked_clients:0
Memory
used_memory:31857704 used_memory_human:30.38M used_memory_rss:11726848 used_memory_rss_human:11.18M used_memory_peak:31857704 used_memory_peak_human:30.38M used_memory_peak_perc:100.05% used_memory_overhead:25703536 used_memory_startup:791000 used_memory_dataset:6154168 used_memory_dataset_perc:19.81% allocator_allocated:31874760 allocator_active:36175872 allocator_resident:40337408 total_system_memory:8589934592 total_system_memory_human:8.00G used_memory_lua:37888 used_memory_lua_human:37.00K used_memory_scripts:0 used_memory_scripts_human:0B number_of_cached_scripts:0 maxmemory:0 maxmemory_human:0B maxmemory_policy:noeviction allocator_frag_ratio:1.13 allocator_frag_bytes:4301112 allocator_rss_ratio:1.12 allocator_rss_bytes:4161536 rss_overhead_ratio:0.29 rss_overhead_bytes:-28610560 mem_fragmentation_ratio:0.37 mem_fragmentation_bytes:-20113864 mem_not_counted_for_evict:0 mem_replication_backlog:0 mem_clients_slaves:0 mem_clients_normal:24847000 mem_aof_buffer:0 mem_allocator:jemalloc-5.1.0 active_defrag_running:0 lazyfree_pending_objects:0
Persistence
loading:0 rdb_changes_since_last_save:266718 rdb_bgsave_in_progress:0 rdb_last_save_time:1556255718 rdb_last_bgsave_status:ok rdb_last_bgsave_time_sec:0 rdb_current_bgsave_time_sec:-1 rdb_last_cow_size:0 aof_enabled:0 aof_rewrite_in_progress:0 aof_rewrite_scheduled:0 aof_last_rewrite_time_sec:-1 aof_current_rewrite_time_sec:-1 aof_last_bgrewrite_status:ok aof_last_write_status:ok aof_last_cow_size:0
Stats
total_connections_received:1301 total_commands_processed:11064944 instantaneous_ops_per_sec:54805 total_net_input_bytes:425288286 total_net_output_bytes:55322625 instantaneous_input_kbps:2056.73 instantaneous_output_kbps:267.63 rejected_connections:0 sync_full:0 sync_partial_ok:0 sync_partial_err:0 expired_keys:0 expired_stale_perc:0.00 expired_time_cap_reached_count:0 evicted_keys:0 keyspace_hits:0 keyspace_misses:10058167 pubsub_channels:0 pubsub_patterns:0 latest_fork_usec:6247 migrate_cached_sockets:0 slave_expires_tracked_keys:0 active_defrag_hits:0 active_defrag_misses:0 active_defrag_key_hits:0 active_defrag_key_misses:0
Replication
role:master connected_slaves:0 master_replid:1c2a763e3eba9495d16f6b4602da6500f8af8747 master_replid2:0000000000000000000000000000000000000000 master_repl_offset:0 second_repl_offset:-1 repl_backlog_active:0 repl_backlog_size:1048576 repl_backlog_first_byte_offset:0 repl_backlog_histlen:0
CPU
used_cpu_sys:153.066778 used_cpu_user:43.238355 used_cpu_sys_children:0.282169 used_cpu_user_children:0.025266
Commandstats
cmdstat_set:calls=1006777,usec=961505,usec_per_call=0.96 cmdstat_get:calls=10058167,usec=4159076,usec_per_call=0.41
Cluster
cluster_enabled:0
Keyspace
db0:keys=1024,expires=0,avg_ttl=0
------ CLIENT LIST OUTPUT ------ id=916 addr=192.168.130.126:51942 fd=120 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=917 addr=192.168.130.126:45351 fd=121 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=918 addr=192.168.130.126:63253 fd=122 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=919 addr=192.168.130.126:34475 fd=123 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=920 addr=192.168.130.126:50211 fd=124 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=921 addr=192.168.130.126:62445 fd=125 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=922 addr=192.168.130.126:58919 fd=126 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=923 addr=192.168.130.126:49814 fd=127 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=924 addr=192.168.130.126:58752 fd=128 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=925 addr=192.168.130.126:52207 fd=129 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=926 addr=192.168.130.126:65175 fd=130 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=927 addr=192.168.130.126:46295 fd=131 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=928 addr=192.168.130.126:50042 fd=132 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=929 addr=192.168.130.126:65074 fd=133 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=930 addr=192.168.130.126:36016 fd=134 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=931 addr=192.168.130.126:50808 fd=135 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=932 addr=192.168.130.126:57271 fd=136 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=933 addr=192.168.130.126:35517 fd=137 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=934 addr=192.168.130.126:64737 fd=138 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=935 addr=192.168.130.126:52276 fd=139 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=936 addr=192.168.130.126:43121 fd=140 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=937 addr=192.168.130.126:52224 fd=141 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=938 addr=192.168.130.126:50570 fd=142 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=939 addr=192.168.130.126:58747 fd=143 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=940 addr=192.168.130.126:61006 fd=144 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=941 addr=192.168.130.126:45897 fd=145 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=942 addr=192.168.130.126:35971 fd=146 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=943 addr=192.168.130.126:58895 fd=147 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=944 addr=192.168.130.126:45689 fd=148 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=945 addr=192.168.130.126:43640 fd=149 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=946 addr=192.168.130.126:56687 fd=150 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=947 addr=192.168.130.126:44401 fd=151 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=948 addr=192.168.130.126:48916 fd=152 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=949 addr=192.168.130.126:60767 fd=153 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=950 addr=192.168.130.126:32986 fd=154 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=951 addr=192.168.130.126:57707 fd=155 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=952 addr=192.168.130.126:40649 fd=156 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=953 addr=192.168.130.126:63792 fd=157 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=954 addr=192.168.130.126:45391 fd=158 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=955 addr=192.168.130.126:64879 fd=159 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=956 addr=192.168.130.126:51189 fd=160 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=957 addr=192.168.130.126:35916 fd=161 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=958 addr=192.168.130.126:36658 fd=162 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=959 addr=192.168.130.126:65045 fd=163 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=960 addr=192.168.130.126:59370 fd=164 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=961 addr=192.168.130.126:47964 fd=165 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=962 addr=192.168.130.126:59451 fd=166 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=963 addr=192.168.130.126:51759 fd=167 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=964 addr=192.168.130.126:40384 fd=168 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=965 addr=192.168.130.126:52659 fd=169 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=966 addr=192.168.130.126:43872 fd=170 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=967 addr=192.168.130.126:51982 fd=171 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=968 addr=192.168.130.126:45708 fd=172 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=969 addr=192.168.130.126:59415 fd=173 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=970 addr=192.168.130.126:40903 fd=174 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=971 addr=192.168.130.126:42731 fd=175 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=972 addr=192.168.130.126:44430 fd=176 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=973 addr=192.168.130.126:39173 fd=177 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=974 addr=192.168.130.126:59176 fd=178 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=975 addr=192.168.130.126:47671 fd=179 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=976 addr=192.168.130.126:50266 fd=180 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=977 addr=192.168.130.126:59704 fd=181 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=978 addr=192.168.130.126:59901 fd=182 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=979 addr=192.168.130.126:38845 fd=183 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=980 addr=192.168.130.126:40627 fd=184 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=981 addr=192.168.130.126:36866 fd=185 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=982 addr=192.168.130.126:45673 fd=186 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=983 addr=192.168.130.126:40498 fd=187 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=984 addr=192.168.130.126:52597 fd=188 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=985 addr=192.168.130.126:46937 fd=189 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=986 addr=192.168.130.126:40764 fd=190 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=987 addr=192.168.130.126:43309 fd=191 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=988 addr=192.168.130.126:36746 fd=192 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=989 addr=192.168.130.126:52436 fd=193 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=990 addr=192.168.130.126:60460 fd=194 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=991 addr=192.168.130.126:52385 fd=195 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=992 addr=192.168.130.126:39764 fd=196 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=993 addr=192.168.130.126:50789 fd=197 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=994 addr=192.168.130.126:47027 fd=198 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=995 addr=192.168.130.126:60740 fd=199 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=996 addr=192.168.130.126:54834 fd=200 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=997 addr=192.168.130.126:53976 fd=201 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=998 addr=192.168.130.126:50422 fd=202 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=999 addr=192.168.130.126:48965 fd=203 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1000 addr=192.168.130.126:50772 fd=204 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1001 addr=192.168.130.126:37480 fd=205 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1002 addr=192.168.130.126:48884 fd=206 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1003 addr=192.168.130.126:43648 fd=207 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1004 addr=192.168.130.126:52657 fd=208 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1005 addr=192.168.130.126:40714 fd=209 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1006 addr=192.168.130.126:48250 fd=210 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1007 addr=192.168.130.126:50564 fd=211 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1008 addr=192.168.130.126:35063 fd=212 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1009 addr=192.168.130.126:47813 fd=213 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1010 addr=192.168.130.126:33572 fd=214 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1011 addr=192.168.130.126:40238 fd=215 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1012 addr=192.168.130.126:58397 fd=216 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1013 addr=192.168.130.126:37472 fd=217 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1014 addr=192.168.130.126:52060 fd=218 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1015 addr=192.168.130.126:48649 fd=219 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1016 addr=192.168.130.126:64915 fd=220 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1017 addr=192.168.130.126:64086 fd=221 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1018 addr=192.168.130.126:49552 fd=222 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1019 addr=192.168.130.126:54962 fd=223 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1020 addr=192.168.130.126:63596 fd=224 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1021 addr=192.168.130.126:65223 fd=225 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1022 addr=192.168.130.126:57559 fd=226 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1023 addr=192.168.130.126:36906 fd=227 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1024 addr=192.168.130.126:53061 fd=228 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1025 addr=192.168.130.126:47724 fd=229 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1026 addr=192.168.130.126:64539 fd=230 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1027 addr=192.168.130.126:49618 fd=231 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1028 addr=192.168.130.126:50983 fd=232 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1029 addr=192.168.130.126:41360 fd=233 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1030 addr=192.168.130.126:43110 fd=234 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1031 addr=192.168.130.126:45049 fd=235 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1032 addr=192.168.130.126:59104 fd=236 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1033 addr=192.168.130.126:53486 fd=237 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1034 addr=192.168.130.126:53050 fd=238 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1035 addr=192.168.130.126:53659 fd=239 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1036 addr=192.168.130.126:55541 fd=240 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1037 addr=192.168.130.126:36942 fd=241 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1038 addr=192.168.130.126:38648 fd=242 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1039 addr=192.168.130.126:44899 fd=243 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1040 addr=192.168.130.126:37809 fd=244 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1041 addr=192.168.130.126:59599 fd=245 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1042 addr=192.168.130.126:63980 fd=246 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1043 addr=192.168.130.126:55421 fd=247 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1044 addr=192.168.130.126:39280 fd=248 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1045 addr=192.168.130.126:35717 fd=249 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1046 addr=192.168.130.126:52245 fd=250 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1047 addr=192.168.130.126:41866 fd=251 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1048 addr=192.168.130.126:48045 fd=252 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1049 addr=192.168.130.126:49082 fd=253 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1050 addr=192.168.130.126:58633 fd=254 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1051 addr=192.168.130.126:50143 fd=255 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1052 addr=192.168.130.126:63867 fd=256 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1053 addr=192.168.130.126:61232 fd=257 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1054 addr=192.168.130.126:43817 fd=258 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1055 addr=192.168.130.126:35878 fd=259 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1056 addr=192.168.130.126:62079 fd=260 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1057 addr=192.168.130.126:39028 fd=261 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1058 addr=192.168.130.126:50309 fd=262 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1059 addr=192.168.130.126:36989 fd=263 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1060 addr=192.168.130.126:40292 fd=264 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1061 addr=192.168.130.126:47464 fd=265 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1062 addr=192.168.130.126:44435 fd=266 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1063 addr=192.168.130.126:59820 fd=267 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1064 addr=192.168.130.126:34673 fd=268 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1065 addr=192.168.130.126:58302 fd=269 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1066 addr=192.168.130.126:64480 fd=270 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1067 addr=192.168.130.126:41025 fd=271 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1068 addr=192.168.130.126:46678 fd=272 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1069 addr=192.168.130.126:44587 fd=273 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1070 addr=192.168.130.126:40876 fd=274 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1071 addr=192.168.130.126:58345 fd=275 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1072 addr=192.168.130.126:55711 fd=276 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1073 addr=192.168.130.126:49608 fd=277 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1074 addr=192.168.130.126:44989 fd=278 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1075 addr=192.168.130.126:51969 fd=279 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1076 addr=192.168.130.126:56945 fd=280 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1077 addr=192.168.130.126:33401 fd=281 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1078 addr=192.168.130.126:59177 fd=282 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1079 addr=192.168.130.126:39759 fd=283 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1080 addr=192.168.130.126:57248 fd=284 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1081 addr=192.168.130.126:34298 fd=285 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1082 addr=192.168.130.126:53040 fd=286 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1083 addr=192.168.130.126:47472 fd=287 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1084 addr=192.168.130.126:64834 fd=288 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1085 addr=192.168.130.126:44012 fd=289 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1086 addr=192.168.130.126:54692 fd=290 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1275 addr=192.168.130.126:65395 fd=479 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=1276 addr=192.168.130.126:52999 fd=480 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=1277 addr=192.168.130.126:34835 fd=481 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=1278 addr=192.168.130.126:33328 fd=482 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=1279 addr=192.168.130.126:64103 fd=483 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=1280 addr=192.168.130.126:56726 fd=484 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=1281 addr=192.168.130.126:45292 fd=485 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=1282 addr=192.168.130.126:49955 fd=486 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=1283 addr=192.168.130.126:65019 fd=487 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=1284 addr=192.168.130.126:50430 fd=488 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=set id=1285 addr=192.168.130.126:57846 fd=489 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=1286 addr=192.168.130.126:44078 fd=490 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=1287 addr=192.168.130.126:48747 fd=491 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=1288 addr=192.168.130.126:46374 fd=492 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=1289 addr=192.168.130.126:52540 fd=493 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=1290 addr=192.168.130.126:39261 fd=494 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=1291 addr=192.168.130.126:37520 fd=495 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=1292 addr=192.168.130.126:62181 fd=496 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=1293 addr=192.168.130.126:55731 fd=497 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=1294 addr=192.168.130.126:39212 fd=498 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=1295 addr=192.168.130.126:57826 fd=499 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=1296 addr=192.168.130.126:57760 fd=500 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=1297 addr=192.168.130.126:35780 fd=501 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=1298 addr=192.168.130.126:45008 fd=502 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=set id=1299 addr=192.168.130.126:47367 fd=503 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=1300 addr=192.168.130.126:41504 fd=504 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=1301 addr=192.168.130.126:35035 fd=505 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=1302 addr=192.168.130.126:35536 fd=506 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=1303 addr=192.168.130.126:42769 fd=507 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=1087 addr=192.168.130.126:45444 fd=291 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1088 addr=192.168.130.126:39233 fd=292 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1089 addr=192.168.130.126:61965 fd=293 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1090 addr=192.168.130.126:51434 fd=294 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1091 addr=192.168.130.126:53092 fd=295 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1092 addr=192.168.130.126:58049 fd=296 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1093 addr=192.168.130.126:44341 fd=297 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1094 addr=192.168.130.126:64301 fd=298 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1095 addr=192.168.130.126:39946 fd=299 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1096 addr=192.168.130.126:55226 fd=300 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1097 addr=192.168.130.126:34847 fd=301 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1098 addr=192.168.130.126:35323 fd=302 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1099 addr=192.168.130.126:52780 fd=303 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1100 addr=192.168.130.126:59754 fd=304 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1101 addr=192.168.130.126:49219 fd=305 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1102 addr=192.168.130.126:53427 fd=306 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1103 addr=192.168.130.126:48080 fd=307 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1104 addr=192.168.130.126:33994 fd=308 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1105 addr=192.168.130.126:43101 fd=309 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1106 addr=192.168.130.126:56841 fd=310 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1107 addr=192.168.130.126:32925 fd=311 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1108 addr=192.168.130.126:48540 fd=312 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1109 addr=192.168.130.126:44907 fd=313 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1110 addr=192.168.130.126:41706 fd=314 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1111 addr=192.168.130.126:35278 fd=315 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1112 addr=192.168.130.126:42848 fd=316 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1113 addr=192.168.130.126:54624 fd=317 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1114 addr=192.168.130.126:50589 fd=318 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1115 addr=192.168.130.126:34294 fd=319 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1116 addr=192.168.130.126:40220 fd=320 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1117 addr=192.168.130.126:60696 fd=321 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1118 addr=192.168.130.126:59168 fd=322 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1119 addr=192.168.130.126:64431 fd=323 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1120 addr=192.168.130.126:49815 fd=324 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1121 addr=192.168.130.126:41892 fd=325 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1122 addr=192.168.130.126:36908 fd=326 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1123 addr=192.168.130.126:46384 fd=327 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1124 addr=192.168.130.126:61130 fd=328 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1125 addr=192.168.130.126:54922 fd=329 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1126 addr=192.168.130.126:53819 fd=330 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1127 addr=192.168.130.126:53956 fd=331 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1128 addr=192.168.130.126:46932 fd=332 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1129 addr=192.168.130.126:57075 fd=333 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1130 addr=192.168.130.126:62260 fd=334 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1131 addr=192.168.130.126:50553 fd=335 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1132 addr=192.168.130.126:35407 fd=336 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1133 addr=192.168.130.126:64516 fd=337 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1134 addr=192.168.130.126:53937 fd=338 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1135 addr=192.168.130.126:55972 fd=339 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1136 addr=192.168.130.126:45820 fd=340 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1137 addr=192.168.130.126:39102 fd=341 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1138 addr=192.168.130.126:40215 fd=342 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1139 addr=192.168.130.126:37319 fd=343 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1140 addr=192.168.130.126:55347 fd=344 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1141 addr=192.168.130.126:35234 fd=345 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1142 addr=192.168.130.126:42816 fd=346 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1143 addr=192.168.130.126:49737 fd=347 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1144 addr=192.168.130.126:49538 fd=348 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1145 addr=192.168.130.126:34103 fd=349 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1146 addr=192.168.130.126:32898 fd=350 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1147 addr=192.168.130.126:55816 fd=351 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1148 addr=192.168.130.126:61538 fd=352 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1149 addr=192.168.130.126:61004 fd=353 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1150 addr=192.168.130.126:59811 fd=354 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1151 addr=192.168.130.126:57333 fd=355 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1152 addr=192.168.130.126:34295 fd=356 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1153 addr=192.168.130.126:63811 fd=357 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1154 addr=192.168.130.126:47629 fd=358 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1155 addr=192.168.130.126:51186 fd=359 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1156 addr=192.168.130.126:56136 fd=360 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1157 addr=192.168.130.126:42745 fd=361 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1158 addr=192.168.130.126:54409 fd=362 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1159 addr=192.168.130.126:57340 fd=363 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1160 addr=192.168.130.126:53407 fd=364 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1161 addr=192.168.130.126:57000 fd=365 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1162 addr=192.168.130.126:42537 fd=366 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1163 addr=192.168.130.126:40591 fd=367 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1164 addr=192.168.130.126:60335 fd=368 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1165 addr=192.168.130.126:52116 fd=369 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1166 addr=192.168.130.126:59260 fd=370 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1167 addr=192.168.130.126:52208 fd=371 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1168 addr=192.168.130.126:57258 fd=372 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1169 addr=192.168.130.126:33754 fd=373 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1170 addr=192.168.130.126:43362 fd=374 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1171 addr=192.168.130.126:57702 fd=375 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1172 addr=192.168.130.126:53856 fd=376 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1173 addr=192.168.130.126:64796 fd=377 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1174 addr=192.168.130.126:34037 fd=378 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1175 addr=192.168.130.126:59447 fd=379 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1176 addr=192.168.130.126:46177 fd=380 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1177 addr=192.168.130.126:46862 fd=381 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1178 addr=192.168.130.126:45534 fd=382 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1179 addr=192.168.130.126:37755 fd=383 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1180 addr=192.168.130.126:43444 fd=384 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1181 addr=192.168.130.126:52610 fd=385 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1182 addr=192.168.130.126:36963 fd=386 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1183 addr=192.168.130.126:57371 fd=387 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1184 addr=192.168.130.126:43805 fd=388 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1185 addr=192.168.130.126:58139 fd=389 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1186 addr=192.168.130.126:45934 fd=390 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1187 addr=192.168.130.126:54077 fd=391 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1188 addr=192.168.130.126:41113 fd=392 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1189 addr=192.168.130.126:59663 fd=393 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1190 addr=192.168.130.126:55448 fd=394 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1191 addr=192.168.130.126:47693 fd=395 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1192 addr=192.168.130.126:62968 fd=396 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1193 addr=192.168.130.126:48498 fd=397 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1194 addr=192.168.130.126:46221 fd=398 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1195 addr=192.168.130.126:39079 fd=399 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1196 addr=192.168.130.126:38496 fd=400 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1197 addr=192.168.130.126:61404 fd=401 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1198 addr=192.168.130.126:33121 fd=402 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1199 addr=192.168.130.126:49238 fd=403 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1200 addr=192.168.130.126:64744 fd=404 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1201 addr=192.168.130.126:52336 fd=405 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1202 addr=192.168.130.126:39472 fd=406 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1203 addr=192.168.130.126:59743 fd=407 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1204 addr=192.168.130.126:63841 fd=408 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1205 addr=192.168.130.126:35413 fd=409 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1206 addr=192.168.130.126:46924 fd=410 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1207 addr=192.168.130.126:60191 fd=411 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1208 addr=192.168.130.126:49010 fd=412 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1209 addr=192.168.130.126:60180 fd=413 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1210 addr=192.168.130.126:56568 fd=414 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1211 addr=192.168.130.126:41854 fd=415 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1212 addr=192.168.130.126:46318 fd=416 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1213 addr=192.168.130.126:59652 fd=417 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1214 addr=192.168.130.126:36756 fd=418 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1215 addr=192.168.130.126:59997 fd=419 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1216 addr=192.168.130.126:34375 fd=420 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1217 addr=192.168.130.126:33489 fd=421 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1218 addr=192.168.130.126:41116 fd=422 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1219 addr=192.168.130.126:38817 fd=423 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1220 addr=192.168.130.126:62727 fd=424 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1221 addr=192.168.130.126:59878 fd=425 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1222 addr=192.168.130.126:33920 fd=426 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1223 addr=192.168.130.126:42840 fd=427 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1224 addr=192.168.130.126:58921 fd=428 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1225 addr=192.168.130.126:33044 fd=429 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1226 addr=192.168.130.126:51392 fd=430 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1227 addr=192.168.130.126:60748 fd=431 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1228 addr=192.168.130.126:54416 fd=432 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1229 addr=192.168.130.126:41316 fd=433 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1230 addr=192.168.130.126:33299 fd=434 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1231 addr=192.168.130.126:34863 fd=435 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1232 addr=192.168.130.126:50263 fd=436 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1233 addr=192.168.130.126:51564 fd=437 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1234 addr=192.168.130.126:42300 fd=438 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1235 addr=192.168.130.126:49442 fd=439 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1236 addr=192.168.130.126:49553 fd=440 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1237 addr=192.168.130.126:44064 fd=441 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1238 addr=192.168.130.126:33690 fd=442 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1239 addr=192.168.130.126:51909 fd=443 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1240 addr=192.168.130.126:56028 fd=444 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1241 addr=192.168.130.126:44728 fd=445 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1242 addr=192.168.130.126:37588 fd=446 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1243 addr=192.168.130.126:32891 fd=447 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1244 addr=192.168.130.126:48523 fd=448 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1245 addr=192.168.130.126:54804 fd=449 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1246 addr=192.168.130.126:53433 fd=450 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=1247 addr=192.168.130.126:38092 fd=451 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1248 addr=192.168.130.126:51879 fd=452 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1249 addr=192.168.130.126:33857 fd=453 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1250 addr=192.168.130.126:40279 fd=454 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1251 addr=192.168.130.126:54613 fd=455 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1252 addr=192.168.130.126:47638 fd=456 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1253 addr=192.168.130.126:33945 fd=457 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1254 addr=192.168.130.126:57598 fd=458 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1255 addr=192.168.130.126:50221 fd=459 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1256 addr=192.168.130.126:62602 fd=460 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1257 addr=192.168.130.126:62264 fd=461 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1258 addr=192.168.130.126:43632 fd=462 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1259 addr=192.168.130.126:40022 fd=463 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1260 addr=192.168.130.126:38042 fd=464 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1261 addr=192.168.130.126:34720 fd=465 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1262 addr=192.168.130.126:59244 fd=466 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1263 addr=192.168.130.126:49663 fd=467 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1264 addr=192.168.130.126:40687 fd=468 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1265 addr=192.168.130.126:61635 fd=469 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1266 addr=192.168.130.126:60321 fd=470 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1267 addr=192.168.130.126:64559 fd=471 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1268 addr=192.168.130.126:48936 fd=472 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1269 addr=192.168.130.126:50989 fd=473 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1270 addr=192.168.130.126:41692 fd=474 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1271 addr=192.168.130.126:36676 fd=475 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=1272 addr=192.168.130.126:63222 fd=476 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=74 qbuf-free=32694 obl=0 oll=0 omem=0 events=r cmd=set id=1273 addr=192.168.130.126:45153 fd=477 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=1274 addr=192.168.130.126:37363 fd=478 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=804 addr=192.168.130.126:61099 fd=8 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=805 addr=192.168.130.126:33426 fd=9 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=806 addr=192.168.130.126:51507 fd=10 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=807 addr=192.168.130.126:57119 fd=11 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=808 addr=192.168.130.126:46402 fd=12 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=809 addr=192.168.130.126:57361 fd=13 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=810 addr=192.168.130.126:56976 fd=14 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=811 addr=192.168.130.126:40138 fd=15 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=812 addr=192.168.130.126:35308 fd=16 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=813 addr=192.168.130.126:37856 fd=17 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=814 addr=192.168.130.126:43127 fd=18 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=set id=815 addr=192.168.130.126:58618 fd=19 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=816 addr=192.168.130.126:34764 fd=20 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=817 addr=192.168.130.126:65180 fd=21 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=818 addr=192.168.130.126:53692 fd=22 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=819 addr=192.168.130.126:54003 fd=23 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=820 addr=192.168.130.126:51579 fd=24 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=821 addr=192.168.130.126:42421 fd=25 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=822 addr=192.168.130.126:34901 fd=26 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=823 addr=192.168.130.126:48512 fd=27 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=824 addr=192.168.130.126:53571 fd=28 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=825 addr=192.168.130.126:59481 fd=29 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=826 addr=192.168.130.126:48746 fd=30 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=827 addr=192.168.130.126:62044 fd=31 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=828 addr=192.168.130.126:53043 fd=32 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=829 addr=192.168.130.126:57907 fd=33 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=830 addr=192.168.130.126:52947 fd=34 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=831 addr=192.168.130.126:43766 fd=35 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=832 addr=192.168.130.126:53235 fd=36 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=833 addr=192.168.130.126:56683 fd=37 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=834 addr=192.168.130.126:39937 fd=38 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=835 addr=192.168.130.126:33987 fd=39 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=836 addr=192.168.130.126:58036 fd=40 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=837 addr=192.168.130.126:63676 fd=41 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=838 addr=192.168.130.126:45511 fd=42 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=839 addr=192.168.130.126:65010 fd=43 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=840 addr=192.168.130.126:43657 fd=44 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=841 addr=192.168.130.126:39841 fd=45 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=842 addr=192.168.130.126:41531 fd=46 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=843 addr=192.168.130.126:53896 fd=47 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=set id=844 addr=192.168.130.126:56074 fd=48 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=845 addr=192.168.130.126:58067 fd=49 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=846 addr=192.168.130.126:36076 fd=50 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=847 addr=192.168.130.126:58422 fd=51 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=set id=848 addr=192.168.130.126:33065 fd=52 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=849 addr=192.168.130.126:60976 fd=53 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=850 addr=192.168.130.126:64848 fd=54 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=851 addr=192.168.130.126:54818 fd=55 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=852 addr=192.168.130.126:60118 fd=56 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=853 addr=192.168.130.126:35705 fd=57 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=854 addr=192.168.130.126:48058 fd=58 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=855 addr=192.168.130.126:38054 fd=59 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=856 addr=192.168.130.126:45427 fd=60 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=857 addr=192.168.130.126:42000 fd=61 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=858 addr=192.168.130.126:36486 fd=62 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=859 addr=192.168.130.126:63912 fd=63 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=860 addr=192.168.130.126:51716 fd=64 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=861 addr=192.168.130.126:35953 fd=65 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=set id=862 addr=192.168.130.126:61563 fd=66 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=863 addr=192.168.130.126:60843 fd=67 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=864 addr=192.168.130.126:62562 fd=68 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=865 addr=192.168.130.126:48176 fd=69 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=866 addr=192.168.130.126:51384 fd=70 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=867 addr=192.168.130.126:37943 fd=71 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=set id=868 addr=192.168.130.126:46414 fd=72 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=869 addr=192.168.130.126:52642 fd=73 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=870 addr=192.168.130.126:59269 fd=74 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=871 addr=192.168.130.126:62821 fd=75 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=872 addr=192.168.130.126:59008 fd=76 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=873 addr=192.168.130.126:34414 fd=77 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=874 addr=192.168.130.126:53328 fd=78 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=875 addr=192.168.130.126:65078 fd=79 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=876 addr=192.168.130.126:47329 fd=80 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=877 addr=192.168.130.126:49310 fd=81 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=878 addr=192.168.130.126:48890 fd=82 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=879 addr=192.168.130.126:64498 fd=83 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=880 addr=192.168.130.126:62993 fd=84 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=881 addr=192.168.130.126:58894 fd=85 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=882 addr=192.168.130.126:48701 fd=86 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=883 addr=192.168.130.126:46163 fd=87 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=884 addr=192.168.130.126:45782 fd=88 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=885 addr=192.168.130.126:58744 fd=89 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=886 addr=192.168.130.126:37519 fd=90 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=887 addr=192.168.130.126:64126 fd=91 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=888 addr=192.168.130.126:37522 fd=92 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=889 addr=192.168.130.126:55471 fd=93 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=890 addr=192.168.130.126:62035 fd=94 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=891 addr=192.168.130.126:45643 fd=95 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=892 addr=192.168.130.126:36489 fd=96 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=893 addr=192.168.130.126:41778 fd=97 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=894 addr=192.168.130.126:61817 fd=98 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=895 addr=192.168.130.126:52350 fd=99 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=896 addr=192.168.130.126:56515 fd=100 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=897 addr=192.168.130.126:39058 fd=101 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=898 addr=192.168.130.126:53650 fd=102 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=899 addr=192.168.130.126:61240 fd=103 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=900 addr=192.168.130.126:37623 fd=104 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=901 addr=192.168.130.126:52925 fd=105 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=902 addr=192.168.130.126:59883 fd=106 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=903 addr=192.168.130.126:32977 fd=107 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=904 addr=192.168.130.126:40690 fd=108 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=905 addr=192.168.130.126:41874 fd=109 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=906 addr=192.168.130.126:57636 fd=110 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=907 addr=192.168.130.126:52163 fd=111 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=908 addr=192.168.130.126:49479 fd=112 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=909 addr=192.168.130.126:39947 fd=113 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=910 addr=192.168.130.126:65379 fd=114 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=911 addr=192.168.130.126:52359 fd=115 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=912 addr=192.168.130.126:36125 fd=116 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=913 addr=192.168.130.126:35996 fd=117 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=914 addr=192.168.130.126:64309 fd=118 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=915 addr=192.168.130.126:65079 fd=119 name= age=88 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get
Comment From: Adel-Magebinary
This happened to me today. Can produce this with docker + memtier_benchmark-1.2.15
Command as below:
memtier_benchmark -s 192.168.130.125 -n 100001000 -t 10
Comment From: antirez
Adel please send more info about the exact setup and reproduction steps. Also make sure, if possible, to don't touch your setup so that you have a way to replicate it again! Thanks a lot.
On Fri, Apr 26, 2019 at 7:30 AM Adel Abula notifications@github.com wrote:
This happened to me today. Can produce this with docker + memtier_benchmark-1.2.15
Command as below:
memtier_benchmark -s 192.168.130.125 -n 100001000 -t 10
— You are receiving this because you were mentioned. Reply to this email directly, view it on GitHub, or mute the thread.
-- Salvatore 'antirez' Sanfilippo open source developer - Redis Labs https://redislabs.com
"If a system is to have conceptual integrity, someone must control the concepts." — Fred Brooks, "The Mythical Man-Month", 1975.
Comment From: Adel-Magebinary
Joyent Triton docker container with Alpine redis 5 from dockerhub.
=== REDIS BUG REPORT START: Cut & paste starting from here ===
1:M 26 Apr 2019 05:32:55.785 # Redis 5.0.4 crashed by signal: 11
1:M 26 Apr 2019 05:32:55.785 # Crashed running the instruction at: 0x7fffeee36502
1:M 26 Apr 2019 05:32:55.785 # Accessing address: 0x7fffeee36502
1:M 26 Apr 2019 05:32:55.785 # Failed assertion:
------ STACK TRACE ------ EIP: redis-server *:6379(dictAddRaw+0xb2)[0x7fffeee36502]
Backtrace: redis-server :6379(logStackTrace+0x37)[0x7fffeee7df87] redis-server :6379(sigsegvHandler+0xb0)[0x7fffeee7e6b0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x110e0)[0x7fffeda110e0] redis-server :6379(dictAddRaw+0xb2)[0x7fffeee36502] redis-server :6379(dictAdd+0x11)[0x7fffeee36661] redis-server :6379(dbAdd+0x25)[0x7fffeee51965] redis-server :6379(setKey+0x5d)[0x7fffeee51e3d] redis-server :6379(setGenericCommand+0xa4)[0x7fffeee5e174] redis-server :6379(setCommand+0xfa)[0x7fffeee5e38a] redis-server :6379(call+0xa7)[0x7fffeee3a6a7] redis-server :6379(processCommand+0x35f)[0x7fffeee3ad5f] redis-server :6379(processInputBuffer+0x185)[0x7fffeee4ae35] redis-server :6379(aeProcessEvents+0x2a0)[0x7fffeee34870] redis-server :6379(aeMain+0x2b)[0x7fffeee34b0b] redis-server :6379(main+0x4d3)[0x7fffeee31803] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0x7fffed6202e1] redis-server *:6379(_start+0x2a)[0x7fffeee31a6a]
------ INFO OUTPUT ------
Server
redis_version:5.0.4 redis_git_sha1:00000000 redis_git_dirty:0 redis_build_id:c6d7e1572d62bb79 redis_mode:standalone os:Linux 3.13.0 x86_64 arch_bits:64 multiplexing_api:epoll atomicvar_api:atomic-builtin gcc_version:6.3.0 process_id:1 run_id:fe52c23d4d4f69074bdf08196c1f1a77ff4946f2 tcp_port:6379 uptime_in_seconds:991 uptime_in_days:0 hz:10 configured_hz:10 lru_clock:12752903 executable:/data/redis-server config_file:
Clients
connected_clients:500 client_recent_max_input_buffer:2 client_recent_max_output_buffer:0 blocked_clients:0
Memory
used_memory:31986768 used_memory_human:30.50M used_memory_rss:19718144 used_memory_rss_human:18.80M used_memory_peak:622522880 used_memory_peak_human:593.68M used_memory_peak_perc:5.14% used_memory_overhead:25769104 used_memory_startup:791000 used_memory_dataset:6217664 used_memory_dataset_perc:19.93% allocator_allocated:31987224 allocator_active:37806080 allocator_resident:46813184 total_system_memory:8589934592 total_system_memory_human:8.00G used_memory_lua:37888 used_memory_lua_human:37.00K used_memory_scripts:0 used_memory_scripts_human:0B number_of_cached_scripts:0 maxmemory:0 maxmemory_human:0B maxmemory_policy:noeviction allocator_frag_ratio:1.18 allocator_frag_bytes:5818856 allocator_rss_ratio:1.24 allocator_rss_bytes:9007104 rss_overhead_ratio:0.42 rss_overhead_bytes:-27095040 mem_fragmentation_ratio:0.62 mem_fragmentation_bytes:-12235096 mem_not_counted_for_evict:0 mem_replication_backlog:0 mem_clients_slaves:0 mem_clients_normal:24847000 mem_aof_buffer:0 mem_allocator:jemalloc-5.1.0 active_defrag_running:0 lazyfree_pending_objects:0
Persistence
loading:0 rdb_changes_since_last_save:127553 rdb_bgsave_in_progress:0 rdb_last_save_time:1556256750 rdb_last_bgsave_status:ok rdb_last_bgsave_time_sec:0 rdb_current_bgsave_time_sec:-1 rdb_last_cow_size:0 aof_enabled:0 aof_rewrite_in_progress:0 aof_rewrite_scheduled:0 aof_last_rewrite_time_sec:-1 aof_current_rewrite_time_sec:-1 aof_last_bgrewrite_status:ok aof_last_write_status:ok aof_last_cow_size:0
Stats
total_connections_received:26000 total_commands_processed:32371988 instantaneous_ops_per_sec:55021 total_net_input_bytes:11352898481 total_net_output_bytes:161885120 instantaneous_input_kbps:2065.44 instantaneous_output_kbps:268.93 rejected_connections:0 sync_full:0 sync_partial_ok:0 sync_partial_err:0 expired_keys:0 expired_stale_perc:0.00 expired_time_cap_reached_count:0 evicted_keys:0 keyspace_hits:795 keyspace_misses:29416434 pubsub_channels:0 pubsub_patterns:0 latest_fork_usec:43237 migrate_cached_sockets:0 slave_expires_tracked_keys:0 active_defrag_hits:0 active_defrag_misses:0 active_defrag_key_hits:0 active_defrag_key_misses:0
Replication
role:master connected_slaves:0 master_replid:1a8e35687e6515df0be99b86b697f3b10cd1da1f master_replid2:0000000000000000000000000000000000000000 master_repl_offset:0 second_repl_offset:-1 repl_backlog_active:0 repl_backlog_size:1048576 repl_backlog_first_byte_offset:0 repl_backlog_histlen:0
CPU
used_cpu_sys:423.147199 used_cpu_user:139.825817 used_cpu_sys_children:0.342398 used_cpu_user_children:0.068536
Commandstats
cmdstat_set:calls=2954759,usec=3417574,usec_per_call=1.16 cmdstat_get:calls=29417229,usec=13783505,usec_per_call=0.47
Cluster
cluster_enabled:0
Keyspace
db0:keys=2048,expires=0,avg_ttl=0
------ CLIENT LIST OUTPUT ------ id=25641 addr=192.168.130.126:64183 fd=146 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25642 addr=192.168.130.126:49753 fd=147 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25643 addr=192.168.130.126:54843 fd=148 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25644 addr=192.168.130.126:48940 fd=149 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25645 addr=192.168.130.126:40873 fd=150 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=25646 addr=192.168.130.126:51221 fd=151 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25647 addr=192.168.130.126:41772 fd=152 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25648 addr=192.168.130.126:38429 fd=153 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=25649 addr=192.168.130.126:36784 fd=154 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25650 addr=192.168.130.126:43695 fd=155 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25651 addr=192.168.130.126:44283 fd=156 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25652 addr=192.168.130.126:62067 fd=157 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25653 addr=192.168.130.126:49403 fd=158 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=set id=25654 addr=192.168.130.126:50717 fd=159 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25655 addr=192.168.130.126:52887 fd=160 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25656 addr=192.168.130.126:38214 fd=161 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25657 addr=192.168.130.126:61491 fd=162 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25658 addr=192.168.130.126:35832 fd=163 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25659 addr=192.168.130.126:38312 fd=164 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25660 addr=192.168.130.126:41201 fd=165 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25661 addr=192.168.130.126:64602 fd=166 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25662 addr=192.168.130.126:40252 fd=167 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=25663 addr=192.168.130.126:37198 fd=168 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25664 addr=192.168.130.126:35461 fd=169 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25665 addr=192.168.130.126:64525 fd=170 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25666 addr=192.168.130.126:45767 fd=171 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25667 addr=192.168.130.126:39975 fd=172 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25668 addr=192.168.130.126:43081 fd=173 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25669 addr=192.168.130.126:50032 fd=174 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25670 addr=192.168.130.126:57406 fd=175 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25671 addr=192.168.130.126:34846 fd=176 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25672 addr=192.168.130.126:33954 fd=177 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25673 addr=192.168.130.126:33869 fd=178 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25674 addr=192.168.130.126:62835 fd=179 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25675 addr=192.168.130.126:38280 fd=180 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25676 addr=192.168.130.126:46239 fd=181 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25677 addr=192.168.130.126:48480 fd=182 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25678 addr=192.168.130.126:61657 fd=183 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25679 addr=192.168.130.126:60578 fd=184 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25680 addr=192.168.130.126:51940 fd=185 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25681 addr=192.168.130.126:62268 fd=186 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25682 addr=192.168.130.126:58018 fd=187 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25683 addr=192.168.130.126:45771 fd=188 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=25684 addr=192.168.130.126:63804 fd=189 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25685 addr=192.168.130.126:48653 fd=190 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25686 addr=192.168.130.126:52596 fd=191 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25687 addr=192.168.130.126:54862 fd=192 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25688 addr=192.168.130.126:43465 fd=193 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25689 addr=192.168.130.126:62172 fd=194 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25690 addr=192.168.130.126:33481 fd=195 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25691 addr=192.168.130.126:57660 fd=196 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25692 addr=192.168.130.126:42678 fd=197 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25693 addr=192.168.130.126:51746 fd=198 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25694 addr=192.168.130.126:36480 fd=199 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25695 addr=192.168.130.126:51796 fd=200 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25696 addr=192.168.130.126:49118 fd=201 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25697 addr=192.168.130.126:48913 fd=202 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25698 addr=192.168.130.126:53397 fd=203 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25699 addr=192.168.130.126:51897 fd=204 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25700 addr=192.168.130.126:50699 fd=205 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25701 addr=192.168.130.126:53247 fd=206 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=25702 addr=192.168.130.126:40989 fd=207 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25703 addr=192.168.130.126:47096 fd=208 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25704 addr=192.168.130.126:59534 fd=209 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25705 addr=192.168.130.126:37003 fd=210 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25706 addr=192.168.130.126:58669 fd=211 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25707 addr=192.168.130.126:39690 fd=212 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25708 addr=192.168.130.126:36117 fd=213 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25709 addr=192.168.130.126:42108 fd=214 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25710 addr=192.168.130.126:44381 fd=215 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25711 addr=192.168.130.126:41433 fd=216 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25712 addr=192.168.130.126:43187 fd=217 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25713 addr=192.168.130.126:35039 fd=218 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25714 addr=192.168.130.126:40483 fd=219 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25715 addr=192.168.130.126:58905 fd=220 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=25716 addr=192.168.130.126:59479 fd=221 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25717 addr=192.168.130.126:40202 fd=222 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25718 addr=192.168.130.126:36140 fd=223 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25719 addr=192.168.130.126:44671 fd=224 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25720 addr=192.168.130.126:61927 fd=225 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25721 addr=192.168.130.126:63378 fd=226 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25722 addr=192.168.130.126:46735 fd=227 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25723 addr=192.168.130.126:59716 fd=228 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25724 addr=192.168.130.126:63968 fd=229 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25725 addr=192.168.130.126:35734 fd=230 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25726 addr=192.168.130.126:45313 fd=231 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25727 addr=192.168.130.126:41104 fd=232 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25728 addr=192.168.130.126:50710 fd=233 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25729 addr=192.168.130.126:37696 fd=234 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25730 addr=192.168.130.126:38839 fd=235 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25731 addr=192.168.130.126:61090 fd=236 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25732 addr=192.168.130.126:50336 fd=237 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25733 addr=192.168.130.126:35209 fd=238 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25734 addr=192.168.130.126:61259 fd=239 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=25735 addr=192.168.130.126:38819 fd=240 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25736 addr=192.168.130.126:52662 fd=241 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25737 addr=192.168.130.126:55147 fd=242 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25738 addr=192.168.130.126:62114 fd=243 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25739 addr=192.168.130.126:60637 fd=244 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25740 addr=192.168.130.126:45749 fd=245 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25741 addr=192.168.130.126:46191 fd=246 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25742 addr=192.168.130.126:47931 fd=247 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25743 addr=192.168.130.126:32852 fd=248 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25744 addr=192.168.130.126:47179 fd=249 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25745 addr=192.168.130.126:62090 fd=250 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25746 addr=192.168.130.126:40959 fd=251 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25747 addr=192.168.130.126:46654 fd=252 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25748 addr=192.168.130.126:56810 fd=253 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25749 addr=192.168.130.126:51540 fd=254 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25750 addr=192.168.130.126:36606 fd=255 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25751 addr=192.168.130.126:35269 fd=256 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25752 addr=192.168.130.126:60592 fd=257 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25753 addr=192.168.130.126:32980 fd=258 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25754 addr=192.168.130.126:60744 fd=259 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25755 addr=192.168.130.126:54247 fd=260 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25756 addr=192.168.130.126:41180 fd=261 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25757 addr=192.168.130.126:43170 fd=262 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25758 addr=192.168.130.126:52900 fd=263 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25759 addr=192.168.130.126:38813 fd=264 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25760 addr=192.168.130.126:55094 fd=265 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25761 addr=192.168.130.126:55426 fd=266 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25762 addr=192.168.130.126:43049 fd=267 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25763 addr=192.168.130.126:41432 fd=268 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25764 addr=192.168.130.126:38734 fd=269 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25765 addr=192.168.130.126:56325 fd=270 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25766 addr=192.168.130.126:54082 fd=271 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25767 addr=192.168.130.126:62576 fd=272 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=25768 addr=192.168.130.126:51742 fd=273 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25769 addr=192.168.130.126:39510 fd=274 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25770 addr=192.168.130.126:47628 fd=275 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25771 addr=192.168.130.126:41710 fd=276 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25772 addr=192.168.130.126:48590 fd=277 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25773 addr=192.168.130.126:54761 fd=278 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25774 addr=192.168.130.126:51634 fd=279 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25775 addr=192.168.130.126:47997 fd=280 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25776 addr=192.168.130.126:45855 fd=281 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25777 addr=192.168.130.126:57099 fd=282 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25778 addr=192.168.130.126:38201 fd=283 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25779 addr=192.168.130.126:64481 fd=284 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=25780 addr=192.168.130.126:57530 fd=285 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25781 addr=192.168.130.126:55627 fd=286 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25782 addr=192.168.130.126:42797 fd=287 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25783 addr=192.168.130.126:32954 fd=288 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25784 addr=192.168.130.126:58807 fd=289 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25785 addr=192.168.130.126:50322 fd=290 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25786 addr=192.168.130.126:56777 fd=291 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25787 addr=192.168.130.126:40660 fd=292 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25788 addr=192.168.130.126:39034 fd=293 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25789 addr=192.168.130.126:51242 fd=294 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25790 addr=192.168.130.126:37504 fd=295 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25791 addr=192.168.130.126:65268 fd=296 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25792 addr=192.168.130.126:55643 fd=297 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25793 addr=192.168.130.126:61607 fd=298 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=25794 addr=192.168.130.126:45383 fd=299 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25795 addr=192.168.130.126:64729 fd=300 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25796 addr=192.168.130.126:55523 fd=301 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25797 addr=192.168.130.126:43045 fd=302 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25798 addr=192.168.130.126:47966 fd=303 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25799 addr=192.168.130.126:46235 fd=304 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25800 addr=192.168.130.126:52176 fd=305 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25801 addr=192.168.130.126:57579 fd=306 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25802 addr=192.168.130.126:45159 fd=307 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25803 addr=192.168.130.126:65261 fd=308 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25804 addr=192.168.130.126:54854 fd=309 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25805 addr=192.168.130.126:48925 fd=310 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25806 addr=192.168.130.126:59812 fd=311 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25807 addr=192.168.130.126:45511 fd=312 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25808 addr=192.168.130.126:65480 fd=313 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25809 addr=192.168.130.126:49836 fd=314 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=25810 addr=192.168.130.126:43147 fd=315 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25811 addr=192.168.130.126:60680 fd=316 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25812 addr=192.168.130.126:57269 fd=317 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25813 addr=192.168.130.126:51176 fd=319 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25814 addr=192.168.130.126:46866 fd=320 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25815 addr=192.168.130.126:52270 fd=321 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25816 addr=192.168.130.126:33927 fd=322 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25817 addr=192.168.130.126:54633 fd=323 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25818 addr=192.168.130.126:63056 fd=324 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25819 addr=192.168.130.126:36806 fd=325 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25820 addr=192.168.130.126:33719 fd=326 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25821 addr=192.168.130.126:48794 fd=327 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=25822 addr=192.168.130.126:45086 fd=328 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25823 addr=192.168.130.126:52048 fd=329 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=25824 addr=192.168.130.126:60779 fd=330 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25825 addr=192.168.130.126:56017 fd=331 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25826 addr=192.168.130.126:58074 fd=332 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25827 addr=192.168.130.126:57166 fd=333 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25828 addr=192.168.130.126:52613 fd=334 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25829 addr=192.168.130.126:51883 fd=335 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25830 addr=192.168.130.126:46466 fd=336 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25831 addr=192.168.130.126:50461 fd=337 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25832 addr=192.168.130.126:60132 fd=338 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25833 addr=192.168.130.126:38063 fd=339 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25834 addr=192.168.130.126:49087 fd=340 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=25835 addr=192.168.130.126:42943 fd=341 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25836 addr=192.168.130.126:53145 fd=342 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25837 addr=192.168.130.126:51870 fd=343 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25838 addr=192.168.130.126:35286 fd=344 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25839 addr=192.168.130.126:52329 fd=345 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25840 addr=192.168.130.126:32777 fd=346 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25841 addr=192.168.130.126:51272 fd=347 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25842 addr=192.168.130.126:33554 fd=348 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25843 addr=192.168.130.126:59871 fd=349 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25844 addr=192.168.130.126:60793 fd=350 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25845 addr=192.168.130.126:40308 fd=351 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25846 addr=192.168.130.126:59580 fd=352 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25847 addr=192.168.130.126:35224 fd=353 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25848 addr=192.168.130.126:60232 fd=354 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25849 addr=192.168.130.126:62173 fd=355 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25850 addr=192.168.130.126:58573 fd=357 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=25851 addr=192.168.130.126:46862 fd=358 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25852 addr=192.168.130.126:44884 fd=359 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25853 addr=192.168.130.126:45344 fd=360 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25854 addr=192.168.130.126:59314 fd=361 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25855 addr=192.168.130.126:54817 fd=362 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25856 addr=192.168.130.126:53895 fd=363 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25857 addr=192.168.130.126:52668 fd=364 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25858 addr=192.168.130.126:37113 fd=365 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25859 addr=192.168.130.126:38359 fd=366 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25860 addr=192.168.130.126:45773 fd=367 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25861 addr=192.168.130.126:36897 fd=368 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25862 addr=192.168.130.126:60088 fd=369 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25863 addr=192.168.130.126:64228 fd=370 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25864 addr=192.168.130.126:63876 fd=371 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25865 addr=192.168.130.126:48773 fd=372 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25866 addr=192.168.130.126:46215 fd=373 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25867 addr=192.168.130.126:42566 fd=374 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25868 addr=192.168.130.126:41614 fd=375 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25869 addr=192.168.130.126:46296 fd=376 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25870 addr=192.168.130.126:35821 fd=377 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25871 addr=192.168.130.126:58943 fd=378 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25872 addr=192.168.130.126:42074 fd=379 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25873 addr=192.168.130.126:49516 fd=380 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25874 addr=192.168.130.126:61881 fd=381 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25875 addr=192.168.130.126:44883 fd=382 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25876 addr=192.168.130.126:38823 fd=383 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25877 addr=192.168.130.126:61488 fd=384 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25878 addr=192.168.130.126:49366 fd=388 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=25879 addr=192.168.130.126:64863 fd=389 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25880 addr=192.168.130.126:48395 fd=391 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25881 addr=192.168.130.126:63935 fd=392 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25882 addr=192.168.130.126:64831 fd=393 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25883 addr=192.168.130.126:59623 fd=394 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25884 addr=192.168.130.126:33649 fd=395 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25885 addr=192.168.130.126:54581 fd=397 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25886 addr=192.168.130.126:47483 fd=398 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25887 addr=192.168.130.126:54374 fd=399 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25888 addr=192.168.130.126:47863 fd=400 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25889 addr=192.168.130.126:55837 fd=401 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25890 addr=192.168.130.126:63386 fd=402 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25891 addr=192.168.130.126:40761 fd=403 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25892 addr=192.168.130.126:46849 fd=404 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25893 addr=192.168.130.126:61433 fd=405 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25894 addr=192.168.130.126:35686 fd=406 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25895 addr=192.168.130.126:51113 fd=408 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25896 addr=192.168.130.126:33806 fd=409 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25918 addr=192.168.130.126:44046 fd=439 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25919 addr=192.168.130.126:37363 fd=440 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=25920 addr=192.168.130.126:55463 fd=442 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25921 addr=192.168.130.126:56613 fd=443 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25922 addr=192.168.130.126:38911 fd=444 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25923 addr=192.168.130.126:33123 fd=445 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25924 addr=192.168.130.126:35716 fd=446 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25925 addr=192.168.130.126:43584 fd=447 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25926 addr=192.168.130.126:60471 fd=448 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25927 addr=192.168.130.126:60136 fd=449 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25928 addr=192.168.130.126:63595 fd=450 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25929 addr=192.168.130.126:46453 fd=453 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25930 addr=192.168.130.126:36556 fd=454 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25931 addr=192.168.130.126:39305 fd=455 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25932 addr=192.168.130.126:35094 fd=456 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25933 addr=192.168.130.126:62137 fd=457 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25934 addr=192.168.130.126:35996 fd=458 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25935 addr=192.168.130.126:61423 fd=459 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=25936 addr=192.168.130.126:56358 fd=462 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25937 addr=192.168.130.126:53778 fd=463 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25938 addr=192.168.130.126:45251 fd=464 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25939 addr=192.168.130.126:50105 fd=465 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25940 addr=192.168.130.126:55221 fd=467 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25941 addr=192.168.130.126:36250 fd=468 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25942 addr=192.168.130.126:47883 fd=469 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25943 addr=192.168.130.126:60646 fd=470 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25944 addr=192.168.130.126:40318 fd=471 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=25945 addr=192.168.130.126:33644 fd=473 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25946 addr=192.168.130.126:41050 fd=474 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=74 qbuf-free=32694 obl=0 oll=0 omem=0 events=r cmd=set id=25947 addr=192.168.130.126:53467 fd=477 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25948 addr=192.168.130.126:54697 fd=478 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25949 addr=192.168.130.126:55986 fd=479 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25950 addr=192.168.130.126:34306 fd=480 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25951 addr=192.168.130.126:62520 fd=481 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25952 addr=192.168.130.126:49383 fd=482 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25953 addr=192.168.130.126:49894 fd=483 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25954 addr=192.168.130.126:57531 fd=484 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25955 addr=192.168.130.126:56159 fd=485 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25956 addr=192.168.130.126:48714 fd=487 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25957 addr=192.168.130.126:41694 fd=488 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25958 addr=192.168.130.126:61664 fd=489 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25959 addr=192.168.130.126:57131 fd=490 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25960 addr=192.168.130.126:55187 fd=494 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=set id=25961 addr=192.168.130.126:38281 fd=495 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25962 addr=192.168.130.126:43694 fd=499 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=set id=25963 addr=192.168.130.126:42714 fd=501 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25964 addr=192.168.130.126:39056 fd=502 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25965 addr=192.168.130.126:57454 fd=506 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25966 addr=192.168.130.126:35398 fd=508 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25967 addr=192.168.130.126:48864 fd=509 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25968 addr=192.168.130.126:49057 fd=511 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=set id=25969 addr=192.168.130.126:35736 fd=512 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25970 addr=192.168.130.126:34265 fd=514 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25971 addr=192.168.130.126:35157 fd=515 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25972 addr=192.168.130.126:62270 fd=516 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25973 addr=192.168.130.126:44674 fd=517 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25974 addr=192.168.130.126:50978 fd=518 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25975 addr=192.168.130.126:63130 fd=519 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25976 addr=192.168.130.126:45611 fd=520 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25977 addr=192.168.130.126:42898 fd=521 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25978 addr=192.168.130.126:50903 fd=523 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25979 addr=192.168.130.126:62103 fd=525 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25980 addr=192.168.130.126:42567 fd=527 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=set id=25981 addr=192.168.130.126:61517 fd=528 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25982 addr=192.168.130.126:38168 fd=529 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25983 addr=192.168.130.126:33335 fd=530 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25984 addr=192.168.130.126:65251 fd=532 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25985 addr=192.168.130.126:54130 fd=533 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25986 addr=192.168.130.126:60206 fd=534 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25987 addr=192.168.130.126:45954 fd=535 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25988 addr=192.168.130.126:32837 fd=537 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25989 addr=192.168.130.126:53891 fd=538 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25990 addr=192.168.130.126:45436 fd=540 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25991 addr=192.168.130.126:65338 fd=542 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25992 addr=192.168.130.126:51600 fd=543 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25993 addr=192.168.130.126:46376 fd=544 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=set id=25994 addr=192.168.130.126:44125 fd=545 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25995 addr=192.168.130.126:63393 fd=546 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25996 addr=192.168.130.126:55836 fd=547 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25997 addr=192.168.130.126:50587 fd=548 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25998 addr=192.168.130.126:60498 fd=549 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25999 addr=192.168.130.126:38379 fd=552 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=26000 addr=192.168.130.126:43054 fd=553 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=26001 addr=192.168.130.126:45692 fd=556 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=26002 addr=192.168.130.126:38713 fd=557 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25897 addr=192.168.130.126:50373 fd=410 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25898 addr=192.168.130.126:43504 fd=411 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25899 addr=192.168.130.126:36121 fd=412 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25900 addr=192.168.130.126:62497 fd=413 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25901 addr=192.168.130.126:44194 fd=414 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25902 addr=192.168.130.126:52237 fd=417 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25903 addr=192.168.130.126:60256 fd=418 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25904 addr=192.168.130.126:39954 fd=419 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25905 addr=192.168.130.126:35504 fd=420 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25906 addr=192.168.130.126:38446 fd=421 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25907 addr=192.168.130.126:47307 fd=422 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25908 addr=192.168.130.126:59833 fd=425 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25909 addr=192.168.130.126:48436 fd=427 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25910 addr=192.168.130.126:45076 fd=428 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25911 addr=192.168.130.126:65082 fd=429 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25912 addr=192.168.130.126:53080 fd=432 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25913 addr=192.168.130.126:54320 fd=433 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25914 addr=192.168.130.126:42377 fd=435 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25915 addr=192.168.130.126:43255 fd=436 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=25916 addr=192.168.130.126:63106 fd=437 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=25917 addr=192.168.130.126:36683 fd=438 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25503 addr=192.168.130.126:59203 fd=8 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25504 addr=192.168.130.126:36229 fd=9 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25505 addr=192.168.130.126:48025 fd=10 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25506 addr=192.168.130.126:37641 fd=11 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25507 addr=192.168.130.126:54314 fd=12 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=set id=25508 addr=192.168.130.126:64401 fd=13 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25509 addr=192.168.130.126:35672 fd=14 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25510 addr=192.168.130.126:57742 fd=15 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25511 addr=192.168.130.126:49629 fd=16 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25512 addr=192.168.130.126:49127 fd=17 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25513 addr=192.168.130.126:37402 fd=18 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25514 addr=192.168.130.126:56123 fd=19 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25515 addr=192.168.130.126:57511 fd=20 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25516 addr=192.168.130.126:49663 fd=21 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25517 addr=192.168.130.126:40643 fd=22 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25518 addr=192.168.130.126:40499 fd=23 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25519 addr=192.168.130.126:43416 fd=24 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25520 addr=192.168.130.126:43852 fd=25 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25521 addr=192.168.130.126:32964 fd=26 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25522 addr=192.168.130.126:56766 fd=27 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25523 addr=192.168.130.126:42093 fd=28 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25524 addr=192.168.130.126:40266 fd=29 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25525 addr=192.168.130.126:61788 fd=30 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25526 addr=192.168.130.126:33194 fd=31 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25527 addr=192.168.130.126:46925 fd=32 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25528 addr=192.168.130.126:45482 fd=33 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25529 addr=192.168.130.126:64122 fd=34 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25530 addr=192.168.130.126:50536 fd=35 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25531 addr=192.168.130.126:44053 fd=36 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25532 addr=192.168.130.126:41716 fd=37 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25533 addr=192.168.130.126:51844 fd=38 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25534 addr=192.168.130.126:42148 fd=39 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25535 addr=192.168.130.126:34687 fd=40 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25536 addr=192.168.130.126:64654 fd=41 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25537 addr=192.168.130.126:44208 fd=42 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25538 addr=192.168.130.126:39380 fd=43 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25539 addr=192.168.130.126:51352 fd=44 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25540 addr=192.168.130.126:36462 fd=45 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25541 addr=192.168.130.126:63587 fd=46 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25542 addr=192.168.130.126:44772 fd=47 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25543 addr=192.168.130.126:63864 fd=48 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25544 addr=192.168.130.126:55102 fd=49 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25545 addr=192.168.130.126:62121 fd=50 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25546 addr=192.168.130.126:55268 fd=51 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25547 addr=192.168.130.126:50733 fd=52 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25548 addr=192.168.130.126:60732 fd=53 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25549 addr=192.168.130.126:51217 fd=54 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25550 addr=192.168.130.126:47353 fd=55 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25551 addr=192.168.130.126:45321 fd=56 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25552 addr=192.168.130.126:55406 fd=57 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25553 addr=192.168.130.126:52612 fd=58 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25554 addr=192.168.130.126:45536 fd=59 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25555 addr=192.168.130.126:50016 fd=60 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25556 addr=192.168.130.126:37996 fd=61 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25557 addr=192.168.130.126:56646 fd=62 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=25558 addr=192.168.130.126:38039 fd=63 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25559 addr=192.168.130.126:52635 fd=64 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25560 addr=192.168.130.126:57626 fd=65 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25561 addr=192.168.130.126:62015 fd=66 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25562 addr=192.168.130.126:42702 fd=67 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25563 addr=192.168.130.126:64092 fd=68 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25564 addr=192.168.130.126:35469 fd=69 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25565 addr=192.168.130.126:59643 fd=70 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25566 addr=192.168.130.126:62167 fd=71 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=set id=25567 addr=192.168.130.126:64285 fd=72 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25568 addr=192.168.130.126:34065 fd=73 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25569 addr=192.168.130.126:64793 fd=74 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25570 addr=192.168.130.126:41297 fd=75 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25571 addr=192.168.130.126:54342 fd=76 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25572 addr=192.168.130.126:58042 fd=77 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25573 addr=192.168.130.126:64391 fd=78 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25574 addr=192.168.130.126:61200 fd=79 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25575 addr=192.168.130.126:61432 fd=80 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25576 addr=192.168.130.126:49536 fd=81 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25577 addr=192.168.130.126:42932 fd=82 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25578 addr=192.168.130.126:61122 fd=83 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25579 addr=192.168.130.126:42355 fd=84 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25580 addr=192.168.130.126:49029 fd=85 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25581 addr=192.168.130.126:47846 fd=86 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25582 addr=192.168.130.126:41381 fd=87 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25583 addr=192.168.130.126:59388 fd=88 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25584 addr=192.168.130.126:42300 fd=89 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25585 addr=192.168.130.126:56858 fd=90 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25586 addr=192.168.130.126:56161 fd=91 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25587 addr=192.168.130.126:43596 fd=92 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25588 addr=192.168.130.126:55352 fd=93 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=set id=25589 addr=192.168.130.126:38513 fd=94 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25590 addr=192.168.130.126:54401 fd=95 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25591 addr=192.168.130.126:45941 fd=96 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25592 addr=192.168.130.126:45929 fd=97 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25593 addr=192.168.130.126:62077 fd=98 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25594 addr=192.168.130.126:40084 fd=99 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25595 addr=192.168.130.126:49447 fd=100 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25596 addr=192.168.130.126:53802 fd=101 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25597 addr=192.168.130.126:54283 fd=102 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25598 addr=192.168.130.126:63963 fd=103 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25599 addr=192.168.130.126:44935 fd=104 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25600 addr=192.168.130.126:58017 fd=105 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25601 addr=192.168.130.126:64606 fd=106 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25602 addr=192.168.130.126:50075 fd=107 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=set id=25603 addr=192.168.130.126:44726 fd=108 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25604 addr=192.168.130.126:46062 fd=109 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25605 addr=192.168.130.126:49128 fd=110 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25606 addr=192.168.130.126:58571 fd=111 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25607 addr=192.168.130.126:48322 fd=112 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25608 addr=192.168.130.126:36481 fd=113 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25609 addr=192.168.130.126:40784 fd=114 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=set id=25610 addr=192.168.130.126:45017 fd=115 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25611 addr=192.168.130.126:58646 fd=116 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25612 addr=192.168.130.126:36437 fd=117 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25613 addr=192.168.130.126:37142 fd=118 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=set id=25614 addr=192.168.130.126:38220 fd=119 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25615 addr=192.168.130.126:46889 fd=120 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25616 addr=192.168.130.126:53746 fd=121 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25617 addr=192.168.130.126:38517 fd=122 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25618 addr=192.168.130.126:49016 fd=123 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25619 addr=192.168.130.126:61951 fd=124 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25620 addr=192.168.130.126:49930 fd=125 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25621 addr=192.168.130.126:47660 fd=126 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=set id=25622 addr=192.168.130.126:43354 fd=127 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25623 addr=192.168.130.126:55702 fd=128 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25624 addr=192.168.130.126:53048 fd=129 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=set id=25625 addr=192.168.130.126:41310 fd=130 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25626 addr=192.168.130.126:48343 fd=131 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25627 addr=192.168.130.126:51620 fd=132 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25628 addr=192.168.130.126:58509 fd=133 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25629 addr=192.168.130.126:54628 fd=134 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25630 addr=192.168.130.126:64607 fd=135 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25631 addr=192.168.130.126:41878 fd=136 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25632 addr=192.168.130.126:49471 fd=137 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=5 oll=0 omem=0 events=r cmd=get id=25633 addr=192.168.130.126:36330 fd=138 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25634 addr=192.168.130.126:57383 fd=139 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25635 addr=192.168.130.126:59567 fd=140 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25636 addr=192.168.130.126:58854 fd=141 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25637 addr=192.168.130.126:41894 fd=142 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25638 addr=192.168.130.126:39429 fd=143 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25639 addr=192.168.130.126:53154 fd=144 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get id=25640 addr=192.168.130.126:41533 fd=145 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=get
------ CURRENT CLIENT INFO ------ id=25946 addr=192.168.130.126:41050 fd=474 name= age=166 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=74 qbuf-free=32694 obl=0 oll=0 omem=0 events=r cmd=set argv[0]: 'SET' argv[1]: 'memtier-4429492' argv[2]: 'xxxxxxxxxxxxxxxxxxxxxxxxxxxxxxxx' 1:C 26 Apr 2019 05:33:11.749 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo 1:C 26 Apr 2019 05:33:11.750 # Redis version=5.0.4, bits=64, commit=00000000, modified=0, pid=1, just started 1:C 26 Apr 2019 05:33:11.750 # Warning: no config file specified, using the default config. In order to specify a config file use redis-server /path/to/redis.conf 1:M 26 Apr 2019 05:33:11.754 * Running mode=standalone, port=6379. 1:M 26 Apr 2019 05:33:11.754 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128. 1:M 26 Apr 2019 05:33:11.754 # Server initialized 1:M 26 Apr 2019 05:33:11.754 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect. 1:M 26 Apr 2019 05:33:11.758 * DB loaded from disk: 0.004 seconds 1:M 26 Apr 2019 05:33:11.758 * Ready to accept connections 1:M 26 Apr 2019 05:37:40.633 * 10000 changes in 60 seconds. Saving... 1:M 26 Apr 2019 05:37:40.638 * Background saving started by pid 290920 290920:C 26 Apr 2019 05:37:40.650 * DB saved on disk 1:M 26 Apr 2019 05:37:40.739 * Background saving terminated with success 1:M 26 Apr 2019 05:38:41.044 * 10000 changes in 60 seconds. Saving... 1:M 26 Apr 2019 05:38:41.048 * Background saving started by pid 291070 291070:C 26 Apr 2019 05:38:41.062 * DB saved on disk 1:M 26 Apr 2019 05:38:41.152 * Background saving terminated with success 1:M 26 Apr 2019 05:39:42.091 * 10000 changes in 60 seconds. Saving... 1:M 26 Apr 2019 05:39:42.095 * Background saving started by pid 291389 291389:C 26 Apr 2019 05:39:42.108 * DB saved on disk 1:M 26 Apr 2019 05:39:42.198 * Background saving terminated with success 1:M 26 Apr 2019 05:40:43.091 * 10000 changes in 60 seconds. Saving... 1:M 26 Apr 2019 05:40:43.095 * Background saving started by pid 291564 291564:C 26 Apr 2019 05:40:43.108 * DB saved on disk 1:M 26 Apr 2019 05:40:43.197 * Background saving terminated with success 1:M 26 Apr 2019 05:41:44.095 * 10000 changes in 60 seconds. Saving... 1:M 26 Apr 2019 05:41:44.099 * Background saving started by pid 291696 291696:C 26 Apr 2019 05:41:44.112 * DB saved on disk 1:M 26 Apr 2019 05:41:44.203 * Background saving terminated with success 1:M 26 Apr 2019 05:42:45.093 * 10000 changes in 60 seconds. Saving... 1:M 26 Apr 2019 05:42:45.098 * Background saving started by pid 291833 291833:C 26 Apr 2019 05:42:45.117 * DB saved on disk 1:M 26 Apr 2019 05:42:45.203 * Background saving terminated with success 1:M 26 Apr 2019 05:43:46.030 * 10000 changes in 60 seconds. Saving... 1:M 26 Apr 2019 05:43:46.035 * Background saving started by pid 291987 291987:C 26 Apr 2019 05:43:46.056 * DB saved on disk 1:M 26 Apr 2019 05:43:46.141 * Background saving terminated with success 1:M 26 Apr 2019 05:44:47.068 * 10000 changes in 60 seconds. Saving... 1:M 26 Apr 2019 05:44:47.072 * Background saving started by pid 292125 292125:C 26 Apr 2019 05:44:47.096 * DB saved on disk 1:M 26 Apr 2019 05:44:47.172 * Background saving terminated with success 1:M 26 Apr 2019 05:45:48.076 * 10000 changes in 60 seconds. Saving... 1:M 26 Apr 2019 05:45:48.081 * Background saving started by pid 292286 292286:C 26 Apr 2019 05:45:48.105 * DB saved on disk 1:M 26 Apr 2019 05:45:48.185 * Background saving terminated with success 1:M 26 Apr 2019 05:46:49.100 * 10000 changes in 60 seconds. Saving... 1:M 26 Apr 2019 05:46:49.105 * Background saving started by pid 292429 292429:C 26 Apr 2019 05:46:49.129 * DB saved on disk 1:M 26 Apr 2019 05:46:49.212 * Background saving terminated with success
Comment From: antirez
@itamarhaber may I ask you some help in reproducing this in some Redis Labs EC2 instance? I can jump into once we have a way to reproduce of course. That would be super helpful. Thanks!
Comment From: itamarhaber
@antirez on it.
Comment From: itamarhaber
So. Firstly, the OP's crash and the recent crash do not look the same.
That said, I tried reproducing using memtier on a freshly minted EC2 instance, both against a locally-made Redis as well as against the Alpine docker hub image (although for some reason my containers INFO build id is different - "e0bf1ed947563972").
Could not reproduce after running for a while or even after 42 runs (42 = 26000 / (10 threads * 50 conn). That number is funny, sure, but also kind of weird in this context.
@Adel-Magebinary are there any more details you can share with regards to reproducing this?
Comment From: antirez
Thanks @itamarhaber, yes the look different but they are both inexplicable and both in the operation of setting keys. Since my guess about this bug is that it's not a dict, nor a rax bug actually, but something else in the cluster that corrupts the memory layout, they may be the same thing actually. Btw thank you a ton for trying, let's hope @Adel-Magebinary may help us to reproduce.
Comment From: itamarhaber
@antirez any time - my pleasure, I take it very personally when Redis crashes :P
Comment From: antirez
@Adel-Magebinary any help on that? Your setup seems much more reproducible than @roychen25 so your help would be really important here. Thanks!
Comment From: Adel-Magebinary
@antirez , I believe the easiest way to reproduce this is to sign up for the Triton cloud services. Then launch a redis alpine docker container. Then pressure test it with the tool that I mentioned above.
memtier_benchmark -s 192.168.130.125 -n 100001000 -t 10
Mainly the triton runs illumos (solaris) + zfs + linux lcx containers.
Comment From: Adel-Magebinary
=== REDIS BUG REPORT START: Cut & paste starting from here ===
1:M 27 May 2019 23:23:49.909 # Redis 5.0.4 crashed by signal: 11
1:M 27 May 2019 23:23:49.909 # Crashed running the instruction at: 0x7fffeee36502
1:M 27 May 2019 23:23:49.909 # Accessing address: 0x7fffeee36502
1:M 27 May 2019 23:23:49.909 # Failed assertion:
------ STACK TRACE ------ EIP: redis-server *:6379(dictAddRaw+0xb2)[0x7fffeee36502]
Backtrace: redis-server :6379(logStackTrace+0x37)[0x7fffeee7df87] redis-server :6379(sigsegvHandler+0xb0)[0x7fffeee7e6b0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x110e0)[0x7fffeda110e0] redis-server :6379(dictAddRaw+0xb2)[0x7fffeee36502] redis-server :6379(setTypeAdd+0xd6)[0x7fffeee61866] redis-server :6379(saddCommand+0x65)[0x7fffeee61995] redis-server :6379(call+0xa7)[0x7fffeee3a6a7] redis-server :6379(execCommand+0xf8)[0x7fffeee7b688] redis-server :6379(call+0xa7)[0x7fffeee3a6a7] redis-server :6379(processCommand+0x35f)[0x7fffeee3ad5f] redis-server :6379(processInputBuffer+0x185)[0x7fffeee4ae35] redis-server :6379(aeProcessEvents+0x2a0)[0x7fffeee34870] redis-server :6379(aeMain+0x2b)[0x7fffeee34b0b] redis-server :6379(main+0x4d3)[0x7fffeee31803] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0x7fffed6202e1] redis-server :6379(_start+0x2a)[0x7fffeee31a6a]
------ INFO OUTPUT ------
Server
redis_version:5.0.4 redis_git_sha1:00000000 redis_git_dirty:0 redis_build_id:c6d7e1572d62bb79 redis_mode:standalone os:Linux 3.13.0 x86_64 arch_bits:64 multiplexing_api:epoll atomicvar_api:atomic-builtin gcc_version:6.3.0 process_id:1 run_id:603eee21a61bd05020097bc0db1f151eaee570cc tcp_port:6379 uptime_in_seconds:30 uptime_in_days:0 hz:10 configured_hz:10 lru_clock:15495557 executable:/data/redis-server config_file:
Clients
connected_clients:4 client_recent_max_input_buffer:2 client_recent_max_output_buffer:0 blocked_clients:0
Memory
used_memory:140279568 used_memory_human:133.78M used_memory_rss:147709952 used_memory_rss_human:140.87M used_memory_peak:140279568 used_memory_peak_human:133.78M used_memory_peak_perc:100.00% used_memory_overhead:3641932 used_memory_startup:792024 used_memory_dataset:136637636 used_memory_dataset_perc:97.96% allocator_allocated:140290080 allocator_active:142974976 allocator_resident:148856832 total_system_memory:8589934592 total_system_memory_human:8.00G used_memory_lua:37888 used_memory_lua_human:37.00K used_memory_scripts:0 used_memory_scripts_human:0B number_of_cached_scripts:0 maxmemory:0 maxmemory_human:0B maxmemory_policy:noeviction allocator_frag_ratio:1.02 allocator_frag_bytes:2684896 allocator_rss_ratio:1.04 allocator_rss_bytes:5881856 rss_overhead_ratio:0.99 rss_overhead_bytes:-1146880 mem_fragmentation_ratio:1.06 mem_fragmentation_bytes:7713256 mem_not_counted_for_evict:0 mem_replication_backlog:0 mem_clients_slaves:0 mem_clients_normal:100460 mem_aof_buffer:0 mem_allocator:jemalloc-5.1.0 active_defrag_running:0 lazyfree_pending_objects:0
Persistence
loading:0 rdb_changes_since_last_save:4073 rdb_bgsave_in_progress:0 rdb_last_save_time:1558999399 rdb_last_bgsave_status:ok rdb_last_bgsave_time_sec:-1 rdb_current_bgsave_time_sec:-1 rdb_last_cow_size:0 aof_enabled:0 aof_rewrite_in_progress:0 aof_rewrite_scheduled:0 aof_last_rewrite_time_sec:-1 aof_current_rewrite_time_sec:-1 aof_last_bgrewrite_status:ok aof_last_write_status:ok aof_last_cow_size:0
Stats
total_connections_received:199 total_commands_processed:17440 instantaneous_ops_per_sec:224 total_net_input_bytes:2580906 total_net_output_bytes:84529711 instantaneous_input_kbps:17.80 instantaneous_output_kbps:2133.92 rejected_connections:0 sync_full:0 sync_partial_ok:0 sync_partial_err:0 expired_keys:8 expired_stale_perc:0.00 expired_time_cap_reached_count:0 evicted_keys:0 keyspace_hits:11919 keyspace_misses:554 pubsub_channels:0 pubsub_patterns:0 latest_fork_usec:0 migrate_cached_sockets:0 slave_expires_tracked_keys:0 active_defrag_hits:0 active_defrag_misses:0 active_defrag_key_hits:0 active_defrag_key_misses:0
Replication
role:master connected_slaves:0 master_replid:ae23e6ead753ad35440d7306d0b3785214fa9a29 master_replid2:0000000000000000000000000000000000000000 master_repl_offset:0 second_repl_offset:-1 repl_backlog_active:0 repl_backlog_size:1048576 repl_backlog_first_byte_offset:0 repl_backlog_histlen:0
CPU
used_cpu_sys:0.979594 used_cpu_user:1.263154 used_cpu_sys_children:0.246232 used_cpu_user_children:0.010404
Commandstats
cmdstat_expire:calls=410,usec=808,usec_per_call=1.97 cmdstat_hmset:calls=447,usec=4517,usec_per_call=10.11 cmdstat_select:calls=381,usec=448,usec_per_call=1.18 cmdstat_exec:calls=264,usec=15079,usec_per_call=57.12 cmdstat_sadd:calls=3012,usec=9407,usec_per_call=3.12 cmdstat_multi:calls=265,usec=155,usec_per_call=0.58 cmdstat_hmget:calls=92,usec=361,usec_per_call=3.92 cmdstat_hget:calls=12381,usec=71439,usec_per_call=5.77 cmdstat_hincrby:calls=188,usec=963,usec_per_call=5.12
Cluster
cluster_enabled:0
Keyspace
db1:keys=38257,expires=16844,avg_ttl=4744612 db2:keys=312,expires=312,avg_ttl=445744462 db4:keys=4,expires=4,avg_ttl=24701065475
------ CLIENT LIST OUTPUT ------ id=197 addr=192.168.130.76:48956 fd=16 name= age=1 idle=1 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=expire id=198 addr=192.168.130.76:48585 fd=8 name= age=0 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=hget id=199 addr=192.168.130.76:49101 fd=9 name= age=0 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=expire id=196 addr=192.168.130.76:63497 fd=15 name= age=1 idle=0 flags=x db=1 sub=0 psub=0 multi=16 qbuf=6271 qbuf-free=26497 obl=167 oll=0 omem=0 events=r cmd=exec
------ CURRENT CLIENT INFO ------ id=196 addr=192.168.130.76:63497 fd=15 name= age=1 idle=0 flags=x db=1 sub=0 psub=0 multi=16 qbuf=6271 qbuf-free=26497 obl=167 oll=0 omem=0 events=r cmd=exec argv[0]: 'sadd' argv[1]: 'zc:ti:b49_BLOCK_HTML' argv[2]: 'b49_BLOCK_71326F61CCDF1357C94DE1961E34A3CC4D63A2AB_42861' 1:M 27 May 2019 23:23:49.911 # key 'zc:ti:b49_BLOCK_HTML' found in DB containing the following object: 1:M 27 May 2019 23:23:49.911 # Object type: 2 1:M 27 May 2019 23:23:49.911 # Object encoding: 2 1:M 27 May 2019 23:23:49.911 # Object refcount: 1 1:M 27 May 2019 23:23:49.911 # Set size: 16384
------ REGISTERS ------ 1:M 27 May 2019 23:23:49.911 # RAX:00007fffe17aeb80 RBX:00007fffe1571e03 RCX:0000000000000045 RDX:ffffffffffffffc8 RDI:00007fffe1571e3b RSI:00007fffe54cd47b RBP:47e4397a73f25277 RSP:00007fffffeff810 R8 :0000000000000038 R9 :00007fffece09000 R10:0000000000000000 R11:00007fffed76a060 R12:0000000000000000 R13:00007fffe544f890 R14:00000000000046ab R15:00007fffe544f860 RIP:00007fffeee36502 EFL:0000000000010206 CSGSFS:004b000000000053 1:M 27 May 2019 23:23:49.911 # (00007fffffeff81f) -> 0000000000000002 1:M 27 May 2019 23:23:49.911 # (00007fffffeff81e) -> 000000000000000f 1:M 27 May 2019 23:23:49.911 # (00007fffffeff81d) -> 000589e6d7398bd9 1:M 27 May 2019 23:23:49.911 # (00007fffffeff81c) -> 0000000000200008 1:M 27 May 2019 23:23:49.911 # (00007fffffeff81b) -> 00007fffeee61866 1:M 27 May 2019 23:23:49.911 # (00007fffffeff81a) -> 000000000000000f 1:M 27 May 2019 23:23:49.911 # (00007fffffeff819) -> 00007fffe5428bd0 1:M 27 May 2019 23:23:49.911 # (00007fffffeff818) -> 0000000000000000 1:M 27 May 2019 23:23:49.911 # (00007fffffeff817) -> 00007fffe1571e03 1:M 27 May 2019 23:23:49.911 # (00007fffffeff816) -> 0000000000000010 1:M 27 May 2019 23:23:49.911 # (00007fffffeff815) -> 00007fffe544f860 1:M 27 May 2019 23:23:49.911 # (00007fffffeff814) -> 000000000000000f 1:M 27 May 2019 23:23:49.911 # (00007fffffeff813) -> 00007fffe544f870 1:M 27 May 2019 23:23:49.911 # (00007fffffeff812) -> 00007fffe544f8b0 1:M 27 May 2019 23:23:49.911 # (00007fffffeff811) -> 0000000000023558 1:M 27 May 2019 23:23:49.911 # (00007fffffeff810) -> 96beed197775c6ab
------ FAST MEMORY TEST ------ *** Preparing to test memory region 1000 (135168 bytes) *** Preparing to test memory region 7fffde200000 (29360128 bytes) *** Preparing to test memory region 7fffe0000000 (25165824 bytes) *** Preparing to test memory region 7fffe1a00000 (20971520 bytes) *** Preparing to test memory region 7fffe3000000 (16777216 bytes) *** Preparing to test memory region 7fffe4200000 (14680064 bytes) *** Preparing to test memory region 7fffe5200000 (12582912 bytes) *** Preparing to test memory region 7fffe6000000 (10485760 bytes) *** Preparing to test memory region 7fffe6c00000 (8388608 bytes) *** Preparing to test memory region 7fffe7600000 (7340032 bytes) *** Preparing to test memory region 7fffe7e00000 (6291456 bytes) *** Preparing to test memory region 7fffe8600000 (5242880 bytes) *** Preparing to test memory region 7fffe8c00000 (4194304 bytes) *** Preparing to test memory region 7fffe9200000 (3670016 bytes) *** Preparing to test memory region 7fffe9600000 (3145728 bytes) *** Preparing to test memory region 7fffe9a00000 (2621440 bytes) *** Preparing to test memory region 7fffe9e01000 (2088960 bytes) *** Preparing to test memory region 7fffeac01000 (2088960 bytes) *** Preparing to test memory region 7fffeba01000 (2088960 bytes) *** Preparing to test memory region 7fffec800000 (4194304 bytes) *** Preparing to test memory region 7fffece00000 (2097152 bytes) *** Preparing to test memory region 7fffed200000 (2097152 bytes) *** Preparing to test memory region 7fffed99b000 (16384 bytes) *** Preparing to test memory region 7fffedc19000 (16384 bytes) *** Preparing to test memory region 7fffeeb5e000 (262144 bytes) *** Preparing to test memory region 7fffeeb9f000 (262144 bytes) *** Preparing to test memory region 7fffeebe0000 (4096 bytes) *** Preparing to test memory region 7fffeebf0000 (65536 bytes) *** Preparing to test memory region 7fffeec10000 (65536 bytes) *** Preparing to test memory region 7fffeec25000 (4096 bytes) *** Preparing to test memory region 7fffeec3e000 (131072 bytes) *** Preparing to test memory region 7fffeec5f000 (262144 bytes) *** Preparing to test memory region 7fffeeca0000 (16384 bytes) *** Preparing to test memory region 7fffeecb0000 (8192 bytes) *** Preparing to test memory region 7fffeecc0000 (8192 bytes) *** Preparing to test memory region 7fffeecdf000 (262144 bytes) *** Preparing to test memory region 7fffeed20000 (4096 bytes) *** Preparing to test memory region 7fffeed30000 (24576 bytes) *** Preparing to test memory region 7fffeedd7000 (32768 bytes) *** Preparing to test memory region 7fffeede0000 (4096 bytes) *** Preparing to test memory region 7fffeedf0000 (4096 bytes) *** Preparing to test memory region 7fffeefe0000 (4096 bytes) *** Preparing to test memory region 7fffeeff0000 (4096 bytes) *** Preparing to test memory region 7fffef1a1000 (16384 bytes) *** Preparing to test memory region 7fffef1b3000 (2248704 bytes) *** Preparing to test memory region 7fffef3ea000 (4096 bytes) *** Preparing to test memory region 7fffef420000 (4096 bytes) *** Preparing to test memory region 7fffef430000 (4096 bytes) *** Preparing to test memory region 7fffef440000 (4096 bytes) *** Preparing to test memory region 7fffef450000 (4096 bytes) *** Preparing to test memory region 7fffef4ca000 (8192 bytes) *** Preparing to test memory region 7fffef4fe000 (4096 bytes) *** Preparing to test memory region 7fffffefd000 (12288 bytes) .O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O Fast memory test PASSED, however your memory can still be broken. Please run a memory test for several hours if possible.
------ DUMPING CODE AROUND EIP ------ Symbol: dictAddRaw (base: 0x7fffeee36450) Module: redis-server *:6379 (base 0x7fffeee00000) $ xxd -r -p /tmp/dump.hex /tmp/dump.bin $ objdump --adjust-vma=0x7fffeee36450 -D -b binary -m i386:x86-64 /tmp/dump.bin
1:M 27 May 2019 23:23:50.963 # dump of function (hexdump of 306 bytes): 415741564989ff415541544989d455534889f34883ec2848837f50ff740b48837f58000f8467010000498b074889dfff104d85e448890424740849c704240000000049837f50ff0f8493000000498d471048894424184989c5498d475048894424104c8b34244d2375104a8d04f5000000004889442408498b45004a8b2cf04885ed752ee9870000000f1f8000000000498b07488b40184885c0740d498b7f084889deffd085c07512488b6d104885ed745e488b55004839d375d54d85e4740449892c244531ed4883c4284c89e85b5d415c415d415e415fc30f1f8000000000498b4f184885c90f85b300000049837f280477d0be040000004c89ffe8dff8ffff83f8010f8543ffffffebb80f1f400049837f50ff0f84c80000004983c5204c396c24100f8538ffffff4983feff74944d8d
=== REDIS BUG REPORT END. Make sure to include from START to END. ===
Please report the crash by opening an issue on github:
http://github.com/antirez/redis/issues
Suspect RAM error? Use redis-server --test-memory to verify it.
1:C 27 May 2019 23:24:03.477 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo 1:C 27 May 2019 23:24:03.477 # Redis version=5.0.4, bits=64, commit=00000000, modified=0, pid=1, just started 1:C 27 May 2019 23:24:03.477 # Warning: no config file specified, using the default config. In order to specify a config file use redis-server /path/to/redis.conf 1:M 27 May 2019 23:24:03.482 * Running mode=standalone, port=6379. 1:M 27 May 2019 23:24:03.482 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128. 1:M 27 May 2019 23:24:03.482 # Server initialized 1:M 27 May 2019 23:24:03.482 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect. 1:M 27 May 2019 23:24:04.479 * DB loaded from disk: 0.997 seconds 1:M 27 May 2019 23:24:04.479 * Ready to accept connections
=== REDIS BUG REPORT START: Cut & paste starting from here ===
1:M 27 May 2019 23:25:00.193 # Redis 5.0.4 crashed by signal: 11
1:M 27 May 2019 23:25:00.193 # Crashed running the instruction at: 0x7fffeee36502
1:M 27 May 2019 23:25:00.193 # Accessing address: 0x7fffeee36502
1:M 27 May 2019 23:25:00.193 # Failed assertion:
------ STACK TRACE ------ EIP: redis-server *:6379(dictAddRaw+0xb2)[0x7fffeee36502]
Backtrace: redis-server :6379(logStackTrace+0x37)[0x7fffeee7df87] redis-server :6379(sigsegvHandler+0xb0)[0x7fffeee7e6b0] /lib/x86_64-linux-gnu/libpthread.so.0(+0x110e0)[0x7fffeda110e0] redis-server :6379(dictAddRaw+0xb2)[0x7fffeee36502] redis-server :6379(setTypeAdd+0xd6)[0x7fffeee61866] redis-server :6379(saddCommand+0x65)[0x7fffeee61995] redis-server :6379(call+0xa7)[0x7fffeee3a6a7] redis-server :6379(execCommand+0xf8)[0x7fffeee7b688] redis-server :6379(call+0xa7)[0x7fffeee3a6a7] redis-server :6379(processCommand+0x35f)[0x7fffeee3ad5f] redis-server :6379(processInputBuffer+0x185)[0x7fffeee4ae35] redis-server :6379(aeProcessEvents+0x2a0)[0x7fffeee34870] redis-server :6379(aeMain+0x2b)[0x7fffeee34b0b] redis-server :6379(main+0x4d3)[0x7fffeee31803] /lib/x86_64-linux-gnu/libc.so.6(__libc_start_main+0xf1)[0x7fffed6202e1] redis-server :6379(_start+0x2a)[0x7fffeee31a6a]
------ INFO OUTPUT ------
Server
redis_version:5.0.4 redis_git_sha1:00000000 redis_git_dirty:0 redis_build_id:c6d7e1572d62bb79 redis_mode:standalone os:Linux 3.13.0 x86_64 arch_bits:64 multiplexing_api:epoll atomicvar_api:atomic-builtin gcc_version:6.3.0 process_id:1 run_id:74e2453a7fb4ad6ec3da46edf030cf0a1758d144 tcp_port:6379 uptime_in_seconds:57 uptime_in_days:0 hz:10 configured_hz:10 lru_clock:15495628 executable:/data/redis-server config_file:
Clients
connected_clients:6 client_recent_max_input_buffer:2 client_recent_max_output_buffer:0 blocked_clients:0
Memory
used_memory:141915912 used_memory_human:135.34M used_memory_rss:149082112 used_memory_rss_human:142.18M used_memory_peak:141915912 used_memory_peak_human:135.34M used_memory_peak_perc:100.22% used_memory_overhead:3789452 used_memory_startup:791000 used_memory_dataset:138126460 used_memory_dataset_perc:97.88% allocator_allocated:141787400 allocator_active:144470016 allocator_resident:150237184 total_system_memory:8589934592 total_system_memory_human:8.00G used_memory_lua:37888 used_memory_lua_human:37.00K used_memory_scripts:0 used_memory_scripts_human:0B number_of_cached_scripts:0 maxmemory:0 maxmemory_human:0B maxmemory_policy:noeviction allocator_frag_ratio:1.02 allocator_frag_bytes:2682616 allocator_rss_ratio:1.04 allocator_rss_bytes:5767168 rss_overhead_ratio:0.99 rss_overhead_bytes:-1155072 mem_fragmentation_ratio:1.05 mem_fragmentation_bytes:7570480 mem_not_counted_for_evict:0 mem_replication_backlog:0 mem_clients_slaves:0 mem_clients_normal:232620 mem_aof_buffer:0 mem_allocator:jemalloc-5.1.0 active_defrag_running:0 lazyfree_pending_objects:0
Persistence
loading:0 rdb_changes_since_last_save:7155 rdb_bgsave_in_progress:0 rdb_last_save_time:1558999443 rdb_last_bgsave_status:ok rdb_last_bgsave_time_sec:-1 rdb_current_bgsave_time_sec:-1 rdb_last_cow_size:0 aof_enabled:0 aof_rewrite_in_progress:0 aof_rewrite_scheduled:0 aof_last_rewrite_time_sec:-1 aof_current_rewrite_time_sec:-1 aof_last_bgrewrite_status:ok aof_last_write_status:ok aof_last_cow_size:0
Stats
total_connections_received:387 total_commands_processed:31128 instantaneous_ops_per_sec:522 total_net_input_bytes:4549028 total_net_output_bytes:161712490 instantaneous_input_kbps:58.44 instantaneous_output_kbps:3851.19 rejected_connections:0 sync_full:0 sync_partial_ok:0 sync_partial_err:0 expired_keys:16 expired_stale_perc:0.13 expired_time_cap_reached_count:0 evicted_keys:0 keyspace_hits:21214 keyspace_misses:1067 pubsub_channels:0 pubsub_patterns:0 latest_fork_usec:0 migrate_cached_sockets:0 slave_expires_tracked_keys:0 active_defrag_hits:0 active_defrag_misses:0 active_defrag_key_hits:0 active_defrag_key_misses:0
Replication
role:master connected_slaves:0 master_replid:23cb2e0f06529091bbf2d175b6e19a6cc3c776d2 master_replid2:0000000000000000000000000000000000000000 master_repl_offset:0 second_repl_offset:-1 repl_backlog_active:0 repl_backlog_size:1048576 repl_backlog_first_byte_offset:0 repl_backlog_histlen:0
CPU
used_cpu_sys:1.458115 used_cpu_user:1.360852 used_cpu_sys_children:0.254460 used_cpu_user_children:0.012355
Commandstats
cmdstat_sadd:calls=5076,usec=16846,usec_per_call=3.32 cmdstat_hincrby:calls=381,usec=1845,usec_per_call=4.84 cmdstat_hmset:calls=864,usec=7631,usec_per_call=8.83 cmdstat_hget:calls=22101,usec=128717,usec_per_call=5.82 cmdstat_expire:calls=770,usec=1502,usec_per_call=1.95 cmdstat_multi:calls=507,usec=394,usec_per_call=0.78 cmdstat_exec:calls=506,usec=27095,usec_per_call=53.55 cmdstat_select:calls=743,usec=817,usec_per_call=1.10 cmdstat_hmget:calls=180,usec=750,usec_per_call=4.17
Cluster
cluster_enabled:0
Keyspace
db1:keys=38546,expires=17029,avg_ttl=4853176 db2:keys=318,expires=318,avg_ttl=351730798 db4:keys=4,expires=4,avg_ttl=24700991647
------ CLIENT LIST OUTPUT ------ id=385 addr=192.168.130.76:40894 fd=12 name= age=1 idle=0 flags=x db=1 sub=0 psub=0 multi=11 qbuf=1400 qbuf-free=31368 obl=118 oll=0 omem=0 events=r cmd=exec id=386 addr=192.168.130.76:37134 fd=13 name= age=1 idle=1 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=expire id=373 addr=192.168.130.76:65010 fd=10 name= age=2 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=hget id=374 addr=192.168.130.76:55564 fd=11 name= age=2 idle=2 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=expire id=388 addr=192.168.130.76:57014 fd=8 name= age=0 idle=0 flags=N db=1 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=hget id=389 addr=192.168.130.76:35379 fd=9 name= age=0 idle=0 flags=N db=2 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=expire
------ CURRENT CLIENT INFO ------ id=385 addr=192.168.130.76:40894 fd=12 name= age=1 idle=0 flags=x db=1 sub=0 psub=0 multi=11 qbuf=1400 qbuf-free=31368 obl=118 oll=0 omem=0 events=r cmd=exec argv[0]: 'sadd' argv[1]: 'zc:tags' argv[2]: 'b49_BLOCK_HTML' argv[3]: 'b49_CAT_P_62711' argv[4]: 'b49_CAT_P' argv[5]: 'b49_CAT_P_62707' argv[6]: 'b49_CAT_P_62708' argv[7]: 'b49_CAT_P_62709' argv[8]: 'b49_CAT_P_62710' argv[9]: 'b49_MAGE' 1:M 27 May 2019 23:25:00.195 # key 'zc:tags' found in DB containing the following object: 1:M 27 May 2019 23:25:00.195 # Object type: 2 1:M 27 May 2019 23:25:00.195 # Object encoding: 2 1:M 27 May 2019 23:25:00.195 # Object refcount: 1 1:M 27 May 2019 23:25:00.195 # Set size: 16384
------ REGISTERS ------ 1:M 27 May 2019 23:25:00.195 # RAX:00007fffde3c4140 RBX:00007fffe209c31b RCX:096ef444709a0457 RDX:2953c32caa06b144 RDI:0000000000000050 RSI:699bae29f6bc7854 RBP:c590bfca785bf34a RSP:00007fffffeff810 R8 :00007fffeef6f390 R9 :5f5441435f393462 R10:00007fffe209c323 R11:0000000000000007 R12:0000000000000000 R13:00007fffe1eda870 R14:0000000000003513 R15:00007fffe1eda840 RIP:00007fffeee36502 EFL:0000000000010282 CSGSFS:004b000000000053 1:M 27 May 2019 23:25:00.195 # (00007fffffeff81f) -> 0000000000000003 1:M 27 May 2019 23:25:00.196 # (00007fffffeff81e) -> 000000000000000f 1:M 27 May 2019 23:25:00.196 # (00007fffffeff81d) -> 000589e6db69ffc5 1:M 27 May 2019 23:25:00.196 # (00007fffffeff81c) -> 0000000000200008 1:M 27 May 2019 23:25:00.196 # (00007fffffeff81b) -> 00007fffeee61866 1:M 27 May 2019 23:25:00.196 # (00007fffffeff81a) -> 000000000000000f 1:M 27 May 2019 23:25:00.196 # (00007fffffeff819) -> 00007fffe2012870 1:M 27 May 2019 23:25:00.196 # (00007fffffeff818) -> 0000000000000000 1:M 27 May 2019 23:25:00.196 # (00007fffffeff817) -> 00007fffe209c31b 1:M 27 May 2019 23:25:00.196 # (00007fffffeff816) -> 0000000000000018 1:M 27 May 2019 23:25:00.196 # (00007fffffeff815) -> 00007fffe1eda840 1:M 27 May 2019 23:25:00.196 # (00007fffffeff814) -> 000000000000000f 1:M 27 May 2019 23:25:00.196 # (00007fffffeff813) -> 00007fffe1eda850 1:M 27 May 2019 23:25:00.196 # (00007fffffeff812) -> 00007fffe1eda890 1:M 27 May 2019 23:25:00.196 # (00007fffffeff811) -> 000000000001a898 1:M 27 May 2019 23:25:00.196 # (00007fffffeff810) -> 203d3768da9cb513
------ FAST MEMORY TEST ------ *** Preparing to test memory region 1000 (135168 bytes) *** Preparing to test memory region 7fffde200000 (29360128 bytes) *** Preparing to test memory region 7fffe0000000 (25165824 bytes) *** Preparing to test memory region 7fffe1a00000 (20971520 bytes) *** Preparing to test memory region 7fffe3000000 (16777216 bytes) *** Preparing to test memory region 7fffe4200000 (14680064 bytes) *** Preparing to test memory region 7fffe5200000 (12582912 bytes) *** Preparing to test memory region 7fffe6000000 (10485760 bytes) *** Preparing to test memory region 7fffe6c00000 (8388608 bytes) *** Preparing to test memory region 7fffe7600000 (7340032 bytes) *** Preparing to test memory region 7fffe7e00000 (6291456 bytes) *** Preparing to test memory region 7fffe8600000 (5242880 bytes) *** Preparing to test memory region 7fffe8c00000 (4194304 bytes) *** Preparing to test memory region 7fffe9200000 (3670016 bytes) *** Preparing to test memory region 7fffe9600000 (3145728 bytes) *** Preparing to test memory region 7fffe9a00000 (2621440 bytes) *** Preparing to test memory region 7fffe9e01000 (2088960 bytes) *** Preparing to test memory region 7fffeac01000 (2088960 bytes) *** Preparing to test memory region 7fffeba01000 (2088960 bytes) *** Preparing to test memory region 7fffec800000 (4194304 bytes) *** Preparing to test memory region 7fffece00000 (2097152 bytes) *** Preparing to test memory region 7fffed200000 (2097152 bytes) *** Preparing to test memory region 7fffed99b000 (16384 bytes) *** Preparing to test memory region 7fffedc19000 (16384 bytes) *** Preparing to test memory region 7fffeeb5e000 (262144 bytes) *** Preparing to test memory region 7fffeeb9f000 (262144 bytes) *** Preparing to test memory region 7fffeebe0000 (4096 bytes) *** Preparing to test memory region 7fffeebf0000 (65536 bytes) *** Preparing to test memory region 7fffeec10000 (65536 bytes) *** Preparing to test memory region 7fffeec25000 (4096 bytes) *** Preparing to test memory region 7fffeec3e000 (131072 bytes) *** Preparing to test memory region 7fffeec5f000 (262144 bytes) *** Preparing to test memory region 7fffeeca0000 (16384 bytes) *** Preparing to test memory region 7fffeecb0000 (8192 bytes) *** Preparing to test memory region 7fffeecc0000 (8192 bytes) *** Preparing to test memory region 7fffeecdf000 (262144 bytes) *** Preparing to test memory region 7fffeed20000 (4096 bytes) *** Preparing to test memory region 7fffeed24000 (4096 bytes) *** Preparing to test memory region 7fffeed30000 (24576 bytes) *** Preparing to test memory region 7fffeedd7000 (32768 bytes) *** Preparing to test memory region 7fffeede0000 (4096 bytes) *** Preparing to test memory region 7fffeedf0000 (4096 bytes) *** Preparing to test memory region 7fffeefe0000 (4096 bytes) *** Preparing to test memory region 7fffeeff0000 (4096 bytes) *** Preparing to test memory region 7fffef1a1000 (16384 bytes) *** Preparing to test memory region 7fffef1b3000 (2248704 bytes) *** Preparing to test memory region 7fffef420000 (4096 bytes) *** Preparing to test memory region 7fffef430000 (4096 bytes) *** Preparing to test memory region 7fffef440000 (4096 bytes) *** Preparing to test memory region 7fffef450000 (4096 bytes) *** Preparing to test memory region 7fffef4ca000 (8192 bytes) *** Preparing to test memory region 7fffef4fe000 (4096 bytes) *** Preparing to test memory region 7fffffefd000 (12288 bytes) .O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O.O Fast memory test PASSED, however your memory can still be broken. Please run a memory test for several hours if possible.
------ DUMPING CODE AROUND EIP ------ Symbol: dictAddRaw (base: 0x7fffeee36450) Module: redis-server *:6379 (base 0x7fffeee00000) $ xxd -r -p /tmp/dump.hex /tmp/dump.bin $ objdump --adjust-vma=0x7fffeee36450 -D -b binary -m i386:x86-64 /tmp/dump.bin
1:M 27 May 2019 23:25:01.271 # dump of function (hexdump of 306 bytes): 415741564989ff415541544989d455534889f34883ec2848837f50ff740b48837f58000f8467010000498b074889dfff104d85e448890424740849c704240000000049837f50ff0f8493000000498d471048894424184989c5498d475048894424104c8b34244d2375104a8d04f5000000004889442408498b45004a8b2cf04885ed752ee9870000000f1f8000000000498b07488b40184885c0740d498b7f084889deffd085c07512488b6d104885ed745e488b55004839d375d54d85e4740449892c244531ed4883c4284c89e85b5d415c415d415e415fc30f1f8000000000498b4f184885c90f85b300000049837f280477d0be040000004c89ffe8dff8ffff83f8010f8543ffffffebb80f1f400049837f50ff0f84c80000004983c5204c396c24100f8538ffffff4983feff74944d8d
=== REDIS BUG REPORT END. Make sure to include from START to END. ===
Please report the crash by opening an issue on github:
http://github.com/antirez/redis/issues
Suspect RAM error? Use redis-server --test-memory to verify it.
1:C 27 May 2019 23:25:14.029 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo 1:C 27 May 2019 23:25:14.029 # Redis version=5.0.4, bits=64, commit=00000000, modified=0, pid=1, just started 1:C 27 May 2019 23:25:14.029 # Warning: no config file specified, using the default config. In order to specify a config file use redis-server /path/to/redis.conf 1:M 27 May 2019 23:25:14.034 * Running mode=standalone, port=6379. 1:M 27 May 2019 23:25:14.034 # WARNING: The TCP backlog setting of 511 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128. 1:M 27 May 2019 23:25:14.034 # Server initialized 1:M 27 May 2019 23:25:14.034 # WARNING overcommit_memory is set to 0! Background save may fail under low memory condition. To fix this issue add 'vm.overcommit_memory = 1' to /etc/sysctl.conf and then reboot or run the command 'sysctl vm.overcommit_memory=1' for this to take effect.
Comment From: gripleaf
Hi guys, I may reproduce this crash. I use follow way to reproduce crash every time.
I suspect the problem lies in the cleanup between two consecutive failovers. When first failover didn't finished, the second failover is coming, redis may not do cleanup well before it process the second failover.
here is my reproduce way: 1. take three redis node (A, B, C). 2. first make A be master, B and C replicate A. 3. write almost 900MB data into redis node. (more data is easily to reproduce). 4. force failover B, wait A and C full sync with B. 5. to make sure C full resync quicker than A, I gdb attach A until C finished. 6. watch at A's log, once A print "Loading DB in memory", send force failover to C. 7. A will full resync with C again, once it flush old data, it crash.
follow is my origin redis log in my production env which help me find out the way to reproduce crash.
23197:M 02 Jun 15:21:36.671 # CONFIG REWRITE executed with success.
23197:M 02 Jun 15:25:18.934 * Slave 10.11.200.212:30001 asks for synchronization
23197:M 02 Jun 15:25:18.934 * Partial resynchronization not accepted: Replication ID mismatch (Slave asked for '17c34c39a5adf9f123397ba0b6b5446b58b670e0', my replication IDs are '71902be604d5d75ed624a7c321433cba3606af60' and '0000000000000000000000000000000000000000')
23197:M 02 Jun 15:25:18.934 * Starting BGSAVE for SYNC with target: disk
23197:M 02 Jun 15:25:18.956 * Background saving started by pid 11491
23197:M 02 Jun 15:25:57.150 # Failover auth denied to f91002501a996f7f00681c07417595893e7fb2b7: its master is up
23197:M 02 Jun 15:25:57.153 # Failover auth denied to 02d282b66c8cf211fa4b1b1e83568851674f75cd: its master is up
23197:M 02 Jun 15:25:57.157 * FAIL message received from fda3f8758feba67538428e9fbfd647449bbf2c7c about 88dc03d91b8fa42312217d329ca130d861b09589
23197:M 02 Jun 15:25:57.157 * FAIL message received from fda3f8758feba67538428e9fbfd647449bbf2c7c about bf86d443e73df5bec5d3279021be2354984a6fb9
23197:M 02 Jun 15:25:57.185 # Failover auth granted to ca10590ff55ccf0353b9e4a193493a96a34395f8 for epoch 7681
23197:M 02 Jun 15:25:57.198 * FAIL message received from 12942055f75ed135ba5295b20d0b46fc0587d304 about 05b5b1082c78b9b9f1de29db36942153031885ad
23197:M 02 Jun 15:25:57.199 # Failover auth denied to d2bb821ec754ec78061f80030d40eef260b46017: reqEpoch (7680) < curEpoch(7681)
11491:C 02 Jun 15:25:59.394 * DB saved on disk
11491:C 02 Jun 15:25:59.440 * RDB: 411 MB of memory used by copy-on-write
23197:M 02 Jun 15:25:59.581 * FAIL message received from d2bb821ec754ec78061f80030d40eef260b46017 about c7f6be51284b6d52a09b88760173993f0f499513
23197:M 02 Jun 15:25:59.667 # Failover auth denied to 0977eda9598c0b5e4352726698d0d5e32bfd0e2e: its master is up
23197:M 02 Jun 15:25:59.667 # Configuration change detected. Reconfiguring myself as a replica of 0977eda9598c0b5e4352726698d0d5e32bfd0e2e
23197:S 02 Jun 15:25:59.667 # Connection with slave 172.21.108.81:30003 lost.
23197:S 02 Jun 15:25:59.668 # Connection with slave 10.11.200.212:30001 lost.
23197:S 02 Jun 15:25:59.669 * Before turning into a slave, using my master parameters to synthesize a cached master: I may be able to synchronize with the new master with just a partial transfer.
23197:S 02 Jun 15:25:59.686 * Background saving terminated with success
23197:S 02 Jun 15:25:59.686 * Connecting to MASTER 172.21.108.81:30003
23197:S 02 Jun 15:25:59.686 * MASTER <-> SLAVE sync started
23197:S 02 Jun 15:25:59.780 * Clear FAIL state for node bf86d443e73df5bec5d3279021be2354984a6fb9: slave is reachable again.
23197:S 02 Jun 15:25:59.781 * Clear FAIL state for node 88dc03d91b8fa42312217d329ca130d861b09589: master without slots is reachable again.
23197:S 02 Jun 15:25:59.781 * Clear FAIL state for node 05b5b1082c78b9b9f1de29db36942153031885ad: master without slots is reachable again.
23197:S 02 Jun 15:25:59.800 * Non blocking connect for SYNC fired the event.
23197:S 02 Jun 15:25:59.860 * Clear FAIL state for node c7f6be51284b6d52a09b88760173993f0f499513: master without slots is reachable again.
23197:S 02 Jun 15:25:59.947 * Master replied to PING, replication can continue...
23197:S 02 Jun 15:25:59.966 * Trying a partial resynchronization (request 71902be604d5d75ed624a7c321433cba3606af60:3468292904910).
23197:S 02 Jun 15:25:59.992 * Full resync from master: d5a136addd65775445e62c46f544f73f2c0bafba:3468284920254
23197:S 02 Jun 15:25:59.992 * Discarding previously cached master state.
23197:S 02 Jun 15:26:06.538 * FAIL message received from eeb1da7e702dce1a46a41d73efc5b2a2e734be22 about a4b2308b2f2199b75e5b0453f577dd842ba26490
23197:S 02 Jun 15:26:06.538 * FAIL message received from eeb1da7e702dce1a46a41d73efc5b2a2e734be22 about bf86d443e73df5bec5d3279021be2354984a6fb9
23197:S 02 Jun 15:26:06.538 * FAIL message received from eeb1da7e702dce1a46a41d73efc5b2a2e734be22 about 88dc03d91b8fa42312217d329ca130d861b09589
23197:S 02 Jun 15:26:07.362 * Clear FAIL state for node 88dc03d91b8fa42312217d329ca130d861b09589: slave is reachable again.
23197:S 02 Jun 15:26:07.382 * Clear FAIL state for node bf86d443e73df5bec5d3279021be2354984a6fb9: slave is reachable again.
23197:S 02 Jun 15:26:07.433 * Clear FAIL state for node a4b2308b2f2199b75e5b0453f577dd842ba26490: slave is reachable again.
23197:S 02 Jun 15:26:23.453 * FAIL message received from 69263005bb568692fc387fc9bad5465ea42fc783 about 0977eda9598c0b5e4352726698d0d5e32bfd0e2e
23197:S 02 Jun 15:26:23.453 * FAIL message received from 69263005bb568692fc387fc9bad5465ea42fc783 about 018ca4ed8e788a26dbc6f596702857575f789547
23197:S 02 Jun 15:26:27.985 * FAIL message received from 2787e1576d4fdac780c6915443f3f2f71b463f3b about 8360bac84d72f5b0229a85659a3f1f0eef789bf3
23197:S 02 Jun 15:26:28.018 * FAIL message received from 2787e1576d4fdac780c6915443f3f2f71b463f3b about 8dfe09b18e0107f3d1944cac5a917031016c5340
23197:S 02 Jun 15:26:29.967 * Clear FAIL state for node 8360bac84d72f5b0229a85659a3f1f0eef789bf3: master without slots is reachable again.
23197:S 02 Jun 15:26:30.389 * MASTER <-> SLAVE sync: receiving 191277957 bytes from master
23197:S 02 Jun 15:26:32.447 * MASTER <-> SLAVE sync: Flushing old data
23197:S 02 Jun 15:26:37.099 * MASTER <-> SLAVE sync: Loading DB in memory
23197:S 02 Jun 15:26:37.166 # Configuration change detected. Reconfiguring myself as a replica of bd0d58a897a45bd521931f73dddfc6de82875d2c
23197:S 02 Jun 15:26:40.452 * MASTER <-> SLAVE sync: Finished with success
23197:S 02 Jun 15:26:40.510 * Clear FAIL state for node 8dfe09b18e0107f3d1944cac5a917031016c5340: slave is reachable again.
23197:S 02 Jun 15:26:40.564 * Clear FAIL state for node 0977eda9598c0b5e4352726698d0d5e32bfd0e2e: master without slots is reachable again.
23197:S 02 Jun 15:26:40.564 * Clear FAIL state for node 018ca4ed8e788a26dbc6f596702857575f789547: master without slots is reachable again.
23197:S 02 Jun 15:27:41.546 # MASTER timeout: no data nor PING received...
23197:S 02 Jun 15:27:41.546 # Connection with master lost.
23197:S 02 Jun 15:27:41.546 * Caching the disconnected master state.
23197:S 02 Jun 15:27:41.546 * Connecting to MASTER 10.11.200.212:30001
23197:S 02 Jun 15:27:41.546 * MASTER <-> SLAVE sync started
23197:S 02 Jun 15:27:41.546 * Non blocking connect for SYNC fired the event.
23197:S 02 Jun 15:27:41.547 * Master replied to PING, replication can continue...
23197:S 02 Jun 15:27:41.547 * Trying a partial resynchronization (request d5a136addd65775445e62c46f544f73f2c0bafba:3468284920255).
23197:S 02 Jun 15:27:41.555 * Full resync from master: df480dfd8f82e2364bfed221b4af421008460d66:3468324737109
23197:S 02 Jun 15:27:41.555 * Discarding previously cached master state.
23197:S 02 Jun 15:27:45.223 * MASTER <-> SLAVE sync: receiving 189018388 bytes from master
23197:S 02 Jun 15:27:46.474 * MASTER <-> SLAVE sync: Flushing old data
=== REDIS BUG REPORT START: Cut & paste starting from here ===
23197:S 02 Jun 15:27:47.936 # Redis 4.0.2 crashed by signal: 11
23197:S 02 Jun 15:27:47.936 # Crashed running the instuction at: 0x4c7f55
23197:S 02 Jun 15:27:47.936 # Accessing address: 0x75f7d0
23197:S 02 Jun 15:27:47.936 # Failed assertion: <no assertion failed> (<no file>:0)
------ STACK TRACE ------
EIP:
/usr/local/bin/redis-server 172.21.108.82:30001 [cluster][0x4c7f55]
Backtrace:
/usr/local/bin/redis-server 172.21.108.82:30001 [cluster](logStackTrace+0x29)[0x467c59]
/usr/local/bin/redis-server 172.21.108.82:30001 [cluster](sigsegvHandler+0xac)[0x4682fc]
/lib64/libpthread.so.0(+0xf5d0)[0x7f055adb25d0]
/usr/local/bin/redis-server 172.21.108.82:30001 [cluster][0x4c7f55]
/usr/local/bin/redis-server 172.21.108.82:30001 [cluster](je_tcache_bin_flush_small+0x2f3)[0x4e9a03]
/usr/local/bin/redis-server 172.21.108.82:30001 [cluster](je_free+0x1d3)[0x4bdf73]
/usr/local/bin/redis-server 172.21.108.82:30001 [cluster](raxRecursiveFree+0x8c)[0x4971ec]
/usr/local/bin/redis-server 172.21.108.82:30001 [cluster](raxRecursiveFree+0x7f)[0x4971df]
/usr/local/bin/redis-server 172.21.108.82:30001 [cluster](raxRecursiveFree+0x7f)[0x4971df]
/usr/local/bin/redis-server 172.21.108.82:30001 [cluster](raxRecursiveFree+0x7f)[0x4971df]
/usr/local/bin/redis-server 172.21.108.82:30001 [cluster](raxRecursiveFree+0x7f)[0x4971df]
/usr/local/bin/redis-server 172.21.108.82:30001 [cluster](raxRecursiveFree+0x7f)[0x4971df]
/usr/local/bin/redis-server 172.21.108.82:30001 [cluster](raxRecursiveFree+0x7f)[0x4971df]
/usr/local/bin/redis-server 172.21.108.82:30001 [cluster](raxRecursiveFree+0x7f)[0x4971df]
/usr/local/bin/redis-server 172.21.108.82:30001 [cluster](raxRecursiveFree+0x7f)[0x4971df]
/usr/local/bin/redis-server 172.21.108.82:30001 [cluster](raxRecursiveFree+0x7f)[0x4971df]
/usr/local/bin/redis-server 172.21.108.82:30001 [cluster](raxFree+0xc)[0x49722c]
/usr/local/bin/redis-server 172.21.108.82:30001 [cluster](slotToKeyFlush+0x14)[0x441c24]
/usr/local/bin/redis-server 172.21.108.82:30001 [cluster](emptyDb+0x105)[0x441d65]
/usr/local/bin/redis-server 172.21.108.82:30001 [cluster](readSyncBulkPayload+0x1fa)[0x44351a]
/usr/local/bin/redis-server 172.21.108.82:30001 [cluster](aeProcessEvents+0x23d)[0x4264fd]
/usr/local/bin/redis-server 172.21.108.82:30001 [cluster](aeMain+0x2b)[0x4267db]
/usr/local/bin/redis-server 172.21.108.82:30001 [cluster](main+0x49f)[0x42365f]
/lib64/libc.so.6(__libc_start_main+0xf5)[0x7f055a9f83d5]
/usr/local/bin/redis-server 172.21.108.82:30001 [cluster][0x423952]
------ INFO OUTPUT ------
# Server
redis_version:4.0.2
redis_git_sha1:eb4d650e
redis_git_dirty:0
redis_build_id:c34dabdc92128457
redis_mode:cluster
os:Linux 3.10.0-862.el7.x86_64 x86_64
arch_bits:64
multiplexing_api:epoll
atomicvar_api:atomic-builtin
gcc_version:4.8.5
process_id:23197
run_id:0b27c7a7432a345b7a089b25320c80d19e2103b6
tcp_port:30001
uptime_in_seconds:13454832
uptime_in_days:155
hz:10
lru_clock:12006130
executable:/usr/local/bin/redis-server
config_file:/etc/redis/30001.conf
# Clients
connected_clients:616
client_longest_output_list:0
client_biggest_input_buf:0
blocked_clients:0
# Memory
used_memory:64369744
used_memory_human:61.39M
used_memory_rss:468037632
used_memory_rss_human:446.36M
used_memory_peak:1366245088
used_memory_peak_human:1.27G
used_memory_peak_perc:4.71%
used_memory_overhead:22958788
used_memory_startup:6773616
used_memory_dataset:41410956
used_memory_dataset_perc:71.90%
total_system_memory:16557187072
total_system_memory_human:15.42G
used_memory_lua:37888
used_memory_lua_human:37.00K
maxmemory:2147483648
maxmemory_human:2.00G
maxmemory_policy:allkeys-lru
mem_fragmentation_ratio:7.27
mem_allocator:jemalloc-4.0.3
active_defrag_running:0
lazyfree_pending_objects:0
# Persistence
loading:0
rdb_changes_since_last_save:45210
rdb_bgsave_in_progress:0
rdb_last_save_time:1622618759
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:41
rdb_current_bgsave_time_sec:-1
rdb_last_cow_size:431398912
aof_enabled:0
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:-1
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:ok
aof_last_write_status:ok
aof_last_cow_size:0
# Stats
total_connections_received:2012409
total_commands_processed:74241829846
instantaneous_ops_per_sec:291
total_net_input_bytes:5214712833204
total_net_output_bytes:14341150650459
instantaneous_input_kbps:95593.13
instantaneous_output_kbps:5.06
rejected_connections:0
sync_full:2
sync_partial_ok:0
sync_partial_err:2
expired_keys:10645643857
evicted_keys:0
keyspace_hits:48883803733
keyspace_misses:10232798985
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:22487
migrate_cached_sockets:0
slave_expires_tracked_keys:0
active_defrag_hits:0
active_defrag_misses:0
active_defrag_key_hits:0
active_defrag_key_misses:0
# Replication
role:slave
master_host:10.11.200.212
master_port:30001
master_link_status:down
master_last_io_seconds_ago:-1
master_sync_in_progress:1
slave_repl_offset:1
master_sync_left_bytes:0
master_sync_last_io_seconds_ago:0
master_link_down_since_seconds:5
slave_priority:100
slave_read_only:1
connected_slaves:0
master_replid:d5a136addd65775445e62c46f544f73f2c0bafba
master_replid2:0000000000000000000000000000000000000000
master_repl_offset:3468284920254
second_repl_offset:-1
repl_backlog_active:0
repl_backlog_size:10485760
repl_backlog_first_byte_offset:3468284920255
repl_backlog_histlen:0
# CPU
used_cpu_sys:840727.19
used_cpu_user:701059.56
used_cpu_sys_children:0.38
used_cpu_user_children:2.57
# Commandstats
cmdstat_role:calls=43,usec=605,usec_per_call=14.07
cmdstat_readonly:calls=18665,usec=4048,usec_per_call=0.22
cmdstat_psync:calls=2,usec=23466,usec_per_call=11733.00
cmdstat_ping:calls=1685704534,usec=569283941,usec_per_call=0.34
cmdstat_slowlog:calls=223294,usec=119002,usec_per_call=0.53
cmdstat_scan:calls=50048,usec=158651388,usec_per_call=3169.98
cmdstat_dbsize:calls=39,usec=17,usec_per_call=0.44
cmdstat_get:calls=60494205069,usec=114008472434,usec_per_call=1.88
cmdstat_auth:calls=1534010,usec=1435492,usec_per_call=0.94
cmdstat_ttl:calls=31178244,usec=29272989,usec_per_call=0.94
cmdstat_info:calls=6968598,usec=2415566006,usec_per_call=346.64
cmdstat_setex:calls=11957731217,usec=56720400360,usec_per_call=4.74
cmdstat_config:calls=223546,usec=2664565,usec_per_call=11.92
cmdstat_replconf:calls=13389827,usec=9755814,usec_per_call=0.73
cmdstat_cluster:calls=7843393,usec=8632862430,usec_per_call=1100.65
cmdstat_debug:calls=31178244,usec=100541556,usec_per_call=3.22
cmdstat_restore-asking:calls=927483,usec=4263998,usec_per_call=4.60
cmdstat_asking:calls=10653535,usec=3269655,usec_per_call=0.31
cmdstat_select:calls=55,usec=22,usec_per_call=0.40
# Cluster
cluster_enabled:1
# Keyspace
------ CLIENT LIST OUTPUT ------
Comment From: madolson
@gripleaf Awesome! I'll see if I can get this to crash consistently with GDB attached.
Comment From: madolson
I was able to get it to crash on 4.0 but not on the tip of unstable. @gripleaf would you mind double checking your test against the latest Redis version to confirm? I'm not entirely clear what we fixed in between now, maybe the backup system?
Comment From: gripleaf
I also couldn't reproduce it in latest version(6.0.0). It's looks like a specific case in 4.0 and 5.0.
follow is log about another crash case in redis 5.0.0 caused by mentioned reproduce method.
1:C 09 Jun 2021 11:56:06.424 # oO0OoO0OoO0Oo Redis is starting oO0OoO0OoO0Oo
1:C 09 Jun 2021 11:56:06.424 # Redis version=5.0.0, bits=64, commit=00000000, modified=0, pid=1, just started
1:C 09 Jun 2021 11:56:06.424 # Configuration loaded
1:M 09 Jun 2021 11:56:06.426 * No cluster configuration found, I'm b2aa0b08b12c2c283d1ea5072cdba34fbcf71a8e
_._
_.-``__ ''-._
_.-`` `. `_. ''-._ Redis 5.0.0 (00000000/0) 64 bit
.-`` .-```. ```\/ _.,_ ''-._
( ' , .-` | `, ) Running in cluster mode
|`-._`-...-` __...-.``-._|'` _.-'| Port: 6001
| `-._ `._ / _.-' | PID: 1
`-._ `-._ `-./ _.-' _.-'
|`-._`-._ `-.__.-' _.-'_.-'|
| `-._`-._ _.-'_.-' | http://redis.io
`-._ `-._`-.__.-'_.-' _.-'
|`-._`-._ `-.__.-' _.-'_.-'|
| `-._`-._ _.-'_.-' |
`-._ `-._`-.__.-'_.-' _.-'
`-._ `-.__.-' _.-'
`-._ _.-'
`-.__.-'
1:M 09 Jun 2021 11:56:06.429 # WARNING: The TCP backlog setting of 5000 cannot be enforced because /proc/sys/net/core/somaxconn is set to the lower value of 128.
1:M 09 Jun 2021 11:56:06.429 # Server initialized
1:M 09 Jun 2021 11:56:06.429 * Module 'bf' loaded from /app/modules/redisbloom.so
1:M 09 Jun 2021 11:56:06.429 * Ready to accept connections
1:M 09 Jun 2021 12:00:46.080 # CONFIG REWRITE executed with success.
1:M 09 Jun 2021 12:00:46.539 # configEpoch set to 1 via CLUSTER SET-CONFIG-EPOCH
1:M 09 Jun 2021 12:00:46.603 # IP address for this node updated to 172.22.216.99
1:M 09 Jun 2021 12:00:51.424 # Cluster state changed: ok
1:M 09 Jun 2021 12:01:41.329 # CONFIG REWRITE executed with success.
1:M 09 Jun 2021 12:01:41.339 * Replica 172.22.169.70:6001 asks for synchronization
1:M 09 Jun 2021 12:01:41.339 * Partial resynchronization not accepted: Replication ID mismatch (Replica asked for '2d1ef697d578045b953ccba74835905501bb556d', my replication IDs are 'e2161ced97b28541f3498164499d1670fab73f5c' and '0000000000000000000000000000000000000000')
1:M 09 Jun 2021 12:01:41.339 * Starting BGSAVE for SYNC with target: disk
1:M 09 Jun 2021 12:01:41.339 * Background saving started by pid 104
104:C 09 Jun 2021 12:01:41.342 * DB saved on disk
104:C 09 Jun 2021 12:01:41.342 * RDB: 0 MB of memory used by copy-on-write
1:M 09 Jun 2021 12:01:41.347 * Background saving terminated with success
1:M 09 Jun 2021 12:01:41.348 * Synchronization with replica 172.22.169.70:6001 succeeded
1:M 09 Jun 2021 12:21:04.979 * Replica 172.22.154.193:6001 asks for synchronization
1:M 09 Jun 2021 12:21:04.979 * Partial resynchronization not accepted: Replication ID mismatch (Replica asked for 'dc7620ce44e507c0c0eefd54a93d1f53fd9b1dbe', my replication IDs are 'c1d9cd34ba631cf80be96573baaf77214baa9a96' and '0000000000000000000000000000000000000000')
1:M 09 Jun 2021 12:21:04.979 * Starting BGSAVE for SYNC with target: disk
1:M 09 Jun 2021 12:21:05.003 * Background saving started by pid 367
367:C 09 Jun 2021 12:21:16.716 * DB saved on disk
367:C 09 Jun 2021 12:21:16.737 * RDB: 940 MB of memory used by copy-on-write
1:M 09 Jun 2021 12:21:16.834 * Background saving terminated with success
1:M 09 Jun 2021 12:21:19.437 * Synchronization with replica 172.22.154.193:6001 succeeded
1:M 09 Jun 2021 12:22:17.573 # Failover auth granted to 7ebaa1f02aaf11106406c6d0be748b0b9fa1f481 for epoch 75
1:M 09 Jun 2021 12:22:17.581 # Connection with replica 172.22.169.70:6001 lost.
1:M 09 Jun 2021 12:22:17.583 # Configuration change detected. Reconfiguring myself as a replica of 7ebaa1f02aaf11106406c6d0be748b0b9fa1f481
1:S 09 Jun 2021 12:22:17.583 # Connection with replica 172.22.154.193:6001 lost.
1:S 09 Jun 2021 12:22:17.583 * Before turning into a replica, using my master parameters to synthesize a cached master: I may be able to synchronize with the new master with just a partial transfer.
1:S 09 Jun 2021 12:22:17.936 * Connecting to MASTER 172.22.169.70:6001
1:S 09 Jun 2021 12:22:17.936 * MASTER <-> REPLICA sync started
1:S 09 Jun 2021 12:22:17.936 * Non blocking connect for SYNC fired the event.
1:S 09 Jun 2021 12:22:17.936 * Master replied to PING, replication can continue...
1:S 09 Jun 2021 12:22:17.937 * Trying a partial resynchronization (request c1d9cd34ba631cf80be96573baaf77214baa9a96:2597298925).
1:S 09 Jun 2021 12:22:17.962 * Full resync from master: 1a47241acead121a397315279d2284925db5ddf0:2598149797
1:S 09 Jun 2021 12:22:17.962 * Discarding previously cached master state.
1:S 09 Jun 2021 12:22:30.474 * MASTER <-> REPLICA sync: receiving 501074370 bytes from master
1:S 09 Jun 2021 12:22:35.016 * MASTER <-> REPLICA sync: Flushing old data
1:S 09 Jun 2021 12:23:26.882 * MASTER <-> REPLICA sync: Loading DB in memory
1:S 09 Jun 2021 12:23:27.210 # Configuration change detected. Reconfiguring myself as a replica of 9dcfcd9eb63c283c2b31f6e18b628e5da6d0b02a
1:S 09 Jun 2021 12:23:43.954 * MASTER <-> REPLICA sync: Finished with success
1:S 09 Jun 2021 12:24:44.074 # MASTER timeout: no data nor PING received...
1:S 09 Jun 2021 12:24:44.074 # Connection with master lost.
1:S 09 Jun 2021 12:24:44.074 * Caching the disconnected master state.
1:S 09 Jun 2021 12:24:44.074 * Connecting to MASTER 172.22.154.193:6001
1:S 09 Jun 2021 12:24:44.074 * MASTER <-> REPLICA sync started
1:S 09 Jun 2021 12:24:44.075 * Non blocking connect for SYNC fired the event.
1:S 09 Jun 2021 12:24:44.075 * Master replied to PING, replication can continue...
1:S 09 Jun 2021 12:24:44.075 * Trying a partial resynchronization (request 1a47241acead121a397315279d2284925db5ddf0:2598149798).
1:S 09 Jun 2021 12:24:44.101 * Full resync from master: 25f81d5da30cca3690ab90e07e4a8eb51af337aa:2961705246
1:S 09 Jun 2021 12:24:44.101 * Discarding previously cached master state.
1:S 09 Jun 2021 12:24:55.675 * MASTER <-> REPLICA sync: receiving 507260342 bytes from master
1:S 09 Jun 2021 12:24:59.333 * MASTER <-> REPLICA sync: Flushing old data
=== REDIS BUG REPORT START: Cut & paste starting from here ===
1:S 09 Jun 2021 12:25:06.260 # Redis 5.0.0 crashed by signal: 11
1:S 09 Jun 2021 12:25:06.260 # Crashed running the instruction at: 0x433035
1:S 09 Jun 2021 12:25:06.260 # Accessing address: 0x3a
1:S 09 Jun 2021 12:25:06.260 # Failed assertion: <no assertion failed> (<no file>:0)
------ STACK TRACE ------
EIP:
/app/bin/redis-server 0.0.0.0:6001 [cluster](sdsfree+0x5)[0x433035]
Backtrace:
/app/bin/redis-server 0.0.0.0:6001 [cluster](logStackTrace+0x2e)[0x46ff0e]
/app/bin/redis-server 0.0.0.0:6001 [cluster](sigsegvHandler+0x96)[0x470596]
/usr/lib64/libpthread.so.0(+0xf5f0)[0x7f0e3116a5f0]
/app/bin/redis-server 0.0.0.0:6001 [cluster](sdsfree+0x5)[0x433035]
/app/bin/redis-server 0.0.0.0:6001 [cluster](_dictClear+0x6a)[0x42b1ba]
/app/bin/redis-server 0.0.0.0:6001 [cluster](dictEmpty+0x18)[0x42bbd8]
/app/bin/redis-server 0.0.0.0:6001 [cluster](emptyDb+0x8d)[0x44658d]
/app/bin/redis-server 0.0.0.0:6001 [cluster](readSyncBulkPayload+0x2a1)[0x448471]
/app/bin/redis-server 0.0.0.0:6001 [cluster](aeProcessEvents+0x101)[0x428e11]
/app/bin/redis-server 0.0.0.0:6001 [cluster](aeMain+0x2b)[0x4291fb]
/app/bin/redis-server 0.0.0.0:6001 [cluster](main+0x4ad)[0x4260fd]
/usr/lib64/libc.so.6(__libc_start_main+0xf5)[0x7f0e30daf505]
/app/bin/redis-server 0.0.0.0:6001 [cluster][0x426349]
------ INFO OUTPUT ------
# Server
redis_version:5.0.0
redis_git_sha1:00000000
redis_git_dirty:0
redis_build_id:bc5d6d9bc764275d
redis_mode:cluster
os:Linux 4.19.95-3 x86_64
arch_bits:64
multiplexing_api:epoll
atomicvar_api:atomic-builtin
gcc_version:8.3.0
process_id:1
run_id:a104946c414c84d2222983312fbd5aa1c5bd9a10
tcp_port:6001
uptime_in_seconds:1733
uptime_in_days:0
hz:10
configured_hz:10
lru_clock:12599963
executable:/app/bin/redis-server
config_file:/data0/redis.conf
# Clients
connected_clients:10
client_recent_max_input_buffer:2
client_recent_max_output_buffer:0
blocked_clients:0
# Memory
used_memory:617568008
used_memory_human:588.96M
used_memory_rss:1402052608
used_memory_rss_human:1.31G
used_memory_peak:1479439688
used_memory_peak_human:1.38G
used_memory_peak_perc:41.74%
used_memory_overhead:292587580
used_memory_startup:1449552
used_memory_dataset:324980428
used_memory_dataset_perc:52.75%
allocator_allocated:1370764384
allocator_active:1374576640
allocator_resident:1410699264
total_system_memory:16550535168
total_system_memory_human:15.41G
used_memory_lua:37888
used_memory_lua_human:37.00K
used_memory_scripts:0
used_memory_scripts_human:0B
number_of_cached_scripts:0
maxmemory:2147483648
maxmemory_human:2.00G
maxmemory_policy:allkeys-lru
allocator_frag_ratio:1.00
allocator_frag_bytes:3812256
allocator_rss_ratio:1.03
allocator_rss_bytes:36122624
rss_overhead_ratio:0.99
rss_overhead_bytes:18446744073700904960
mem_fragmentation_ratio:1.02
mem_fragmentation_bytes:31403848
mem_not_counted_for_evict:0
mem_replication_backlog:0
mem_clients_slaves:0
mem_clients_normal:169140
mem_aof_buffer:0
mem_allocator:jemalloc-5.1.0
active_defrag_running:0
lazyfree_pending_objects:0
# Persistence
loading:0
rdb_changes_since_last_save:1508417
rdb_bgsave_in_progress:0
rdb_last_save_time:1623212476
rdb_last_bgsave_status:ok
rdb_last_bgsave_time_sec:11
rdb_current_bgsave_time_sec:-1
rdb_last_cow_size:986210304
aof_enabled:0
aof_rewrite_in_progress:0
aof_rewrite_scheduled:0
aof_last_rewrite_time_sec:-1
aof_current_rewrite_time_sec:-1
aof_last_bgrewrite_status:ok
aof_last_write_status:ok
aof_last_cow_size:0
# Stats
total_connections_received:56
total_commands_processed:21709140
instantaneous_ops_per_sec:3
total_net_input_bytes:3605828044
total_net_output_bytes:3390036793
instantaneous_input_kbps:117369.09
instantaneous_output_kbps:6.26
rejected_connections:0
sync_full:2
sync_partial_ok:0
sync_partial_err:2
expired_keys:0
expired_stale_perc:0.00
expired_time_cap_reached_count:0
evicted_keys:0
keyspace_hits:0
keyspace_misses:0
pubsub_channels:0
pubsub_patterns:0
latest_fork_usec:24784
migrate_cached_sockets:0
slave_expires_tracked_keys:0
active_defrag_hits:0
active_defrag_misses:0
active_defrag_key_hits:0
active_defrag_key_misses:0
# Replication
role:slave
master_host:172.22.154.193
master_port:6001
master_link_status:down
master_last_io_seconds_ago:-1
master_sync_in_progress:1
slave_repl_offset:1
master_sync_left_bytes:0
master_sync_last_io_seconds_ago:0
master_link_down_since_seconds:15
slave_priority:100
slave_read_only:1
connected_slaves:0
master_replid:1a47241acead121a397315279d2284925db5ddf0
master_replid2:0000000000000000000000000000000000000000
master_repl_offset:2598149797
second_repl_offset:-1
repl_backlog_active:0
repl_backlog_size:10485760
repl_backlog_first_byte_offset:2598149798
repl_backlog_histlen:0
# CPU
used_cpu_sys:89.214315
used_cpu_user:143.055648
used_cpu_sys_children:0.597913
used_cpu_user_children:10.187503
# Commandstats
cmdstat_cluster:calls=1177,usec=646998,usec_per_call=549.70
cmdstat_readonly:calls=6,usec=1,usec_per_call=0.17
cmdstat_config:calls=6,usec=1911,usec_per_call=318.50
cmdstat_auth:calls=56,usec=55,usec_per_call=0.98
cmdstat_info:calls=832,usec=71193,usec_per_call=85.57
cmdstat_psync:calls=2,usec=25245,usec_per_call=12622.50
cmdstat_replconf:calls=1269,usec=1363,usec_per_call=1.07
cmdstat_set:calls=21702874,usec=53684490,usec_per_call=2.47
cmdstat_ping:calls=2918,usec=1276,usec_per_call=0.44
# Cluster
cluster_enabled:1
# Keyspace
db0:keys=295334,expires=6039075,avg_ttl=62937311
------ CLIENT LIST OUTPUT ------
Comment From: madolson
Ok, well at least we can now recommend people just upgrade to the latest version for now. If I get a chance I will take a deeper look through the code to understand why it's crashing.
Comment From: oranagra
I've seen quite a lot of these crashes (indeed only on 4 and 5 AFAIR) and i would rather get to the bottom of it and know exactly where the bug was, and not just suffice by saying it's not reproducing on 6.0. if you're able to reproduce it consistently, how about running it under valgrind?
Comment From: oranagra
@madolson you said you were able to reproduce it, can you please try with Valgrind so we can find what was the bug?
Comment From: madolson
@oranagra Sure, I'll dive deep on it tomorrow. (I was secretly hoping to hand this off to someone in AWS but they got reprioritized :(
Comment From: Adel-Magebinary
https://github.com/redis/redis/issues/8861
Comment From: oranagra
@Adel-Magebinary this issue is (or was) about the crash in raxRecursiveFree.
@madolson a long time has passed, not sure if you still remember how you reproduced this. It might no longer be relevant for newer releases (no longer using rax), but on the other hand it might (if it's an unrelated memory corruption). I would still be glad to reproduce this with valgrind and find out the root cause.
Comment From: Adel-Magebinary
@oranagra It would be super great to resolve the crashing issue from #8861 first as it is crashing regularly with a big load.
You should be able to reproduce this issue with the following steps.
- Install SmartOS
- Boot up a ubuntu 20.04 lx container.
- Install the latest Redis or Redis 5.x
- Install the latest Magento 2
- Use bin/Magento to generate the texture of 1m products
- Enable flat category/product on Magento
- Flush Magento cache (it flush the keys in redis)
- Start full reinext (bin/magento indexer:index)
And watch for redis and it will crash.
Comment From: Adel-Magebinary
Or I can start redis service with valgrind redis-server etc... and give you the output?
Comment From: oranagra
@Adel-Magebinary if you can reproduce it with valgrind it'll be great (i don't have time to do that myself).
but let's do that in the other issue, this one is about raxRecursiveFree, the other ticket is about SADD or RDB loading (two different issues), they don't seem related to the one discussed in this issue.