Redis maxmemory configuration can't limit the client query buffer. config set maxmemory=1GB, but used_memory will to be 5GB, even more.
please check the "used_memory:6183968480" and "maxmemory_human:1.00G" in the "Memory Section", the "client_biggest_input_buf=60686288" in "Clients section".
The Details:
info memory `
Memory
used_memory:6183968480 used_memory_human:5.76G used_memory_rss:5548683264 used_memory_rss_human:5.17G used_memory_peak:6183969080 used_memory_peak_human:5.76G total_system_memory:134911881216 total_system_memory_human:125.65G used_memory_lua:37888 used_memory_lua_human:37.00K maxmemory:1073741824 maxmemory_human:1.00G maxmemory_policy:noeviction mem_fragmentation_ratio:0.90 mem_allocator:jemalloc-4.0.3`
info clients `
Clients
connected_clients:51 client_longest_output_list:0 client_biggest_input_buf:60686288 blocked_clients:0`
client list ` client list
id=9780 addr=127.0.0.1:24173 fd=49 name= age=4206 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46251984 qbuf-free=56148018 obl=0 oll=0 omem=0 events=r cmd=set id=9781 addr=127.0.0.1:24174 fd=50 name= age=4206 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46251984 qbuf-free=56148018 obl=0 oll=0 omem=0 events=r cmd=set id=9767 addr=127.0.0.1:24160 fd=36 name= age=4207 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46268368 qbuf-free=56131634 obl=0 oll=0 omem=0 events=r cmd=set id=9768 addr=127.0.0.1:24161 fd=37 name= age=4207 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46268368 qbuf-free=56131634 obl=0 oll=0 omem=0 events=r cmd=set id=9741 addr=127.0.0.1:24134 fd=10 name= age=4209 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46399440 qbuf-free=983040 obl=0 oll=0 omem=0 events=r cmd=set id=9748 addr=127.0.0.1:24141 fd=17 name= age=4208 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46350288 qbuf-free=983040 obl=0 oll=0 omem=0 events=r cmd=set id=9779 addr=127.0.0.1:24172 fd=48 name= age=4206 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46251984 qbuf-free=56148018 obl=0 oll=0 omem=0 events=r cmd=set id=9752 addr=127.0.0.1:24145 fd=21 name= age=4208 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46333904 qbuf-free=983040 obl=0 oll=0 omem=0 events=r cmd=set id=9757 addr=127.0.0.1:24150 fd=26 name= age=4208 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46301136 qbuf-free=56098866 obl=0 oll=0 omem=0 events=r cmd=set id=9766 addr=127.0.0.1:24159 fd=35 name= age=4207 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46284752 qbuf-free=56115250 obl=0 oll=0 omem=0 events=r cmd=set id=9777 addr=127.0.0.1:24170 fd=46 name= age=4206 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46251984 qbuf-free=56148018 obl=0 oll=0 omem=0 events=r cmd=set id=9778 addr=127.0.0.1:24171 fd=47 name= age=4206 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46251984 qbuf-free=56148018 obl=0 oll=0 omem=0 events=r cmd=set id=9758 addr=127.0.0.1:24151 fd=27 name= age=4208 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46301136 qbuf-free=56098866 obl=0 oll=0 omem=0 events=r cmd=set id=9742 addr=127.0.0.1:24135 fd=11 name= age=4209 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46399440 qbuf-free=56000562 obl=0 oll=0 omem=0 events=r cmd=set id=9736 addr=127.0.0.1:24110 fd=62 name= age=4297 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=32768 obl=0 oll=0 omem=0 events=r cmd=client id=9764 addr=127.0.0.1:24157 fd=33 name= age=4207 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46284752 qbuf-free=56115250 obl=0 oll=0 omem=0 events=r cmd=set id=9776 addr=127.0.0.1:24169 fd=45 name= age=4206 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46251984 qbuf-free=56148018 obl=0 oll=0 omem=0 events=r cmd=set id=9765 addr=127.0.0.1:24158 fd=34 name= age=4207 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46284752 qbuf-free=56115250 obl=0 oll=0 omem=0 events=r cmd=set id=9743 addr=127.0.0.1:24136 fd=12 name= age=4209 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46383056 qbuf-free=56016946 obl=0 oll=0 omem=0 events=r cmd=set id=9750 addr=127.0.0.1:24143 fd=19 name= age=4208 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46333904 qbuf-free=56066098 obl=0 oll=0 omem=0 events=r cmd=set id=9774 addr=127.0.0.1:24167 fd=43 name= age=4207 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46284752 qbuf-free=56115250 obl=0 oll=0 omem=0 events=r cmd=set id=9775 addr=127.0.0.1:24168 fd=44 name= age=4207 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46251984 qbuf-free=56148018 obl=0 oll=0 omem=0 events=r cmd=set id=9756 addr=127.0.0.1:24149 fd=25 name= age=4208 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46317520 qbuf-free=56082482 obl=0 oll=0 omem=0 events=r cmd=set id=9751 addr=127.0.0.1:24144 fd=20 name= age=4208 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46333904 qbuf-free=56066098 obl=0 oll=0 omem=0 events=r cmd=set id=9763 addr=127.0.0.1:24156 fd=32 name= age=4207 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46284752 qbuf-free=56115250 obl=0 oll=0 omem=0 events=r cmd=set id=9746 addr=127.0.0.1:24139 fd=15 name= age=4209 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46366672 qbuf-free=56033330 obl=0 oll=0 omem=0 events=r cmd=set id=9773 addr=127.0.0.1:24166 fd=42 name= age=4207 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46284752 qbuf-free=56115250 obl=0 oll=0 omem=0 events=r cmd=set id=9787 addr=127.0.0.1:24180 fd=56 name= age=4206 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46235600 qbuf-free=56164402 obl=0 oll=0 omem=0 events=r cmd=set id=9747 addr=127.0.0.1:24140 fd=16 name= age=4209 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46350288 qbuf-free=56049714 obl=0 oll=0 omem=0 events=r cmd=set id=9744 addr=127.0.0.1:24137 fd=13 name= age=4209 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46383056 qbuf-free=56016946 obl=0 oll=0 omem=0 events=r cmd=set id=9755 addr=127.0.0.1:24148 fd=24 name= age=4208 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46317520 qbuf-free=311296 obl=0 oll=0 omem=0 events=r cmd=set id=9762 addr=127.0.0.1:24155 fd=31 name= age=4207 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46284752 qbuf-free=311296 obl=0 oll=0 omem=0 events=r cmd=set id=9786 addr=127.0.0.1:24179 fd=55 name= age=4206 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46235600 qbuf-free=311296 obl=0 oll=0 omem=0 events=r cmd=set id=9772 addr=127.0.0.1:24165 fd=41 name= age=4207 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46268368 qbuf-free=311296 obl=0 oll=0 omem=0 events=r cmd=set id=9738 addr=127.0.0.1:24131 fd=7 name= age=4209 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46399440 qbuf-free=311296 obl=0 oll=0 omem=0 events=r cmd=set id=9749 addr=127.0.0.1:24142 fd=18 name= age=4208 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46350288 qbuf-free=147456 obl=0 oll=0 omem=0 events=r cmd=set id=9784 addr=127.0.0.1:24177 fd=53 name= age=4206 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46170064 qbuf-free=147456 obl=0 oll=0 omem=0 events=r cmd=set id=9785 addr=127.0.0.1:24178 fd=54 name= age=4206 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46219216 qbuf-free=147456 obl=0 oll=0 omem=0 events=r cmd=set id=9739 addr=127.0.0.1:24132 fd=8 name= age=4209 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46399440 qbuf-free=147456 obl=0 oll=0 omem=0 events=r cmd=set id=9770 addr=127.0.0.1:24163 fd=39 name= age=4207 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46268368 qbuf-free=147456 obl=0 oll=0 omem=0 events=r cmd=set id=9771 addr=127.0.0.1:24164 fd=40 name= age=4207 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46268368 qbuf-free=933888 obl=0 oll=0 omem=0 events=r cmd=set id=9760 addr=127.0.0.1:24153 fd=29 name= age=4208 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46301136 qbuf-free=933888 obl=0 oll=0 omem=0 events=r cmd=set id=9783 addr=127.0.0.1:24176 fd=52 name= age=4206 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46202832 qbuf-free=933888 obl=0 oll=0 omem=0 events=r cmd=set id=9761 addr=127.0.0.1:24154 fd=30 name= age=4208 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46301136 qbuf-free=933888 obl=0 oll=0 omem=0 events=r cmd=set id=9753 addr=127.0.0.1:24146 fd=22 name= age=4208 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46317520 qbuf-free=933888 obl=0 oll=0 omem=0 events=r cmd=set id=9754 addr=127.0.0.1:24147 fd=23 name= age=4208 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46317520 qbuf-free=540672 obl=0 oll=0 omem=0 events=r cmd=set id=9769 addr=127.0.0.1:24162 fd=38 name= age=4207 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46268368 qbuf-free=540672 obl=0 oll=0 omem=0 events=r cmd=set id=9782 addr=127.0.0.1:24175 fd=51 name= age=4206 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46268368 qbuf-free=540672 obl=0 oll=0 omem=0 events=r cmd=set id=9740 addr=127.0.0.1:24133 fd=9 name= age=4209 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46399440 qbuf-free=540672 obl=0 oll=0 omem=0 events=r cmd=set id=9745 addr=127.0.0.1:24138 fd=14 name= age=4209 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46366672 qbuf-free=540672 obl=0 oll=0 omem=0 events=r cmd=set id=9759 addr=127.0.0.1:24152 fd=28 name= age=4208 idle=0 flags=N db=0 sub=0 psub=0 multi=-1 qbuf=46301136 qbuf-free=229376 obl=0 oll=0 omem=0 events=r cmd=set`
How to repeat - config set maxmemory=1073741824 - benchmark set with big string key, redis-benchmark -q -d 102400000 -n 10000000 -r 25000 -p 6390 -t set - info memory to check memory used
Thanks.
Comment From: rajatdutta
Hi, I tried reproducing this issue with lesser memory benchmarks but couldn't replicate. Can you please try replicating it with maxmemory=100MB and also tweaking down the numbers in your benchmarking.
Comment From: oranagra
this may be resolved or mitigated with #7676