redis list 460000 数据,执行 lrem QPS 约500 同进执行lpush 8台服务器 结果导致整个redis集群挂掉,有这么差吗??????
Comment From: jackyfkc
@liangrui1988 : you need to give more detailed info about test environment, like machine, os, redis version, configuration, the data size used for testing and also the crash log
Comment From: deep011
Set cluster-require-full-coverage to no.
Comment From: liangrui1988
1:redis-benchmark 只能测试少量命令,针对服务器性能测试,用来看redis在这台服务器命令的吞吐情况。 不能单独测某一个key用时,也没有lrem
本地电脑连10.16.6.88 redis相关测试结果
2:单线程去测试 循环10000次 lpush 0-1毫秒 set 0-1毫秒 lrem 11-13毫秒
3:首先打开redis monitor 消耗50%吞吐
list 队列里有460000条数据
100 次请求 每隔1秒 并发50次请求 最后set用时0-1毫秒 lpush用时800-2377毫秒 lrem 50-720毫秒 如果把lpush和lrem执行顺序调换 用时则也会返过来,lrem和lpush执行像是一样的
把并发调到100最后打印日志 11:11:29 WARN [Thread-9793]c.k.s.o.QualityUserCommService - redisList lrem 用时 时间:45 11:11:29 WARN [Thread-9784]c.k.s.o.QualityUserCommService - redisList lpus用时时间:4976 11:11:29 WARN [Thread-9792]c.k.s.o.QualityUserCommService - redisList lrem 用时 时间:45 11:11:29 WARN [Thread-9796]c.k.s.o.QualityUserCommService - redisList lrem 用时 时间:45 11:11:29 WARN [Thread-9788]c.k.s.o.QualityUserCommService - redisList lpus用时时间:4976 11:11:29 WARN [Thread-9791]c.k.s.o.QualityUserCommService - redisList lrem 用时 时间:45 11:11:29 WARN [Thread-9782]c.k.s.o.QualityUserCommService - redisList lpus用时时间:4976 11:11:29 WARN [Thread-9773]c.k.s.o.QualityUserCommService - redisList lpus用时时间:4976 11:11:29 WARN [Thread-9793]c.k.s.o.QualityUserCommService - key set 用时时间:1 11:11:29 WARN [Thread-9792]c.k.s.o.QualityUserCommService - key set 用时时间:1 11:11:29 WARN [Thread-9791]c.k.s.o.QualityUserCommService - key set 用时时间:1 11:11:29 WARN [Thread-9796]c.k.s.o.QualityUserCommService - key set 用时时间:1
10次 并发200 测试最后输出日志 11:17:38 WARN [Thread-83]c.k.s.o.QualityUserCommService - key set 用时时间:1 11:17:38 WARN [Thread-97]c.k.s.o.QualityUserCommService - key set 用时时间:1 11:17:38 WARN [Thread-99]c.k.s.o.QualityUserCommService - redisList lrem 用时 时间:41 11:17:38 WARN [Thread-620]c.k.s.o.QualityUserCommService - redisList lrem 用时 时间:41 11:17:38 WARN [Thread-626]c.k.s.o.QualityUserCommService - redisList lpus用时时间:3035 11:17:38 WARN [Thread-106]c.k.s.o.QualityUserCommService - redisList lrem 用时 时间:42 11:17:38 WARN [Thread-622]c.k.s.o.QualityUserCommService - redisList lpus用时时间:3035 11:17:38 WARN [Thread-624]c.k.s.o.QualityUserCommService - redisList lpus用时时间:3035 11:17:38 WARN [Thread-629]c.k.s.o.QualityUserCommService - redisList lpus用时时间:3035 11:17:38 WARN [Thread-625]c.k.s.o.QualityUserCommService - redisList lpus用时时间:3036 11:17:38 WARN [Thread-620]c.k.s.o.QualityUserCommService - key set 用时时间:0 11:17:38 WARN [Thread-99]c.k.s.o.QualityUserCommService - key set 用时时间:1 顺序调换过来后 50次 并发200 测试最后输出日志 我电脑内存溢出了 11:19:16 WARN [Thread-373]c.k.s.o.QualityUserCommService - redisList lpus用时时间:46 11:19:16 WARN [Thread-357]c.k.s.o.QualityUserCommService - redisList lpus用时时间:46 11:19:16 WARN [Thread-325]c.k.s.o.QualityUserCommService - redisList lrem 用时 时间:3045 11:19:16 WARN [Thread-329]c.k.s.o.QualityUserCommService - redisList lrem 用时 时间:3045 11:19:16 WARN [Thread-341]c.k.s.o.QualityUserCommService - redisList lpus用时时间:46 11:19:16 WARN [Thread-333]c.k.s.o.QualityUserCommService - redisList lrem 用时 时间:3045 11:19:16 WARN [Thread-349]c.k.s.o.QualityUserCommService - redisList lpus用时时间:46 11:19:16 WARN [Thread-373]c.k.s.o.QualityUserCommService - key set 用时时间:1 11:19:16 WARN [Thread-357]c.k.s.o.QualityUserCommService - key set 用时时间:1 11:19:16 WARN [Thread-341]c.k.s.o.QualityUserCommService - key set 用时时间:1
Comment From: veficos
redis本身就不适合存储大数据...
Comment From: yoav-steinberg
This is old and not in English. I'm closing. If still relevant please provide details in English and let us know.