redis,主从时，数据loading至内存完成后写入磁盘报错，具体错误如下

Comment From: lianghk1987

=== REDIS BUG REPORT START: Cut & paste starting from here === 18269:C 17 Jun 15:42:54.464 # === ASSERTION FAILED === 18269:C 17 Jun 15:42:54.464 # ==> ziplist.c:411 'NULL' is not true 18269:C 17 Jun 15:42:54.464 # (forcing SIGSEGV to print the bug report.) 18269:C 17 Jun 15:42:54.464 # Redis 3.2.0 crashed by signal: 11 18269:C 17 Jun 15:42:54.464 # Crashed running the instuction at: 0x45af3f 18269:C 17 Jun 15:42:54.464 # Accessing address: 0xffffffffffffffff 18269:C 17 Jun 15:42:54.464 # Failed assertion: NULL (ziplist.c:411)

------ STACK TRACE ------ EIP: redis-aof-rewrite 0.0.0.0:8112(_serverAssert+0x6f)[0x45af3f]

Backtrace: redis-aof-rewrite 0.0.0.0:8112(logStackTrace+0x3c)[0x45b34c] redis-aof-rewrite 0.0.0.0:8112(sigsegvHandler+0xa1)[0x45c231] /lib64/libpthread.so.0[0x302e00f7e0] redis-aof-rewrite 0.0.0.0:8112(_serverAssert+0x6f)[0x45af3f] redis-aof-rewrite 0.0.0.0:8112[0x43035f] redis-aof-rewrite 0.0.0.0:8112(ziplistGet+0x72)[0x430572] redis-aof-rewrite 0.0.0.0:8112(quicklistNext+0x1ec)[0x41e2ac] redis-aof-rewrite 0.0.0.0:8112(rewriteListObject+0x8a)[0x457daa] redis-aof-rewrite 0.0.0.0:8112(rewriteAppendOnlyFile+0x4ab)[0x458e0b] redis-aof-rewrite 0.0.0.0:8112(rewriteAppendOnlyFileBackground+0x87)[0x459287] redis-aof-rewrite 0.0.0.0:8112(startAppendOnly+0x4f)[0x4594af] redis-aof-rewrite 0.0.0.0:8112(readSyncBulkPayload+0x2d4)[0x43c1d4] redis-aof-rewrite 0.0.0.0:8112(aeProcessEvents+0x13d)[0x41f67d] redis-aof-rewrite 0.0.0.0:8112(aeMain+0x2b)[0x41f97b] redis-aof-rewrite 0.0.0.0:8112(main+0x371)[0x427031] /lib64/libc.so.6(__libc_start_main+0xfd)[0x302dc1ed1d] redis-aof-rewrite 0.0.0.0:8112[0x41ce69]

------ INFO OUTPUT ------

Server

redis_version:3.2.0 redis_git_sha1:00000000 redis_git_dirty:0 redis_build_id:e7804f828d34d66 redis_mode:standalone os:Linux 2.6.32-696.el6.x86_64 x86_64 arch_bits:64 multiplexing_api:epoll gcc_version:4.4.7 process_id:18269 run_id:10390e3c8aadc74053c373a685ba56a68c102598 tcp_port:8112 uptime_in_seconds:229 uptime_in_days:0 hz:10 lru_clock:2494650 executable:/usr/local/bin/redis-server config_file:/data/redis/configs/8112/redis.conf

Clients

connected_clients:1 client_longest_output_list:0 client_biggest_input_buf:0 blocked_clients:0

Memory

used_memory:15652850720 used_memory_human:14.58G used_memory_rss:7737344 used_memory_rss_human:7.38M used_memory_peak:15652850720 used_memory_peak_human:14.58G total_system_memory:541523742720 total_system_memory_human:504.33G used_memory_lua:37888 used_memory_lua_human:37.00K maxmemory:53687091200 maxmemory_human:50.00G maxmemory_policy:volatile-ttl mem_fragmentation_ratio:0.00 mem_allocator:jemalloc-4.0.3

Persistence

loading:0 rdb_changes_since_last_save:1 rdb_bgsave_in_progress:0 rdb_last_save_time:1529221145 rdb_last_bgsave_status:ok rdb_last_bgsave_time_sec:-1 rdb_current_bgsave_time_sec:-1 aof_enabled:0 aof_rewrite_in_progress:0 aof_rewrite_scheduled:0 aof_last_rewrite_time_sec:-1 aof_current_rewrite_time_sec:-1 aof_last_bgrewrite_status:ok aof_last_write_status:ok

Stats

total_connections_received:0 total_commands_processed:0 instantaneous_ops_per_sec:0 total_net_input_bytes:6771655206 total_net_output_bytes:0 instantaneous_input_kbps:219274.31 instantaneous_output_kbps:0.00 rejected_connections:0 sync_full:0 sync_partial_ok:0 sync_partial_err:0 expired_keys:0 evicted_keys:0 keyspace_hits:0 keyspace_misses:0 pubsub_channels:0 pubsub_patterns:0 latest_fork_usec:0 migrate_cached_sockets:0

Replication

role:slave master_host:10.1.220.10 master_port:8112 master_link_status:up master_last_io_seconds_ago:0 master_sync_in_progress:0 slave_repl_offset:71065793 slave_priority:100 slave_read_only:1 connected_slaves:0 master_repl_offset:0 repl_backlog_active:0 repl_backlog_size:1048576 repl_backlog_first_byte_offset:0 repl_backlog_histlen:0

CPU

used_cpu_sys:0.00 used_cpu_user:0.00 used_cpu_sys_children:0.00 used_cpu_user_children:0.00

Commandstats

Cluster

cluster_enabled:0

Keyspace

db0:keys=21697171,expires=21696973,avg_ttl=0 hash_init_value: 1529381194

------ CLIENT LIST OUTPUT ------ id=2 addr=10.1.220.10:8112 fd=6 name= age=0 idle=0 flags=M db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=NULL

------ REGISTERS ------ 18269:C 17 Jun 15:42:54.467 # RAX:0000000000000000 RBX:000000000000019b RCX:0000000000000000 RDX:000000302df8e178 RDI:000000302df8e120 RSI:0000000000000000 RBP:00000000004e0b60 RSP:00007ffe9ade6160 R8 :00007ffb350a5740 R9 :0000000000000000 R10:7562206568742074 R11:0000000000000206 R12:00000000004e10f7 R13:00007ffe9ade6250 R14:0000000000430860 R15:0000000000000000 RIP:000000000045af3f EFL:0000000000010206 CSGSFS:5647000000000033 18269:C 17 Jun 15:42:54.467 # (00007ffe9ade616f) -> 0000000000000001 18269:C 17 Jun 15:42:54.467 # (00007ffe9ade616e) -> 00007ffe9ade6230 18269:C 17 Jun 15:42:54.467 # (00007ffe9ade616d) -> 00007ff777bd79c0 18269:C 17 Jun 15:42:54.467 # (00007ffe9ade616c) -> 00007ffe9ade63f0 18269:C 17 Jun 15:42:54.467 # (00007ffe9ade616b) -> 00007ff88d0679ff 18269:C 17 Jun 15:42:54.467 # (00007ffe9ade616a) -> 000000ce00000002 18269:C 17 Jun 15:42:54.467 # (00007ffe9ade6169) -> 0000000000000001 18269:C 17 Jun 15:42:54.467 # (00007ffe9ade6168) -> 0000000000000001 18269:C 17 Jun 15:42:54.467 # (00007ffe9ade6167) -> 0000000000430572 18269:C 17 Jun 15:42:54.467 # (00007ffe9ade6166) -> 0000000000000002 18269:C 17 Jun 15:42:54.467 # (00007ffe9ade6165) -> 000000302dc678bd 18269:C 17 Jun 15:42:54.467 # (00007ffe9ade6164) -> 0000000000000004 18269:C 17 Jun 15:42:54.467 # (00007ffe9ade6163) -> 000000000043035f 18269:C 17 Jun 15:42:54.467 # (00007ffe9ade6162) -> 00007ffe9ade6258 18269:C 17 Jun 15:42:54.467 # (00007ffe9ade6161) -> 00007ffe9ade6248 18269:C 17 Jun 15:42:54.468 # (00007ffe9ade6160) -> 00007ff88d0679ff

------ FAST MEMORY TEST ------ *** Preparing to test memory region 721000 (114688 bytes) *** Preparing to test memory region 20fa000 (135168 bytes) *** Preparing to test memory region 302d622000 (4096 bytes) *** Preparing to test memory region 302df90000 (16384 bytes) *** Preparing to test memory region 302e219000 (16384 bytes) *** Preparing to test memory region 7ff777a00000 (16047407104 bytes) *** Preparing to test memory region 7ffb343ff000 (4194304 bytes) *** Preparing to test memory region 7ffb34800000 (4194304 bytes) *** Preparing to test memory region 7ffb34c00000 (4194304 bytes) *** Preparing to test memory region 7ffb350a5000 (16384 bytes) *** Preparing to test memory region 7ffb350b2000 (8192 bytes) *** Preparing to test memory region 7ffb350b4000 (4096 bytes) .O.O.O.O.O.

=== REDIS BUG REPORT START: Cut & paste starting from here === 10532:S 17 Jun 15:42:54.559 # Redis 3.2.0 crashed by signal: 11 10532:S 17 Jun 15:42:54.559 # Crashed running the instuction at: 0x302dc8a00b 10532:S 17 Jun 15:42:54.559 # Accessing address: 0x7ff776bffff8 10532:S 17 Jun 15:42:54.559 # Failed assertion: (:0)

------ STACK TRACE ------ EIP: /lib64/libc.so.6[0x302dc8a00b]

Backtrace: /usr/local/bin/redis-server 0.0.0.0:8112(logStackTrace+0x3c)[0x45b34c] /usr/local/bin/redis-server 0.0.0.0:8112(sigsegvHandler+0xa1)[0x45c231] /lib64/libpthread.so.0[0x302e00f7e0] /lib64/libc.so.6[0x302dc8a00b] /lib64/libc.so.6(memmove+0x129)[0x302dc83969] /usr/local/bin/redis-server 0.0.0.0:8112[0x430e84] /usr/local/bin/redis-server 0.0.0.0:8112[0x4313cb] /usr/local/bin/redis-server 0.0.0.0:8112(quicklistPushTail+0x52)[0x41ead2] /usr/local/bin/redis-server 0.0.0.0:8112(listTypePush+0x58)[0x444d38] /usr/local/bin/redis-server 0.0.0.0:8112(pushGenericCommand+0x88)[0x445568] /usr/local/bin/redis-server 0.0.0.0:8112(call+0x72)[0x423fb2] /usr/local/bin/redis-server 0.0.0.0:8112(processCommand+0x365)[0x428b35] /usr/local/bin/redis-server 0.0.0.0:8112(processInputBuffer+0x109)[0x434e39] /usr/local/bin/redis-server 0.0.0.0:8112(aeProcessEvents+0x13d)[0x41f67d] /usr/local/bin/redis-server 0.0.0.0:8112(aeMain+0x2b)[0x41f97b] /usr/local/bin/redis-server 0.0.0.0:8112(main+0x371)[0x427031] /lib64/libc.so.6(__libc_start_main+0xfd)[0x302dc1ed1d] /usr/local/bin/redis-server 0.0.0.0:8112[0x41ce69]

------ INFO OUTPUT ------

Server

redis_version:3.2.0 redis_git_sha1:00000000 redis_git_dirty:0 redis_build_id:e7804f828d34d66 redis_mode:standalone os:Linux 2.6.32-696.el6.x86_64 x86_64 arch_bits:64 multiplexing_api:epoll gcc_version:4.4.7 process_id:10532 run_id:10390e3c8aadc74053c373a685ba56a68c102598 tcp_port:8112 uptime_in_seconds:229 uptime_in_days:0 hz:10 lru_clock:2494718 executable:/usr/local/bin/redis-server config_file:/data/redis/configs/8112/redis.conf

Clients

connected_clients:1 client_longest_output_list:0 client_biggest_input_buf:0 blocked_clients:0

Memory

used_memory:15665527152 used_memory_human:14.59G used_memory_rss:16055222272 used_memory_rss_human:14.95G used_memory_peak:15665527152 used_memory_peak_human:14.59G total_system_memory:541523742720 total_system_memory_human:504.33G used_memory_lua:37888 used_memory_lua_human:37.00K maxmemory:53687091200 maxmemory_human:50.00G maxmemory_policy:volatile-ttl mem_fragmentation_ratio:1.02 mem_allocator:jemalloc-4.0.3

Persistence

loading:0 rdb_changes_since_last_save:195 rdb_bgsave_in_progress:0 rdb_last_save_time:1529221145 rdb_last_bgsave_status:ok rdb_last_bgsave_time_sec:-1 rdb_current_bgsave_time_sec:-1 aof_enabled:1 aof_rewrite_in_progress:1 aof_rewrite_scheduled:0 aof_last_rewrite_time_sec:-1 aof_current_rewrite_time_sec:0 aof_last_bgrewrite_status:ok aof_last_write_status:ok aof_current_size:50 aof_base_size:50 aof_pending_rewrite:0 aof_buffer_length:0 aof_rewrite_buffer_length:29475 aof_pending_bio_fsync:0 aof_delayed_fsync:0

Stats

total_connections_received:0 total_commands_processed:220 instantaneous_ops_per_sec:0 total_net_input_bytes:6771753510 total_net_output_bytes:0 instantaneous_input_kbps:203022.31 instantaneous_output_kbps:0.00 rejected_connections:0 sync_full:0 sync_partial_ok:0 sync_partial_err:0 expired_keys:0 evicted_keys:0 keyspace_hits:0 keyspace_misses:0 pubsub_channels:0 pubsub_patterns:0 latest_fork_usec:10758 migrate_cached_sockets:0

Replication

role:slave master_host:10.1.220.10 master_port:8112 master_link_status:up master_last_io_seconds_ago:0 master_sync_in_progress:0 slave_repl_offset:71164097 slave_priority:100 slave_read_only:1 connected_slaves:0 master_repl_offset:0 repl_backlog_active:0 repl_backlog_size:1048576 repl_backlog_first_byte_offset:0 repl_backlog_histlen:0

CPU

used_cpu_sys:30.90 used_cpu_user:61.78 used_cpu_sys_children:0.00 used_cpu_user_children:0.00

Commandstats

cmdstat_del:calls=25,usec=26,usec_per_call=1.04 cmdstat_rpush:calls=78,usec=38375,usec_per_call=491.99 cmdstat_lset:calls=38,usec=24660,usec_per_call=648.95 cmdstat_select:calls=1,usec=3,usec_per_call=3.00 cmdstat_expire:calls=78,usec=21555,usec_per_call=276.35

Cluster

cluster_enabled:0

Keyspace

db0:keys=21697215,expires=21697017,avg_ttl=0 hash_init_value: 1529381194

------ CLIENT LIST OUTPUT ------ id=2 addr=10.1.220.10:8112 fd=6 name= age=0 idle=0 flags=M db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=rpush

------ CURRENT CLIENT INFO ------ id=2 5 RPUSH $31 lags=M db=0 sub=0 psub=0 multi=-1 qbuf=0 qbuf-free=0 obl=0 oll=0 omem=0 events=r cmd=rpush argv[0]: 'RPUSH' O.O.O.O.O.O.O Fast memory test PASSED, however your memory can still be broken. Please run a memory test for several hours if possible. === REDIS BUG REPORT END. Make sure to include from START to END. ===

Comment From: austingod

楼主这个问题解决了吗？我也遇到了一样的问题

Comment From: yoav-steinberg

Looks like dup of #3740. Closing. Also seems like not relevant in newer redis versions (5+).

Redis redis

Server

Clients

Memory

Persistence

Stats

Replication

CPU

Commandstats

Cluster

Keyspace

Server

Clients

Memory

Persistence

Stats

Replication

CPU

Commandstats

Cluster

Keyspace