Execute the following command.

redis-cli RPUSH "minion-send-zminion_CLSAN-02-00" "{\"Command\":\"ping -c2 10.243.1.51\",\"ReturnQueue\":\"zminion-return-763d91df-9502-5754-68fe-5e6205e0cd62\",\"Time\":\"2019-12-30T13:18:30.534307617Z\"}"

Via the Redis Monitor I could see the following call is made.

[root@9a9f1c32a9ec ~]# redis-cli monitor | grep zminion 1577715278.182533 [0 127.0.0.1:59492] "RPUSH" "minion-send-zminion_CLSAN-02-00" "{\"Command\":\"ping -c2 10.243.1.51\",\"ReturnQueue\":\"zminion-return-763d91df-9502-5754-68fe-5e6205e0cd62\",\"Time\":\"2019-12-30T13:18:30.534307617Z\"}"

However, Looking @ the List I am not able to retrieve the List and always return Empty List

(zenoss) [zenoss@9a9f1c32a9ec ~]$ redis-cli keys minion-send-zminion_CLSAN-02-00 (empty list or set)

Note : minion-send-zminion_CLSAN-02-00 Key is not poped yet.

But when I try to execute

redis-cli RPUSH "minion-send-zminion_CLSAN-01-00" "{\"Command\":\"ping -c2 10.243.1.51\",\"ReturnQueue\":\"zminion-return-763d91df-9502-5754-68fe-5e6205e0cd62\",\"Time\":\"2019-12-30T13:18:30.534307617Z\"}"

(zenoss) [zenoss@9a9f1c32a9ec ~]$ redis-cli keys minion-send-zminion_CLSAN-01-00 1) "minion-send-zminion_CLSAN-01-00"

I would see the List was added Successfully.

Concluding In Redis I am unable to add a List with Specific Key minion-send-zminion_CLSAN-02-00 Apparently all other Keys works

Any ideas to debug further.. where to look and what to look.

I tired enabling debug logs in redis and tried to use redis-monitor command. However nothing relevant could be found ecplaining this issue

Redis Info

(zenoss) [zenoss@9a9f1c32a9ec ~]$ redis-cli info

Server redis_version:5.0.7 redis_git_sha1:00000000 redis_git_dirty:0 redis_build_id:a29954d59643a87b redis_mode:standalone os:Linux 3.10.0-693.11.6.el7.x86_64 x86_64 arch_bits:64 multiplexing_api:epoll atomicvar_api:atomic-builtin gcc_version:4.8.5 process_id:2039 run_id:789c9a012380120c0300160ad5592916698aab17 tcp_port:6379 uptime_in_seconds:12662 uptime_in_days:0 hz:10 configured_hz:10 lru_clock:657541 executable:/usr/bin/redis-server config_file:/etc/redis.conf

Clients connected_clients:69 client_recent_max_input_buffer:57361 client_recent_max_output_buffer:0 blocked_clients:6

Memory used_memory:2831760 used_memory_human:2.70M used_memory_rss:6373376 used_memory_rss_human:6.08M used_memory_peak:3545032 used_memory_peak_human:3.38M used_memory_peak_perc:79.88% used_memory_overhead:2207402 used_memory_startup:791360 used_memory_dataset:624358 used_memory_dataset_perc:30.60% allocator_allocated:2987456 allocator_active:3764224 allocator_resident:10096640 total_system_memory:33566855168 total_system_memory_human:31.26G used_memory_lua:161792 used_memory_lua_human:158.00K used_memory_scripts:1928 used_memory_scripts_human:1.88K number_of_cached_scripts:5 maxmemory:1073741824 maxmemory_human:1.00G maxmemory_policy:noeviction allocator_frag_ratio:1.26 allocator_frag_bytes:776768 allocator_rss_ratio:2.68 allocator_rss_bytes:6332416 rss_overhead_ratio:0.63 rss_overhead_bytes:-3723264 mem_fragmentation_ratio:2.30 mem_fragmentation_bytes:3604552 mem_not_counted_for_evict:0 mem_replication_backlog:0 mem_clients_slaves:0 mem_clients_normal:1356066 mem_aof_buffer:0 mem_allocator:jemalloc-5.1.0 active_defrag_running:0 lazyfree_pending_objects:0

Persistence loading:0 rdb_changes_since_last_save:3479 rdb_bgsave_in_progress:0 rdb_last_save_time:1577715796 rdb_last_bgsave_status:ok rdb_last_bgsave_time_sec:0 rdb_current_bgsave_time_sec:-1 rdb_last_cow_size:483328 aof_enabled:0 aof_rewrite_in_progress:0 aof_rewrite_scheduled:0 aof_last_rewrite_time_sec:-1 aof_current_rewrite_time_sec:-1 aof_last_bgrewrite_status:ok aof_last_write_status:ok aof_last_cow_size:0

Stats total_connections_received:84681 total_commands_processed:2608329 instantaneous_ops_per_sec:296 total_net_input_bytes:1965591855 total_net_output_bytes:2151413622 instantaneous_input_kbps:510.99 instantaneous_output_kbps:1351.68 rejected_connections:128 sync_full:0 sync_partial_ok:0 sync_partial_err:0 expired_keys:14365 expired_stale_perc:0.04 expired_time_cap_reached_count:0 evicted_keys:0 keyspace_hits:233551 keyspace_misses:519533 pubsub_channels:0 pubsub_patterns:0 latest_fork_usec:692 migrate_cached_sockets:0 slave_expires_tracked_keys:0 active_defrag_hits:0 active_defrag_misses:0 active_defrag_key_hits:0 active_defrag_key_misses:0

Replication role:master connected_slaves:0 master_replid:22e41c4cfee313a007d8b70d8bbceb929ec0c8ba master_replid2:0000000000000000000000000000000000000000 master_repl_offset:0 second_repl_offset:-1 repl_backlog_active:0 repl_backlog_size:1048576 repl_backlog_first_byte_offset:0 repl_backlog_histlen:0

CPU used_cpu_sys:130.743372 used_cpu_user:302.352116 used_cpu_sys_children:0.506021 used_cpu_user_children:0.349528

Cluster cluster_enabled:0

Keyspace db0:keys=654,expires=646,avg_ttl=136146