Running redis-benchmark does not report error when test is running without the -a flag for a server which requires authentication.
The results reported are effectively for time to get a (error) NOAUTH Authentication required. response rather than actually run the command. So, the benchmark reports incorrect results.
The fix could be to run a test ping to test whether authentication is required or not.
Comment From: filipecosta90
@zodvik fixed by #8869.