PR failures currently fail early if there are formatting or checkstyle issues. It would be nice if the user could see every problem, including test failures.

For command line builds, we'll leaving it failing fast.