Reapply and fix "Log jobs that have been retried" (#2332) (#2335) (#2338)

This reverts commit 4da09fabf3ef40f44cad9ebc09fd4e9b245468a3.

Additional code to fix errors:
- Upload errors are no longer fatal
- Added some logging
- Fixed `gsutil cp` command to require fewer permissions.
1 file changed