Do not fail if diffbase tmpdir cannot be deleted (#1648)

This should fix
https://buildkite.com/bazel/google-bazel-presubmit/builds/66803#0187fc62-25e9-4997-b1b4-f93da9d1ffef

Progress towards
https://github.com/bazelbuild/continuous-integration/issues/1643