Remove unused functions (#2111)

Removing `shutil.rmtree(tmpdir)` could help resolve some Windows flaky
like:
https://buildkite.com/bazel/rules-python-python/builds/9668#01932a14-22ac-497e-adf1-f74a20539881