Make the dynamic spawn scheduler use cross-cancellation between spawns.

This modifies the dynamic spawn scheduler so that each pair of concurrent
spawns has the ability to explicitly cancel its corresponding spawn as
desired, without relying on each spawn to abort execution before writing
to the output tree.

This is necessary so that we can later allow the remote branch of the
spawn to interrupt the local branch -- but only once all artifacts have
been downloaded. Such feature will come later.

This change is very intrusive to the point where I consider it a
different implementation of the DynamicSpawnStrategy with possible new
concurrency bugs. As a result, I'm keeping the old implementation around
behind a --legacy_spawn_scheduler flag (which defaults to true for now to
preserve the old behavior). The goal is, of course, to remove the legacy
implementation once we are confident with the new one.

As a side-effect, the changes in how exceptions are handled allow crashes
to propagate properly through the dynamic scheduler. They were previously
being coerced into ExecException, which made debugging more difficult.

RELNOTES: None.
PiperOrigin-RevId: 270039481
5 files changed
tree: 184119c52ab11719e41271e326b29d71a93547c9
  1. .bazelci/
  2. examples/
  3. scripts/
  4. site/
  5. src/
  6. third_party/
  7. tools/
  8. .bazelrc
  9. .gitattributes
  10. .gitignore
  11. AUTHORS
  12. BUILD
  13. CHANGELOG.md
  14. CODEOWNERS
  15. combine_distfiles.py
  16. combine_distfiles_to_tar.sh
  17. compile.sh
  18. CONTRIBUTING.md
  19. CONTRIBUTORS
  20. distdir.bzl
  21. ISSUE_TEMPLATE.md
  22. LICENSE
  23. README.md
  24. WORKSPACE
README.md

Bazel

{Fast, Correct} - Choose two

Build and test software of any size, quickly and reliably.

  • Speed up your builds and tests: Bazel only rebuilds what is necessary. With advanced local and distributed caching, optimized dependency analysis and parallel execution, you get fast and incremental builds.

  • One tool, multiple languages: Build and test Java, C++, Android, iOS, Go, and a wide variety of other language platforms. Bazel runs on Windows, macOS, and Linux.

  • Scalable: Bazel helps you scale your organization, codebase, and continuous integration solution. It handles codebases of any size, in multiple repositories or a huge monorepo.

  • Extensible to your needs: Easily add support for new languages and platforms with Bazel's familiar extension language. Share and re-use language rules written by the growing Bazel community.

Getting Started

Documentation

Contributing to Bazel

See CONTRIBUTING.md

Build status

Bazel is released in ‘Beta’. See the product roadmap to learn about the path toward a stable 1.0 release.