Google Git
Sign in
bazel / bazel / 07924e8260a447b69b18e8248203e1089b46962a
commit07924e8260a447b69b18e8248203e1089b46962a[log] [tgz]
authorleba <leba@google.com>Thu Oct 10 05:16:01 2019 -0700
committerCopybara-Service <copybara-worker@google.com>Thu Oct 10 05:16:53 2019 -0700
treea2d63dff3a6041666018e46e29f32e8ae35ea94d
parent6d05ca5e5c9245f18052a3315a954f4c8ff40d96 [diff]
First iteration of NestedSet-on-Skyframe

Main Idea:
When an Action is executed with ActionExecutionFunction, the actions's input
NestedSet<Artifact> could be evaluated as an ArtifactNestedSetKey [1].
ArtifactNestedSetFunction then evaluates the ArtifactNestedSetKey:
- Evaluates the directs elements as Artifacts. Commit the result into artifactToSkyValueMap.
- Evaluates the transitive elements as ArtifactNestedSetKey.

ActionExecutionFunction can then access this map to get the Artifacts' values.

[1] Heuristic: If the size of the NestedSet exceeds a certain threshold, we evaluate it as an ArtifactNestedSetKey.

Notes:
- The new feature is hidden behind a flag --experimental_nested_set_as_skykey_threshold. The default code path is not affected. We'd like to get this checked into the codebase, then from there improve it incrementally.
- It currently only works without the Action Cache.

Next Steps:
- Figure out the main source of additional pressure on GC & address it
- Add tests

RELNOTES: Introduce --experimental_nested_set_as_skykey_threshold
PiperOrigin-RevId: 273938957
11 files changed
tree: a2d63dff3a6041666018e46e29f32e8ae35ea94d
  1. .bazelci/
  2. examples/
  3. scripts/
  4. site/
  5. src/
  6. third_party/
  7. tools/
  8. .bazelrc
  9. .gitattributes
  10. .gitignore
  11. AUTHORS
  12. BUILD
  13. CHANGELOG.md
  14. CODEOWNERS
  15. combine_distfiles.py
  16. combine_distfiles_to_tar.sh
  17. compile.sh
  18. CONTRIBUTING.md
  19. CONTRIBUTORS
  20. distdir.bzl
  21. ISSUE_TEMPLATE.md
  22. LICENSE
  23. README.md
  24. WORKSPACE
README.md

Bazel

{Fast, Correct} - Choose two

Build and test software of any size, quickly and reliably.

  • Speed up your builds and tests: Bazel rebuilds only what is necessary. With advanced local and distributed caching, optimized dependency analysis and parallel execution, you get fast and incremental builds.

  • One tool, multiple languages: Build and test Java, C++, Android, iOS, Go, and a wide variety of other language platforms. Bazel runs on Windows, macOS, and Linux.

  • Scalable: Bazel helps you scale your organization, codebase, and continuous integration solution. It handles codebases of any size, in multiple repositories or a huge monorepo.

  • Extensible to your needs: Easily add support for new languages and platforms with Bazel's familiar extension language. Share and re-use language rules written by the growing Bazel community.

Getting Started

Documentation

Contributing to Bazel

See CONTRIBUTING.md

Build status

Bazel is released in ‘Beta’. See the product roadmap to learn about the path toward a stable 1.0 release.