commit | 1ef910b28bc01af1f36beed9cff6e5e4e9a29bcc | [log] [tgz] |
---|---|---|
author | ulfjack <ulfjack@google.com> | Wed Jun 05 07:09:04 2019 -0700 |
committer | Copybara-Service <copybara-worker@google.com> | Wed Jun 05 07:10:00 2019 -0700 |
tree | 903d21622b3d7666800f85b629c4dd0a3ef606c2 | |
parent | 9083bbe645818a25894b23e70d723f7c7dad36e4 [diff] |
Query performance: Support length-delimited protos Add support for --output=streamed_proto, which outputs the targets as a stream of length-delimited plain protos rather than a single monolithic proto. For queries with a lot of results, this is significantly faster (up to ~30% in my tests, though note that my baseline test contained a series of as-yet unsubmitted improvements). The primary driver of the performance improvement on the Bazel side appears to be the decreased memory pressure resulting in lower gc times. In any case, the requirement to retain the full result on the Bazel side as well as the receiver side is a showstopper for large queries. We might want to consider wrapping the resulting targets in another proto that allows us to add some per-package information in the future. Another performance issue is the duplicate location field on every single target, which constitutes up to ~30% of the output size. Even with relative paths, we see around ~14% of the output being location data. PiperOrigin-RevId: 251636100
{Fast, Correct} - Choose two
Build and test software of any size, quickly and reliably.
Speed up your builds and tests: Bazel only rebuilds what is necessary. With advanced local and distributed caching, optimized dependency analysis and parallel execution, you get fast and incremental builds.
One tool, multiple languages: Build and test Java, C++, Android, iOS, Go, and a wide variety of other language platforms. Bazel runs on Windows, macOS, and Linux.
Scalable: Bazel helps you scale your organization, codebase, and continuous integration solution. It handles codebases of any size, in multiple repositories or a huge monorepo.
Extensible to your needs: Easily add support for new languages and platforms with Bazel's familiar extension language. Share and re-use language rules written by the growing Bazel community.
Follow our tutorials:
See CONTRIBUTING.md
Bazel is released in ‘Beta’. See the product roadmap to learn about the path toward a stable 1.0 release.