blob: c4155f84a0c3dde9d56859b541bf1c35a6c6e402 [file] [log] [blame] [view] [edit]
Project: /_project.yaml
Book: /_book.yaml
keywords: product:Bazel,Bzlmod,vendor
{# disableFinding("vendoring") #}
{# disableFinding("Vendoring") #}
{# disableFinding("vendored") #}
{# disableFinding("repo") #}
# Vendor Mode
{% include "_buttons.html" %}
Vendor mode is a feature that lets you create a local copy of
external dependencies. This is useful for offline builds, or when you want to
control the source of an external dependency.
## Enable vendor mode {:#enable-vendor-mode}
You can enable vendor mode by specifying `--vendor_dir` flag.
For example, by adding it to your `.bazelrc` file:
```none
# Enable vendor mode with vendor directory under <workspace>/vendor_src
common --vendor_dir=vendor_src
```
The vendor directory can be either a relative path to your workspace root or an
absolute path.
## Vendor a specific external repository {:#vendor-specific-repository}
You can use the `vendor` command with the `--repo` flag to specify which repo
to vendor, it accepts both [canonical repo
name](/external/overview#canonical-repo-name) and [apparent repo
name](/external/overview#apparent-repo-name).
For example, running:
```none
bazel vendor --vendor_dir=vendor_src --repo=@rules_cc
```
or
```none
bazel vendor --vendor_dir=vendor_src --repo=@@rules_cc+
```
will both get rules_cc to be vendored under
`<workspace root>/vendor_src/rules_cc+`.
## Vendor external dependencies for given targets {:#vendor-target-dependencies}
To vendor all external dependencies required for building given target patterns,
you can run `bazel vendor <target patterns>`.
For example
```none
bazel vendor --vendor_dir=vendor_src //src/main:hello-world //src/test/...
```
will vendor all repos required for building the `//src/main:hello-world` target
and all targets under `//src/test/...` with the current configuration.
Under the hood, it's doing a `bazel build --nobuild` command to analyze the
target patterns, therefore build flags could be applied to this command and
affect the result.
### Build the target offline {:#build-the-target-offline}
With the external dependencies vendored, you can build the target offline by
```none
bazel build --vendor_dir=vendor_src //src/main:hello-world //src/test/...
```
The build should work in a clean build environment without network access and
repository cache.
Therefore, you should be able to check in the vendored source and build the same
targets offline on another machine.
Note: If you make changes to the targets to build, the external dependencies,
the build configuration, or the Bazel version, you may need to re-vendor to make
sure offline build still works.
## Vendor all external dependencies {:#vendor-all-dependencies}
To vendor all repos in your transitive external dependencies graph, you can
run:
```none
bazel vendor --vendor_dir=vendor_src
```
Note that vendoring all dependencies has a few **disadvantages**:
- Fetching all repos, including those introduced transitively, can be time-consuming.
- The vendor directory can become very large.
- Some repos may fail to fetch if they are not compatible with the current platform or environment.
Therefore, consider vendoring for specific targets first.
## Configure vendor mode with VENDOR.bazel {:#configure-vendor-mode}
You can control how given repos are handled with the VENDOR.bazel file located
under the vendor directory.
There are two directives available, both accepting a list of
[canonical repo names](/external/overview#canonical-repo-name) as arguments:
- `ignore()`: to completely ignore a repository from vendor mode.
- `pin()`: to pin a repository to its current vendored source as if there is a
`--override_repository` flag for this repo. Bazel will NOT update the vendored
source for this repo while running the vendor command unless it's unpinned.
The user can modify and maintain the vendored source for this repo manually.
For example
```python
ignore("@@rules_cc+")
pin("@@bazel_skylib+")
```
With this configuration
- Both repos will be excluded from subsequent vendor commands.
- Repo `bazel_skylib` will be overridden to the source located under the
vendor directory.
- The user can safely modify the vendored source of `bazel_skylib`.
- To re-vendor `bazel_skylib`, the user has to disable the pin statement
first.
Note: Repository rules with
[`local`](/rules/lib/globals/bzl#repository_rule.local) or
[`configure`](/rules/lib/globals/bzl#repository_rule.configure) set to true are
always excluded from vendoring.
## Understand how vendor mode works {:#how-vendor-mode-works}
Bazel fetches external dependencies of a project under `$(bazel info
output_base)/external`. Vendoring external dependencies means moving out
relevant files and directories to the given vendor directory and use the
vendored source for later builds.
The content being vendored includes:
- The repo directory
- The repo marker file
During a build, if the vendored marker file is up-to-date or the repo is
pinned in the VENDOR.bazel file, then Bazel uses the vendored source by creating
a symlink to it under `$(bazel info output_base)/external` instead of actually
running the repository rule. Otherwise, a warning is printed and Bazel will
fallback to fetching the latest version of the repo.
Note: Bazel assumes the vendored source is not changed by users unless the repo
is pinned in the VENDOR.bazel file. If a user does change the vendored source
without pinning the repo, the changed vendored source will be used, but it will
be overwritten if its existing marker file is
outdated and the repo is vendored again.
### Vendor registry files {:#vendor-registry-files}
Bazel has to perform the Bazel module resolution in order to fetch external
dependencies, which may require accessing registry files through internet. To
achieve offline build, Bazel vendors all registry files fetched from
network under the `<vendor_dir>/_registries` directory.
### Vendor symlinks {:#vendor-symlinks}
External repositories may contain symlinks pointing to other files or
directories. To make sure symlinks work correctly, Bazel uses the following
strategy to rewrite symlinks in the vendored source:
- Create a symlink `<vendor_dir>/bazel-external` that points to `$(bazel info
output_base)/external`. It is refreshed by every Bazel command
automatically.
- For the vendored source, rewrite all symlinks that originally point to a
path under `$(bazel info output_base)/external` to a relative path under
`<vendor_dir>/bazel-external`.
For example, if the original symlink is
```none
<vendor_dir>/repo_foo+/link => $(bazel info output_base)/external/repo_bar+/file
```
It will be rewritten to
```none
<vendor_dir>/repo_foo+/link => ../../bazel-external/repo_bar+/file
```
where
```none
<vendor_dir>/bazel-external => $(bazel info output_base)/external # This might be new if output base is changed
```
Since `<vendor_dir>/bazel-external` is generated by Bazel automatically, it's
recommended to add it to `.gitignore` or equivalent to avoid checking it in.
With this strategy, symlinks in the vendored source should work correctly even
after the vendored source is moved to another location or the bazel output base
is changed.
Note: symlinks that point to an absolute path outside of $(bazel info
output_base)/external are not rewritten. Therefore, it could still break
cross-machine compatibility.
Note: On Windows, vendoring symlinks only works with
[`--windows_enable_symlinks`][windows_enable_symlinks]
flag enabled.
[windows_enable_symlinks]: /reference/command-line-reference#flag--windows_enable_symlinks