| --- | |
| layout: documentation | |
| title: Cquery (configurable query) | |
| --- | |
| <h1>Cquery (Configurable Query)</h1> | |
| <ul class="toc"> | |
| <li><a href="#overview">Overview</a></li> | |
| <li><a href="#basic-syntax">Basic Syntax</a></li> | |
| <li><a href="#functions">Functions</a></li> | |
| <li><a href="#options">Options</a></li> | |
| <li><a href="#known-issues">Known Issues</a></li> | |
| <li><a href="#updates">Updates</a></li> | |
| </ul> | |
| <h2 id='overview'>Overview</h2> | |
| <p> | |
| <code>cquery</code> is a command complementary to <code>query</code> that properly handles | |
| configurations. While <code>cquery</code> returns answers that are more correct, it does not | |
| replace <code>query</code> as it does not support all of <code>query</code>'s functions.</p> | |
| <p> | |
| <code>cquery</code> achieves configuration awareness by running after the | |
| <a href="skylark/concepts.html#evaluation-model">analysis phase</a> | |
| of a build, unlike traditional <code>query</code>, which runs after the loading phase.</p> | |
| <p> | |
| The most common use for <code>cquery</code> is obtaining answers that correctly evaluate | |
| <a href="be/common-definitions.html#configurable-attributes"><code>select()</code></a> | |
| statements in configurable attributes. For example: | |
| </p> | |
| <pre> | |
| $ cat > tree/BUILD <<EOF | |
| sh_library( | |
| name = "ash", | |
| deps = select({ | |
| ":excelsior": [":manna-ash"], | |
| ":americana": [":white-ash"], | |
| "//conditions:default": [":common-ash"], | |
| }), | |
| ) | |
| sh_library(name = "manna-ash") | |
| sh_library(name = "white-ash") | |
| sh_library(name = "common-ash") | |
| config_setting( | |
| name = "excelsior", | |
| values = {"define": "species=excelsior"}, | |
| ) | |
| config_setting( | |
| name = "americana", | |
| values = {"define": "species=americana"}, | |
| ) | |
| EOF | |
| #Traditional query | |
| $ bazel query "deps(//tree:ash)" --define species=excelsior --noimplicit_deps | |
| //tree:ash | |
| //tree:white-ash | |
| //tree:manna-ash | |
| //tree:common-ash | |
| #cquery | |
| $ bazel cquery "deps(//tree:ash)" --define species=excelsior --noimplicit_deps | |
| //tree:ash (hash-of-config) | |
| //tree:manna-ash (hash-of-config) | |
| </pre> | |
| <p> | |
| Keep in mind that <code>cquery</code> works only on the configured target graph. Because of this, | |
| it does not have insight into artifacts like build actions nor access to | |
| <code><a href="be/general.html#test_suite">test_suite</a></code> | |
| rules as they are not configured targets. | |
| </p> | |
| <h2 id='basic-syntax'>Basic Syntax</h2> | |
| <p>A simple example of the syntax for <code>cquery</code> is as follows:</p> | |
| <p><code>bazel cquery "function(//target)"</code></p> | |
| <p>The query expression (in quotes) consists of the following: | |
| <ul> | |
| <li> | |
| <b><code>function(...)</code></b> is the function to run on the target. <code>cquery</code> | |
| supports most of the same <a href="query.html#functions">functions</a> | |
| as traditional <code>query</code>. | |
| </li> | |
| <li><b><code>//target</code></b> is the expression fed to the function. In this example, the | |
| expression is a simple target, but the query language also allows nesting of functions. | |
| See the <a href="query-how-to.md">Query How-To</a> for examples. | |
| </li> | |
| </ul> | |
| <p> | |
| Note that <code>cquery</code> requires a target on which to run the | |
| loading and analysis phases. Unless otherwise specified, <code>cquery</code> parses | |
| the target(s) listed in the query expression. See the <code>--universe_scope</code> | |
| option below for querying targets built under other targets. | |
| </p> | |
| <h2 id='functions'>Functions</h2> | |
| <p> | |
| Of the <a href="query.html#functions" title="list of query functions">set of functions</a> | |
| supported by the traiditional <code>query</code>, <code>cquery</code> supports all but siblings, buildfiles, and tests. The | |
| functions listed below are <code>cquery</code>-specific. | |
| </p> | |
| <h3>config</h3> | |
| <p><code>expr ::= config(expr, word)</code></p> | |
| <p> | |
| The <code>config</code> operator attempts to return the result of the first argument, configured | |
| in the configuration specified by the second argument. Today, the second argument can only take in | |
| three options <code>target</code>, <code>host</code>, or <code>null</code> but we hope to expand | |
| this functionality to be able to input custom configurations (or custom configuration diffs from | |
| the default target configuration). | |
| </p> | |
| <p><code>$ bazel cquery config(//foo, host) --universe_scope=//bar</code></p> | |
| <p> | |
| Note that the above example query will return <code>//foo</code> configured in the host configuration | |
| <em>if and only if</em> <code>//foo</code> exists in the host configuration in the universe of | |
| this query (which we've set to the transitive closure of <code>//bar</code>). | |
| </p> | |
| <p> | |
| If not all results of the first argument can be found in the specified | |
| configuration, then only those that can be found are returned. If no results of the | |
| first argument can be found in the specified configuration, an error is thrown. | |
| </p> | |
| <h2 id='options'>Options</h2> | |
| <h3>Build Options</h3> | |
| <p> | |
| <code>cquery</code> runs on top of a regular Bazel build and thus inherits the set of | |
| <a href="command-line-reference.html#build-options">options</a> | |
| available during a build. | |
| </p> | |
| <h3>Cquery options</h3> | |
| <h4><code>--universe_scope</code> (comma-separated list)</h4> | |
| <p> | |
| Often, the dependencies of configured targets go through | |
| <a href="skylark/rules.html#configurations">transitions</a>, | |
| which causes their configuration to differ from their dependent. This flag allows you to query | |
| a target as if it were built as a dependency or a transitive dependency of another target. For | |
| example: | |
| </p> | |
| <pre> | |
| # x/BUILD | |
| genrule( | |
| name = "my_gen", | |
| srcs = ["x.in"], | |
| outs = ["x.cc"], | |
| cmd = "$(locations :tool) $< >$@", | |
| tools = [":tool"], | |
| ) | |
| cc_library( | |
| name = "tool", | |
| ) | |
| </pre> | |
| <p> | |
| Genrules configure their tools in the | |
| <a href="skylark/rules.html#configurations">host configuration</a> | |
| so the following queries would produce the following outputs: | |
| </p> | |
| <table class="table table-condensed table-bordered table-params"> | |
| <thead> | |
| <tr> | |
| <th>Query</th> | |
| <th>Target Built</th> | |
| <th>Output</th> | |
| </tr> | |
| </thead> | |
| <tbody> | |
| <tr> | |
| <td>bazel cquery "//x:tool"</td> | |
| <td>//x:tool</td> | |
| <td>//x:tool(targetconfig)</td> | |
| </tr> | |
| <tr> | |
| <td>bazel cquery "//x:tool" --universe_scope="//x:my_gen"</td> | |
| <td>//x:my_gen</td> | |
| <td>//x:tool(hostconfig)</td> | |
| </tr> | |
| </tbody> | |
| </table> | |
| <p> | |
| If this flag is set, its contents are built. <em>If it's not set, all targets | |
| mentioned in the query expression are built</em> instead. The transitive closure of the | |
| built targets are used as the universe of the query. Either way, the targets to | |
| be built must be buildable at the top level (that is, compatible with top-level | |
| options). <code>cquery</code> returns results in the transitive closure of these | |
| top-level targets. | |
| </p> | |
| <p> | |
| Even if it's possible to build all targets in a query expression at the top | |
| level, it may be beneficial to not do so. For example, explicitly setting | |
| <code>--universe_scope</code> could prevent building targets multiple times in | |
| configurations you don't care about. It could also help specify which configuration version of a | |
| target you're looking for (since it's not currently possible | |
| to fully specify this any other way). We recommend that you set this | |
| flag if your query expression is more complex than <code>deps(//foo)</code>. | |
| </p> | |
| <h4><code>--implicit_deps</code> (boolean, default=True)</h4> | |
| <p> | |
| Setting this flag to false filters out all results that aren't explicitly set in | |
| the BUILD file and instead set elsewhere by Bazel. | |
| </p> | |
| <h4><code>--tool_deps</code> (boolean, default=True)</h4> | |
| <p> | |
| Setting this flag to false filters out all configured targets for which the | |
| path from the queried target to them crosses a transition between the target | |
| configuration and the | |
| <a href="skylark/rules.html#configurations">non-target configurations</a>. | |
| If the queried target is in the target configuration, setting <code>--notool_deps</code> will | |
| only return targets that also are in the target configuration. If the queried | |
| target is in a non-target configuration, setting <code>--notool_deps</code> will only return | |
| targets also in non-target configurations. | |
| </p> | |
| <h2 id='output-formats'>Output Formats</h2> | |
| <p> By default, cquery outputs results in a dependency-ordered list of label and configuration pairs. | |
| There are other options for exposing the results as well. </p> | |
| <h3> Transitions </h3> | |
| <p> | |
| Configuration <a href="skylark/rules.html#configurations">transitions</a> | |
| are used to build targets underneath the top level targets in different configurations than the top | |
| level targets. For example, a target might impose a transition to the host transition on all | |
| dependencies in its <code>tools</code> attribute. These are known as attribute transitions. | |
| Rules can also impose transitions on their own configurations, known as rule class transitions. | |
| This output format outputs information about these transitions such as what type they are and the | |
| effect they have on build options. | |
| </p> | |
| <p>This output format is triggered by the <code>--transitions</code> flag which by default is set to | |
| <code>NONE</code>. It can be set to <code>FULL</code> or <code>LITE</code> mode. <code>FULL</code> | |
| mode outputs information about rule class transitions and attribute transitions including a detailed | |
| diff of the options before and after the transition. <code>LITE</code> mode outputs the same information | |
| without the options diff. | |
| </p> | |
| <h2 id='known-issues'>Known Issues</h2> | |
| <ul> | |
| <li> | |
| <strong>Inaccessible configurations.</strong> With the exception of the host configuration being | |
| printed as <code>HOST</code>, Configurations are currently output as | |
| hashes and there is no way for the user to input them (and thus to directly | |
| specify the configuration to query a target in).</li> | |
| <li> | |
| <strong>No support for <a href="skylark/aspects.html">aspects</a>, | |
| <a href="query.html#output-formats" title="list of query output formats">output | |
| options</a>, or recursive target patterns (/...).</strong></li> | |
| <li> | |
| <strong>Non-deterministic output.</strong> <code>Cquery</code> does not automatically wipe the build | |
| graph from previous commands and is therefore prone to picking up results | |
| from past queries. For example, <code>genquery</code> exerts a host transition on its <code>tools</code> | |
| attribute - that is, it configures its tools in the | |
| <a href="skylark/rules.html#configurations">host configuration</a>. | |
| We can see the lingering effects of that transition below.</li> | |
| </ul> | |
| <pre> | |
| $ cat > foo/BUILD <<<EOF | |
| genrule( | |
| name = "my_gen", | |
| srcs = ["x.in"], | |
| outs = ["x.cc"], | |
| cmd = "$(locations :tool) $< >$@", | |
| tools = [":tool"], | |
| ) | |
| cc_library( | |
| name = "tool", | |
| ) | |
| EOF | |
| $ bazel cquery "//foo:tool" | |
| tool(target_config) | |
| $ bazel cquery "deps(//foo:my_gen)" | |
| my_gen (target_config) | |
| tool (host_config) | |
| ... | |
| $ bazel cquery "//foo:tool" | |
| tool(host_config) | |
| </pre> | |
| <p> | |
| Workaround: change any startup option to force re-analysis of configured targets. For example, | |
| add <code>--test_arg=<whatever></code> to your build command. | |
| </p> | |
| <h2 id='updates'>Updates</h2> | |
| <p> | |
| The Bazel configurability team is continuously improving <code>cquery</code>. If you want to | |
| ask questions, stay updated, or get involved, contact juliexxia@google.com | |
| </p> |