No description
Find a file
Daz DeBoer cfc50b189a
Merge pull request #527 from gradle/dd/fix-toolchain-cache
Fix caching of JDK toolchains for Gradle 7.6
2022-12-07 01:21:18 -07:00
.github Use Gradle 7.6 in unit tests 2022-12-07 17:30:05 +13:00
dist Build outputs 2022-12-07 20:10:55 +13:00
patches Reset patch and build outputs 2022-10-20 07:28:45 -06:00
release Update changelog post-release 2022-06-20 09:02:53 -06:00
src Save/restore extracted JDK instead of archive 2022-12-07 20:07:40 +13:00
test Use Gradle 7.6 in unit tests 2022-12-07 17:30:05 +13:00
.eslintignore Add various js build configs 2020-06-13 12:46:29 +02:00
.eslintrc.json Update development dependencies 2022-09-13 09:06:17 -06:00
.gitignore Commit asdf .tool-versions 2022-12-07 13:57:00 +13:00
.nvmrc Add .nvmrc 2022-06-04 09:10:03 -06:00
.prettierignore Add various js build configs 2020-06-13 12:46:29 +02:00
.prettierrc.json Allow source files to contain lines up to 120 characters 2021-10-29 07:50:06 -06:00
.tool-versions Commit asdf .tool-versions 2022-12-07 13:57:00 +13:00
action.yml Add experimental support for cache-cleanup 2022-08-22 14:08:28 -06:00
CODE_OF_CONDUCT.md add code of conduct 2019-09-21 20:57:04 +02:00
CONTRIBUTING.md Document the process to merge Dependabot upgrades 2022-09-27 07:53:44 -06:00
jest.config.js Simplify Jest setup 2022-05-15 09:52:50 -06:00
LICENSE Initial commit 2019-09-20 23:06:59 +02:00
package-lock.json Update development dependencies 2022-12-07 17:30:50 +13:00
package.json Update development dependencies 2022-12-07 17:30:50 +13:00
README.md Document gradle-home-cache-cleanup 2022-08-29 11:47:27 -06:00
tsconfig.json Split action, step 1 2020-06-13 13:30:20 +02:00

Execute Gradle builds in GitHub Actions workflows

This GitHub Action can be used to configure Gradle and optionally execute a Gradle build on any platform supported by GitHub Actions.

Use the action to setup Gradle

If you have an existing workflow invoking Gradle, you can add an initial "Setup Gradle" Step to benefit from caching, build-scan capture and other features of the gradle-build-action.

All subsequent Gradle invocations will benefit from this initial setup, via init scripts added to the Gradle User Home.

name: Run Gradle on PRs
on: pull_request
jobs:
  gradle:
    strategy:
      matrix:
        os: [ubuntu-latest, macos-latest, windows-latest]
    runs-on: ${{ matrix.os }}
    steps:
    - uses: actions/checkout@v3
    - uses: actions/setup-java@v3
      with:
        distribution: temurin
        java-version: 11
        
    - name: Setup Gradle
      uses: gradle/gradle-build-action@v2
    
    - name: Execute Gradle build
      run: ./gradlew build

Why use the gradle-build-action?

It is possible to directly invoke Gradle in your workflow, and the actions/setup-java@v3 action provides a simple way to cache Gradle dependencies.

However, the gradle-build-action offers a number of advantages over this approach:

The gradle-build-action is designed to provide these benefits with minimal configuration. These features work both when Gradle is executed via the gradle-build-action and for any Gradle execution in subsequent steps.

When using gradle-build-action we recommend that you not use actions/cache or actions/setup-java@v3 to explicitly cache the Gradle User Home. Doing so may interfere with the caching provided by this action.

Use a specific Gradle version

The gradle-build-action can download and install a specified Gradle version, adding this installed version to the PATH. Downloaded Gradle versions are stored in the GitHub Actions cache, to avoid requiring downloading again later.

 - uses: gradle/gradle-build-action@v2
   with:
     gradle-version: 6.5

The gradle-version parameter can be set to any valid Gradle version.

Moreover, you can use the following aliases:

Alias Selects
wrapper The Gradle wrapper's version (default, useful for matrix builds)
current The current stable release
release-candidate The current release candidate if any, otherwise fallback to current
nightly The latest nightly, fails if none.
release-nightly The latest release nightly, fails if none.

This can be handy to automatically verify your build works with the latest release candidate of Gradle:

name: Test latest Gradle RC
on:
  schedule:
    - cron: 0 0 * * * # daily
jobs:
  gradle-rc:
    runs-on: ubuntu-latest
    steps:
    - uses: actions/checkout@v3
    - uses: actions/setup-java@v3
      with:
        distribution: temurin
        java-version: 11
    - uses: gradle/gradle-build-action@v2
      with:
        gradle-version: release-candidate
    - run: gradle build --dry-run # just test build configuration

Gradle Execution

If the action is configured with an arguments input, then Gradle will execute a Gradle build with the arguments provided.

If no arguments are provided, the action will not execute Gradle, but will still cache Gradle state and configure build-scan capture for all subsequent Gradle executions.

name: Run Gradle on PRs
on: pull_request
jobs:
  gradle:
    strategy:
      matrix:
        os: [ubuntu-latest, macos-latest, windows-latest]
    runs-on: ${{ matrix.os }}
    steps:
    - uses: actions/checkout@v3
    - uses: actions/setup-java@v3
      with:
        distribution: temurin
        java-version: 11
    
    - name: Setup and execute Gradle 'test' task
      uses: gradle/gradle-build-action@v2
      with:
        arguments: test

Multiple Gradle executions in the same Job

It is possible to configure multiple Gradle executions to run sequentially in the same job. The initial Action step will perform the Gradle setup.

- uses: gradle/gradle-build-action@v2
  with:
    arguments: assemble
- uses: gradle/gradle-build-action@v2
  with:
    arguments: check

Gradle command-line arguments

The arguments input can be used to pass arbitrary arguments to the gradle command line. Arguments can be supplied in a single line, or as a multi-line input.

Here are some valid examples:

arguments: build
arguments: check --scan
arguments: some arbitrary tasks
arguments: build -PgradleProperty=foo
arguments: |
    build
    --scan
    -PgradleProperty=foo
    -DsystemProperty=bar    

If you need to pass environment variables, use the GitHub Actions workflow syntax:

- uses: gradle/gradle-build-action@v2
  env:
    CI: true
  with:
    arguments: build

Gradle build located in a subdirectory

By default, the action will execute Gradle in the root directory of your project. Use the build-root-directory input to target a Gradle build in a subdirectory.

- uses: gradle/gradle-build-action@v2
  with:
    arguments: build
    build-root-directory: some/subdirectory

Using a specific Gradle executable

The action will first look for a Gradle wrapper script in the root directory of your project. If not found, gradle will be executed from the PATH. Use the gradle-executable input to execute using a specific Gradle installation.

 - uses: gradle/gradle-build-action@v2
   with:
     arguments: build
     gradle-executable: /path/to/installed/gradle

This mechanism can also be used to target a Gradle wrapper script that is located in a non-default location.

Caching

By default, this action aims to cache any and all reusable state that may be speed up a subsequent build invocation.

The state that is cached includes:

  • Any distributions downloaded to satisfy a gradle-version parameter ;
  • A subset of the Gradle User Home directory, including downloaded dependencies, wrapper distributions, and the local build cache ;
  • Any configuration-cache data stored in the project .gradle directory. (Only supported for Gradle 7 or higher.)

To reduce the space required for caching, this action makes a best effort to reduce duplication in cache entries.

Caching is enabled by default. You can disable caching for the action as follows:

cache-disabled: true

Cache keys

Distributions downloaded to satisfy a gradle-version parameter are stored outside of Gradle User Home and cached separately. The cache key is unique to the downloaded distribution and will not change over time.

The state of the Gradle User Home and configuration-cache are highly dependent on the Gradle execution, so the cache key is composed of the current commit hash and the GitHub actions job id. As such, the cache key is likely to change on each subsequent run of GitHub actions. This allows the most recent state to always be available in the GitHub actions cache.

To reduce duplication between cache entries, certain artifacts are cached independently based on their identity. Artifacts that are cached independently include downloaded dependencies, downloaded wrapper distributions and generated Gradle API jars. For example, this means that all jobs executing a particular version of the Gradle wrapper will share common entries for wrapper distributions and for generated Gradle API jars.

Using the caches read-only

By default, the gradle-build-action will only write to the cache from Jobs on the default (main/master) branch. Jobs on other branches will read entries from the cache but will not write updated entries. See Optimizing cache effectiveness for a more detailed explanation.

In some circumstances it makes sense to change this default, and to configure a workflow Job to read existing cache entries but not to write changes back.

You can configure read-only caching for the gradle-build-action as follows:

# Only write to the cache for builds on the 'main' and 'release' branches. (Default is 'main' only.)
# Builds on other branches will only read existing entries from the cache.
cache-read-only: ${{ github.ref != 'refs/heads/main' && github.ref != 'refs/heads/release' }}

Stopping the Gradle daemon

By default, the action will stop all running Gradle daemons in the post-action step, prior to saving the Gradle User Home state. This allows for any Gradle User Home cleanup to occur, and avoid file-locking issues on Windows.

If caching is unavailable or the cache is in read-only mode, the daemon will not be stopped and will continue running after the job is completed.

Gradle User Home cache tuning

As well as any wrapper distributions, the action will attempt to save and restore the caches and notifications directories from Gradle User Home.

The contents to be cached can be fine tuned by including and excluding certain paths with Gradle User Home.

# Cache downloaded JDKs in addition to the default directories.
gradle-home-cache-includes: |
    caches
    notifications
    jdks    
# Exclude the local build-cache from the directories cached.
gradle-home-cache-excludes: |
    caches/build-cache-1    

You can specify any number of fixed paths or patterns to include or exclude. File pattern support is documented at https://docs.github.com/en/actions/learn-github-actions/workflow-syntax-for-github-actions#patterns-to-match-file-paths.

Cache debugging and analysis

Gradle User Home state will be restored from the cache during the first gradle-build-action step for any workflow job. This state will be saved back to the cache at the end of the job, after all Gradle executions have completed. A report of all cache entries restored and saved is printed to the Job Summary when saving the cache entries. This report can provide valuable insignt into how much cache space is being used.

It is possible to enable additional debug logging for cache operations. You do via the GRADLE_BUILD_ACTION_CACHE_DEBUG_ENABLED environment variable:

env:
  GRADLE_BUILD_ACTION_CACHE_DEBUG_ENABLED: true

Note that this setting will also prevent certain cache operations from running in parallel, further assisting with debugging.

Optimizing cache effectiveness

Cache storage space for GitHub actions is limited, and writing new cache entries can trigger the deletion of existing entries. Eviction of shared cache entries can reduce cache effectiveness, slowing down your gradle-build-action steps.

There are a number of actions you can take if your cache use is less effective due to entry eviction.

Select branches that should write to the cache

GitHub cache entries are not shared between builds on different branches. This means that each PR branch will have it's own Gradle User Home cache, and will not benefit from cache entries written by other PR branches. An exception to this is that cache entries written in parent and upstream branches are visible to child branches, and cache entries for the default (master/main) branch can be read by actions invoked for any other branch.

By default, the gradle-build-action will only write to the cache for builds run on the default (master/main) branch. Jobs run on other branches will only read from the cache. In most cases, this is the desired behaviour, because Jobs run against other branches will benefit from the cache Gradle User Home from main, without writing private cache entries that could lead to evicting shared entries.

If you have other long-lived development branches that would benefit from writing to the cache, you can configure these by overriding the cache-read-only action parameter. See Using the caches read-only for more details.

Similarly, you could use cache-read-only for certain jobs in the workflow, and instead have these jobs reuse the cache content from upstream jobs.

Exclude content from Gradle User Home cache

Each build is different, and some builds produce more Gradle User Home content than others. Cache debugging can provide insight into which cache entries are the largest, and you can selectively exclude content using gradle-home-cache-exclude.

Removing unused files from Gradle User Home before saving to cache

The Gradle User Home directory has a tendency to grow over time. When you switch to a new Gradle wrapper version or upgrade a dependency version the old files are not automatically and immediately removed. While this can make sense in a local environment, in a GitHub Actions environment it can lead to ever-larger Gradle User Home cache entries being saved and restored.

In order to avoid this situation, the gradle-build-action supports the gradle-home-cache-cleanup parameter. When enabled, this feature will attempt to delete any files in the Gradle User Home that were not used by Gradle during the GitHub Actions workflow, prior to saving the Gradle User Home to the GitHub Actions cache.

Gradle Home cache cleanup is disabled by default. You can enable this feature for the action as follows:

gradle-home-cache-cleanup: true

Saving build outputs

By default, a GitHub Actions workflow using gradle-build-action will record the log output and any Build Scan links for your build, but any output files generated by the build will not be saved.

To save selected files from your build execution, you can use the core Upload-Artifact action. For example:

jobs:   
  gradle:
    runs-on: ubuntu-latest
    steps:
    - name: Checkout project sources
      uses: actions/checkout@v3
    - name: Setup Gradle
      uses: gradle/gradle-build-action@v2
    - name: Run build with Gradle wrapper
      run: ./gradlew build --scan
    - name: Upload build reports
      uses: actions/upload-artifact@v3
      with:
        name: build-reports
        path: build/reports/

Build scans

If your build publishes a build scan the gradle-build-action action will:

  • Add a notice with the link to the GitHub Actions user interface
  • For each step that executes Gradle, adds the link to the published build scan as a Step output named build-scan-url.

You can then use that link in subsequent actions of your workflow. For example:

# .github/workflows/gradle-build-pr.yml
name: Run Gradle on PRs
on: pull_request
jobs:
  gradle:
    runs-on: ubuntu-latest
    steps:
    - name: Checkout project sources
      uses: actions/checkout@v3
    - name: Setup Gradle
      uses: gradle/gradle-build-action@v2
    - name: Run build with Gradle wrapper
      id: gradle
      run: ./gradlew build --scan
    - name: "Add build scan URL as PR comment"
      uses: actions/github-script@v5
      if: github.event_name == 'pull_request' && failure()
      with:
        github-token: ${{secrets.GITHUB_TOKEN}}
        script: |
          github.rest.issues.createComment({
            issue_number: context.issue.number,
            owner: context.repo.owner,
            repo: context.repo.repo,
            body: '❌ ${{ github.workflow }} failed: ${{ steps.gradle.outputs.build-scan-url }}'
          })          

Support for GitHub Enterprise Server (GHES)

You can use the gradle-build-action on GitHub Enterprise Server, and benefit from the improved integration with Gradle. Depending on the version of GHES you are running, certain features may be limited:

  • Build scan links are captured and displayed in the GitHub Actions UI
  • Easily run your build with different versions of Gradle
  • Save/restore of Gradle User Home (requires GHES v3.5+ : GitHub Actions cache was introduced in GHES 3.5)
  • Support for GitHub Actions Job Summary is not yet available in any version of GHES. Instead of producing a Job Summary, the build-results summary and caching report will be written to the workflow log, as part of the post-action step.