Skip to main content

Overview

Google Cloud Batch is a fully managed batch processing service that enables you to run large-scale batch jobs on Google Cloud. Tracer integrates with Google Cloud Batch to provide real-time observability for your batch workloads.

Prerequisites

  • Google Cloud account with Batch API enabled
  • gcloud CLI installed and configured
  • Tracer account and API token

Getting Started

1. Create a Machine Image With Tracer Installed

1

Create a new VM instance in Google Cloud.

2

Install Tracer on the instance.

3

Configure Tracer to run as a service so it automatically starts when the system boots.

Once everything is correctly installed and running, create a Machine Image from this VM. This Machine Image will serve as the base template for future instances.

2. Set the Machine Image as the Default for New Instances

1

In your Google Batch configuration, set the Machine Image created above to be the default boot image.

2

This makes sure that every time a new Batch machine is spawned, it loads the image with Tracer pre-installed and running.

In this way, all new instances will automatically have Tracer active without any manual setup.

3. Update Your nextflow.config to Work With Tracer

1

Improve your nextflow.config so that it integrates correctly with Tracer in Google Batch environments.

2

You can base the necessary configuration changes on the example below:

Link: https://github.com/healops-ai/nextflow-test-pipelines/pull/84/files