Skip to content

Configure Cloud BigQuery Billing inputs for the Splunk Add-on for Google Cloud Platform

Google has deprecated regular file export of your Cloud Billing data to CSV and JSON. To export your Cloud Billing data for analysis, use Cloud Billing export to BigQuery.

Configure Cloud BigQuery Billing inputs for the Splunk Add-on for Google Cloud Platform using Splunk Web or via configuration file, using the information in the inputs parameters table below. For ease-of-use, configure your inputs for Cloud Billing via Splunk Web.

Configure Cloud BigQuery Billing inputs using Splunk Web

  1. Click Create New Input in the Inputs tab, and then choose Google Cloud BigQuery Billing.
  2. Enter the Name, Credentials, Project, BigQuery Dataset, BigQuery Table, Start Date, Interval and Index using the information in the inputs parameter table.

Google Cloud BigQuery Billing generates billing report at 00:00 every day at UTC−07:00 timezone.

For more information, see the Export Cloud Billing data to BigQuery topic in the Google Cloud documentation.

Configure Cloud BigQuery Billing inputs using the configuration file

  1. Create a file named google_cloud_billing_inputs.conf under $SPLUNK_HOME/etc/apps/Splunk_TA_google-cloudplatform/local.
  2. Create stanzas using the following template. Use the google_cloud_billing_inputs.conf.spec file in $SPLUNK_HOME/etc/apps/Splunk_TA_google-cloudplatform/README as a reference).

    [<name>]
    google_credentials_name = <value>
    google_project = <value>
    google_bq_dataset = <value>
    google_bq_table = <value>
    ingestion_start = <value>
    index = <value>
    polling_interval = <value>
    

    3. Save the file and return to your Splunk instance.

Restart your Splunk platform after making changes to configuration (.conf) files.

Input Parameters

Each attribute in the following table corresponds to a field in Splunk Web.

Attribute

Corresponding field in Splunk Web

Description

name

Name

Enter a unique name of the Google Cloud BigQuery Billing input

google_credentials_name

Credentials

The stanza name defined in google_cloud_credentials.conf

google_project

Project

Google project ID

google_bq_dataset

BigQuery Dataset

Google BigQuery dataset name

google_bq_table

BigQuery Table

Google BigQuery table name

polling_interval

Interval

Data collection interval in seconds. The default is 3600 seconds.

ingestion_start

Start Date

The add-on starts collecting data with a date later than this.
Note: Google Cloud Billing generates a billing report at 00:00 every day at UTC−07:00 timezone.

index

Index

The index in which to store Google Cloud billing data.