Configure Cloud BigQuery Billing inputs for the Splunk Add-on for Google Cloud Platform¶
Google has deprecated regular file export of your Cloud Billing data to CSV and JSON. To export your Cloud Billing data for analysis, use Cloud Billing export to BigQuery.
Configure Cloud BigQuery Billing inputs for the Splunk Add-on for Google Cloud Platform using Splunk Web or via configuration file, using the information in the inputs parameters table below. For ease-of-use, configure your inputs for Cloud Billing via Splunk Web.
Configure Cloud BigQuery Billing inputs using Splunk Web¶
- Click Create New Input in the Inputs tab, and then choose Google Cloud BigQuery Billing.
- Enter the Name, Credentials, Project, BigQuery Dataset, BigQuery Table, Start Date, Interval and Index using the information in the inputs parameter table.
Google Cloud BigQuery Billing generates billing report at 00:00 every day at UTC−07:00 timezone.
For more information, see the Export Cloud Billing data to BigQuery topic in the Google Cloud documentation.
Configure Cloud BigQuery Billing inputs using the configuration file¶
- Create a file named
google_cloud_billing_inputs.conf
under$SPLUNK_HOME/etc/apps/Splunk_TA_google-cloudplatform/local
. -
Create stanzas using the following template. Use the
google_cloud_billing_inputs.conf.spec
file in$SPLUNK_HOME/etc/apps/Splunk_TA_google-cloudplatform/README
as a reference).[<name>] google_credentials_name = <value> google_project = <value> google_bq_dataset = <value> google_bq_table = <value> ingestion_start = <value> index = <value> polling_interval = <value>
Restart your Splunk platform after making changes to configuration (.conf) files.
Input Parameters¶
Each attribute in the following table corresponds to a field in Splunk Web.
Attribute |
Corresponding field in Splunk Web |
Description |
---|---|---|
|
Name |
Enter a unique name of the Google Cloud BigQuery Billing input |
|
Credentials |
The stanza name defined in
|
|
Project |
Google project ID |
|
BigQuery Dataset |
Google BigQuery dataset name |
|
BigQuery Table |
Google BigQuery table name |
|
Interval |
Data collection interval in seconds. The default is 3600 seconds. |
|
Start Date |
The add-on starts collecting data with a date later than
this. |
|
Index |
The index in which to store Google Cloud billing data. |