Connecting cloud account is an essential part of Cloudthread onboarding process and the most fundamental part of the setup. You cannot skip this step – your organization's cloud savings, billing, and usage data is essential for the platform to deliver value, i.e. help you to increase efficiency of your cloud spend.
This is the guide for the initial data access setup, which is aimed at GCP Billing Account (see GCP Cloud Billing documentation for more information). This setup fully covers:
After your account is created and confirmed via email, you'll be prompted to get connected to your GCP environment by following the instructions.
Execute following steps in your GCP Organization:
- Create a Billing Account (if applicable)
- Create a Billing Project (if applicable)
- Link the Billing Project from Step 2 to the Billing Account from Step 1 (if applicable)
- Link the desired Resource Projects to the Billing Account from Step 1 (if applicable)
- Create the Billing BigQuery Export Dataset
- Enable the Detailed usage cost export for the Billing Account from Step 1 using the Billing BigQuery Export Dataset from Step 3
Once you've completed the steps above click the button below to complete the integration by providing permissions to a Cloudthread generated Service Account.
Once the billing reporting is set up in GCP, click Setup GCP Service Account Permissions
and fill in the Create GCP Collection Config form.
{% hint style="info" %} GCP Collection Config is used to pull data from your GCP environment. {% endhint %}
For the GCP projects you want to be covered by the cost-savings features (leveraging GCP Recommender API) set up IAM permissions for Cloudthread in GCP Console:
- Copy the Service Account in the integration form in Cloudthread App
- Go to IAM in all the Projects where you'd like to collect savings opportunities
- For each Project, click
+ Grant Access
- Paste the Service Account into the New principals field
- Add
Recommender Viewer
permissions - Save the access
- Ensure the Recommender API is enabled for each Project
Once the permissions are added and saved for each target Project, come back to Cloudthread Create GCP Collection Config form and add Recommender Project IDs
to the form field.
Step 1. Add IAM permissions for Big Query access
- Copy the Service Account in the integration form in Cloudthread App
- Go to IAM in your Billing Project
- Click
+ Grant Access
- Paste the Service Account into the
New principals
field - Add the
BigQuery Job User
permissions - Save the access
- Go to BigQuery in your Billing Project
Step 2. Add permissions for Billing Dataset access
- Navigate to your Billing BigQuery Export Dataset and click the data set
- Click
+ Sharing
and thenPermissions
- Click
+ Add Principal
- Paste the Service Account into the
New principals
field - Add the
BigQuery Data Viewer
permissions - Save the access
- Ensure the BigQuery API is enabled for your Billing Project
Step 3. Fill in Create GCP Collection Config form
Once the permissions are added and saved for each target Project, come back to Cloudthread Create GCP Collection Config form and:
-
Add
Billing Data Project ID
to the form field- Make sure the Project has the billing data – it can be different from the one you enabled Recommender for.
-
Add
Billing Data Table ID
to the form filed- To determine your Table ID go to GCP BigQuery and select your Billing BigQuery Export Dataset and find the
Detailed usage cost
Table ID in the table Details
- To determine your Table ID go to GCP BigQuery and select your Billing BigQuery Export Dataset and find the
Once the permissions are set up in GCP console and GCP Collection Config form is filled, click Validate
to make sure the integration has no errors. If this is the case, click Save Config
to enable the integration.
If the GCP integration went through, you will see the success message in Cloudthread app.
Clock Continue
to start using the app and seeing the first cost insights.
{% hint style="warning" %} Some sections of the app are grayed out right after the integration due to data pull integration timeline. {% endhint %}