Skip to content

Commit

Permalink
Add table to record GPU hours used (#6295)
Browse files Browse the repository at this point in the history 
* Add table to record GPU hours used

* Formatting

* add newline
  • Loading branch information
@chelseatroy
chelseatroy authored Oct 16, 2024
1 parent 96b3446 commit 8b81394
Show file tree
Hide file tree
Showing 2 changed files with 41 additions and 0 deletions.
13 changes: 13 additions & 0 deletions sql/moz-fx-data-shared-prod/monitoring_derived/outerbounds_gpu_hours_v1/metadata.yaml
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,13 @@
friendly_name: Outerbounds GPU Hours Spreadsheet
description: >
The hours we use on Outerbounds GPU
owners:
- ctroy@mozilla.com
- aplacitelli@mozilla.com
- aaggarwal@mozilla.com
external_data:
format: google_sheets
source_uris:
- https://docs.google.com/spreadsheets/d/1j-tBTKOMlDxjbdEtn9EvH8KN99I5_jE5F0TSXvFuND4 # URL to the spreadsheet
options:
skip_leading_rows: 1 # number of rows that should be skipped, e.g if there are header rows
28 changes: 28 additions & 0 deletions sql/moz-fx-data-shared-prod/monitoring_derived/outerbounds_gpu_hours_v1/schema.yaml
View file
Original file line number Diff line number Diff line change
@@ -0,0 +1,28 @@
fields:
- mode: NULLABLE
name: event_date
type: DATE
- mode: NULLABLE
name: nca_id
type: STRING
- mode: NULLABLE
name: org_name
type: STRING
- mode: NULLABLE
name: email_domain
type: STRING
- mode: NULLABLE
name: function_id
type: STRING
- mode: NULLABLE
name: gpu_type
type: STRING
- mode: NULLABLE
name: gpus
type: INTEGER
- mode: NULLABLE
name: backend
type: STRING
- mode: NULLABLE
name: gpu_hours
type: FLOAT64

1 comment on commit 8b81394

@dataops-ci-bot
Copy link

Choose a reason for hiding this comment

The reason will be displayed to describe this comment to others. Learn more.

Integration report for "Add table to record GPU hours used (#6295)"

sql.diff

Click to expand! 
Only in /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/monitoring_derived: outerbounds_gpu_hours_v1
diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/monitoring_derived/outerbounds_gpu_hours_v1/metadata.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/monitoring_derived/outerbounds_gpu_hours_v1/metadata.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/monitoring_derived/outerbounds_gpu_hours_v1/metadata.yaml	1970-01-01 00:00:00.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/monitoring_derived/outerbounds_gpu_hours_v1/metadata.yaml	2024-10-16 17:16:46.000000000 +0000
@@ -0,0 +1,23 @@
+friendly_name: Outerbounds GPU Hours Spreadsheet
+description: |
+  The hours we use on Outerbounds GPU
+owners:
+- ctroy@mozilla.com
+- aplacitelli@mozilla.com
+- aaggarwal@mozilla.com
+labels:
+  owner1: ctroy
+  owner2: aplacitelli
+  owner3: aaggarwal
+bigquery: null
+workgroup_access:
+- role: roles/bigquery.dataViewer
+  members:
+  - workgroup:mozilla-confidential
+references: {}
+external_data:
+  format: google_sheets
+  source_uris:
+  - https://docs.google.com/spreadsheets/d/1j-tBTKOMlDxjbdEtn9EvH8KN99I5_jE5F0TSXvFuND4
+  options:
+    skip_leading_rows: 1
diff -bur --no-dereference --new-file /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/monitoring_derived/outerbounds_gpu_hours_v1/schema.yaml /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/monitoring_derived/outerbounds_gpu_hours_v1/schema.yaml
--- /tmp/workspace/main-generated-sql/sql/moz-fx-data-shared-prod/monitoring_derived/outerbounds_gpu_hours_v1/schema.yaml	1970-01-01 00:00:00.000000000 +0000
+++ /tmp/workspace/generated-sql/sql/moz-fx-data-shared-prod/monitoring_derived/outerbounds_gpu_hours_v1/schema.yaml	2024-10-16 17:14:28.000000000 +0000
@@ -0,0 +1,28 @@
+fields:
+  - mode: NULLABLE
+    name: event_date
+    type: DATE
+  - mode: NULLABLE
+    name: nca_id
+    type: STRING
+  - mode: NULLABLE
+    name: org_name
+    type: STRING
+  - mode: NULLABLE
+    name: email_domain
+    type: STRING
+  - mode: NULLABLE
+    name: function_id
+    type: STRING
+  - mode: NULLABLE
+    name: gpu_type
+    type: STRING
+  - mode: NULLABLE
+    name: gpus
+    type: INTEGER
+  - mode: NULLABLE
+    name: backend
+    type: STRING
+  - mode: NULLABLE
+    name: gpu_hours
+    type: FLOAT64

Link to full diff

Please sign in to comment.