Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Jump to bottom

Updated iOS onboarding funnel config to fix the submission_date error #6328

Open
wants to merge 46 commits into
base: rhythmofrain63-patch-1
Choose a base branch
from
Open

Updated iOS onboarding funnel config to fix the submission_date error #6328

wants to merge 46 commits into from

Conversation

rhythmofrain63
Copy link
Contributor

@rhythmofrain63 rhythmofrain63 commented Oct 10, 2024 •
edited by data-sync-user
Loading

Description

Related Tickets & Documents

  • DENG-XXXX
  • DSRE-XXXX

Reviewer, please follow this checklist

┆Issue is synchronized with this Jira Task

alekhyamoz and others added 30 commits October 9, 2024 16:09
@alekhyamoz @scholtzan
Skip generating org_mozilla_ios_focus_derived/baseline_clients_last_s… (
deae84e 
#6320)

* Skip generating org_mozilla_ios_focus_derived/baseline_clients_last_seen_v1/metadata.yaml

* Update bqetl_project.yaml

Co-authored-by: Anna Scholtz <anna@scholtzan.net>

---------

Co-authored-by: Anna Scholtz <anna@scholtzan.net>
@dependabot
Bump google-cloud-bigquery from 3.25.0 to 3.26.0 (#6318)
a329ce9 
Bumps [google-cloud-bigquery](https://github.com/googleapis/python-bigquery) from 3.25.0 to 3.26.0.
- [Release notes](https://github.com/googleapis/python-bigquery/releases)
- [Changelog](https://github.com/googleapis/python-bigquery/blob/main/CHANGELOG.md)
- [Commits](googleapis/python-bigquery@v3.25.0...v3.26.0)

---
updated-dependencies:
- dependency-name: google-cloud-bigquery
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump pre-commit from 3.8.0 to 4.0.1 (#6319)
75f4ae5 
Bumps [pre-commit](https://github.com/pre-commit/pre-commit) from 3.8.0 to 4.0.1.
- [Release notes](https://github.com/pre-commit/pre-commit/releases)
- [Changelog](https://github.com/pre-commit/pre-commit/blob/main/CHANGELOG.md)
- [Commits](pre-commit/pre-commit@v3.8.0...v4.0.1)

---
updated-dependencies:
- dependency-name: pre-commit
  dependency-type: direct:production
  update-type: version-update:semver-major
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump types-pytz from 2024.2.0.20240913 to 2024.2.0.20241003 (#6317)
f4d313c 
Bumps [types-pytz](https://github.com/python/typeshed) from 2024.2.0.20240913 to 2024.2.0.20241003.
- [Commits](https://github.com/python/typeshed/commits)

---
updated-dependencies:
- dependency-name: types-pytz
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@scholtzan
Fix typo in Bigconfig (#6321)
1920e18
@scholtzan
Generate BigConfig files for views (#6312)
c0114f4 
* Generate BigConfig files for views

* Re-enable monitoring for telemetry.releases
@dependabot
Bump exceptiongroup from 1.2.0 to 1.2.2 (#6324)
4322b46 
Bumps [exceptiongroup](https://github.com/agronholm/exceptiongroup) from 1.2.0 to 1.2.2.
- [Release notes](https://github.com/agronholm/exceptiongroup/releases)
- [Changelog](https://github.com/agronholm/exceptiongroup/blob/main/CHANGES.rst)
- [Commits](agronholm/exceptiongroup@1.2.0...1.2.2)

---
updated-dependencies:
- dependency-name: exceptiongroup
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump sqlglot from 25.21.3 to 25.24.5 (#6323)
aba76a0 
Bumps [sqlglot](https://github.com/tobymao/sqlglot) from 25.21.3 to 25.24.5.
- [Changelog](https://github.com/tobymao/sqlglot/blob/main/CHANGELOG.md)
- [Commits](tobymao/sqlglot@v25.21.3...v25.24.5)

---
updated-dependencies:
- dependency-name: sqlglot
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump types-python-dateutil from 2.9.0.20240906 to 2.9.0.20241003 (#6322)
c657841 
Bumps [types-python-dateutil](https://github.com/python/typeshed) from 2.9.0.20240906 to 2.9.0.20241003.
- [Commits](https://github.com/python/typeshed/commits)

---
updated-dependencies:
- dependency-name: types-python-dateutil
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@m-d-bowerman
replace CAST with SAFE_CAST (#6327)
e4ff38b
@kik-kik
fix: only generate Airflow task for BigEye if monitoring enabled in t…
221cd9b 
…he metadata (#6326)
@curtismorales
Extend timeout for no output for private-generate-sql step (#6336)
102669a
@ahal
Bug 1923976 - Change fxci_derived queries to run at 1800 (#6335)
6f53a9a 
These queries depend on data from the billing table, which often doesn't
get finalized until the afternoon of the following day.

It can sometimes populate records much later than that (one month I've
seen in the worst case), but that's a problem for another time. This
patch should at least fix the common case.
@dependabot
Bump pytest-pydocstyle from 2.3.2 to 2.4.0 (#6334)
8950757 
Bumps [pytest-pydocstyle](https://github.com/henry0312/pytest-pydocstyle) from 2.3.2 to 2.4.0.
- [Release notes](https://github.com/henry0312/pytest-pydocstyle/releases)
- [Commits](henry0312/pytest-pydocstyle@v2.3.2...v2.4.0)

---
updated-dependencies:
- dependency-name: pytest-pydocstyle
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump pandas from 2.2.2 to 2.2.3 (#6333)
0f108bb 
Bumps [pandas](https://github.com/pandas-dev/pandas) from 2.2.2 to 2.2.3.
- [Release notes](https://github.com/pandas-dev/pandas/releases)
- [Commits](pandas-dev/pandas@v2.2.2...v2.2.3)

---
updated-dependencies:
- dependency-name: pandas
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump bigeye-sdk from 0.4.88 to 0.4.90 (#6332)
8f3e440 
Bumps [bigeye-sdk](https://docs.bigeye.com/docs) from 0.4.88 to 0.4.90.

---
updated-dependencies:
- dependency-name: bigeye-sdk
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@BenWu
Add vpnsession and daemonsession pings to vpn events unnested (#6338)
dec443d
@dklawren @whd
Bug 1922987 - create syndication file for bugzilla_metrics (#6330)
5427f88 
* create syndication file for bugzilla_metrics

* I will need both dev and prod instances so split up into two configurations

* Update sql/moz-fx-data-shared-prod/bugzilla_dev_metrics/dataset_metadata.yaml

---------

Co-authored-by: whd <whd@users.noreply.github.com>
@BenWu
Create shredder_targets_joined table with additional table metadata (#…
14c2f18 
…6331)
@whd
Fix PR checklist link (#6340)
e0f5873
@scholtzan
Fix schema for sumo ga4_events (#6341)
530e987
@curtismorales
Add more memory for private-generate-sql task (#6342)
5f7ce6c
@whd
DSRE-1755 switch to v2 workgroup for stripe (#6290)
fe03467
@mmiermans @chelseybeck
[MC-1458] Add newtab_merino_priors DAG (#6303)
5e08071 
* [MC-1458] Add newtab_merino_priors DAG

* Extract shared JSON export function

---------

Co-authored-by: Chelsey Beck <64881557+chelseybeck@users.noreply.github.com>
@chelseybeck
adding dependecies on upstream tables (#6345)
dd2f02b
@whd
Set analysis dataset default retention to 180 days (#6346)
5dfb2ef
@kik-kik @scholtzan
feat: tweak glean_usage generator to include install_source in derive…
405402e 
…d baseline tables (#6173)

* feat: tweak glean_usage generator to include install_source in derived baseline tables

* Apply suggestions from code review

Co-authored-by: Anna Scholtz <anna@scholtzan.net>

* Update sql_generators/glean_usage/templates/clients_last_seen_joined.query.sql

* feat: update the test definition to include install_source

---------

Co-authored-by: Anna Scholtz <anna@scholtzan.net>
@kik-kik
feat: update fenix and ios feature_usage tables to use the new attrib…
da84f23 
…ution_clients (#6325)
@dependabot
Bump sqlglot from 25.24.5 to 25.25.0 (#6348)
36e4f6c 
Bumps [sqlglot](https://github.com/tobymao/sqlglot) from 25.24.5 to 25.25.0.
- [Changelog](https://github.com/tobymao/sqlglot/blob/main/CHANGELOG.md)
- [Commits](tobymao/sqlglot@v25.24.5...v25.25.0)

---
updated-dependencies:
- dependency-name: sqlglot
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump mkdocs-material from 9.5.39 to 9.5.40 (#6344)
21be705 
Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.5.39 to 9.5.40.
- [Release notes](https://github.com/squidfunk/mkdocs-material/releases)
- [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG)
- [Commits](squidfunk/mkdocs-material@9.5.39...9.5.40)

---
updated-dependencies:
- dependency-name: mkdocs-material
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
dependabot bot and others added 16 commits October 15, 2024 16:30
@dependabot
Bump black from 24.8.0 to 24.10.0 (#6343)
f60fbfc 
Bumps [black](https://github.com/psf/black) from 24.8.0 to 24.10.0.
- [Release notes](https://github.com/psf/black/releases)
- [Changelog](https://github.com/psf/black/blob/main/CHANGES.md)
- [Commits](psf/black@24.8.0...24.10.0)

---
updated-dependencies:
- dependency-name: black
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@kik-kik
feat: add bigconfig.yml to all mobile_kpi_metric tables only (#6337)
433b954 
* feat: add bigconfig.yml to all mobile_kpi_metric tables only

* fix: update the named schedule to be valid (exist inside BigEye)
@scholtzan
Deploy all BigConfig files at once (#6351)
c3c5cad
@chelseybeck
adding referenced tables for upstream dependencies (#6347)
68ed290 
* adding referenced tables for upstream dependencies

* formatting yaml
@kik-kik
feat(DENG-4577): add monitoring bigeye_usage view to allow us to get …
12677b6 
…more insight into bq usage and costs from bigeye (#6260)

* feat: add monitoring bigeye_usage view to allow us to get more insight into bq usage and costs from bigeye

* feat: add extract of bigeye table id checked in the bq information_schema

* feat: remove usage of the query field when setting up bigeye usage

* fix: invalid view definition for bigeye_usage view
@kik-kik
fix: add missing project id prefix in the bigconfig templates in the …
e886d4c 
…fq_table_name (#6352)

* fix: add missing project id prefix in the bigconfig templates in the fq_table_name

* feat: update the bigeye collection to use the non-kpi collection
@ahal
Bug 1923976 - Create a backfill for 'moz-fx-data-shared-prod.fxci_der…
484b8a9 
…ived.worker_costs_v1' to populate missing records (#6350)
@kik-kik
feat: add install_source to new_profiles selection as baseline ping n…
0e5b7c3 
…ow contains this info on the fenix app (#6356)
@dependabot
Bump google-cloud-bigquery-storage[fastavro] from 2.26.0 to 2.27.0 (#…
d066ba0 
…6354)

Bumps [google-cloud-bigquery-storage[fastavro]](https://github.com/googleapis/python-bigquery-storage) from 2.26.0 to 2.27.0.
- [Release notes](https://github.com/googleapis/python-bigquery-storage/releases)
- [Changelog](https://github.com/googleapis/python-bigquery-storage/blob/main/CHANGELOG.md)
- [Commits](googleapis/python-bigquery-storage@v2.26.0...v2.27.0)

---
updated-dependencies:
- dependency-name: google-cloud-bigquery-storage[fastavro]
  dependency-type: direct:production
  update-type: version-update:semver-minor
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot
Bump mkdocs-material from 9.5.40 to 9.5.41 (#6353)
571f923 
Bumps [mkdocs-material](https://github.com/squidfunk/mkdocs-material) from 9.5.40 to 9.5.41.
- [Release notes](https://github.com/squidfunk/mkdocs-material/releases)
- [Changelog](https://github.com/squidfunk/mkdocs-material/blob/master/CHANGELOG)
- [Commits](squidfunk/mkdocs-material@9.5.40...9.5.41)

---
updated-dependencies:
- dependency-name: mkdocs-material
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
@dependabot @scholtzan
Bump types-requests from 2.32.0.20240914 to 2.32.0.20241016 (#6355)
96b3446 
Bumps [types-requests](https://github.com/python/typeshed) from 2.32.0.20240914 to 2.32.0.20241016.
- [Commits](https://github.com/python/typeshed/commits)

---
updated-dependencies:
- dependency-name: types-requests
  dependency-type: direct:production
  update-type: version-update:semver-patch
...

Signed-off-by: dependabot[bot] <support@github.com>
Co-authored-by: dependabot[bot] <49699333+dependabot[bot]@users.noreply.github.com>
Co-authored-by: Anna Scholtz <anna@scholtzan.net>
@chelseatroy
Add table to record GPU hours used (#6295)
8b81394 
* Add table to record GPU hours used

* Formatting

* add newline
@ahal
Bug 1923976 - Mark fxci worker_costs_v1 backfill complete (#6359)
3e5528f
@alekhyamoz
Search Mobile - Fix engine coding from baseline tables (#6357)
bf391d7 
* Search Mobile -Fix engine coding from baseline tables

* fix the query to use existing udf

---------

Co-authored-by: Alekhya <alekhya@Mac.lan>
@kwindau
feat(DSRE-1774) Grant Google Ads access to desktop conv events view (#…
8d17916 
…6361)

* feat(DSRE-1774) Adding permissions for Google ads to access desktop conv events view

* feat(DSRE-1774): fix metadata file format

* DSRE-1774 - remove references and other unnecessary metadata
@BenWu @sean-rose
Bug 1905938 Support events with no metrics in glean_usage generator (#…
d7c8a12 
…6358)

* Bug 1905938 Support events with no metrics in glean_usage generator

* fix event_error_monitoring

* not

* Apply suggestions from code review

Co-authored-by: Sean Rose <1994030+sean-rose@users.noreply.github.com>

---------

Co-authored-by: Sean Rose <1994030+sean-rose@users.noreply.github.com>
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Reviewers
No reviews
Assignees
No one assigned
Labels
None yet
Projects
None yet
Milestone
No milestone
Development

Successfully merging this pull request may close these issues.