Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Stream 957/adhoc gha #57

Closed
wants to merge 165 commits into from
Closed
Changes from 2 commits
Commits
Show all changes
165 commits
Select commit Hold shift + click to select a range
7cb3fbb
Updated README.md & configured xyz-models fork for datascience
ShahNewazKhan Mar 27, 2024
ebc146a
Merge pull request #1 from FlipsideCrypto/STREAM-827/setup-poc-quantu…
ShahNewazKhan Mar 27, 2024
0dd0e31
set dbt docs update to workflow_dispatch
ShahNewazKhan Mar 27, 2024
749ea6e
deploy livequery schemas | models
ShahNewazKhan Mar 27, 2024
73e3d73
add api integrations and udf_bulk_rest_api macros
ShahNewazKhan Mar 28, 2024
d656580
added poc sportsdv lq model
ShahNewazKhan Mar 28, 2024
121c1fb
Update dbt_docs_update.yml
ShahNewazKhan Apr 3, 2024
793832c
Merge pull request #3 from FlipsideCrypto/ShahNewazKhan-patch-1
ShahNewazKhan Apr 3, 2024
15d6eb6
Update dbt_docs_update.yml
ShahNewazKhan Apr 3, 2024
d8d4c0c
Merge pull request #4 from FlipsideCrypto/ShahNewazKhan-patch-2
ShahNewazKhan Apr 3, 2024
e6fc0c0
fix lq dbt_project vars
ShahNewazKhan Apr 4, 2024
5acf5cb
Added makefile poc directive
ShahNewazKhan Apr 4, 2024
59d76ef
added gha task artifacts
ShahNewazKhan Apr 4, 2024
d629579
Create dbt_test_tasks.yml
ShahNewazKhan Apr 4, 2024
0e12a41
Merge pull request #5 from FlipsideCrypto/ShahNewazKhan-patch-3
ShahNewazKhan Apr 4, 2024
ea13b6c
e2e run success
ShahNewazKhan Apr 5, 2024
d411d54
inline comments for quantum model poc
ShahNewazKhan Apr 5, 2024
c4946ac
add make directive doc and fix typos in inline comments
ShahNewazKhan Apr 5, 2024
f7a256e
set user_id system for lq pull cte
ShahNewazKhan Apr 5, 2024
78ff99f
add gha tasks documentation pointer
ShahNewazKhan Apr 5, 2024
18e6a91
Update README.md
ShahNewazKhan Apr 5, 2024
fabb341
Update README.md
ShahNewazKhan Apr 5, 2024
11007d1
update external table
ShahNewazKhan Apr 5, 2024
554bbf7
Add streamline tuning documentation pointers
ShahNewazKhan Apr 5, 2024
4a50b76
Update README.md
ShahNewazKhan Apr 5, 2024
e307b70
unpin patch versions
ShahNewazKhan Apr 5, 2024
5b097db
Merge branch 'main' into STREAM-827/create-poc-quantum-models
ShahNewazKhan Apr 5, 2024
5f7623b
Merge pull request #2 from FlipsideCrypto/STREAM-827/create-poc-quant…
ShahNewazKhan Apr 5, 2024
f0a15df
Update README.md
ShahNewazKhan Apr 5, 2024
dbe5ae1
Merge pull request #6 from FlipsideCrypto/ShahNewazKhan-patch-4
ShahNewazKhan Apr 5, 2024
a208028
Update README.md
ShahNewazKhan Apr 5, 2024
bf80b96
Merge pull request #7 from FlipsideCrypto/ShahNewazKhan-patch-5
ShahNewazKhan Apr 5, 2024
d41fea3
Update README.md
ShahNewazKhan Apr 5, 2024
555af45
Update README.md
ShahNewazKhan Apr 5, 2024
225a423
Update README.md
ShahNewazKhan Apr 5, 2024
ad9c142
Update README.md
ShahNewazKhan Apr 5, 2024
9de56c0
Update README.md
ShahNewazKhan Apr 5, 2024
6d9de51
Update README.md
ShahNewazKhan Apr 5, 2024
eb2d465
remove sportsdb poc
ShahNewazKhan Apr 9, 2024
df1f5ee
add bronze / silver blocks artifacts
ShahNewazKhan Apr 9, 2024
a526fc9
remove wip .sql
ShahNewazKhan Apr 9, 2024
b7984a3
remove decode logs macro
ShahNewazKhan Apr 9, 2024
39fef51
remove cached gha workflow
ShahNewazKhan Apr 9, 2024
3062a93
lowercase target.database
ShahNewazKhan Apr 9, 2024
b53f2e5
Merge pull request #8 from FlipsideCrypto/STREAM-827/blocks-quantum-m…
ShahNewazKhan Apr 9, 2024
bc7f478
aptos silver blocks success
ShahNewazKhan Apr 10, 2024
eb35231
add batched quantum model
ShahNewazKhan Apr 10, 2024
416607e
purge comments | fix partition_key
ShahNewazKhan Apr 10, 2024
713a44d
remove non batched example
ShahNewazKhan Apr 10, 2024
00b5c14
move depends on clause up
ShahNewazKhan Apr 10, 2024
91a4b8e
Merge branch 'main' into STREAM-827/aptos-blocks-silver-quantum-model…
ShahNewazKhan Apr 10, 2024
17c4973
Merge pull request #9 from FlipsideCrypto/STREAM-827/aptos-blocks-sil…
ShahNewazKhan Apr 10, 2024
3b9ab0a
aggregate block_height in batches cte
ShahNewazKhan Apr 10, 2024
bad6c07
add non batched example
ShahNewazKhan Apr 10, 2024
c2384e6
Add inline comments to DL aptos_blocks_tx model
ShahNewazKhan Apr 11, 2024
ae13144
add batched lq calls to silver__blocks
ShahNewazKhan Apr 11, 2024
6ba8bca
Add max_batch_rows support
ShahNewazKhan Apr 11, 2024
b2e810f
add make silver directive
ShahNewazKhan Apr 11, 2024
6f2ff06
Add quantum synergy documentation
ShahNewazKhan Apr 11, 2024
b2690f7
Merge branch 'STREAM-827/aptos-blocks-silver-quantum-models-poc' into…
ShahNewazKhan Apr 11, 2024
6ba538a
Update README.md docs formating
ShahNewazKhan Apr 11, 2024
96c3e53
Fix readme.md typos
ShahNewazKhan Apr 11, 2024
db46a4d
add details about bronze -> silver layer ingest to README.md
ShahNewazKhan Apr 11, 2024
980c47e
Fix formating for Makefile
ShahNewazKhan Apr 11, 2024
8f8c3a4
add pre-hook to set lq_context for bronze layer to spoof SL run
ShahNewazKhan Apr 11, 2024
35ad3c9
Add make ephemeral directive
ShahNewazKhan Apr 11, 2024
43583f0
add resuable ephemeral quantum model to bronze & silver
ShahNewazKhan Apr 11, 2024
7cebab7
Updated bronze and silver ephemeral details in README.md
ShahNewazKhan Apr 11, 2024
65b0e89
Update dbt_project pre-hook paths
ShahNewazKhan Apr 12, 2024
d69447f
add aptos_poc_model sequence diagram artifacts
ShahNewazKhan Apr 15, 2024
1a07275
update dbt_project with MAX_BATCH_ROWS definition
ShahNewazKhan Apr 15, 2024
3bb862a
Merge pull request #10 from FlipsideCrypto/STREAM-827/batched-lq-quantum
ShahNewazKhan Apr 15, 2024
1b202b0
Merge pull request #11 from FlipsideCrypto/STREAM-827/aptos-blocks-si…
ShahNewazKhan Apr 15, 2024
451c0bd
add silver blocks sequence diagram
ShahNewazKhan Apr 16, 2024
fcb5899
Merge pull request #12 from FlipsideCrypto/STREAM-827/silver_blocks_s…
ShahNewazKhan Apr 16, 2024
08ebb15
add silver blocks sequence diagram to readme.md
ShahNewazKhan Apr 16, 2024
603b2db
Merge pull request #13 from FlipsideCrypto/STREAM-827/silver_blocks_s…
ShahNewazKhan Apr 16, 2024
cda8ebf
fixed README.MD typos
ShahNewazKhan Apr 18, 2024
0d885b4
Merge pull request #14 from FlipsideCrypto/STREAM-827/fix-readme-typos
ShahNewazKhan Apr 18, 2024
718adb4
Update README.md
ShahNewazKhan Apr 25, 2024
4605263
Merge pull request #15 from FlipsideCrypto/ShahNewazKhan-patch-6
ShahNewazKhan Apr 25, 2024
e01affb
Update README.md
ShahNewazKhan May 7, 2024
4dac7b2
Merge pull request #16 from FlipsideCrypto/ShahNewazKhan-patch-7
ShahNewazKhan May 7, 2024
17f54ae
incremental avax scoring model
ShahNewazKhan Jun 21, 2024
68b5ead
prune unused files
ShahNewazKhan Jun 21, 2024
720c747
remove full-refresh flag from makefile
ShahNewazKhan Jun 21, 2024
1a6417e
fix sql formatting
ShahNewazKhan Jun 21, 2024
e3277ec
removed aptos batched file from poc checkin
ShahNewazKhan Jun 21, 2024
e7f00b3
add unique_key & cluster_by configs | fix filename typ0
ShahNewazKhan Jun 21, 2024
3a4a3a2
add onchain scores gha
ShahNewazKhan Jun 21, 2024
9dedb75
set full-refresh config to false
ShahNewazKhan Jun 21, 2024
dc0a1ab
add current_date_var
ShahNewazKhan Jun 21, 2024
7fa2ebe
Merge pull request #18 from FlipsideCrypto/STREAM-933/scoring-gha
ShahNewazKhan Jun 21, 2024
dab0924
fix current_date_var interpolation into jinja
ShahNewazKhan Jun 21, 2024
e3c9260
name gha appropriately
ShahNewazKhan Jun 21, 2024
0d23bb9
Create dbt_run_daily_onchain_scores.yml
ShahNewazKhan Jun 21, 2024
a087935
add workflow envar logic
ShahNewazKhan Jun 21, 2024
758e17c
Merge pull request #19 from FlipsideCrypto/ShahNewazKhan-patch-8
ShahNewazKhan Jun 21, 2024
86829c5
remove on-run-start
ShahNewazKhan Jun 21, 2024
0d1e3ee
fix warehouse
ShahNewazKhan Jun 21, 2024
75a387d
add incremental run logic to get current_date_var
ShahNewazKhan Jun 21, 2024
18f40e8
add date string interpolation logic for strings passed in
ShahNewazKhan Jun 21, 2024
9cbf638
update incremental logic to account for dynamic date range
ShahNewazKhan Jun 25, 2024
99a513a
Merge branch 'main' into STREAM-932/avax-mdl
ShahNewazKhan Jun 25, 2024
4998c06
Merge pull request #17 from FlipsideCrypto/STREAM-932/avax-mdl
ShahNewazKhan Jun 25, 2024
a850051
remove =
gronders Jun 25, 2024
408e3b4
Merge pull request #21 from FlipsideCrypto/first_edit
gronders Jun 25, 2024
baefd2c
dbt versioning success
ShahNewazKhan Jun 27, 2024
54a5bdf
add score_version column
ShahNewazKhan Jun 27, 2024
741b23e
update gha selector to run latest version of avalanche scoring model
ShahNewazKhan Jun 27, 2024
a23eaa8
add eth & base scoring models and artifacts
ShahNewazKhan Jun 28, 2024
3633bba
add incremental logic
ShahNewazKhan Jun 28, 2024
5afe831
Merge pull request #22 from FlipsideCrypto/STREAM-392/dbt-versioning
ShahNewazKhan Jun 28, 2024
8972da6
add eth & base gha
ShahNewazKhan Jun 28, 2024
a711c0c
add optimism models
ShahNewazKhan Jun 28, 2024
d491b5f
add avalanche properties
ShahNewazKhan Jul 1, 2024
04f264d
add avalanche properties
ShahNewazKhan Jul 1, 2024
d08f05a
Merge pull request #25 from FlipsideCrypto/STREAM-392/dbt-versioning
ShahNewazKhan Jul 1, 2024
bcd1e61
Merge pull request #23 from FlipsideCrypto/STREAM-392/evm-models
ShahNewazKhan Jul 1, 2024
fd9cdd4
Merge pull request #24 from FlipsideCrypto/STREAM-392/evm-models-2
ShahNewazKhan Jul 1, 2024
e8a1538
add arbitrum scores
ShahNewazKhan Jul 2, 2024
8684b7d
Merge pull request #26 from FlipsideCrypto/STREAM-932/arbitrum_scores
ShahNewazKhan Jul 3, 2024
e827d2b
add evm permissions macro
ShahNewazKhan Jul 8, 2024
61544f8
update avalanche model version to 2
ShahNewazKhan Jul 8, 2024
c22d53e
remove tags
ShahNewazKhan Jul 8, 2024
963edf5
add envar for source evm db
ShahNewazKhan Jul 8, 2024
dcc09f0
add aptos scores model & associated artifacts | fix arbitrum md5 hash
ShahNewazKhan Jul 9, 2024
e25f9a6
Merge pull request #27 from FlipsideCrypto/STREAM-949/chain-perms-macro
ShahNewazKhan Jul 9, 2024
d7131e9
Merge branch 'main' into STREAM-392/evm-models
ShahNewazKhan Jul 9, 2024
e2c0c29
Merge pull request #30 from FlipsideCrypto/STREAM-392/evm-models
ShahNewazKhan Jul 9, 2024
4ee93ea
fix sources
ShahNewazKhan Jul 9, 2024
457f922
Merge pull request #31 from FlipsideCrypto/STREAM-932/fix-daily-gha
ShahNewazKhan Jul 9, 2024
205972b
Merge branch 'main' into STREAM-943/aptos-scores
ShahNewazKhan Jul 9, 2024
7a81206
Merge pull request #29 from FlipsideCrypto/STREAM-943/aptos-scores
ShahNewazKhan Jul 9, 2024
c5eca60
fix sql syntax
ShahNewazKhan Jul 9, 2024
559c597
Fix sql syntax, dim_labels -> dim_address_labels
ShahNewazKhan Jul 9, 2024
749896e
update block timestamp for gov.fact_staking_actions
ShahNewazKhan Jul 9, 2024
c834f0a
add near scoring model & artifacts
ShahNewazKhan Jul 9, 2024
430aca3
Merge pull request #28 from FlipsideCrypto/STREAM-941/near-scores
ShahNewazKhan Jul 10, 2024
e0e3f0c
blast scores init
ShahNewazKhan Jul 11, 2024
82b42a7
add flow scores artifacts
ShahNewazKhan Jul 12, 2024
ca4d495
Merge pull request #32 from FlipsideCrypto/STREAM-958/blast-scores
ShahNewazKhan Jul 12, 2024
929074d
resolve blast scores merge conflicts
ShahNewazKhan Jul 12, 2024
1945c10
Merge pull request #33 from FlipsideCrypto/STREAM-942/flow-scores
ShahNewazKhan Jul 12, 2024
24547d9
add blast.blitz source
ShahNewazKhan Jul 12, 2024
79d4d72
Merge pull request #34 from FlipsideCrypto/STREAM-958/blast-blitz-fix
ShahNewazKhan Jul 15, 2024
f5da965
added incremental solana scores model & properties
ShahNewazKhan Jul 17, 2024
17d7524
Merge pull request #35 from FlipsideCrypto/STREAM-945/solana-score-init
ShahNewazKhan Jul 17, 2024
ecfd22d
Create dbt_run_scores_backfill.yml
ShahNewazKhan Jul 19, 2024
8d40af8
Merge pull request #37 from FlipsideCrypto/ShahNewazKhan-patch-9
ShahNewazKhan Jul 19, 2024
dc29a70
Update dbt_run_scores_backfill.yml
ShahNewazKhan Jul 19, 2024
3f3c910
Merge pull request #38 from FlipsideCrypto/ShahNewazKhan-patch-10
ShahNewazKhan Jul 19, 2024
e471294
string escape date ranges output
ShahNewazKhan Jul 19, 2024
9b59fb0
update shell:bash
ShahNewazKhan Jul 19, 2024
d4ac9b4
cast string to date for comparison
ShahNewazKhan Jul 19, 2024
849e720
remove hardcoded date and use matrix strategy
ShahNewazKhan Jul 19, 2024
6dd96f2
add concurrent run
ShahNewazKhan Jul 19, 2024
7f645ab
uncomment install deps
ShahNewazKhan Jul 19, 2024
5ae473f
add dbt envars
ShahNewazKhan Jul 19, 2024
6aad639
add dbt selector
ShahNewazKhan Jul 19, 2024
ffd50ee
string interpolate chain
ShahNewazKhan Jul 19, 2024
6555303
add enable concurency flag & warehouse configurability
ShahNewazKhan Jul 19, 2024
15a4441
string escape
ShahNewazKhan Jul 19, 2024
8bb8741
use bash date comparison
ShahNewazKhan Jul 19, 2024
8119a8e
Merge branch 'main' into STREAM-957/adhoc-gha
ShahNewazKhan Jul 19, 2024
File filter

Filter by extension

Filter by extension

Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
Original file line number Diff line number Diff line change
@@ -339,7 +339,7 @@ scores AS (
user_address,
(CASE WHEN n_days_active > 2 THEN 1 ELSE 0 END
+ CASE WHEN n_complex_txn > 0 THEN 1 ELSE 0 END
+ CASE WHEN n_contracts >= 5 THEN 1 ELSE 0 END) AS activity_score,
+ CASE WHEN n_contracts > 5 THEN 1 ELSE 0 END) AS activity_score,
(CASE WHEN n_bridge_in > 3 THEN 1 ELSE 0 END
+ CASE WHEN n_cex_withdrawals > 0 THEN 1 ELSE 0 END
+ CASE WHEN net_token_accumulate > 0 THEN 1 ELSE 0 END) AS tokens_score,