Skip to content

Latest commit

 

History

History
10 lines (6 loc) · 639 Bytes

README.md

File metadata and controls

10 lines (6 loc) · 639 Bytes

gcp-serverless-twitter-pipeline

A full end-to-end serverless pipeline to read Tweets and send them to BigQuery and Firestore/Firebase

Note that the below image/architecture does not include Dataflow -> PubSub -> Cloud Function -> Firestore (for brevity's sake it only showed Dataflow to Firestore). Also, the ML component doesn't exist yet off the back of BigQuery, but this could be simply BigQueryML.

Screen Shot 2019-03-14 at 3 06 03 pm

To deploy:

gcloud builds submit --config=cloudbuild.yaml .