- Spark Tips & Tricks from
dusenberrymw - Download the driver's spark log given an EMR cluster id
- Sparklens spark tuning tool
- Awesome Apache Airflow - A curated list of resources about Airflow.
- Amplitude's Data Taxonomy Playbook. Specific to Amplitude, but it is generally important to think carefully about a taxonomy of the data you will use early on.
- Software Architecture stuff
- The C4 Model for software architecture
- Structurizr is a web-based publishing platform for software architecture models created using the Structurizr for Java or Structurizr for .NET open source libraries; allowing you to visualise, document and explore your software architecture using the C4 model.