Hari Sekhon - Knowledge Base from 20 years in DevOps, Linux, Cloud, Big Data, Security, AWS, GCP etc
Repo focused on advanced knowledge, tips & tricks, debugging & fixes.
I'm gradually migrating my huge private personal knowledge base into this public repo.
Hit the watch button on the top right for updates.
Some of these pages are still in progress pending porting and populated yet from my private knowledge base pages, some are stubs pending migration.
Much more advanced knowledge is captured in code and code comments. References to my major GitHub Repos are provided throughout where relevant.
References to official docs and some classic books are provided for those who want to thoroughly cover the basics.
- GitHub Repos
- Systems
- Architecture & Documentation
- Git
- Cloud
- Containerization
- Programming
- Infrastructure-as-Code
- Configuration Management
- CI/CD
- Internet Services
- Databases / RDBMS
- NoSQL
- Coordination & Discovery Services
- Pub / Sub & Message Queues
- Data
- Security
- Virtualization
- Hardware
- Networking
- Monitoring
- AI & Automation
- Work
- Miscellaneous
- Star History
- Memes
- More Core Repos
This is the lost documentation.
Full of open source tools and scripts used throughout the rest of these docs to make it easier to install and operate these technologies:
- DevOps-Bash-tools - 1000+ Bash scripts, advanced shell environment customizations, quick installation scripts and dot configs
- DevOps-Python-tools - 80+ Python programs for DevOps & Data
- DevOps-Perl-tools - 25+ Perl programs for DevOps
- DevOps-Golang-tools - a handful of Golang programs
- Kubernetes-configs - many Kubernetes applications and advanced templates with Tips & Tricks from production environments
- SQL-scripts - 100+ database scripts
- Templates - templates for many common file formats for programming languages, build systems and DevOps configs
- Diagrams-as-Code - Cloud & Open Source architecture diagrams
This one is used widely throughout these pages:
- Architecture TODO
- Product Selection TODO
- Diagrams-as-Code
- Documentation
- Microservices TODO
- Medium.com (blog)
- Systems Design
- Git
- Git Repo Hosting Providers:
- GitHub TODO
- GitLab
- Azure DevOps TODO
- Bitbucket TODO
- Pre-Commit
- Docker
- Podman
- Dockerfiles for many technologies:
- Kubernetes
- Kubernetes Upgrades
- Kubernetes Configs
- Kubernetes Production Ready Checklist
- Traefik
- Kong API Gateway
- Istio TODO
- Kubeflow TODO
- Docker Desktop embedded Kubernetes (easiest to use)
- MiniKube
- MiniShift - for OpenShift upstream okd
- K3d
- Kind
- DockerHub
- AWS ECR
- GCP GAR
- GCP GCR (deprecated / shut down)
- Azure ACR
- GitHub GHCR
- Redhat Quay.io (there is an on-prem installable too)
- JFrog Container Registry
- Nexus
- Harbor
- Chart Museum
- Perl
- Python
- Golang TODO
- Ruby
- R TODO
- TCL / Expect
- JVM:
- APIs
- Regular Expressions
- Testing
- CI/CD
- Self-Hosted CI/CD:
- Jenkins
- Jenkins-on-Kubernetes
- HariSekhon/Jenkins - master
Jenkinsfiletemplate and Groovy Shared Library functions
- TeamCity TODO
- Concourse
- GoCD TODO
- Jenkins
- Git Repo Providers hosted CI/CD:
- GitHub Actions
- GitLab CI TODO
- Azure DevOps TODO
- Bitbucket Pipelines TODO
- 3rd Party hosted CI/CD:
- SQL TODO
- SQL scripts
- Databases
- Data Warehousing TODO
- MySQL TODO
- PostgreSQL TODO
- Oracle
- CloudBeaver
Massively Parallel Processing databases - horizontally scaling databases:
- Distributed SQL
- Snowflake
- Google BigQuery TODO
- AWS Redshift TODO
See also the Hadoop Ecosystem section further down for more distributed SQL databases.
- Pub / Sub & Message Queues
- Kafka
- RabbitMQ
- Celery
- AWS Kinesis
- Data
- Big Data
- Data Warehousing TODO
- Spark TODO
- Airflow TODO
- Apache Camel
- JSON
- Informatica
- Spark TODO
- Kafka
- Hadoop TODO
- Kerberos Hadoop TODO
- YARN TODO
- HDFS TODO
- Pig TODO
- Hive TODO
- Impala TODO
- Presto
- Apache Drill
- Kudu
- Kylin
- Storm TODO
- Mahout
- ZooKeeper
- Data Science TODO
- Machine Learning TODO
- Python
- Anaconda TODO
- R TODO
- Octave TODO
- Security TODO
- SSL TODO
- Kerberos TODO
- FreeIPA TODO
- Keycloak
- Penetration Testing TODO
- Secrets Managers
- SOC - Security Operations Center
- Networking TODO
- Firewalls
- VPNs
- Cisco TODO
- Juniper TODO
- Foundry TODO
- Keepalived
- Load Balancing TODO
- HAProxy
- F5
- Monitoring
- Nagios
- Prometheus TODO
- Thanos TODO
- Grafana TODO
- Notifications
- Fluentd
This section is probably the most financially important thing you'll ever learn.
- Bitcoin
- more financially beneficial than your Tech knowledge
- the most important knowledge along with avoiding feminist divorce law
- Crypto
- every day you're not in crypto you're losing money due to constant inflationary money printing by central banks and governments to fund budgetary deficits caused by universal suffrage spending liabilities
- even many investments, which are also taxed and often confiscated by governments or ex-wives, are losing ground to inflation in real terms
From my LinkedIn:
I tried to make these docs as short as possible... but as you can see above, I didn't quite make it.
I've been both the bottom and top of this meme:
The rest of my original source repos are here.
Pre-built Docker images are available on my DockerHub.