The New Data Engineering Stack. Technologies for the Complete Data… | by Kovid Rathee | Nov, 2020



Technologies for the Complete Data Engineer

Relational (OLTP)

The Big Four — Oracle, MySQL, MS SQL Server, PostgreSQL.

Warehouses (OLAP)

The Big Four — BigQuery, Redshift, Snowflake, Azure DW.


The Big Eight — MongoDB, InfluxDB, neo4j, Redis, Elasticsearch, CosmosDB, DynamoDB, Cloud Datastore.

The Big Three — Google Cloud, Azure, AWS.

The Big One — Airflow.

The Big Two — SQL, Spark.

The Big Two — Terraform, Pulumi.

The Big Four — Jenkins, AWS CodePipeline, Google Cloud Build, Azure DevOps.

The Big Two — Pytest, JUnit.

The Big Three — SQL, Python, Java.

Read More …


Write a comment