Alireza Sadeghi – Medium

Alireza Sadeghi

Pinned

Alireza Sadeghi

Open Source Data Engineering Landscape 2024

Exploration of the open source software in data engineering ecosystem

11 min readFeb 4, 2024

--

15

Open Source Data Engineering Landscape 2024

--

15

Alireza Sadeghi

How to build a dual Incremental + snapshot data ingestion pipeline

A useful batch data ingestion pattern for maximum data correctness and reliability as well as providing low latency access

6 min readOct 1, 2023

--

How to build a dual Incremental + snapshot data ingestion pipeline

--

Alireza Sadeghi

Techniques For Periodically Extracting Data From Relational Databases

Presenting techniques for extracting data from relational databases when building ETL pipelines for a data lake, DWH or data lakehouse

10 min readSep 19, 2023

--

Techniques For Periodically Extracting Data From Relational Databases

--

Alireza Sadeghi

Techniques for Managing Dependency Between Data Pipelines

It’s a common challenge to manage dependency between data pipelines on data-driven systems and analytical platforms which having data…

7 min readAug 29, 2023

--

Techniques for Managing Dependency Between Data Pipelines

--

Alireza Sadeghi

Internal Storage Design of Modern Key-value Database Engines [Part 1]

Deep dive into physical storage design implemented by many modern popular key-value stores such as Amazon Dynamo DB, Apache Cassandra, Riak

8 min readAug 14, 2023

--

Internal Storage Design of Modern Key-value Database Engines [Part 1]

--

Alireza Sadeghi

Airflow callbacks to Slack notifications for DAG monitoring and alerting

In this post I’ll demonstrate the step by step guide to integrate Airflow workflows with Slack for notification and monitoring purpose. The…

5 min readJul 23, 2023

--

Airflow callbacks to Slack notifications for DAG monitoring and alerting

--

Alireza Sadeghi
in
Towards Dev

Adding Custom Country Map to Apache Superset

In this post I demonstrate the steps followed to add a custom country map to superset repository and rebuild the app.

5 min readJul 12, 2023

--

1

Adding Custom Country Map to Apache Superset

--

1

Alireza Sadeghi

Alireza Sadeghi

Senior Software and Data Engineer [big data, distributed storage ,distributed processing, data pipelines, infraustructure, cluster management, workflow orch]

Following

Help
Status
About
Careers
Blog
Privacy
Terms
Text to speech
Teams