Alireza Sadeghi – Medium

Alireza Sadeghi

Pinned

DuckDB Beyond the Hype

A Powerful Addition to the Data Scientist’s and Data Engineer’s Toolbox

Sep 18

DuckDB Beyond the Hype

Sep 18

Pinned

Open Source Data Engineering Landscape 2024

Exploration of the open source software in data engineering ecosystem

Feb 4

Open Source Data Engineering Landscape 2024

Feb 4

Building a High-Performance Data Pipeline Using DuckDB

Using DuckDB to Serialise, Transform, and Aggregate Data in Data Lakes

Oct 20

Building a High-Performance Data Pipeline Using DuckDB

Oct 20

The History and Evolution of Open Table Formats

From Hive to High Performance: A Journey Through the Evolution of Data Management on Data Lakes

Aug 23

The History and Evolution of Open Table Formats

Aug 23

How to build a dual Incremental + snapshot data ingestion pipeline

A useful batch data ingestion pattern for maximum data correctness and reliability as well as providing low latency access

Oct 1, 2023

How to build a dual Incremental + snapshot data ingestion pipeline

Oct 1, 2023

Techniques For Periodically Extracting Data From Relational Databases

Presenting techniques for extracting data from relational databases when building ETL pipelines for a data lake, DWH or data lakehouse

Sep 19, 2023

Techniques For Periodically Extracting Data From Relational Databases

Sep 19, 2023

Techniques for Managing Dependency Between Data Pipelines

It’s a common challenge to manage dependency between data pipelines on data-driven systems and analytical platforms which having data…

Aug 29, 2023

Techniques for Managing Dependency Between Data Pipelines

Aug 29, 2023

Internal Storage Design of Modern Key-value Database Engines [Part 1]

Deep dive into physical storage design implemented by many modern popular key-value stores such as Amazon Dynamo DB, Apache Cassandra, Riak

Aug 14, 2023

Internal Storage Design of Modern Key-value Database Engines [Part 1]

Aug 14, 2023

Airflow callbacks to Slack notifications for DAG monitoring and alerting

In this post I’ll demonstrate the step by step guide to integrate Airflow workflows with Slack for notification and monitoring purpose. The…

Jul 23, 2023

Airflow callbacks to Slack notifications for DAG monitoring and alerting

Jul 23, 2023

Published in
Towards Dev

Adding Custom Country Map to Apache Superset

In this post I demonstrate the steps followed to add a custom country map to superset repository and rebuild the app.

Jul 12, 2023

Adding Custom Country Map to Apache Superset

Jul 12, 2023

Alireza Sadeghi

Alireza Sadeghi

Senior Data Engineer with 16 years experience building and scaling software and data platforms My Newsletter: https://practicaldataengineering.substack.com

Following

Help
Status
About
Careers
Press
Blog
Privacy
Terms
Text to speech
Teams