Alireza Sadeghi – Medium

Alireza Sadeghi

Pinned

Open Source Data Engineering Landscape 2025

A comprehensive view of active open source tools and emerging trends in data engineering ecosystem in 2024–2025

Feb 12

Open Source Data Engineering Landscape 2025

Feb 12

Pinned

DuckDB Beyond the Hype

A Powerful Addition to the Data Scientist’s and Data Engineer’s Toolbox

Sep 18, 2024

DuckDB Beyond the Hype

Sep 18, 2024

Pinned

Open Source Data Engineering Landscape 2024

Exploration of the open source software in data engineering ecosystem

Feb 4, 2024

Open Source Data Engineering Landscape 2024

Feb 4, 2024

The Rise of Single-Node Processing: Challenging the Distributed-First Mindset

Data Landscape Trends: 2024–2025 Series

Jan 29

The Rise of Single-Node Processing: Challenging the Distributed-First Mindset

Jan 29

The Evolution of Business Intelligence: From Monolithic to Composable Architecture

Data Landscape Trends #1: 2024–2025 Series

Jan 23

The Evolution of Business Intelligence: From Monolithic to Composable Architecture

Jan 23

Building a High-Performance Data Pipeline Using DuckDB

Using DuckDB to Serialise, Transform, and Aggregate Data in Data Lakes

Oct 20, 2024

Building a High-Performance Data Pipeline Using DuckDB

Oct 20, 2024

The History and Evolution of Open Table Formats

From Hive to High Performance: A Journey Through the Evolution of Data Management on Data Lakes

Aug 23, 2024

The History and Evolution of Open Table Formats

Aug 23, 2024

How to build a dual Incremental + snapshot data ingestion pipeline

A useful batch data ingestion pattern for maximum data correctness and reliability as well as providing low latency access

Oct 1, 2023

How to build a dual Incremental + snapshot data ingestion pipeline

Oct 1, 2023

Techniques For Periodically Extracting Data From Relational Databases

Presenting techniques for extracting data from relational databases when building ETL pipelines for a data lake, DWH or data lakehouse

Sep 19, 2023

Techniques For Periodically Extracting Data From Relational Databases

Sep 19, 2023

Techniques for Managing Dependency Between Data Pipelines

It’s a common challenge to manage dependency between data pipelines on data-driven systems and analytical platforms which having data…

Aug 29, 2023

Techniques for Managing Dependency Between Data Pipelines

Aug 29, 2023

Alireza Sadeghi

Alireza Sadeghi

Senior Data Engineer & Architect. My official Blog & Newsletter: https://www.pracdata.io LinkedIn: https://www.linkedin.com/in/alirezasadeghi/

Following

Help

Status

About

Careers

Press

Blog

Privacy

Rules

Terms

Text to speech