Pipeline To Insights
Subscribe
Sign in
Home
Notes
Data Engineering Lifecycle
SQL Optimisation
DE Interview Preperation
Data Quality
Data Career Transition
data build tool (dbt) series
Archive
Leaderboard
About
Latest
Top
Discussions
How to Gather Requirements Effectively as a Data Engineer
A practical guide for data engineers and related roles to apply effective requirements gathering in everyday work
Sep 5
•
Erfan Hesami
21
August 2025
How to Succeed in Data Engineering Interviews
Practical advice from Yordan, Head of Data Engineering
Aug 31
•
Yordan Ivanov
and
Erfan Hesami
20
Week 28/31: Behavioural Interview Questions for Data Engineers
How to prepare, structure answers, and impress interviewers with real word examples.
Aug 17
•
Erfan Hesami
15
1
Infrastructure as Code for Data Engineers
What Data Engineers Need to Know About Infrastructure as Code (IaC) With a Simple Terraform Hands-On Example
Aug 10
•
Erfan Hesami
28
1
Week 27/31: Data Visualisation for Data Engineers
What Data Engineers need to know about Data Visualisation and Storytelling skills
Aug 3
•
Erfan Hesami
10
July 2025
Survival Tips for Data Engineers in the Age of Generative AI
Industry Experts’ Insights on AI’s Impact in Data Engineering, Highlights from Melbourne DataEngBytes 2025 Conference.
Jul 26
•
Erfan Hesami
39
7
Week 26/31: Machine Learning for Data Engineers
How Data and ML Engineers can work together to build robust ML Systems.
Jul 19
•
Erfan Hesami
12
Centralised Orchestration in Dagster Using Code Locations
How to manage independent projects under one Dagster instance
Jul 13
•
Erfan Hesami
10
Week 26/31: Data Governance for Data Engineers
What Data Engineers need to know about data goverance
Jul 6
•
Erfan Hesami
18
June 2025
Week 25/34: System Design for Data Engineering Interviews
What system design means for data engineers and how to prepare for interviews
Jun 30
•
Erfan Hesami
14
Docker for Data Engineers
From introduction to implementation, learn how to build reliable, reproducible data pipelines using Docker
Jun 21
•
Erfan Hesami
46
Week 24/31: DevOps and DataOps Practices for Data Engineering Interviews
Building trustworthy, observable, and resilient data systems with the right mindset, culture, and tools.
Jun 15
•
Erfan Hesami
19
This site requires JavaScript to run correctly. Please
turn on JavaScript
or unblock scripts
