Pipeline To Insights

Pipeline To Insights

Data Engineering Lifecycle

Security Fundamentals for Data Engineers
What every data engineer needs to know about protecting data, from access control to encryption to compliance.
 • Pipeline to Insights and Erfan Hesami
Storage Fundamentals for Data Engineers
From the storage hierarchy to cloud storage types, what every data engineer needs to know to choose the right solution and interact with it.
 • Erfan Hesami
How to Gather Requirements Effectively as a Data Engineer
A practical guide for data engineers and related roles to apply effective requirements gathering in everyday work
 • Erfan Hesami
How to Choose Between Batch and Stream Processing?
When to Use Batch vs Stream Processing: Key Differences, Use Cases, and Tools for Data Engineers
 • Erfan Hesami
What is Data Architecture And Why Every Data Engineer Should Care About it
Understanding the principles of Data Architecture and their importance
 • Erfan Hesami
What Does Data Maturity Mean for Data Engineers?
Understanding How Data Maturity Shapes the Role of the Data Engineer
 • Erfan Hesami
From Data to Decisions: A guide to serving insights for maximum impact
Master the final step in data engineering, serving data, to empower stakeholders, drive smarter decisions, and transform insights into action.
 • Erfan Hesami
The Crucial Midpoint of Data Engineering: Data Transformation
From Raw Data to Gourmet Insights: The Art and Science of Data Transformation
 • Erfan Hesami
Data Ingestion: Batch vs. Stream, Which Strategy is Right for You?
Choosing Between Batch and Stream Processing for Optimal Data Pipelines
 • Erfan Hesami
Thinking Like a Data Engineer Framework
Joe Reis' guide to Developing a Data Engineer Mindset
 • Erfan Hesami
© 2026 Erfan Hesami · Privacy ∙ Terms ∙ Collection notice
Start your SubstackGet the app
Substack is the home for great culture