Introduction to Data Engineering

About this course

In this course, you will be introduced to the data engineering lifecycle, from data generation in source systems, to ingestion, transformation, storage, and serving data to downstream stakeholders. You’ll study the key undercurrents that affect all stages of the lifecycle, and start developing a framework for how to think like a data engineer. To gain hands-on practice, you’ll gather stakeholder needs, translate those needs into system requirements, and choose tools and technologies to build systems that provide business value. By the end of this course you’ll be spinning up batch and streaming data pipelines to serve product recommendations on the AWS cloud!

What you will learn

• Gain a comprehensive understanding of the data engineering lifecycle and its undercurrents
• Gather stakeholder needs and translate them into system requirements
• Design and implement batch and streaming data pipelines on AWS