Hadoop and Spark Fundamentals: Unit 1

About this course

This course provides a practical introduction to the Apache Hadoop ecosystem. You will learn the basic skills needed to analyze and manage large, unstructured datasets. The course covers core concepts such as the data lake, MapReduce, and using Spark for analytics. You will install and configure Hadoop on your own computer using the Hortonworks HDP sandbox. The course includes instruction on the Hadoop Distributed File System (HDFS), its architecture, and how to use it in real-world situations. This course is suitable for beginners and those looking to expand their data analytics skills. By the end, you will understand the fundamentals of Hadoop and Spark for scalable data processing.

What you will learn

• Understand the core concepts of Hadoop, including its architecture, data lake metaphor, and the role of MapReduce and Spark in big data analytics.
• Install and configure a full-featured Hadoop and Spark environment on your desktop or laptop using the Hortonworks HDP sandbox.
• Navigate and utilize the Hadoop Distributed File System (HDFS), including advanced features like high availability and federation.
• Gain hands-on experience running Hadoop and Spark applications, preparing you for real-world data analytics challenges.