Preparing with Cloudera Data Engineering and Apache Spark

This four-day hands-on training course delivers the key concepts and expertise developers need to use Apache Spark to develop high-performance parallel applications.

Participants will learn how to use Spark SQL to query structured data and Spark Streaming to perform real-time processing on streaming data from a variety of sources. Developers will also practice writing applications that use core Spark to perform ETL processing and iterative algorithms.

Note: Scala and Python developers will learn key concepts and gain the expertise needed to ingest and process data, and develop high-performance applications using Apache Spark 2.

1:1 Coaching

24*7 Support

Cloud Labs

High Success Rate

Globally Renowned Trainer

Real-time code analysis and feedback

Course Description

The course covers how to work with “big data” stored in a distributed file system, and execute Spark applications on a Hadoop cluster. After taking this course, participants will be prepared to face real-world challenges and build applications to execute faster decisions, better decisions, and interactive analysis, applied to a wide variety of use cases, architectures, and industries.

Learning Objectives

Distribute, store, and process data in a Cloudera cluster
Write, configure, and deploy Apache Spark applications
Use the Spark interpreters and Spark applications to explore, process, and analyze distributed data

Query data using Spark SQL, DataFrames, and Hive tables
Deploy a Spark application on the Data Engineering Service

Schedule

Enroll your course from

$3,564.00

25th – 27th Aug, 2025

09:30AM – 05:30PM

Trainer

Ajit Kumar Amit

Singapore

Weekday

Enroll your course from

$3,564.00

10th – 12th Nov, 2025

09:30AM – 05:30PM

Trainer

Ajit Kumar Amit

Singapore

Weekday

Certification Curriculum

Introduction

HDFS Introduction

HDFS Overview
HDFS Components and Interactions
Additional HDFS Interactions
Ozone Overview
Exercise: Working with HDFS

Module 1

YARN Introduction

YARN Overview
YARN Components and Interaction
Working with YARN
Exercise: Working with YARN

Module 2

Working with RDDs

Resilient Distributed Datasets (RDDs)
Exercise: Working with RDDs

Module 3

Working with DataFrames

Introduction to DataFrames
Exercise: Introducing DataFrames
Exercise: Reading and Writing DataFrames
Exercise: Working with Columns
Exercise: Working with Complex Types
Exercise: Combining and Splitting DataFrames
Exercise: Summarizing and Grouping DataFrames
Exercise: Working with UDFs
Exercise: Working with Windows

Module 4

Introduction to Apache Hive

About Hive
Transforming data with Hive QL

Module 5

Working with Apache Hive

Exercise: Working with Partitions
Exercise: Working with Buckets
Exercise: Working with Skew
Exercise: Using Serdes to Ingest Text Data
Exercise: Using Complex Types to Denormalize Data

Module 6

Hive and Spark Integration

Hive and Spark Integration
Exercise: Spark Integration with Hive

Module 7

Distributed Processing Challenges

Shuffle
Skew
Order

Module 8

Spark Distributed Processing

Spark Distributed Processing
Exercise: Explore Query Execution Order

Module 9

Spark Distributed Persistence

DataFrame and Dataset Persistence
Persistence Storage Levels
Viewing Persisted RDDs
Exercise: Persisting DataFrames

Module 10

Data Engineering Service

Create and Trigger Ad-Hoc Spark Jobs
Orchestrate a Set of Jobs Using Airflow
Data Lineage using Atlas
Auto-scaling in Data Engineering Service

Prerequisites

This course is designed for developers and engineers who have programming experience, but prior knowledge of Spark and Hadoop is not required. Apache Spark examples and hands-on exercises are presented in Scala and Python. The ability to program in one of those languages is required. Basic familiarity with the Linux command line is assumed. Basic knowledge of SQL is helpful.

Certification Assessment

When you complete all of the courses in the program, you’ll earn a Certificate to share with your professional network as well as unlock access to career support resources to help you kickstart your new career. Many Professional Certificates have hiring partners that recognize the Professional Certificate credential and others can help prepare you for a certification exam. You can find more information on individual Professional Certificate pages where it applies.

Testimonials

Our clients praise us for our great results, personable service, expert knowledge, and on-time delivery. Here are what just a few of them had to say:

Sarbojit Bose

The course is one of the two in the track of Agile Professional Coach. It is designed to provide both wide and deep knowledge to become a competent Coach with the additional skills of a Trainer and a Mentor. The two trainers, Preeth Panday and Naveen K Singh, are excellent Facilitators and Coaches with patience and promptness.

Tiong Yeow Tan

It was a good introductory course to agile coaching, providing a good overview and potential deep dive into other courses if one wishes to learn more about a particular topic. Trainer was able to address most of the questions from the participants and demonstrate coaching in his interaction with us.

Chun Ngee Boo Alson

The course is well structure. Timing is also right. The trainer Mr Raj is professional. And he asnwer all my question and doubts.

Puli

One of best I have encountered in my life. Freedom to interact and respond candidly and with courage for every question is not an easy task for Trainers which they did it exceptionally well.

Training FAQ's

Is this training conducted as an online/ virtual course?

As a response to the COVID-19, we have moved our classes online. Our Live Virtual format delivers the same benefits as our face-to-face training: expert instruction, hands-on labs and exercises, peer-to-peer collaboration, and high-quality instructional material.

If I cancel the enrollment, will I get a refund?

Cancellation requests received within 24 hours of registration would be offered a full refund (minus payment gateway charges), please reach out to our support team through drop a refund request to enquiry@agilitics.sg. Visit our page for more details about Cancellation & Refund Policy.

What Payment Options Are Available?

The process of enrolling for this classroom training is simple. The payment can be made through different options by using a debit/credit card which includes MasterCard, Visa Card, American Express or through PayPal. Acknowledgment will be issued automatically via email to the candidates once payment is done.

What are the modes of payment available for payment of accreditation fees?

Payment can be made via credit card, debit card, UPI, and internet banking.

Have more doubts?

Please send in an email to enquiry@agilitics.sg, and we will answer any queries you may have!

Preparing with Cloudera Data Engineering and Apache Spark

Course Description

Learning Objectives

Schedule

Certification Curriculum

HDFS Introduction

YARN Introduction

Working with RDDs

Working with DataFrames

Introduction to Apache Hive

Working with Apache Hive

Hive and Spark Integration

Distributed Processing Challenges

Spark Distributed Processing

Spark Distributed Persistence

Data Engineering Service

Prerequisites

Download Brochure

Certification Assessment

Testimonials

Our clients praise us for our great results, personable service, expert knowledge, and on-time delivery. Here are what just a few of them had to say:

Training FAQ's

Trending Course

Leading Safe®️ 5.1

Cloudera Data Analyst

Certified Agile Coaching

We'd love
to hear from you

Quick Links

Trending Courses

Discover

Contact Information

Singapore

Preparing with Cloudera Data Engineering and Apache Spark

Course Description

Learning Objectives

Schedule

Certification Curriculum

HDFS Introduction

YARN Introduction

Working with RDDs

Working with DataFrames

Introduction to Apache Hive

Working with Apache Hive

Hive and Spark Integration

Distributed Processing Challenges

Spark Distributed Processing

Spark Distributed Persistence

Data Engineering Service

Prerequisites

Download Brochure

Certification Assessment

Testimonials

Our clients praise us for our great results, personable service, expert knowledge, and on-time delivery. Here are what just a few of them had to say:

Training FAQ's

Trending Course

Leading Safe®️ 5.1

Cloudera Data Analyst

Certified Agile Coaching

We'd loveto hear from you

Quick Links

Trending Courses

Discover

Contact Information

Singapore

Social

We'd love
to hear from you