Hadoop Training – Administrator
This training session will cover the system administration aspects of Hadoop from installation and configuration to load balancing and tuning, to diagnosing and solving problems in your deployment.
About This Course
About Z Data
An Introduction To Hadoop And HDFS
Hive, Pig, HBase and other sub-projects
Planning Your Hadoop Cluster
General Planning Considerations
Choosing The Right Hardware
Choosing The Right Software
Deploying Your Cluster
Typical Configuration Parameters
Hands-On Exercise: Install a pseudo-distributed Hadoop Cluster
Starting and stopping MapReduce jobs
Hands-On Exercise: Using the JobTracker UI to start and kill jobs
Checking HDFS with fsck
Copying data with distcp
Rebalancing cluster nodes
Adding and removing cluster nodes
Backup And Restore
Upgrading and Migrating
The FIFO Scheduler
The Fair Scheduler
Hands-On Exercise: Using Fair Scheduler
Cluster Monitoring and Troubleshooting
General system profiling
Using the NameNode UI to inspect the filesystem
Monitoring with Ganglia
Other monitoring tools
Hadoop Log Files
Benchmarking Your Cluster
Dealing with a corrupt NameNode
Installing And Managing Other Hadoop Projects
Populating HDFS From Databases Using Sqoop
What is Sqoop?
Sqoop command-line options
Hands-On Exercise: Importing data from MySQL
Augmenting Existing Systems with Hadoop
Hadoop rarely replaces existing infrastructure, but rather enables you to do more with your data by providing a scalable batch processing system. This lecture helps you understand how it all fits together.
Best Practices for Data Processing Pipelines
In order for Hadoop to crunch large volumes of data, first you’ll need to get that data into Hadoop. This lecture will help you understand how to import different types of data from various sources into Hadoop for further analysis.
Debugging MapReduce Programs
Debugging in the distributed environment is challenging. This lecture will expose you to best practices for program design to mitigate debugging challenges, as well as local testing tools and techniques for debugging at scale.
Advanced Hadoop API
This lecture probes into the API, covering custom data types and file formats, direct HDFS access, intermediate data partitioning, and other tools such as the DistributedCache.
Optimizing MapReduce Programs
We’ll use the Cloudera Training VM to work through an example where you write a MapReduce program and improve its performance using techniques explored earlier