14/11/2016
We are starting New HADOOP/BIGDATA classes for serious Learners with Architect level experience Trainers..Syllabus follows as below
Prerequisites
Unix (Optional)
Java Fundamentals(Optional)
OOPS
Collections
Serialization
Strings
Threads
What is Big Data & Why Hadoop?
Big Data Characteristics, Challenges with traditional system
Hadoop Overview & it’s Ecosystem
Anatomy of Hadoop Cluster, Installing and Configuring Hadoop
Hands-On Exercise
HDFS – Hadoop Distributed File System
HDFS Architecture, Name Nodes, Data Nodes and Secondary Name Node
HDFS changes in Hadoop 2.0
Hands-On Exercise
Map Reduce
How Map Reduce Works?
The Mapper & Reducer, Data Type, Input& Output Formats
Hands on Exercises
Developing Map Reduce Programs
Setting up Eclipse Development Environment, Creating Map Reduce Projects, Debugging and Unit Testing
Developing a map reduce algorithm on real world scenario
Hands On Exercises
Advanced Map Reduce Concepts
Combiner, Partitioner, Counter, Compression, Setup and teardown, Speculative Ex*****on, Zero Reducer and Distributed Cache
Advanced Map Reduce Algorithms
Sorting, Searching , Multiple Inputs, Chaining multiple jobs
Joins, Handling Binary & Unstructured data
Advanced Tips & Techniques
Determining optimal number of reducers, skipping bad records
Partitioning into multiple output files & Passing parameters to tasks
Hadoop Cluster sizing and capacity planning
YARN - Yet Another Resource Negotiator
YARN Architecture
Running MR programs on YARN
How to write YARN Applications
HBase
NoSQL Basics, other NoSQL DBs
HBase Basics
HBase Architecture
Schema Design
Hands On Exercise
Hive
Hive Basics, Internal & External Tables, Partitioning, Buckets
Writing queries – Joins, Union, Dynamic partitioning, Sampling
Hands On Exercise – Structured data analysis
Pig
Pig Basics, Loading data files
Writing queries – SPLIT, FILTER, JOIN, GROUP, SAMPLE, ILLUSTRATE etc.
Hands On Exercise – Semi-structured Data Analysis
Sqoop
Importing and Exporting data from RDBMS
Hands On Exercises – Import and Export
Spark
Scala (Optional)
Spark Architecture
Spark vs MR
RDD, DataFrame and DataSets
Spark API
Spark SQL
ML Lib
Spark Streaming
Spark 2.0
Real world Scenarios
Best Practices
