With the advance of IT storage, processing, computation, and sensing technologies, Big Data has become a novel norm of life. Only until recently, computers are able to capture and analysis all sorts of large-scale data from all kinds of fields -- people, behaviour, information, devices, sensors, biological signals, finance, vehicles, astrology, neurology, etc. Almost all industries are bracing into the challenge of Big Data and want to dig out valuable information to get insight to solve their challenges.
- Big Data Features & Challenges
- 7 V's of Big Data, Type of Data
- Google File System, HDFS, Blocks of Hadoop (Namenode, Data Node, Secondary Node, Job Tracker, Task Tracker
- Writing Map Reduce Programs
- Hadoop I/O
- Pig
- Applying Structure to Hadoop Data with Hive
After studying this course, the students will be able to
- Student will be able to identified and implement the basics of data structures like Linked list, stack, queue, set and map in Java.
- Student will be able to design the knowledge of big data analytics and implement different file management task in Hadoop.
- Student will be able to write or design Map Reduce Paradigm and develop data applications using variety of systems.
- Student will be able to work and perform different operations on data using Pig Latin scripts.
- Student will be able to work and apply different operations on relations and databases using Hive.