Скачать или смотреть Hive: A Relational Data Store for Hadoop | What is Hive and how it works? | Hadoop Tutorial

This lecture is all about Hive- A relational data store for Hadoop where we have seen what is Hive, how it works, where Hive sits on Hadoop stack also discussed all about Hive Architecture which includes:
Metastore
Driver
Compiler
Optimizer
Executor
CLI, UI, and Thrift Server

In the previous lecture MapReduce Exercise to analyze movie ratings data to get the most popular movie from our movies data set. This lecture will cover getting all the required scripts and data files, then we will learn our mapreduce script written in Python and what are the different stages and their function such as Mapper function and Reducer function.

Getting the required files:
wget https://raw.githubusercontent.com/ash...
wget https://raw.githubusercontent.com/ash...
Running locally:
python TopMovies.py ratings.data
Running on Hadoop cluster:
python TopMovies.py –r hadoop --hadoop-streaming-jar /usr/hdp/current/hadoop-mapreduce-client/hadoop-streaming.jar ratings.data

----------------------------------------------------------------------------------------------------------------

Installing mrjob on HDP 2.6.5 (be sure to "su root" first, as shown in the video.)

yum-config-manager --save --setopt=HDP-SOLR-2.6-100.skip_if_unavailable=true
yum install https://repo.ius.io/ius-release-el7.rpm https://dl.fedoraproject.org/pub/epel...
yum install python-pip
pip install pathlib
pip install mrjob==0.7.4
pip install PyYAML==5.4.1
yum install nano

----------------------------------------------------------------------------------------------------------------

Want to know more about Big Data? then checkout the full course dedicated to Big Data fundamentals:    • Big Data Full Course  

---------------------------------------------------------------------------------------------------------

HDP Sandbox Installation links:

Oracle VM Virtualbox: https://download.virtualbox.org/virtu...

HDP Sandbox link: https://archive.cloudera.com/hwx-sand...

HDP Sandbox installation guide: https://hortonworks.com/tutorial/sand...

-------------------------------------------------------------------------------------------------------------

Also check out similar informative videos in the field of cloud computing:


What is Big Data:    • What is Big Data? | Big Data Use Cases, Be...  


How Cloud Computing changed the world:    • How Cloud Computing changed the world!  

What is Cloud?    • What is Cloud Computing?  

Top 10 facts about Cloud Computing that will blow your mind!    • Top 10 facts about Cloud Computing that wi...  

Audience

This tutorial is made for professionals who are willing to learn the basics of Big Data Analytics using Hadoop Ecosystem and become a Hadoop Developer. Software Professionals, Analytics Professionals, and ETL developers are the key beneficiaries of this course.

Prerequisites

Before you start proceeding with this course, I am assuming that you have some basic knowledge to Core Java, database concepts, and any of the Linux operating system flavors.

---------------------------------------------------------------------------------------------------------------------------

Check out our full course topic wise playlist on some of the most popular technologies:

SQL Full Course Playlist-
   • SQL Full Course  


PYTHON Full Course Playlist-
   • Python Full Course  

Data Warehouse Playlist-

   • Data Warehouse Full Course  


Unix Shell Scripting Full Course Playlist-
   • Unix Shell Scripting Full Course  

--------------------------------------------------------------------------------------------------------------------------
Don't forget to like and follow us on our social media accounts which are linked below.

Facebook-
  / ampcode  

Instagram-
  / ampcode_tutorials  

Twitter-
  / ampcodetutorial  

Tumblr-
ampcode.tumblr.com

-------------------------------------------------------------------------------------------------------------------------

Channel Description-

AmpCode provides you e-learning platform with a mission of making education accessible to every student. AmpCode will provide you tutorials, full courses of some of the best technologies in the world today.By subscribing to this channel, you will never miss out on high quality videos on trending topics in the areas of Big Data & Hadoop, DevOps, Machine Learning, Artificial Intelligence, Angular, Data Science, Apache Spark, Python, Selenium, Tableau, AWS , Digital Marketing and many more.

#bigdata #datascience #technology #dataanalytics #datascientist #hadoop #hdfs #mrjob #hdp #hdfs #hive