Скачать или смотреть Installing and Running Apache Pig : How to Install pig

Official Website: http://bigdataelearning.com

In this module, you will understand the basics of apache Pig. You will also understand how to install apache pig in an Ubuntu machine using the 3 step process. Finally you will get to know how to explore different ways to execute the pig commands.

This module also includes a screen sharing demo on how to install apache pig and also on how to run basic commands in grunt console.

Transcript
==========
Did you know 200 lines of mapreduce programs can be written in 10 lines of pig code? yes, Apache Pig reduces development effort to a great extent.

well, in this video, I am going to teach on
How to install apache Pig : here I will go over the Steps to install pig on an ubuntu machine, or hadoop cluster
Then I will also explain two ways to execute the pig commands, one through grunt shell and other by executing as a pig script.

By the end of this video, you will be able to install apache pig on your machine and get started. You will also get to know
the different ways to execute the pig commands.

Installing apache Pig : How to Install apache pig ?
========================================

The prerequisite for installing apache pig are,

Hadoop 1.X or 2.X
java 1.7 - if you don't have java 1.7 already you can install from the below site

Apache Pig can be installed using the below 3 steps

1. First step is to Download the apache pig latest stable release from apache mirrors site.

At the time of making this video, the latest release is "0.16.0" and the link for the 0.16.0 release is highlighted.

we can use the wget command to download the gzipped file as shown below.

To make it consistent, you can download the pig to a node location where the other tools, platforms were installed.
For e.g. if hadoop version is installed in user local directory, you can create a pig folder in that location and download the pig components there.


2. Secondly we need to extract the gzipped file using 'tar hyphen xvzf' command.


3. Third step is to Edit the dot bashrc file. The bash rc file will be in home user directory.

In the bashrc file , Verify if the path is correct for the following variables.
JAVA_HOME, Pig_HOME, PATH. They all should point to their installation folders. Pig's bin directory should be specified in PATH variable.

Let me show these steps in an ubuntu machine.
First I am typing pig and hitting enter, it says no such file or directory.

Next I am executing the wget command to download pig. Before executing , I am making sure, I am in the right location where I need Pig files to be available.

Executing wget command has downloaded the latest pig 0.16.0 version from the apache mirrors site as gzipped file pig-0.16.0.tar.gz

Next I am going to extract the files using tar hyphen xvzf command. here the gzipped file is being extracted and loaded into the pig directory as pig-0.16.0.

I am going to rename and make the folder as pig.
Finally I am going to home user directory, and edit the .bashrc file.
Here I am making sure if the Pig_HOME, PATH, JAVA_HOME variable are set properly.

we need to make sure that these are pointing to their installation folders. PATH variable should be appended with Pig's bin directory.

Now that the installation is completed, i am typing pig and hitting enter. wow , we are in pig's shell which is grunt console.
Next, let's see how to execute the pig commands in shell.

Two ways to execute the pig commands
=================================

There are 2 ways to execute the Pig commands.
one is through Grunt console and other is by executing as pig scripts.

First let us look at the grunt console and I am going to walk you through it.

As we did earlier, To enter into grunt console, type pig and hit enter.
Notice here we are seeing 'grunt' prompt, which means we are in grunt console.

You can access hdfs files from within the grunt console , using fs commands. I am typing fs hyphen ls filename. you can see the hdfs file names are listed.

I am Typing Ctrl-E and it moves the cursor to the end of line.
I can press the tab key to expand the commands. for e.g. if I type 'L' 'O' and press the tab, then it auto completes the command as LOAD.

In this video we saw ,

how to install the apache pig on a local machine
we also saw 2 ways to execute the pig commands, one through grunt console and other by executing as a pig script.

In next video, we will learn about the apache Pig's data model, using which you will be able to describe your data to Pig