Location via proxy:   [ UP ]  
[Report a bug]   [Manage cookies]                
Scribd Logo
Upload

Welcome to Scribd!

  • 74 views

    Hadoop 2.8.0 Installation On Window 10: Prepare

    Uploaded by

    Alvaro Rivas
    This document provides instructions for installing Hadoop 2.8.0 on Windows 10 64-bit. It outlines downloading and extracting required software, configuring environment variables and Hadoop files, formatting the HDFS namenode, starting Hadoop processes, and verifying the installation works by accessing the YARN resource manager web UI.

    Copyright:

    © All Rights Reserved
    Download as DOCX, PDF, TXT or read online from Scribd

    Hadoop 2.8.0 Installation On Window 10: Prepare

    Uploaded by

    Alvaro Rivas
    74 views9 pages
    This document provides instructions for installing Hadoop 2.8.0 on Windows 10 64-bit. It outlines downloading and extracting required software, configuring environment variables and Hadoop files, formatting the HDFS namenode, starting Hadoop processes, and verifying the installation works by accessing the YARN resource manager web UI.

    Original Title

    05 InstalacionWindows.docx

    Copyright

    © © All Rights Reserved

    Available Formats

    DOCX, PDF, TXT or read online from Scribd

    Did you find this document useful?

    Is this content inappropriate?

    This document provides instructions for installing Hadoop 2.8.0 on Windows 10 64-bit. It outlines downloading and extracting required software, configuring environment variables and Hadoop files, formatting the HDFS namenode, starting Hadoop processes, and verifying the installation works by accessing the YARN resource manager web UI.

    Copyright:

    © All Rights Reserved
    Download as DOCX, PDF, TXT or read online from Scribd
    Download as docx, pdf, or txt
    74 views9 pages

    Hadoop 2.8.0 Installation On Window 10: Prepare

    Uploaded by

    Alvaro Rivas
    This document provides instructions for installing Hadoop 2.8.0 on Windows 10 64-bit. It outlines downloading and extracting required software, configuring environment variables and Hadoop files, formatting the HDFS namenode, starting Hadoop processes, and verifying the installation works by accessing the YARN resource manager web UI.

    Copyright:

    © All Rights Reserved
    Download as DOCX, PDF, TXT or read online from Scribd
    Download as docx, pdf, or txt
    of 9

    Sign up

    GitHub

    MuhammadBilalYar/Hadoop-On-Window

    Hadoop 2.8.0 installation on Window


    10

    Prepare:
    These softwares should be prepared to install Hadoop 2.8.0 on window 10 64bit

    1. Download Hadoop 2.8.0 (Link: http://www-eu.apache.org/dist/hadoop/common/hadoop-


    2.8.0/hadoop-2.8.0.tar.gz OR http://archive.apache.org/dist/hadoop/core//hadoop-
    2.8.0/hadoop-2.8.0.tar.gz)
    2. Java JDK 1.8.0.zip (Link: http://www.oracle.com/technetwork/java/javase/downloads/jdk8-
    downloads-2133151.html)

    Set up

    1. Check either Java 1.8.0 is already installed on your system or not, use "Javac -version" to
    check.
    2. If Java is not installed on your system then first install java

    under "C:\JAVA"
    3. Extract file Hadoop 2.8.0.tar.gz or Hadoop-2.8.0.zip and place under "C:\Hadoop-

    2.8.0".
    4. Set the path HADOOP_HOME Environment variable on windows 10(see Step 1,2,3 and 4
    below).
    5. Set the path JAVA_HOME Environment variable on windows 10(see Step 1,2,3 and 4
    below).
    6. Next we set the Hadoop bin directory path and JAVA bin directory

    path.

    Configuration

    1. Edit file C:/Hadoop-2.8.0/etc/hadoop/core-site.xml, paste below xml paragraph and save


    this file.

    <configuration>
    <property>
    <name>fs.defaultFS</name>
    <value>hdfs://localhost:9000</value>
    </property>
    </configuration>
    2. Rename "mapred-site.xml.template" to "mapred-site.xml" and edit this file C:/Hadoop-
    2.8.0/etc/hadoop/mapred-site.xml, paste below xml paragraph and save this file.

    <configuration>
    <property>
    <name>mapreduce.framework.name</name>
    <value>yarn</value>
    </property>
    </configuration>

    3. Create folder "data" under "C:\Hadoop-2.8.0"

     Create folder "datanode" under "C:\Hadoop-2.8.0\data"


     Create folder "namenode" under "C:\Hadoop-
    2.8.0\data"

    4. Edit file C:\Hadoop-2.8.0/etc/hadoop/hdfs-site.xml, paste below xml paragraph and save


    this file.

    <configuration>
    <property>
    <name>dfs.replication</name>
    <value>1</value>
    </property>
    <property>
    <name>dfs.namenode.name.dir</name>
    <value>C:\hadoop-2.8.0\data\namenode</value>
    </property>
    <property>
    <name>dfs.datanode.data.dir</name>
    <value>C:\hadoop-2.8.0\data\datanode</value>
    </property>
    </configuration>

    5. Edit file C:/Hadoop-2.8.0/etc/hadoop/yarn-site.xml, paste below xml paragraph and save


    this file.

    <configuration>
    <property>
    <name>yarn.nodemanager.aux-services</name>
    <value>mapreduce_shuffle</value>
    </property>
    <property>
    <name>yarn.nodemanager.auxservices.mapreduce.shuffle.class</name>
    <value>org.apache.hadoop.mapred.ShuffleHandler</value>
    </property>
    </configuration>

    6. Edit file C:/Hadoop-2.8.0/etc/hadoop/hadoop-env.cmd by closing the command


    line"JAVA_HOME=%JAVA_HOME%" instead of set "JAVA_HOME=C:\Java" (On C:\java
    this is path to file jdk.18.0)

    Hadoop Configuration

    1. Dowload file Hadoop Configuration.zip


    (Link: https://github.com/MuhammadBilalYar/HADOOP-INSTALLATION-ON-WINDOW-
    10/blob/master/Hadoop%20Configuration.zip)
    2. Delete file bin on C:\Hadoop-2.8.0\bin, replaced by file bin on file just download (from
    Hadoop Configuration.zip).
    3. Open cmd and typing command "hdfs namenode –format" . You will
    see

    Testing
    1. Open cmd and change directory to "C:\Hadoop-2.8.0\sbin" and type "start-all.cmd" to
    start
    apache.

    2. Make sure these apps are running

     Hadoop Namenode
     Hadoop datanode
     YARN Resourc Manager
     YARN Node
    Manager
    3. Open: http://localhost:8088

    You might also like