Cloud VM - OpenNebula with Netrunner

VM : 


https://drive.google.com/file/d/1dRnOTbPK2tnu0Qmd_pHjJvqImF7ttCyg/view?usp=sharing

CLOUD COMPUTING LAB Hadoop Deployed in 32 bit Machine

CLOUD COMPUTING LAB

32  bit Virtual Machine 


https://drive.google.com/drive/folders/1USRzSI0iIk0Q1bX3dZT1_ak6RLrJTpNW?usp=sharing


Open Nebula - Testing 

                        Netrunner OS Image 

https://drive.google.com/file/d/1sjZl0azrKWW6X3vdc0fPd8A0IoInalkL/view?usp=sharing

CLOUD COMPUTING LAB Deployed in Virtual Machine

CLOUD COMPUTING LAB

System Requirements

Windows

• Microsoft® Windows® 7/8/10 (64-bit)
• 3 GB RAM minimum, 8 GB RAM recommended; 
• 20 GB of available disk space minimum,
  10 GB Recommended (500 MB for Oracle Virtual Box + 9.5 GB for system image)
• 1280 x 800 minimum screen resolution

Step 1 :

Download the Oracle Virtual box and install in your system

Link : https://drive.google.com/file/d/1en98xuffrI7WpJJEOq3odyTqHHjLm8uG/view?usp=sharing

Step 2:

Download the OVA File and deploy it to the Oracle Virtual box

Link :

https://drive.google.com/file/d/10mOLRj6LmD12dA5eM47gGk5dkrSxRAwy/view?usp=sharing

User Name : kesav

Password   :  k7cloud

Root User Name : root

Password              : k7cloud

Execute the following Experiments

1. Find procedure to run the virtual machine of different configuration. Check how many virtual machines can be utilized at particular time.

2. Find procedure to attach virtual block to the virtual machine and check whether it holds the data even after the release of the virtual machine.

3. Install a C compiler in the virtual machine and execute a sample program.

4. Show the virtual machine migration based on the certain condition from one node to the other.

5. Find procedure to install storage controller and interact with it.

Step 3:

Download the OVA File and deploy it to the Oracle Virtual box

Link :

https://drive.google.com/file/d/14pTB3IvJadzwJNNQ5-AHD62T00oLd-Rl/view?usp=sharing

User Name : kesav

Password   :  k7cloud

Root User Name : root

Password              : k7cloud

Execute the following Experiments

6. Find procedure to set up the one node Hadoop cluster.

Step 4:

Download the OVA File and deploy it to the Oracle Virtual box

Link :

https://drive.google.com/file/d/1P7QTz3BM9-7V_vAGCA4umAOjZMAhBbLY/view?usp=sharing

User Name : kesav

Password   :  k7cloud

Root User Name : root

Password              : k7cloud

Execute the following Experiments

7. Mount the one node Hadoop cluster using FUSE.

8. Write a program to use the API's of Hadoop to interact with it.

9. Write a wordcount program to demonstrate the use of Map and Reduce tasks

“CLOUD COMPUTING LAB SETUP USING HADOOP & OPEN NEBULA”

Two Day Hands on Workshop on

“CLOUD COMPUTING LAB SETUP USING HADOOP & OPEN NEBULA”

Organized By

Department of Computer Science and Engineering

TRP Engineering College

NH 45, Mannachanallur Taluk, Tiruchirappalli District,

Irungalur, Tamil Nadu 621105

16-09-2016 & 17-09-2016

Resource Person

Mr.D.Kesavaraja M.E , MBA, (PhD) , MISTE Assistant Professor, Department of Computer Science and Engineering, Dr.Sivanthi Aditanar College of Engineering Tiruchendur  - 628215

CLOUD COMPUTING LAB SETUP USING HADOOP & OPEN NEBULA

Day – 01

Big Data Analytics with HADOOP

v  Introduction to Big Data

v  BIG DATA Analogy

v  Big Data Analytics

v  Installing Cent OS – 7

v  Hadoop Installation – Single Node

v  Hadoop Distributed File System

v  To set up the one node Hadoop cluster.

v  Mount the one node Hadoop cluster using FUSE.

v  JAVA API’s of Hadoop

v  Map and Reduce tasks

v  JAVA wordcount program to demonstrate the use of Map and Reduce tasks

v  Big Data Analytics Job Opportunities

Day – 02

Cloud Computing – Open Nebula IaaS

v  Cloud Computing

v  Virtualization – VM Ware Demo

v  IaaS, PaaS, SaaS

v  XaaS

v  What is OpenNebula?

v  Ecosystem

v  Open Nebula Setup

v  Open Nebula Installation

v  Procedure to configure IaaS

v  Virtual Machine Creation

v  Virtual Block

v  Storage Controller

v  Virtual Machine migration

·         Hands on -  Live Experiments ·         E-Resources , Forums and Groups. ·         Discussion and Clarifications

“Knowing is not enough

We must apply

Willing is not enough

We must do”

Installation OpenNebula 4.14 CentOS 7.2

 Edit 0 17…

In this quick installation, we are going to show how to install OpenNebula on a CentOS 7.2.
However this will only be the installation part, for creating things like a host, a Template or a Virtual Machine you may wanna go for those articles.

First we have to add Opennebula to the repo list, always watch out for using the newest version.
In this case we're using CentOS 7.2 and the newest available version is 4.14.
Commands that should be run as root are marked by a #, however those marked with a $ should be run by the oneadmin.

First we add the epel, an additional repository needed.

#

yum install -y epel-release

Then we make sure to get the opennebula-repository. Always check for the newest version!
For more information you can visit this Page.

#

cat << EOT > /etc/yum.repos.d/opennebula.repo
> [opennebula]
> name=opennebula
> baseurl=http://downloads.opennebula.org/repo/4.14/CentOS/7/x86_64/
> enabled=1
> gpgcheck=0
> EOT

Install Opennebula + KVM + sunstone webinterface

#

yum install -y opennebula-server opennebula-node-kvm opennebula-sunstone

Install system-utilities, we need them for later use!

#

yum install -y policycoreutils-python setroubleshoot-server firewalld wget

Install redhat-related-stuff aswell as ruby-developer stuff and the MySQL-Server

#

yum install -y redhat-lsb ruby-devel mariadb-server

To install the ruby gems do the following:

#

/usr/share/one/install_gems

Then you should come up with something like this:

Distribution "redhat" detected.
About to install these dependencies:
* gcc-c++
* gcc
* sqlite-devel
* curl-devel
* mysql-devel
* openssl-devel
* ruby-devel
* make
 
Press enter to continue...
 
yum install gcc-c++ gcc sqlite-devel curl-devel mysql-devel openssl-devel ruby-devel make

Enable, aswell start the mariaidb service

#

systemctl enable mariadb
 
systemctl start mariadb

Start the MySQL Installation

#

mysql_secure_installation

Create a new user, configure the mariadb for opennebula usage

#

mysql -u oneadmin -p Your password
CREATE DATABASE one;
GRANT ALL PRIVILEGES ON one.* TO 'oneadmin'@'localhost' IDENTIFIED BY '1oneadm1n';
FLUSH PRIVILEGES;

Head into the oneadmin user

#

su oneadmin

Get an ssh-key, add the host to the trusted ones

$

cat << EOT > ~/.ssh/config
Host *
StrictHostKeyChecking no
UserKnownHostsFile /dev/null
EOT

Gice access to the ssh key, by setting the right permissions

$

chmod 600 ~/.ssh/config

Leave oneadmin

$

exit

In this case we want to start opennbeula and opennebula and start opennebula by startup

#

systemctl start opennebula
 
systemctl start opennebula-sunstone
 
systemctl enable opennebula

Move over to the following directory

#

cd /etc/pki/rpm-gpg

Download the GPG-Key for the openvswitch

#

wget http://artemit.com.es/repo/RPM-GPG-KEY-artemit

Add the repo for openvswitch

#

cat << EOT >/etc/yum.repos.d/artemit.repo
[artemit]
Name = artemit
baseurl =http://artemit.com.es/repo
Enabled = 1
dem Parameter gpgcheck deaktiviert = 1
gpgkey = file:///etc/pki/rpm-gpg/RPM-GPG-KEY-artemit
EOT

Install openvswitch

#

yum install openvswitch -y

We start openvswitch in the old-fashion way

#

chkconfig openvswitch on
 
systemctl start openvswitch
 
ovs-vsctl show

This is our configuration for the openvswitch-bridge

#

cat << EOT > /etc/sysconfig/network-scripts/ifcfg-ovsbr0
DEVICE=ovsbr0
ONBOOT=yes
DEVICETYPE=ovs
TYPE=OVSBridge
BOOTPROTO=static
IPADDR=192.168.1.1
NETMASK=255.255.255.0
IPV6INIT=yes
IPV6ADDR=2a01:4f8:191:12af::2/64
DNS1=213.133.100.100
DNS2=213.133.98.98
DNS3=213.133.99.99
DNS4=2a01:4f8:0:a102::add:9999
DNS5=2a01:4f8:0:a0a1::add:1010
DNS6=2a01:4f8:0:a111::add:9898
HOTPLUG=no
EOT

Add firewall rules

#

echo net.ipv4.ip_forward=1 >> /usr/lib/sysctl.d/00-system.conf
echo net.ipv6.conf.all.forwarding=1 >> /usr/lib/sysctl.d/00-system.conf
firewall-cmd --zone=public --add-port=9869/tcp --permanent
sysctl -p /usr/lib/sysctl.d/00-system.conf

You can login with the "oneadmin" and the password you get from
#

cat /var/lib/one/.one/one_auth

But dont forget to tell your server where to listen on:
#

nano /etc/one/sunstone-server.conf

Then search for somehing like this:

# Server Configuration
#
:host: 127.0.0.1
:port: 9869

Change it to the desired port and IP, in our case this is:

# Server Configuration
#
:host: 0.0.0.0
:port: 9869

Ref : http://iaas.wikispaces.com/Installation+OpenNebula+14.4+CentOS+7.2

Packstack quickstart — RDO

Packstack quickstart: Proof of concept for single node

Packstack is an installation utility that lets you spin up a proof of concept cloud on one node. You will be able to add more nodes to your OpenStack cloud later, if you choose.

• If you are looking for instructions on how to deploy a production-ready cloud, possibly with HA, see the TripleO quickstart.
• If you just want to try out OpenStack without installing anything, check out TryStack.

This document describes installing the current Mitaka release.

Summary for the impatient

If you are using non-English locale make sure your /etc/environment is populated:

LANG=en_US.utf-8
LC_ALL=en_US.utf-8

If your system meets all the prerequisites mentioned below, proceed with running the following commands.

• On RHEL:

  $ sudo yum install -y https://www.rdoproject.org/repos/rdo-release.rpm
  $ sudo yum update -y
  $ sudo yum install -y openstack-packstack
  $ packstack --allinone
  

• On CentOS:

  $ sudo yum install -y centos-release-openstack-mitaka
  $ sudo yum update -y
  $ sudo yum install -y openstack-packstack
  $ packstack --allinone
  

Step 0: Prerequisites

Software

Red Hat Enterprise Linux (RHEL) 7 is the minimum recommended version, or the equivalent version of one of the RHEL-based Linux distributions such as CentOS, Scientific Linux, and so on.x86_64 is currently the only supported architecture.

• See RDO repositories for details on required repositories.

Name the host with a fully qualified domain name rather than a short-form name to avoid DNS issues with Packstack.

Hardware

Machine with at least 4GB RAM, preferably 6GB RAM, processors with hardware virtualization extensions, and at least one network adapter.

Network

If you plan on having external network access to the server and instances, this is a good moment to properly configure your network settings. A static IP address to your network card, and disabling NetworkManager are good ideas.

$ sudo systemctl disable firewalld
$ sudo systemctl stop firewalld
$ sudo systemctl disable NetworkManager
$ sudo systemctl stop NetworkManager
$ sudo systemctl enable network
$ sudo systemctl start network

If you are planing on something fancier, read the document on advanced networking before proceeding.

Step 1: Software repositories

On RHEL, download and install the RDO repository RPM to set up the OpenStack repository:

$ sudo yum install -y https://rdoproject.org/repos/rdo-release.rpm

On CentOS, the Extras repository provides the RPM that enables the OpenStack repository. Extras is enabled by default on CentOS 7, so you can simply install the RPM to set up the OpenStack repository:

$ sudo yum install -y centos-release-openstack-mitaka

Update your current packages:

$ sudo yum update -y

Looking for an older version? See http://rdoproject.org/repos/ for the full listing.

Step 2: Install Packstack Installer

$ sudo yum install -y openstack-packstack

Step 3: Run Packstack to install OpenStack

Packstack takes the work out of manually setting up OpenStack. For a single node OpenStack deployment, run the following command:

$ packstack --allinone

If you encounter failures, see the Workarounds page for tips.

If you have run Packstack previously, there will be a file in your home directory named something like packstack-answers-20130722-153728.txt You will probably want to use that file again, using the --answer-file option, so that any passwords you have already set (for example, mysql) will be reused.

The installer will ask you to enter the root password for each host node you are installing on the network, to enable remote configuration of the host so it can remotely configure each node using Puppet.

Once the process is complete, you can log in to the OpenStack web interface Horizon by going to http://$YOURIP/dashboard. The user name is admin. The password can be found in the filekeystonerc_admin in the /root directory of the control node.

Ref : https://www.rdoproject.org/install/quickstart/

Tools Installation Help

Globus Toolkit 4.0.2 Deployment on Ubuntu 9.04 Jaunty Jackelope [part 1]
https://www.youtube.com/watch?v=_x7f4Nqjw5A

Globus Toolkit 4.0.2 Deployment on Ubuntu 9.04 Jaunty Jackelope [part 2]
https://www.youtube.com/watch?v=gd-OIP6l6ws

OpenNebula 4.0 Home Lab - Part 1 - Lab VM Creation
https://www.youtube.com/watch?v=N6JV8bOQoSw

OpenNebula 4.0 Home Lab - Part 2 - Installing OpenNebula on Ubuntu 13.04
https://www.youtube.com/watch?v=TRoA1I5nJW8


OpenNebula 4.0 Home Lab - Part 3 - KVM and Open vSwitch Install on Ubuntu 13.04
https://www.youtube.com/watch?v=FflA9j61LvE