LXC Environment OEL6
Setting up an LXC Container on tme-srv2567 an Oracle Enterprise Linux 6 box.
Setting Up Host Environment
So that networking from LXC Linux Containers and KVM guests will both be able to resolve, ping, and communicate with external IP addresses, several configurations must be made according to the instructions here by Venu Murthy.
The /etc/selinux/config file must be configured as described and as shown below. The "permissive" setting MUST be used. Do not use "disabled" setting. The "permissive" setting is one of the requirements as described by Venu Murthy, which is required for resolution of external IP addresses.
[OEL 6.6][~][root@tme-srv2567]# cat /etc/selinux/config
# This file controls the state of SELinux on the system.
# SELINUX= can take one of these three values:
# enforcing - SELinux security policy is enforced.
# permissive - SELinux prints warnings instead of enforcing.
# disabled - No SELinux policy is loaded.
SELINUX=permissive
# SELINUXTYPE= can take one of these two values:
# targeted - Targeted processes are protected,
# mls - Multi Level Security protection.
SELINUXTYPE=enforcing
[OEL 6.6][~][root@tme-srv2567]#
Also, there are settings required in the /etc/sysctl.conf file as well as described and as shown below. The settings shown in bold are required so that resolution of external IP addresses will work correctly in the KVM guests and LXC Linux Containers.
[OEL 6.6][~][root@tme-srv2567]# cat /etc/sysctl.conf
# Kernel sysctl configuration file for Red Hat Linux
#
# For binary values, 0 is disabled, 1 is enabled. See sysctl(8) and
# sysctl.conf(5) for more details.
# Controls IP packet forwarding
# net.ipv4.ip_forward = 0
net.ipv4.ip_forward = 1
# Controls source route verification
# net.ipv4.conf.default.rp_filter = 1 #GLS
net.ipv4.conf.default.rp_filter = 0
net.ipv4.conf.all.rp_filter = 0
# Do not accept source routing
net.ipv4.conf.default.accept_source_route = 0
# Controls the System Request debugging functionality of the kernel
kernel.sysrq = 0
# Controls whether core dumps will append the PID to the core filename.
# Useful for debugging multi-threaded applications.
kernel.core_uses_pid = 1
# Controls the use of TCP syncookies
net.ipv4.tcp_syncookies = 1
# Disable netfilter on bridges.
net.bridge.bridge-nf-call-ip6tables = 0
net.bridge.bridge-nf-call-iptables = 0
net.bridge.bridge-nf-call-arptables = 0
# Controls the default maxmimum size of a mesage queue
kernel.msgmnb = 65536
# Controls the maximum size of a message, in bytes
kernel.msgmax = 65536
# Controls the maximum shared segment size, in bytes
# Controls the maximum number of shared memory segments, in pages
kernel.shmall = 4294967296
# Hugepages Oracle
vm.nr_hugepages = 2060
# oracle-rdbms-server-11gR2-preinstall setting for fs.file-max is 6815744
fs.file-max = 6815744
# oracle-rdbms-server-11gR2-preinstall setting for kernel.sem is '250 32000 100 128'
kernel.sem = 250 32000 100 128
# oracle-rdbms-server-11gR2-preinstall setting for kernel.shmmni is 4096
kernel.shmmni = 4096
# oracle-rdbms-server-11gR2-preinstall setting for kernel.shmall is 1073741824 on x86_64
# oracle-rdbms-server-11gR2-preinstall setting for kernel.shmall is 2097152 on i386
# oracle-rdbms-server-11gR2-preinstall setting for kernel.shmmax is 4398046511104 on x86_64
# oracle-rdbms-server-11gR2-preinstall setting for kernel.shmmax is 4294967295 on i386
kernel.shmmax = 4398046511104
# oracle-rdbms-server-11gR2-preinstall setting for kernel.panic_on_oops is 1 per Orabug 19212317
kernel.panic_on_oops = 1
# oracle-rdbms-server-11gR2-preinstall setting for net.core.rmem_default is 262144
net.core.rmem_default = 262144
# oracle-rdbms-server-11gR2-preinstall setting for net.core.rmem_max is 4194304
net.core.rmem_max = 4194304
# oracle-rdbms-server-11gR2-preinstall setting for net.core.wmem_default is 262144
net.core.wmem_default = 262144
# oracle-rdbms-server-11gR2-preinstall setting for net.core.wmem_max is 1048576
net.core.wmem_max = 1048576
# oracle-rdbms-server-11gR2-preinstall setting for fs.aio-max-nr is 1048576
fs.aio-max-nr = 1048576
# oracle-rdbms-server-11gR2-preinstall setting for net.ipv4.ip_local_port_range is 9000 65500
net.ipv4.ip_local_port_range = 9000 65500
vm.nr_hugepages = 2060
[OEL 6.6][~][root@tme-srv2567]#
Configuring IPTables Rule for Multicast
Configure iptables to permit multicast with the bolded entry as shown below. Note that the rule must be placed prior to the "icmp-host-prohibited" rule as shown (order of rules matters in this case). This solution works and was obtained from the reference here by Kleber Sacilotto de Souza.
Please note that this is related to the earlier information referenced from Venu Murthy that for OpenStack and similar deployments of VMs and LXC Linux Containers using OpenvSwitch, selinux "permissive" must be used (and NOT "disabled") and iptables must NOT be disabled, but rather the required iptables rules added for multipath and any other Oracle requirements, as well as the entries mentioned in the previous section in /etc/sysctl.conf file.
[root@kvmora01 ~]# cat /etc/sysconfig/iptables
# Firewall configuration written by system-config-firewall
# Manual customization of this file is not recommended.
*filter
:INPUT ACCEPT [0:0]
:FORWARD ACCEPT [0:0]
:OUTPUT ACCEPT [0:0]
-A INPUT -m state --state ESTABLISHED,RELATED -j ACCEPT
-A INPUT -p icmp -j ACCEPT
-A INPUT -i lo -j ACCEPT
-A INPUT -m state --state NEW -m tcp -p tcp --dport 22 -j ACCEPT
-A INPUT -m pkttype --pkt-type multicast -j ACCEPT
-A INPUT -j REJECT --reject-with icmp-host-prohibited
-A FORWARD -j REJECT --reject-with icmp-host-prohibited
COMMIT
[root@kvmora01 ~]#
This rule is needed to solve the following error during cluster verification (cluvfy) as shown below.
Checking subnet "10.207.39.0" for multicast communication with multicast group "224.0.0.251"...
PRVG-11138 : Interface "10.207.39.89" on node "kvmora01" is not able to communicate with interface "10.207.39.89" on node "kvmora01" over multicast group "224.0.0.251"
Configuring for EM Express Management GUI
The following rule shown in bold will also need to be added to /etc/sysconfig/iptables and then the iptables will need to be reloaded to access EM Express GUI for database management.
[root@kvmora01 sysconfig]# cat iptables
# Firewall configuration written by system-config-firewall
# Manual customization of this file is not recommended.
*filter
:INPUT ACCEPT [0:0]
:FORWARD ACCEPT [0:0]
:OUTPUT ACCEPT [0:0]
-A INPUT -m state --state ESTABLISHED,RELATED -j ACCEPT
-A INPUT -p icmp -j ACCEPT
-A INPUT -i lo -j ACCEPT
-A INPUT -m state --state NEW -m tcp -p tcp --dport 22 -j ACCEPT
-A INPUT -p udp --dport 123 -j ACCEPT
-A INPUT -m state --state NEW -m tcp -p tcp --dport 5500 -j ACCEPT
-A INPUT -m pkttype --pkt-type multicast -j ACCEPT
-A INPUT -j REJECT --reject-with icmp-host-prohibited
-A FORWARD -j REJECT --reject-with icmp-host-prohibited
COMMIT
[root@kvmora01 sysconfig]#
Next, so that the new iptables rule will take effect, reload iptables as shown below.
[root@kvmora02 ~]# service iptables reload
iptables: Trying to reload firewall rules: [ OK ]
[root@kvmora02 ~]#
Note that later in this set of procedures, once the database is created, it will also be necessary to unlock the XDB user as shown below in order to access EM Express GUI.
[oracle@kvmora01 ~]$ sqlplus "/ as sysdba"
SQL*Plus: Release 12.1.0.2.0 Production on Sat Dec 6 16:15:16 2014
Copyright (c) 1982, 2014, Oracle. All rights reserved.
Connected to:
Oracle Database 12c Enterprise Edition Release 12.1.0.2.0 - 64bit Production
With the Partitioning, Automatic Storage Management, OLAP, Advanced Analytics
and Real Application Testing options
SQL> alter user xdb account unlock;
User altered.
SQL>
The port for EM Express GUI can be changed using the command shown below. The example shown below changes the port for EM Express to "5601". Refer to Oracle Support Document 1575988.1 for more details, or consult public references on web for additional information.
[oracle@kvmora01 ~]$ sqlplus "/ as sysdba"
SQL*Plus: Release 12.1.0.2.0 Production on Sat Dec 6 16:40:35 2014
Copyright (c) 1982, 2014, Oracle. All rights reserved.
Connected to:
Oracle Database 12c Enterprise Edition Release 12.1.0.2.0 - 64bit Production
With the Partitioning, Automatic Storage Management, OLAP, Advanced Analytics
and Real Application Testing options
SQL> exec dbms_xdb_config.sethttpsport(5601);
PL/SQL procedure successfully completed.
SQL> exit
Disconnected from Oracle Database 12c Enterprise Edition Release 12.1.0.2.0 - 64bit Production
With the Partitioning, Automatic Storage Management, OLAP, Advanced Analytics
and Real Application Testing options
[oracle@kvmora01 ~]$
Installing OpenvSwitch and LXC
The procedure for installing OpenvSwitch on an Oracle Enterprise Linux 6 server is described here. Basically what is explained there is that the Beta repo for public-yum,oracle.com must be added to the yum repos and then once this is done, both lxc and openvswitch can be installed using "yum install lxc" and "yum install openvswitch" as shown below. Also, be sure to run "yum install tunctl" because this tutorial uses tunctl for some of the OpenvSwitch configuration.
[OEL 6.3][~][root@tme-srv2567]# wget http://public-yum.oracle.com/beta/public-yum-ol6-beta.repo
[OEL 6.3][~][root@tme-srv2567]# cd /etc/yum.repos.d
[OEL 6.3][~][root@tme-srv2567]# sed -i s/enabled=0/enabled=1/g public-yum-ol6-beta.repo
[OEL 6.3][~][root@tme-srv2567]# yum update
[OEL 6.3][~][root@tme-srv2567]# yum install openvswitch lxc
[OEL 6.3][~][root@tme-srv2567]# ovs-vsctl show
[OEL 6.3][~][root@tme-srv2567]# service openvswitch start
[OEL 6.3][~][root@tme-srv2567]# chkconfig openvswitch on
[OEL 6.3][~][root@tme-srv2567]# ovs-vsctl show
[OEL 6.3][~][root@tme-srv2567]# yum install tunctl
Create OpenvSwitch
Create the openvswitch "sw1" which will be the management network for the LXC containers.
Install LXC Container
[OEL 6.3][~][root@tme-srv2567]# lxc-create -t oracle -n lxcora03
The output will look something like this below (some output at beginning of install omitted).
rpm x86_64 4.8.0-37.el6 ol6_u6_base 901 k
rpm-libs x86_64 4.8.0-37.el6 ol6_u6_base 312 k
rpm-python x86_64 4.8.0-37.el6 ol6_u6_base 56 k
sed x86_64 4.2.1-10.el6 ol6_u6_base 215 k
setup noarch 2.8.14-20.el6_4.1 ol6_u6_base 150 k
shadow-utils x86_64 2:4.1.4.2-19.el6 ol6_u6_base 899 k
shared-mime-info x86_64 0.70-6.el6 ol6_u6_base 208 k
sqlite x86_64 3.6.20-1.el6 ol6_u6_base 301 k
sysvinit-tools x86_64 2.87-5.dsf.el6 ol6_u6_base 59 k
tcp_wrappers-libs x86_64 7.6-57.el6 ol6_u6_base 62 k
tzdata noarch 2014g-1.el6 ol6_u6_base 448 k
udev x86_64 147-2.57.0.2.el6 ol6_u6_base 351 k
upstart x86_64 0.6.5-13.el6_5.3 ol6_u6_base 176 k
ustr x86_64 1.0.4-9.1.el6 ol6_u6_base 85 k
util-linux-ng x86_64 2.17.2-12.18.0.1.el6 ol6_u6_base 1.6 M
xz-libs x86_64 4.999.9-0.5.beta.20091007git.el6 ol6_u6_base 89 k
yum-metadata-parser x86_64 1.1.2-16.el6 ol6_u6_base 26 k
zlib x86_64 1.2.3-29.el6 ol6_u6_base 72 k
Transaction Summary
=============================================================================================================================================================================================================
Install 143 Package(s)
Total download size: 82 M
Installed size: 304 M
Downloading Packages:
(1/143): MAKEDEV-3.24-6.el6.x86_64.rpm | 88 kB 00:00
(2/143): audit-libs-2.3.7-5.el6.x86_64.rpm | 71 kB 00:00
(3/143): basesystem-10.0-4.0.1.el6.noarch.rpm | 4.3 kB 00:00
(4/143): bash-4.1.2-29.el6.x86_64.rpm | 906 kB 00:00
(5/143): binutils-2.20.51.0.2-5.42.el6.x86_64.rpm | 2.8 MB 00:00
(6/143): bzip2-libs-1.0.5-7.el6_0.x86_64.rpm | 36 kB 00:00
(7/143): ca-certificates-2014.1.98-65.1.el6.noarch.rpm | 1.1 MB 00:00
(8/143): checkpolicy-2.0.22-1.el6.x86_64.rpm | 189 kB 00:00
(9/143): chkconfig-1.3.49.3-2.el6_4.1.x86_64.rpm | 158 kB 00:00
(10/143): coreutils-8.4-37.0.1.el6.x86_64.rpm | 3.0 MB 00:00
(11/143): coreutils-libs-8.4-37.0.1.el6.x86_64.rpm | 50 kB 00:00
(12/143): cpio-2.10-12.el6_5.x86_64.rpm | 191 kB 00:00
(13/143): cracklib-2.8.16-4.el6.x86_64.rpm | 70 kB 00:00
(14/143): cracklib-dicts-2.8.16-4.el6.x86_64.rpm | 3.6 MB 00:00
(15/143): curl-7.19.7-37.el6_5.3.x86_64.rpm | 193 kB 00:00
(16/143): cyrus-sasl-lib-2.1.23-15.el6.x86_64.rpm | 136 kB 00:00
(17/143): db4-4.7.25-18.el6_4.x86_64.rpm | 562 kB 00:00
(18/143): db4-utils-4.7.25-18.el6_4.x86_64.rpm | 130 kB 00:00
(19/143): dbus-glib-0.86-6.el6_4.x86_64.rpm | 169 kB 00:00
(20/143): dbus-libs-1.2.24-7.0.1.el6_3.x86_64.rpm | 126 kB 00:00
(21/143): dhclient-4.1.1-43.P1.0.1.el6.x86_64.rpm | 317 kB 00:00
(22/143): dhcp-common-4.1.1-43.P1.0.1.el6.x86_64.rpm | 142 kB 00:00
(23/143): diffutils-2.8.1-28.el6.x86_64.rpm | 198 kB 00:00
(24/143): elfutils-libelf-0.158-3.2.el6.x86_64.rpm | 182 kB 00:00
(25/143): ethtool-3.5-5.el6.x86_64.rpm | 101 kB 00:00
(26/143): expat-2.0.1-11.el6_2.x86_64.rpm | 76 kB 00:00
(27/143): file-libs-5.04-21.el6.x86_64.rpm | 313 kB 00:00
(28/143): filesystem-2.4.30-3.el6.x86_64.rpm | 1.0 MB 00:00
(29/143): findutils-4.4.2-6.el6.x86_64.rpm | 447 kB 00:00
(30/143): fipscheck-1.2.0-7.el6.x86_64.rpm | 14 kB 00:00
(31/143): fipscheck-lib-1.2.0-7.el6.x86_64.rpm | 7.8 kB 00:00
(32/143): gamin-0.1.10-9.el6.x86_64.rpm | 122 kB 00:00
(33/143): gawk-3.1.7-10.el6.x86_64.rpm | 774 kB 00:00
(34/143): gdbm-1.8.0-36.el6.x86_64.rpm | 28 kB 00:00
(35/143): glib2-2.28.8-4.el6.x86_64.rpm | 1.7 MB 00:00
(36/143): glibc-2.12-1.149.el6.x86_64.rpm | 3.8 MB 00:00
(37/143): glibc-common-2.12-1.149.el6.x86_64.rpm | 14 MB 00:01
(38/143): gmp-4.3.1-7.el6_2.2.x86_64.rpm | 206 kB 00:00
(39/143): gnupg2-2.0.14-8.el6.x86_64.rpm | 1.6 MB 00:00
(40/143): gpgme-1.1.8-3.el6.x86_64.rpm | 144 kB 00:00
(41/143): grep-2.6.3-6.el6.x86_64.rpm | 229 kB 00:00
(42/143): groff-1.18.1.4-21.el6.x86_64.rpm | 1.5 MB 00:00
(43/143): gzip-1.3.12-22.el6.x86_64.rpm | 116 kB 00:00
(44/143): hwdata-0.233-11.1.el6.noarch.rpm | 1.2 MB 00:00
(45/143): info-4.13a-8.el6.x86_64.rpm | 177 kB 00:00
(46/143): initscripts-9.03.46-1.0.2.el6.x86_64.rpm | 943 kB 00:00
(47/143): iproute-2.6.32-32.el6_5.x86_64.rpm | 364 kB 00:00
(48/143): iptables-1.4.7-14.0.1.el6.x86_64.rpm | 252 kB 00:00
(49/143): iputils-20071127-17.el6_4.2.x86_64.rpm | 120 kB 00:00
(50/143): keyutils-libs-1.4-5.el6.x86_64.rpm | 20 kB 00:00
(51/143): krb5-libs-1.10.3-33.el6.x86_64.rpm | 764 kB 00:00
(52/143): less-436-13.el6.x86_64.rpm | 107 kB 00:00
(53/143): libacl-2.2.49-6.el6.x86_64.rpm | 23 kB 00:00
(54/143): libattr-2.4.44-7.el6.x86_64.rpm | 15 kB 00:00
(55/143): libblkid-2.17.2-12.18.0.1.el6.x86_64.rpm | 115 kB 00:00
(56/143): libcap-2.16-5.5.el6.x86_64.rpm | 31 kB 00:00
(57/143): libcap-ng-0.6.4-3.el6_0.1.x86_64.rpm | 21 kB 00:00
(58/143): libcom_err-1.42.8-1.0.1.el6.x86_64.rpm | 36 kB 00:00
(59/143): libcurl-7.19.7-37.el6_5.3.x86_64.rpm | 165 kB 00:00
(60/143): libedit-2.11-4.20080712cvs.1.el6.x86_64.rpm | 74 kB 00:00
(61/143): libffi-3.0.5-3.2.el6.x86_64.rpm | 25 kB 00:00
(62/143): libgcc-4.4.7-11.el6.x86_64.rpm | 101 kB 00:00
(63/143): libgcrypt-1.4.5-11.el6_4.x86_64.rpm | 228 kB 00:00
(64/143): libgpg-error-1.7-4.el6.x86_64.rpm | 59 kB 00:00
(65/143): libidn-1.18-2.el6.x86_64.rpm | 205 kB 00:00
(66/143): libnih-1.0.1-7.el6.x86_64.rpm | 137 kB 00:00
(67/143): libselinux-2.0.94-5.8.el6.x86_64.rpm | 108 kB 00:00
(68/143): libselinux-utils-2.0.94-5.8.el6.x86_64.rpm | 81 kB 00:00
(69/143): libsemanage-2.0.43-4.2.el6.x86_64.rpm | 103 kB 00:00
(70/143): libsepol-2.0.41-4.el6.x86_64.rpm | 128 kB 00:00
(71/143): libssh2-1.4.2-1.el6.x86_64.rpm | 122 kB 00:00
(72/143): libstdc++-4.4.7-11.el6.x86_64.rpm | 294 kB 00:00
(73/143): libtasn1-2.3-6.el6_5.x86_64.rpm | 238 kB 00:00
(74/143): libusb-0.1.12-23.el6.x86_64.rpm | 27 kB 00:00
(75/143): libuser-0.56.13-5.el6.x86_64.rpm | 368 kB 00:00
(76/143): libutempter-1.1.5-4.1.el6.x86_64.rpm | 22 kB 00:00
(77/143): libuuid-2.17.2-12.18.0.1.el6.x86_64.rpm | 68 kB 00:00
(78/143): libxml2-2.7.6-14.0.1.el6_5.2.x86_64.rpm | 800 kB 00:00
(79/143): logrotate-3.7.8-17.el6.x86_64.rpm | 55 kB 00:00
(80/143): lua-5.1.4-4.1.el6.x86_64.rpm | 184 kB 00:00
(81/143): make-3.81-20.el6.x86_64.rpm | 388 kB 00:00
(82/143): mingetty-1.08-5.el6.x86_64.rpm | 20 kB 00:00
(83/143): module-init-tools-3.9-24.0.1.el6.x86_64.rpm | 465 kB 00:00
(84/143): ncurses-5.7-3.20090208.el6.x86_64.rpm | 267 kB 00:00
(85/143): ncurses-base-5.7-3.20090208.el6.x86_64.rpm | 60 kB 00:00
(86/143): ncurses-libs-5.7-3.20090208.el6.x86_64.rpm | 245 kB 00:00
(87/143): net-tools-1.60-110.el6_2.x86_64.rpm | 268 kB 00:00
(88/143): nspr-4.10.6-1.el6_5.x86_64.rpm | 113 kB 00:00
(89/143): nss-3.16.1-14.0.1.el6.x86_64.rpm | 834 kB 00:00
(90/143): nss-softokn-3.14.3-17.el6.x86_64.rpm | 261 kB 00:00
(91/143): nss-softokn-freebl-3.14.3-17.el6.x86_64.rpm | 163 kB 00:00
(92/143): nss-sysinit-3.16.1-14.0.1.el6.x86_64.rpm | 43 kB 00:00
(93/143): nss-tools-3.16.1-14.0.1.el6.x86_64.rpm | 422 kB 00:00
(94/143): nss-util-3.16.1-3.el6.x86_64.rpm | 65 kB 00:00
(95/143): openldap-2.4.39-8.el6.x86_64.rpm | 279 kB 00:00
(96/143): openssh-5.3p1-104.el6.x86_64.rpm | 271 kB 00:00
(97/143): openssh-clients-5.3p1-104.el6.x86_64.rpm | 435 kB 00:00
(98/143): openssh-server-5.3p1-104.el6.x86_64.rpm | 320 kB 00:00
(99/143): openssl-1.0.1e-30.el6_6.2.x86_64.rpm | 1.5 MB 00:00
(100/143): oracle-logos-60.0.14-1.0.2.el6.noarch.rpm | 12 MB 00:01
(101/143): oraclelinux-release-6Server-6.0.2.x86_64.rpm | 22 kB 00:00
(102/143): p11-kit-0.18.5-2.el6_5.2.x86_64.rpm | 94 kB 00:00
(103/143): p11-kit-trust-0.18.5-2.el6_5.2.x86_64.rpm | 71 kB 00:00
(104/143): pam-1.1.1-20.el6.x86_64.rpm | 659 kB 00:00
(105/143): passwd-0.77-4.el6_2.2.x86_64.rpm | 89 kB 00:00
(106/143): pcre-7.8-6.el6.x86_64.rpm | 194 kB 00:00
(107/143): pinentry-0.7.6-6.el6.x86_64.rpm | 65 kB 00:00
(108/143): pkgconfig-0.23-9.1.el6.x86_64.rpm | 70 kB 00:00
(109/143): policycoreutils-2.0.83-19.47.0.1.el6.x86_64.rpm | 650 kB 00:00
(110/143): popt-1.13-7.el6.x86_64.rpm | 38 kB 00:00
(111/143): procps-3.2.8-30.0.1.el6.x86_64.rpm | 214 kB 00:00
(112/143): psmisc-22.6-19.el6_5.x86_64.rpm | 80 kB 00:00
(113/143): pth-2.0.7-9.3.el6.x86_64.rpm | 85 kB 00:00
(114/143): pygpgme-0.1-18.20090824bzr68.el6.x86_64.rpm | 70 kB 00:00
(115/143): python-2.6.6-52.el6.x86_64.rpm | 73 kB 00:00
(116/143): python-iniparse-0.3.1-2.1.el6.noarch.rpm | 36 kB 00:00
(117/143): python-libs-2.6.6-52.el6.x86_64.rpm | 5.3 MB 00:01
(118/143): python-pycurl-7.19.0-8.el6.x86_64.rpm | 76 kB 00:00
(119/143): python-urlgrabber-3.9.1-9.0.1.el6.noarch.rpm | 85 kB 00:00
(120/143): readline-6.0-4.el6.x86_64.rpm | 178 kB 00:00
(121/143): redhat-release-server-6Server-6.6.0.2.0.1.el6.x86_64.rpm | 2.6 kB 00:00
(122/143): rootfiles-8.1-6.1.el6.noarch.rpm | 6.3 kB 00:00
(123/143): rpm-4.8.0-37.el6.x86_64.rpm | 901 kB 00:00
(124/143): rpm-libs-4.8.0-37.el6.x86_64.rpm | 312 kB 00:00
(125/143): rpm-python-4.8.0-37.el6.x86_64.rpm | 56 kB 00:00
(126/143): rsyslog-5.8.10-8.0.1.el6.x86_64.rpm | 649 kB 00:00
(127/143): sed-4.2.1-10.el6.x86_64.rpm | 215 kB 00:00
(128/143): setup-2.8.14-20.el6_4.1.noarch.rpm | 150 kB 00:00
(129/143): shadow-utils-4.1.4.2-19.el6.x86_64.rpm | 899 kB 00:00
(130/143): shared-mime-info-0.70-6.el6.x86_64.rpm | 208 kB 00:00
(131/143): sqlite-3.6.20-1.el6.x86_64.rpm | 301 kB 00:00
(132/143): sysvinit-tools-2.87-5.dsf.el6.x86_64.rpm | 59 kB 00:00
(133/143): tcp_wrappers-libs-7.6-57.el6.x86_64.rpm | 62 kB 00:00
(134/143): tzdata-2014g-1.el6.noarch.rpm | 448 kB 00:00
(135/143): udev-147-2.57.0.2.el6.x86_64.rpm | 351 kB 00:00
(136/143): upstart-0.6.5-13.el6_5.3.x86_64.rpm | 176 kB 00:00
(137/143): ustr-1.0.4-9.1.el6.x86_64.rpm | 85 kB 00:00
(138/143): util-linux-ng-2.17.2-12.18.0.1.el6.x86_64.rpm | 1.6 MB 00:00
(139/143): vim-minimal-7.2.411-1.8.el6.x86_64.rpm | 363 kB 00:00
(140/143): xz-libs-4.999.9-0.5.beta.20091007git.el6.x86_64.rpm | 89 kB 00:00
(141/143): yum-3.2.29-60.0.1.el6.noarch.rpm | 1.0 MB 00:00
(142/143): yum-metadata-parser-1.1.2-16.el6.x86_64.rpm | 26 kB 00:00
(143/143): zlib-1.2.3-29.el6.x86_64.rpm | 72 kB 00:00
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Total 1.7 MB/s | 82 MB 00:48
Running rpm_check_debug
Running Transaction Test
Transaction Test Succeeded
Running Transaction
Installing : libgcc-4.4.7-11.el6.x86_64 1/143
Installing : setup-2.8.14-20.el6_4.1.noarch 2/143
Installing : filesystem-2.4.30-3.el6.x86_64 3/143
Installing : basesystem-10.0-4.0.1.el6.noarch 4/143
Installing : 1:redhat-release-server-6Server-6.6.0.2.0.1.el6.x86_64 5/143
Installing : 12:dhcp-common-4.1.1-43.P1.0.1.el6.x86_64 6/143
Installing : tzdata-2014g-1.el6.noarch 7/143
Installing : ncurses-base-5.7-3.20090208.el6.x86_64 8/143
Installing : nss-softokn-freebl-3.14.3-17.el6.x86_64 9/143
Installing : glibc-common-2.12-1.149.el6.x86_64 10/143
Installing : glibc-2.12-1.149.el6.x86_64 11/143
Installing : ncurses-libs-5.7-3.20090208.el6.x86_64 12/143
Installing : bash-4.1.2-29.el6.x86_64 13/143
Installing : libattr-2.4.44-7.el6.x86_64 14/143
Installing : libcap-2.16-5.5.el6.x86_64 15/143
Installing : zlib-1.2.3-29.el6.x86_64 16/143
Installing : info-4.13a-8.el6.x86_64 17/143
Installing : nspr-4.10.6-1.el6_5.x86_64 18/143
Installing : popt-1.13-7.el6.x86_64 19/143
Installing : chkconfig-1.3.49.3-2.el6_4.1.x86_64 20/143
Installing : libacl-2.2.49-6.el6.x86_64 21/143
Installing : db4-4.7.25-18.el6_4.x86_64 22/143
Installing : audit-libs-2.3.7-5.el6.x86_64 23/143
Installing : nss-util-3.16.1-3.el6.x86_64 24/143
Installing : libcom_err-1.42.8-1.0.1.el6.x86_64 25/143
Installing : libsepol-2.0.41-4.el6.x86_64 26/143
Installing : libselinux-2.0.94-5.8.el6.x86_64 27/143
Installing : bzip2-libs-1.0.5-7.el6_0.x86_64 28/143
Installing : 2:shadow-utils-4.1.4.2-19.el6.x86_64 29/143
Installing : sed-4.2.1-10.el6.x86_64 30/143
Installing : readline-6.0-4.el6.x86_64 31/143
Installing : libstdc++-4.4.7-11.el6.x86_64 32/143
Installing : 1:dbus-libs-1.2.24-7.0.1.el6_3.x86_64 33/143
Installing : lua-5.1.4-4.1.el6.x86_64 34/143
Installing : sqlite-3.6.20-1.el6.x86_64 35/143
Installing : libidn-1.18-2.el6.x86_64 36/143
Installing : file-libs-5.04-21.el6.x86_64 37/143
Installing : libgpg-error-1.7-4.el6.x86_64 38/143
Installing : elfutils-libelf-0.158-3.2.el6.x86_64 39/143
Installing : xz-libs-4.999.9-0.5.beta.20091007git.el6.x86_64 40/143
Installing : nss-softokn-3.14.3-17.el6.x86_64 41/143
Installing : pcre-7.8-6.el6.x86_64 42/143
Installing : grep-2.6.3-6.el6.x86_64 43/143
Installing : gawk-3.1.7-10.el6.x86_64 44/143
Installing : libxml2-2.7.6-14.0.1.el6_5.2.x86_64 45/143
Installing : libtasn1-2.3-6.el6_5.x86_64 46/143
Installing : p11-kit-0.18.5-2.el6_5.2.x86_64 47/143
Installing : pth-2.0.7-9.3.el6.x86_64 48/143
Installing : expat-2.0.1-11.el6_2.x86_64 49/143
Installing : libuuid-2.17.2-12.18.0.1.el6.x86_64 50/143
Installing : sysvinit-tools-2.87-5.dsf.el6.x86_64 51/143
Installing : libblkid-2.17.2-12.18.0.1.el6.x86_64 52/143
Installing : p11-kit-trust-0.18.5-2.el6_5.2.x86_64 53/143
Installing : ca-certificates-2014.1.98-65.1.el6.noarch 54/143
Installing : libgcrypt-1.4.5-11.el6_4.x86_64 55/143
Installing : libnih-1.0.1-7.el6.x86_64 56/143
Installing : upstart-0.6.5-13.el6_5.3.x86_64 57/143
Installing : gmp-4.3.1-7.el6_2.2.x86_64 58/143
Installing : libusb-0.1.12-23.el6.x86_64 59/143
Installing : libutempter-1.1.5-4.1.el6.x86_64 60/143
Installing : MAKEDEV-3.24-6.el6.x86_64 61/143
Installing : procps-3.2.8-30.0.1.el6.x86_64 62/143
Installing : psmisc-22.6-19.el6_5.x86_64 63/143
Installing : net-tools-1.60-110.el6_2.x86_64 64/143
Installing : checkpolicy-2.0.22-1.el6.x86_64 65/143
Installing : libselinux-utils-2.0.94-5.8.el6.x86_64 66/143
Installing : 1:findutils-4.4.2-6.el6.x86_64 67/143
Installing : cyrus-sasl-lib-2.1.23-15.el6.x86_64 68/143
Installing : db4-utils-4.7.25-18.el6_4.x86_64 69/143
Installing : pinentry-0.7.6-6.el6.x86_64 70/143
Installing : diffutils-2.8.1-28.el6.x86_64 71/143
Installing : 1:make-3.81-20.el6.x86_64 72/143
Installing : cpio-2.10-12.el6_5.x86_64 73/143
Installing : binutils-2.20.51.0.2-5.42.el6.x86_64 74/143
Installing : 6:oraclelinux-release-6Server-6.0.2.x86_64 75/143
Installing : ncurses-5.7-3.20090208.el6.x86_64 76/143
Installing : groff-1.18.1.4-21.el6.x86_64 77/143
Installing : less-436-13.el6.x86_64 78/143
Installing : coreutils-libs-8.4-37.0.1.el6.x86_64 79/143
Installing : gzip-1.3.12-22.el6.x86_64 80/143
Installing : cracklib-2.8.16-4.el6.x86_64 81/143
Installing : cracklib-dicts-2.8.16-4.el6.x86_64 82/143
Installing : coreutils-8.4-37.0.1.el6.x86_64 83/143
Installing : pam-1.1.1-20.el6.x86_64 84/143
Installing : module-init-tools-3.9-24.0.1.el6.x86_64 85/143
Installing : hwdata-0.233-11.1.el6.noarch 86/143
Installing : nss-3.16.1-14.0.1.el6.x86_64 87/143
Installing : nss-sysinit-3.16.1-14.0.1.el6.x86_64 88/143
Installing : nss-tools-3.16.1-14.0.1.el6.x86_64 89/143
Installing : oracle-logos-60.0.14-1.0.2.el6.noarch 90/143
Installing : logrotate-3.7.8-17.el6.x86_64 91/143
Installing : libedit-2.11-4.20080712cvs.1.el6.x86_64 92/143
Installing : gdbm-1.8.0-36.el6.x86_64 93/143
Installing : keyutils-libs-1.4-5.el6.x86_64 94/143
Installing : krb5-libs-1.10.3-33.el6.x86_64 95/143
Installing : openssl-1.0.1e-30.el6_6.2.x86_64 96/143
Installing : libssh2-1.4.2-1.el6.x86_64 97/143
Installing : libcurl-7.19.7-37.el6_5.3.x86_64 98/143
Installing : rpm-libs-4.8.0-37.el6.x86_64 99/143
Installing : curl-7.19.7-37.el6_5.3.x86_64 100/143
Installing : rpm-4.8.0-37.el6.x86_64 101/143
Installing : openldap-2.4.39-8.el6.x86_64 102/143
Installing : gnupg2-2.0.14-8.el6.x86_64 103/143
Installing : gpgme-1.1.8-3.el6.x86_64 104/143
Installing : fipscheck-lib-1.2.0-7.el6.x86_64 105/143
Installing : fipscheck-1.2.0-7.el6.x86_64 106/143
Installing : 2:ethtool-3.5-5.el6.x86_64 107/143
Installing : libffi-3.0.5-3.2.el6.x86_64 108/143
Installing : python-2.6.6-52.el6.x86_64 109/143
Installing : python-libs-2.6.6-52.el6.x86_64 110/143
Installing : python-pycurl-7.19.0-8.el6.x86_64 111/143
Installing : python-urlgrabber-3.9.1-9.0.1.el6.noarch 112/143
Installing : pygpgme-0.1-18.20090824bzr68.el6.x86_64 113/143
Installing : rpm-python-4.8.0-37.el6.x86_64 114/143
Installing : python-iniparse-0.3.1-2.1.el6.noarch 115/143
Installing : ustr-1.0.4-9.1.el6.x86_64 116/143
Installing : libsemanage-2.0.43-4.2.el6.x86_64 117/143
Installing : 1:pkgconfig-0.23-9.1.el6.x86_64 118/143
Installing : gamin-0.1.10-9.el6.x86_64 119/143
Installing : glib2-2.28.8-4.el6.x86_64 120/143
Installing : shared-mime-info-0.70-6.el6.x86_64 121/143
Installing : yum-metadata-parser-1.1.2-16.el6.x86_64 122/143
Installing : dbus-glib-0.86-6.el6_4.x86_64 123/143
Installing : libuser-0.56.13-5.el6.x86_64 124/143
Installing : libcap-ng-0.6.4-3.el6_0.1.x86_64 125/143
Installing : tcp_wrappers-libs-7.6-57.el6.x86_64 126/143
Installing : mingetty-1.08-5.el6.x86_64 127/143
Installing : policycoreutils-2.0.83-19.47.0.1.el6.x86_64 128/143
Installing : iptables-1.4.7-14.0.1.el6.x86_64 129/143
Installing : iproute-2.6.32-32.el6_5.x86_64 130/143
Installing : iputils-20071127-17.el6_4.2.x86_64 131/143
Installing : initscripts-9.03.46-1.0.2.el6.x86_64 132/143
Installing : util-linux-ng-2.17.2-12.18.0.1.el6.x86_64 133/143
Installing : udev-147-2.57.0.2.el6.x86_64 134/143
Installing : openssh-5.3p1-104.el6.x86_64 135/143
Installing : openssh-clients-5.3p1-104.el6.x86_64 136/143
Installing : openssh-server-5.3p1-104.el6.x86_64 137/143
Installing : 12:dhclient-4.1.1-43.P1.0.1.el6.x86_64 138/143
Installing : rsyslog-5.8.10-8.0.1.el6.x86_64 139/143
Installing : passwd-0.77-4.el6_2.2.x86_64 140/143
Installing : yum-3.2.29-60.0.1.el6.noarch 141/143
Installing : 2:vim-minimal-7.2.411-1.8.el6.x86_64 142/143
Installing : rootfiles-8.1-6.1.el6.noarch 143/143
Verifying : libstdc++-4.4.7-11.el6.x86_64 1/143
Verifying : gdbm-1.8.0-36.el6.x86_64 2/143
Verifying : 6:oraclelinux-release-6Server-6.0.2.x86_64 3/143
Verifying : libtasn1-2.3-6.el6_5.x86_64 4/143
Verifying : libattr-2.4.44-7.el6.x86_64 5/143
Verifying : gamin-0.1.10-9.el6.x86_64 6/143
Verifying : ncurses-base-5.7-3.20090208.el6.x86_64 7/143
Verifying : filesystem-2.4.30-3.el6.x86_64 8/143
Verifying : lua-5.1.4-4.1.el6.x86_64 9/143
Verifying : ncurses-libs-5.7-3.20090208.el6.x86_64 10/143
Verifying : pth-2.0.7-9.3.el6.x86_64 11/143
Verifying : nspr-4.10.6-1.el6_5.x86_64 12/143
Verifying : diffutils-2.8.1-28.el6.x86_64 13/143
Verifying : gawk-3.1.7-10.el6.x86_64 14/143
Verifying : glib2-2.28.8-4.el6.x86_64 15/143
Verifying : udev-147-2.57.0.2.el6.x86_64 16/143
Verifying : yum-metadata-parser-1.1.2-16.el6.x86_64 17/143
Verifying : keyutils-libs-1.4-5.el6.x86_64 18/143
Verifying : 2:shadow-utils-4.1.4.2-19.el6.x86_64 19/143
Verifying : openssh-5.3p1-104.el6.x86_64 20/143
Verifying : openssh-clients-5.3p1-104.el6.x86_64 21/143
Verifying : libnih-1.0.1-7.el6.x86_64 22/143
Verifying : bzip2-libs-1.0.5-7.el6_0.x86_64 23/143
Verifying : procps-3.2.8-30.0.1.el6.x86_64 24/143
Verifying : less-436-13.el6.x86_64 25/143
Verifying : libcom_err-1.42.8-1.0.1.el6.x86_64 26/143
Verifying : 2:ethtool-3.5-5.el6.x86_64 27/143
Verifying : db4-4.7.25-18.el6_4.x86_64 28/143
Verifying : gpgme-1.1.8-3.el6.x86_64 29/143
Verifying : policycoreutils-2.0.83-19.47.0.1.el6.x86_64 30/143
Verifying : nss-3.16.1-14.0.1.el6.x86_64 31/143
Verifying : rpm-libs-4.8.0-37.el6.x86_64 32/143
Verifying : dbus-glib-0.86-6.el6_4.x86_64 33/143
Verifying : libffi-3.0.5-3.2.el6.x86_64 34/143
Verifying : p11-kit-0.18.5-2.el6_5.2.x86_64 35/143
Verifying : pam-1.1.1-20.el6.x86_64 36/143
Verifying : gmp-4.3.1-7.el6_2.2.x86_64 37/143
Verifying : ncurses-5.7-3.20090208.el6.x86_64 38/143
Verifying : nss-util-3.16.1-3.el6.x86_64 39/143
Verifying : python-pycurl-7.19.0-8.el6.x86_64 40/143
Verifying : info-4.13a-8.el6.x86_64 41/143
Verifying : passwd-0.77-4.el6_2.2.x86_64 42/143
Verifying : popt-1.13-7.el6.x86_64 43/143
Verifying : curl-7.19.7-37.el6_5.3.x86_64 44/143
Verifying : upstart-0.6.5-13.el6_5.3.x86_64 45/143
Verifying : fipscheck-1.2.0-7.el6.x86_64 46/143
Verifying : psmisc-22.6-19.el6_5.x86_64 47/143
Verifying : cracklib-dicts-2.8.16-4.el6.x86_64 48/143
Verifying : iproute-2.6.32-32.el6_5.x86_64 49/143
Verifying : libgcc-4.4.7-11.el6.x86_64 50/143
Verifying : libutempter-1.1.5-4.1.el6.x86_64 51/143
Verifying : ustr-1.0.4-9.1.el6.x86_64 52/143
Verifying : libxml2-2.7.6-14.0.1.el6_5.2.x86_64 53/143
Verifying : python-libs-2.6.6-52.el6.x86_64 54/143
Verifying : libsepol-2.0.41-4.el6.x86_64 55/143
Verifying : nss-sysinit-3.16.1-14.0.1.el6.x86_64 56/143
Verifying : initscripts-9.03.46-1.0.2.el6.x86_64 57/143
Verifying : net-tools-1.60-110.el6_2.x86_64 58/143
Verifying : p11-kit-trust-0.18.5-2.el6_5.2.x86_64 59/143
Verifying : nss-softokn-freebl-3.14.3-17.el6.x86_64 60/143
Verifying : coreutils-8.4-37.0.1.el6.x86_64 61/143
Verifying : libcap-2.16-5.5.el6.x86_64 62/143
Verifying : setup-2.8.14-20.el6_4.1.noarch 63/143
Verifying : pygpgme-0.1-18.20090824bzr68.el6.x86_64 64/143
Verifying : 1:pkgconfig-0.23-9.1.el6.x86_64 65/143
Verifying : libcap-ng-0.6.4-3.el6_0.1.x86_64 66/143
Verifying : libselinux-2.0.94-5.8.el6.x86_64 67/143
Verifying : libacl-2.2.49-6.el6.x86_64 68/143
Verifying : libidn-1.18-2.el6.x86_64 69/143
Verifying : oracle-logos-60.0.14-1.0.2.el6.noarch 70/143
Verifying : libgpg-error-1.7-4.el6.x86_64 71/143
Verifying : nss-tools-3.16.1-14.0.1.el6.x86_64 72/143
Verifying : iptables-1.4.7-14.0.1.el6.x86_64 73/143
Verifying : pinentry-0.7.6-6.el6.x86_64 74/143
Verifying : openldap-2.4.39-8.el6.x86_64 75/143
Verifying : shared-mime-info-0.70-6.el6.x86_64 76/143
Verifying : expat-2.0.1-11.el6_2.x86_64 77/143
Verifying : pcre-7.8-6.el6.x86_64 78/143
Verifying : grep-2.6.3-6.el6.x86_64 79/143
Verifying : rpm-4.8.0-37.el6.x86_64 80/143
Verifying : MAKEDEV-3.24-6.el6.x86_64 81/143
Verifying : libuuid-2.17.2-12.18.0.1.el6.x86_64 82/143
Verifying : coreutils-libs-8.4-37.0.1.el6.x86_64 83/143
Verifying : 1:make-3.81-20.el6.x86_64 84/143
Verifying : readline-6.0-4.el6.x86_64 85/143
Verifying : tzdata-2014g-1.el6.noarch 86/143
Verifying : groff-1.18.1.4-21.el6.x86_64 87/143
Verifying : 12:dhclient-4.1.1-43.P1.0.1.el6.x86_64 88/143
Verifying : python-urlgrabber-3.9.1-9.0.1.el6.noarch 89/143
Verifying : elfutils-libelf-0.158-3.2.el6.x86_64 90/143
Verifying : sed-4.2.1-10.el6.x86_64 91/143
Verifying : file-libs-5.04-21.el6.x86_64 92/143
Verifying : gnupg2-2.0.14-8.el6.x86_64 93/143
Verifying : 1:dbus-libs-1.2.24-7.0.1.el6_3.x86_64 94/143
Verifying : nss-softokn-3.14.3-17.el6.x86_64 95/143
Verifying : cyrus-sasl-lib-2.1.23-15.el6.x86_64 96/143
Verifying : glibc-2.12-1.149.el6.x86_64 97/143
Verifying : libcurl-7.19.7-37.el6_5.3.x86_64 98/143
Verifying : util-linux-ng-2.17.2-12.18.0.1.el6.x86_64 99/143
Verifying : libblkid-2.17.2-12.18.0.1.el6.x86_64 100/143
Verifying : glibc-common-2.12-1.149.el6.x86_64 101/143
Verifying : python-2.6.6-52.el6.x86_64 102/143
Verifying : krb5-libs-1.10.3-33.el6.x86_64 103/143
Verifying : sqlite-3.6.20-1.el6.x86_64 104/143
Verifying : audit-libs-2.3.7-5.el6.x86_64 105/143
Verifying : logrotate-3.7.8-17.el6.x86_64 106/143
Verifying : libuser-0.56.13-5.el6.x86_64 107/143
Verifying : bash-4.1.2-29.el6.x86_64 108/143
Verifying : libgcrypt-1.4.5-11.el6_4.x86_64 109/143
Verifying : module-init-tools-3.9-24.0.1.el6.x86_64 110/143
Verifying : python-iniparse-0.3.1-2.1.el6.noarch 111/143
Verifying : db4-utils-4.7.25-18.el6_4.x86_64 112/143
Verifying : hwdata-0.233-11.1.el6.noarch 113/143
Verifying : checkpolicy-2.0.22-1.el6.x86_64 114/143
Verifying : cracklib-2.8.16-4.el6.x86_64 115/143
Verifying : ca-certificates-2014.1.98-65.1.el6.noarch 116/143
Verifying : xz-libs-4.999.9-0.5.beta.20091007git.el6.x86_64 117/143
Verifying : openssh-server-5.3p1-104.el6.x86_64 118/143
Verifying : zlib-1.2.3-29.el6.x86_64 119/143
Verifying : rootfiles-8.1-6.1.el6.noarch 120/143
Verifying : 12:dhcp-common-4.1.1-43.P1.0.1.el6.x86_64 121/143
Verifying : rpm-python-4.8.0-37.el6.x86_64 122/143
Verifying : libselinux-utils-2.0.94-5.8.el6.x86_64 123/143
Verifying : cpio-2.10-12.el6_5.x86_64 124/143
Verifying : rsyslog-5.8.10-8.0.1.el6.x86_64 125/143
Verifying : binutils-2.20.51.0.2-5.42.el6.x86_64 126/143
Verifying : libusb-0.1.12-23.el6.x86_64 127/143
Verifying : basesystem-10.0-4.0.1.el6.noarch 128/143
Verifying : fipscheck-lib-1.2.0-7.el6.x86_64 129/143
Verifying : yum-3.2.29-60.0.1.el6.noarch 130/143
Verifying : 2:vim-minimal-7.2.411-1.8.el6.x86_64 131/143
Verifying : tcp_wrappers-libs-7.6-57.el6.x86_64 132/143
Verifying : libedit-2.11-4.20080712cvs.1.el6.x86_64 133/143
Verifying : openssl-1.0.1e-30.el6_6.2.x86_64 134/143
Verifying : 1:redhat-release-server-6Server-6.6.0.2.0.1.el6.x86_64 135/143
Verifying : libsemanage-2.0.43-4.2.el6.x86_64 136/143
Verifying : chkconfig-1.3.49.3-2.el6_4.1.x86_64 137/143
Verifying : iputils-20071127-17.el6_4.2.x86_64 138/143
Verifying : libssh2-1.4.2-1.el6.x86_64 139/143
Verifying : gzip-1.3.12-22.el6.x86_64 140/143
Verifying : mingetty-1.08-5.el6.x86_64 141/143
Verifying : 1:findutils-4.4.2-6.el6.x86_64 142/143
Verifying : sysvinit-tools-2.87-5.dsf.el6.x86_64 143/143
Installed:
chkconfig.x86_64 0:1.3.49.3-2.el6_4.1 dhclient.x86_64 12:4.1.1-43.P1.0.1.el6 initscripts.x86_64 0:9.03.46-1.0.2.el6 openssh-clients.x86_64 0:5.3p1-104.el6
openssh-server.x86_64 0:5.3p1-104.el6 oraclelinux-release.x86_64 6:6Server-6.0.2 passwd.x86_64 0:0.77-4.el6_2.2 policycoreutils.x86_64 0:2.0.83-19.47.0.1.el6
rootfiles.noarch 0:8.1-6.1.el6 rsyslog.x86_64 0:5.8.10-8.0.1.el6 vim-minimal.x86_64 2:7.2.411-1.8.el6 yum.noarch 0:3.2.29-60.0.1.el6
Dependency Installed:
MAKEDEV.x86_64 0:3.24-6.el6 audit-libs.x86_64 0:2.3.7-5.el6 basesystem.noarch 0:10.0-4.0.1.el6 bash.x86_64 0:4.1.2-29.el6
binutils.x86_64 0:2.20.51.0.2-5.42.el6 bzip2-libs.x86_64 0:1.0.5-7.el6_0 ca-certificates.noarch 0:2014.1.98-65.1.el6 checkpolicy.x86_64 0:2.0.22-1.el6
coreutils.x86_64 0:8.4-37.0.1.el6 coreutils-libs.x86_64 0:8.4-37.0.1.el6 cpio.x86_64 0:2.10-12.el6_5 cracklib.x86_64 0:2.8.16-4.el6
cracklib-dicts.x86_64 0:2.8.16-4.el6 curl.x86_64 0:7.19.7-37.el6_5.3 cyrus-sasl-lib.x86_64 0:2.1.23-15.el6 db4.x86_64 0:4.7.25-18.el6_4
db4-utils.x86_64 0:4.7.25-18.el6_4 dbus-glib.x86_64 0:0.86-6.el6_4 dbus-libs.x86_64 1:1.2.24-7.0.1.el6_3 dhcp-common.x86_64 12:4.1.1-43.P1.0.1.el6
diffutils.x86_64 0:2.8.1-28.el6 elfutils-libelf.x86_64 0:0.158-3.2.el6 ethtool.x86_64 2:3.5-5.el6 expat.x86_64 0:2.0.1-11.el6_2
file-libs.x86_64 0:5.04-21.el6 filesystem.x86_64 0:2.4.30-3.el6 findutils.x86_64 1:4.4.2-6.el6 fipscheck.x86_64 0:1.2.0-7.el6
fipscheck-lib.x86_64 0:1.2.0-7.el6 gamin.x86_64 0:0.1.10-9.el6 gawk.x86_64 0:3.1.7-10.el6 gdbm.x86_64 0:1.8.0-36.el6
glib2.x86_64 0:2.28.8-4.el6 glibc.x86_64 0:2.12-1.149.el6 glibc-common.x86_64 0:2.12-1.149.el6 gmp.x86_64 0:4.3.1-7.el6_2.2
gnupg2.x86_64 0:2.0.14-8.el6 gpgme.x86_64 0:1.1.8-3.el6 grep.x86_64 0:2.6.3-6.el6 groff.x86_64 0:1.18.1.4-21.el6
gzip.x86_64 0:1.3.12-22.el6 hwdata.noarch 0:0.233-11.1.el6 info.x86_64 0:4.13a-8.el6 iproute.x86_64 0:2.6.32-32.el6_5
iptables.x86_64 0:1.4.7-14.0.1.el6 iputils.x86_64 0:20071127-17.el6_4.2 keyutils-libs.x86_64 0:1.4-5.el6 krb5-libs.x86_64 0:1.10.3-33.el6
less.x86_64 0:436-13.el6 libacl.x86_64 0:2.2.49-6.el6 libattr.x86_64 0:2.4.44-7.el6 libblkid.x86_64 0:2.17.2-12.18.0.1.el6
libcap.x86_64 0:2.16-5.5.el6 libcap-ng.x86_64 0:0.6.4-3.el6_0.1 libcom_err.x86_64 0:1.42.8-1.0.1.el6 libcurl.x86_64 0:7.19.7-37.el6_5.3
libedit.x86_64 0:2.11-4.20080712cvs.1.el6 libffi.x86_64 0:3.0.5-3.2.el6 libgcc.x86_64 0:4.4.7-11.el6 libgcrypt.x86_64 0:1.4.5-11.el6_4
libgpg-error.x86_64 0:1.7-4.el6 libidn.x86_64 0:1.18-2.el6 libnih.x86_64 0:1.0.1-7.el6 libselinux.x86_64 0:2.0.94-5.8.el6
libselinux-utils.x86_64 0:2.0.94-5.8.el6 libsemanage.x86_64 0:2.0.43-4.2.el6 libsepol.x86_64 0:2.0.41-4.el6 libssh2.x86_64 0:1.4.2-1.el6
libstdc++.x86_64 0:4.4.7-11.el6 libtasn1.x86_64 0:2.3-6.el6_5 libusb.x86_64 0:0.1.12-23.el6 libuser.x86_64 0:0.56.13-5.el6
libutempter.x86_64 0:1.1.5-4.1.el6 libuuid.x86_64 0:2.17.2-12.18.0.1.el6 libxml2.x86_64 0:2.7.6-14.0.1.el6_5.2 logrotate.x86_64 0:3.7.8-17.el6
lua.x86_64 0:5.1.4-4.1.el6 make.x86_64 1:3.81-20.el6 mingetty.x86_64 0:1.08-5.el6 module-init-tools.x86_64 0:3.9-24.0.1.el6
ncurses.x86_64 0:5.7-3.20090208.el6 ncurses-base.x86_64 0:5.7-3.20090208.el6 ncurses-libs.x86_64 0:5.7-3.20090208.el6 net-tools.x86_64 0:1.60-110.el6_2
nspr.x86_64 0:4.10.6-1.el6_5 nss.x86_64 0:3.16.1-14.0.1.el6 nss-softokn.x86_64 0:3.14.3-17.el6 nss-softokn-freebl.x86_64 0:3.14.3-17.el6
nss-sysinit.x86_64 0:3.16.1-14.0.1.el6 nss-tools.x86_64 0:3.16.1-14.0.1.el6 nss-util.x86_64 0:3.16.1-3.el6 openldap.x86_64 0:2.4.39-8.el6
openssh.x86_64 0:5.3p1-104.el6 openssl.x86_64 0:1.0.1e-30.el6_6.2 oracle-logos.noarch 0:60.0.14-1.0.2.el6 p11-kit.x86_64 0:0.18.5-2.el6_5.2
p11-kit-trust.x86_64 0:0.18.5-2.el6_5.2 pam.x86_64 0:1.1.1-20.el6 pcre.x86_64 0:7.8-6.el6 pinentry.x86_64 0:0.7.6-6.el6
pkgconfig.x86_64 1:0.23-9.1.el6 popt.x86_64 0:1.13-7.el6 procps.x86_64 0:3.2.8-30.0.1.el6 psmisc.x86_64 0:22.6-19.el6_5
pth.x86_64 0:2.0.7-9.3.el6 pygpgme.x86_64 0:0.1-18.20090824bzr68.el6 python.x86_64 0:2.6.6-52.el6 python-iniparse.noarch 0:0.3.1-2.1.el6
python-libs.x86_64 0:2.6.6-52.el6 python-pycurl.x86_64 0:7.19.0-8.el6 python-urlgrabber.noarch 0:3.9.1-9.0.1.el6 readline.x86_64 0:6.0-4.el6
redhat-release-server.x86_64 1:6Server-6.6.0.2.0.1.el6 rpm.x86_64 0:4.8.0-37.el6 rpm-libs.x86_64 0:4.8.0-37.el6 rpm-python.x86_64 0:4.8.0-37.el6
sed.x86_64 0:4.2.1-10.el6 setup.noarch 0:2.8.14-20.el6_4.1 shadow-utils.x86_64 2:4.1.4.2-19.el6 shared-mime-info.x86_64 0:0.70-6.el6
sqlite.x86_64 0:3.6.20-1.el6 sysvinit-tools.x86_64 0:2.87-5.dsf.el6 tcp_wrappers-libs.x86_64 0:7.6-57.el6 tzdata.noarch 0:2014g-1.el6
udev.x86_64 0:147-2.57.0.2.el6 upstart.x86_64 0:0.6.5-13.el6_5.3 ustr.x86_64 0:1.0.4-9.1.el6 util-linux-ng.x86_64 0:2.17.2-12.18.0.1.el6
xz-libs.x86_64 0:4.999.9-0.5.beta.20091007git.el6 yum-metadata-parser.x86_64 0:1.1.2-16.el6 zlib.x86_64 0:1.2.3-29.el6
Complete!
Rebuilding rpm database
Patching container rootfs /container/lxcora03/rootfs for Oracle Linux 6.6
Configuring container for Oracle Linux 6.6
Added container user:oracle password:oracle
Added container user:root password:root
Container : /container/lxcora03/rootfs
Config : /container/lxcora03/config
Network : eth0 (veth) on virbr0
[OEL 6.3][~][root@tme-srv2567]#
Add the Container to OpenvSwitch Networking
The container by default is networking on "lxcbro" as shown below from the file "/container/lxcora03/config" file.
[OEL 6.3][~][root@tme-srv2567]# cat /container/lxcora03/config
# Template used to create this container: /usr/share/lxc/templates/lxc-oracle
# Parameters passed to the template:
# For additional config options, please look at lxc.container.conf(5)
lxc.network.type = veth
lxc.network.flags = up
lxc.network.link = virbr0
lxc.rootfs = /container/lxcora03/rootfs
# Common configuration
lxc.include = /usr/share/lxc/config/oracle.common.conf
# Container configuration for Oracle Linux 6.6
lxc.arch = x86_64
lxc.utsname = lxcora03
lxc.cap.drop = sys_resource
lxc.cap.drop = setfcap setpcap
# Networking
lxc.network.name = eth0
lxc.network.mtu = 1500
lxc.network.hwaddr = fe:a2:59:b2:f8:38
[OEL 6.3][~][root@tme-srv2567]#
Edit this file so that it looks similar to that as shown below. The changed are all in the networking settings. Comment out the three existing lines under "# Networking" and replace them with the OpenvSwitch networking stanza for LXC containers.
[OEL 6.3][lxcora01][root@tme-srv2567]# cat config
# Template used to create this container: /usr/share/lxc/templates/lxc-oracle
# Parameters passed to the template:
# For additional config options, please look at lxc.container.conf(5)
# OpenvSwitch Networking
lxc.network.type = veth
lxc.network.flags = up
lxc.network.script.up = /etc/network/if-up.d/lxcora03-ifup-sw1
lxc.network.script.down = /etc/network/if-down.d/lxcora03-ifdown-sw1
lxc.network.veth.pair = lxcora01
lxc.network.name = eth0
lxc.network.mtu = 1500
lxc.network.hwaddr = fe:a2:59:b2:f8:38
# Default Bridge Networking
# lxc.network.type = veth
# lxc.network.flags = up
# lxc.network.link = virbr0
# Filesystem
lxc.rootfs = /container/lxcora01/rootfs
# Common configuration
lxc.include = /usr/share/lxc/config/oracle.common.conf
# Container configuration for Oracle Linux 6.6
lxc.arch = x86_64
lxc.utsname = lxcora01
lxc.cap.drop = sys_resource
lxc.cap.drop = setfcap setpcap
[OEL 6.3][lxcora01][root@tme-srv2567]#
Create and Edit the "/etc/network/if-up.d" and "/etc/network/if-down.d" Files
The OpenvSwitch networking stanza in the config file for the LXC container references a couple of scripts for bringing up and shutting down the ports on the OpenvSwitch. Create the files and edit them, being sure to name them to match the file calls in the config file for the container, being sure to give them executable permissions, and ensuring that all references to the container name are correct (if copying existing files to create them) as shown below. Notice that in this example, VLANs are being used on the OpenvSwitch (e.g. "tag=10"). Use of VLANs with the OpenvSwitch setup is optional, but is used in this example. Note also that the name of the LXC container is used in the script (e.g. "lxcora03") so it is important to remember ot update this value if copying an existing if-up file in the directory to use for the new container.
[OEL 6.3][dynamic][root@tme-srv2567]# ls -l /etc/network/if-up.d/lxcora03-ifup-sw1
-rwxr-xr-x 1 root root 100 Nov 21 12:17 /etc/network/if-up.d/lxcora03-ifup-sw1
[OEL 6.3][dynamic][root@tme-srv2567]# cat /etc/network/if-up.d/lxcora03-ifup-sw1
#!/bin/bash
ovsBr='sw1'
sudo ovs-vsctl add-port ${ovsBr} $5
sudo ovs-vsctl set port lxcora03 tag=10
[OEL 6.3][dynamic][root@tme-srv2567]#
Create the dhclient.conf file on LXC Container
In order that DNS name resolution will work properly, the "/etc/dhcp/dhclient.conf" file should be created. This file creates required entires in /etc/resolv.conf each time the container boots up, ensuring that resolution of both local LXC containers on the network, as well as www resolution (e.g. when using "yum") will also resolve names like "public-yum.oracle.com". The required entries are shown below.
[root@lxcora03 ~]# cat /etc/dhcp/dhclient.conf
interface "eth0"
{
supersede domain-name-servers 10.207.39.1, 8.8.8.8, 8.8.4.4;
}
[root@lxcora03 ~]#
Note that the first entry, 10.207.39.1, is the local authoritative DNS server on the local machine purpose-built for resolving the LXC container IP addresses to names. The additional entries, 8.8.8.8 and 8.8.4.4 are Google nameservers required for resolving addresses such as "public-yum.oracle.com". If on a network has public net-facing namerservers already in use, the IP addresses of those can be used instead of 8.8.8.8, or 8.8.4.4 public nameservers.
Verify that "/etc/resolv.conf" File in LXC Container is Correct
With these changes to resolution made, shutdown and restart the container, and verify that "/etc/resolv.conf" has gotten the desired entries from dhclient.conf file settings. In this case, those entries are as shown below.
[root@lxcora03 ~]# cat /etc/resolv.conf
; generated by /sbin/dhclient-script
search vmem.org
nameserver 10.207.39.1
nameserver 8.8.8.8
nameserver 8.8.4.4
[root@lxcora03 ~]#
Install bind-utils on LXC Container
Install bind-utils to get access to utilities such as "nslookup", "traceroute", etc. as shown below. Successful installation and resolution of "public-yum.oracle.com" verifies that web addresses can be successfully resolved by the "/etc/resolv.conf" flle.
[root@lxcora03 ~]# yum install bind-utils
Loaded plugins: lxc-patch
Setting up Install Process
Resolving Dependencies
--> Running transaction check
---> Package bind-utils.x86_64 32:9.8.2-0.30.rc1.el6 will be installed
--> Processing Dependency: bind-libs = 32:9.8.2-0.30.rc1.el6 for package: 32:bind-utils-9.8.2-0.30.rc1.el6.x86_64
--> Processing Dependency: libdns.so.81()(64bit) for package: 32:bind-utils-9.8.2-0.30.rc1.el6.x86_64
--> Processing Dependency: libbind9.so.80()(64bit) for package: 32:bind-utils-9.8.2-0.30.rc1.el6.x86_64
--> Processing Dependency: libisc.so.83()(64bit) for package: 32:bind-utils-9.8.2-0.30.rc1.el6.x86_64
--> Processing Dependency: libisccc.so.80()(64bit) for package: 32:bind-utils-9.8.2-0.30.rc1.el6.x86_64
--> Processing Dependency: liblwres.so.80()(64bit) for package: 32:bind-utils-9.8.2-0.30.rc1.el6.x86_64
--> Processing Dependency: libisccfg.so.82()(64bit) for package: 32:bind-utils-9.8.2-0.30.rc1.el6.x86_64
--> Running transaction check
---> Package bind-libs.x86_64 32:9.8.2-0.30.rc1.el6 will be installed
--> Finished Dependency Resolution
Dependencies Resolved
=============================================================================================================================================================================================================
Package Arch Version Repository Size
=============================================================================================================================================================================================================
Installing:
bind-utils x86_64 32:9.8.2-0.30.rc1.el6 ol6_u6_base 184 k
Installing for dependencies:
bind-libs x86_64 32:9.8.2-0.30.rc1.el6 ol6_u6_base 881 k
Transaction Summary
=============================================================================================================================================================================================================
Install 2 Package(s)
Total download size: 1.0 M
Installed size: 2.6 M
Is this ok [y/N]: y
Downloading Packages:
(1/2): bind-libs-9.8.2-0.30.rc1.el6.x86_64.rpm | 881 kB 00:00
(2/2): bind-utils-9.8.2-0.30.rc1.el6.x86_64.rpm | 184 kB 00:00
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Total 1.4 MB/s | 1.0 MB 00:00
warning: rpmts_HdrFromFdno: Header V3 RSA/SHA256 Signature, key ID ec551f03: NOKEY
Retrieving key from file:///etc/pki/rpm-gpg/RPM-GPG-KEY-oracle
Importing GPG key 0xEC551F03:
Userid : Oracle OSS group (Open Source Software group) <build@oss.oracle.com>
Package: 6:oraclelinux-release-6Server-6.0.2.x86_64 (@ol6_u6_base/$releasever)
From : /etc/pki/rpm-gpg/RPM-GPG-KEY-oracle
Is this ok [y/N]: y
Running rpm_check_debug
Running Transaction Test
Transaction Test Succeeded
Running Transaction
Installing : 32:bind-libs-9.8.2-0.30.rc1.el6.x86_64 1/2
Installing : 32:bind-utils-9.8.2-0.30.rc1.el6.x86_64 2/2
lxc-patch: checking if updated pkgs need patching...
Verifying : 32:bind-libs-9.8.2-0.30.rc1.el6.x86_64 1/2
Verifying : 32:bind-utils-9.8.2-0.30.rc1.el6.x86_64 2/2
Installed:
bind-utils.x86_64 32:9.8.2-0.30.rc1.el6
Dependency Installed:
bind-libs.x86_64 32:9.8.2-0.30.rc1.el6
Complete!
[root@lxcora03 ~]#
Test Lookups on LXC Container
Lookup the hostname of the current container using nslookup to verify that the container DHCP generated IP has been added automatically to both forward and reverse zone lookup files in DNS as shown below. This test verifies that lookups of local LXC containers on the server are working.
[root@lxcora03 ~]# nslookup lxcora03.vmem.org
Server: 10.207.39.1
Address: 10.207.39.1#53
Name: lxcora03.vmem.org
Address: 10.207.39.71
[root@lxcora03 ~]#
Setup NFS Client on LXC Container
Setup NFS client as shown below.
[root@lxcora03 ~]# yum install nfs-utils nfs-utils-lib
Loaded plugins: lxc-patch
Setting up Install Process
Resolving Dependencies
--> Running transaction check
---> Package nfs-utils.x86_64 1:1.2.3-54.el6 will be installed
--> Processing Dependency: keyutils >= 1.4-4 for package: 1:nfs-utils-1.2.3-54.el6.x86_64
--> Processing Dependency: libgssglue for package: 1:nfs-utils-1.2.3-54.el6.x86_64
--> Processing Dependency: libtirpc for package: 1:nfs-utils-1.2.3-54.el6.x86_64
--> Processing Dependency: rpcbind for package: 1:nfs-utils-1.2.3-54.el6.x86_64
--> Processing Dependency: libevent for package: 1:nfs-utils-1.2.3-54.el6.x86_64
--> Processing Dependency: libgssglue.so.1(libgssapi_CITI_2)(64bit) for package: 1:nfs-utils-1.2.3-54.el6.x86_64
--> Processing Dependency: libevent-1.4.so.2()(64bit) for package: 1:nfs-utils-1.2.3-54.el6.x86_64
--> Processing Dependency: libtirpc.so.1()(64bit) for package: 1:nfs-utils-1.2.3-54.el6.x86_64
--> Processing Dependency: libgssglue.so.1()(64bit) for package: 1:nfs-utils-1.2.3-54.el6.x86_64
---> Package nfs-utils-lib.x86_64 0:1.1.5-9.el6 will be installed
--> Running transaction check
---> Package keyutils.x86_64 0:1.4-5.el6 will be installed
---> Package libevent.x86_64 0:1.4.13-4.el6 will be installed
---> Package libgssglue.x86_64 0:0.1-11.el6 will be installed
---> Package libtirpc.x86_64 0:0.2.1-10.el6 will be installed
---> Package rpcbind.x86_64 0:0.2.0-11.el6 will be installed
--> Finished Dependency Resolution
Dependencies Resolved
=============================================================================================================================================================================================================
Package Arch Version Repository Size
=============================================================================================================================================================================================================
Installing:
nfs-utils x86_64 1:1.2.3-54.el6 ol6_u6_base 326 k
nfs-utils-lib x86_64 1.1.5-9.el6 ol6_u6_base 67 k
Installing for dependencies:
keyutils x86_64 1.4-5.el6 ol6_u6_base 39 k
libevent x86_64 1.4.13-4.el6 ol6_u6_base 65 k
libgssglue x86_64 0.1-11.el6 ol6_u6_base 22 k
libtirpc x86_64 0.2.1-10.el6 ol6_u6_base 78 k
rpcbind x86_64 0.2.0-11.el6 ol6_u6_base 51 k
Transaction Summary
=============================================================================================================================================================================================================
Install 7 Package(s)
Total download size: 648 k
Installed size: 1.7 M
Is this ok [y/N]: y
Downloading Packages:
(1/7): keyutils-1.4-5.el6.x86_64.rpm | 39 kB 00:00
(2/7): libevent-1.4.13-4.el6.x86_64.rpm | 65 kB 00:00
(3/7): libgssglue-0.1-11.el6.x86_64.rpm | 22 kB 00:00
(4/7): libtirpc-0.2.1-10.el6.x86_64.rpm | 78 kB 00:00
(5/7): nfs-utils-1.2.3-54.el6.x86_64.rpm | 326 kB 00:00
(6/7): nfs-utils-lib-1.1.5-9.el6.x86_64.rpm | 67 kB 00:00
(7/7): rpcbind-0.2.0-11.el6.x86_64.rpm | 51 kB 00:00
-------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------------
Total 245 kB/s | 648 kB 00:02
Running rpm_check_debug
Running Transaction Test
Transaction Test Succeeded
Running Transaction
Installing : libgssglue-0.1-11.el6.x86_64 1/7
Installing : libtirpc-0.2.1-10.el6.x86_64 2/7
Installing : rpcbind-0.2.0-11.el6.x86_64 3/7
Installing : keyutils-1.4-5.el6.x86_64 4/7
Installing : libevent-1.4.13-4.el6.x86_64 5/7
Installing : nfs-utils-lib-1.1.5-9.el6.x86_64 6/7
Installing : 1:nfs-utils-1.2.3-54.el6.x86_64 7/7
lxc-patch: checking if updated pkgs need patching...
Verifying : libevent-1.4.13-4.el6.x86_64 1/7
Verifying : rpcbind-0.2.0-11.el6.x86_64 2/7
Verifying : keyutils-1.4-5.el6.x86_64 3/7
Verifying : 1:nfs-utils-1.2.3-54.el6.x86_64 4/7
Verifying : nfs-utils-lib-1.1.5-9.el6.x86_64 5/7
Verifying : libtirpc-0.2.1-10.el6.x86_64 6/7
Verifying : libgssglue-0.1-11.el6.x86_64 7/7
Installed:
nfs-utils.x86_64 1:1.2.3-54.el6 nfs-utils-lib.x86_64 0:1.1.5-9.el6
Dependency Installed:
keyutils.x86_64 0:1.4-5.el6 libevent.x86_64 0:1.4.13-4.el6 libgssglue.x86_64 0:0.1-11.el6 libtirpc.x86_64 0:0.2.1-10.el6 rpcbind.x86_64 0:0.2.0-11.el6
Complete!
[root@lxcora03 ~]#
Setting Up Users on the LXC Host
On the OEL6 LXC host, users and groups can be created so that processes running in the various LXC containers can be better identified and associated with various running LXC containers, as shown below.
[OEL 6.3][/][root@tme-srv2567]# groupadd -g 1401 backupdba
[OEL 6.3][/][root@tme-srv2567]# groupadd -g 1501 dgdba
[OEL 6.3][/][root@tme-srv2567]# groupadd -g 1601 kmdba
[OEL 6.3][/][root@tme-srv2567]# groupadd -g 1701 osacfs
[OEL 6.3][/][root@tme-srv2567]# groupadd -g 1801 osaudit
[OEL 6.3][/][root@tme-srv2567]# usermod -a -G backupdba,dgdba,kmdba oracle
[OEL 6.3][/][root@tme-srv2567]# useradd -u 1098 -g oinstall -G asmadmin,asmdba,asmoper,dba gridlxc1
View the various created users and added groups to verify creation, as shown below. Note that the new user "gridlxc1" uses as extension "lxc1" which is going to be the name of the 12c GNS RAC ASM Flex Cluster which is to be built. This way, processes owned by "grid" in the container will show up as "gridlxc1" in the OEL 6 host server. Since it is possible to run multiple ASM Flex Clusters (multiple GI installs) in various sets of LXC containers, having users {gridlxc1, gridlxc2, gridlxcN, ...} can be envisioned, hence this naming scheme for process tracking on thos host level. Note that "gridlxc1" must have the SAME GID as the "grid" user in the GI cluster to which it refers so that the GID's map correctly to the usernames in both container and host.
[OEL 6.3][/][root@tme-srv2567]# id oracle
uid=1101(oracle) gid=1000(oinstall) groups=1000(oinstall),1200(dba),1300(asmdba),1201(oper),1401(backupdba),1501(dgdba),1601(kmdba)
[OEL 6.3][/][root@tme-srv2567]# id grid
uid=1100(grid) gid=1000(oinstall) groups=1000(oinstall),1100(asmadmin),1200(dba),1300(asmdba),1301(asmoper)
[OEL 6.3][/][root@tme-srv2567]# id gridlxc1
uid=1098(gridlxc1) gid=1000(oinstall) groups=1000(oinstall),1100(asmadmin),1200(dba),1300(asmdba),1301(asmoper)
Setup X-window in LXC Container for GUI Install
root@vmem1:/var/lib/lxc/lxcora02/rootfs/home/oracle# ssh -Y -C root@tme-srv2567.eng.vmem.int
[OEL 6.3][oracle-build-scripts][root@tme-srv2567]# yum -y install xorg-x11-apps
Loaded plugins: refresh-packagekit, rhnplugin, security
This system is receiving updates from ULN.
Setting up Install Process
Resolving Dependencies
--> Running transaction check
---> Package xorg-x11-apps.x86_64 0:7.7-6.el6 will be installed
--> Finished Dependency Resolution
Dependencies Resolved
=============================================================================================================================================================================================================
Package Arch Version Repository Size
=============================================================================================================================================================================================================
Installing:
xorg-x11-apps x86_64 7.7-6.el6 ol6_x86_64_latest 276 k
Transaction Summary
=============================================================================================================================================================================================================
Install 1 Package(s)
Total download size: 276 k
Installed size: 704 k
Downloading Packages:
xorg-x11-apps-7.7-6.el6.x86_64.rpm | 276 kB 00:00
Running rpm_check_debug
Running Transaction Test
Transaction Test Succeeded
Running Transaction
Warning: RPMDB altered outside of yum.
Installing : xorg-x11-apps-7.7-6.el6.x86_64 1/1
Verifying : xorg-x11-apps-7.7-6.el6.x86_64 1/1
Installed:
xorg-x11-apps.x86_64 0:7.7-6.el6
Complete!
[OEL 6.3][oracle-build-scripts][root@tme-srv2567]# xclock
[OEL 6.3][oracle-build-scripts][root@tme-srv2567]# echo $DISPLAY
localhost:10.0
[OEL 6.3][oracle-build-scripts][root@tme-srv2567]# echo xauth add `xauth list ${DISPLAY#localhost}`
xauth add tme-srv2567.eng.vmem.int/unix:10 MIT-MAGIC-COOKIE-1 d1f2dc01e957d441f643147c167ea037
[OEL 6.3][oracle-build-scripts][root@tme-srv2567]# ssh -Y -C grid@lxcora03
grid@lxcora03's password:
Last login: Sat Nov 22 13:21:15 2014 from tme-srv2567.vmem.org
/usr/bin/xauth: creating new authority file /home/grid/.Xauthority
[grid@lxcora03 ~]$ xclock
[grid@lxcora03 ~]$
Install cvuqdisk on LXC node
[root@lxcora03 rpm]# rpm -Uvh cvuqdisk-1.0.9-1.rpm
Preparing... ########################################### [100%]
Using default group oinstall to install package
1:cvuqdisk ########################################### [100%]
[root@lxcora03 rpm]#
Set NOZEROCONF parameter
The NOZEROCONF should be set to "yes" in "/etc/sysconfig/network" as shown below.
[root@lxcora03 ~]# cat /etc/sysconfig/network
NETWORKING=yes
NETWORKING_IPV6=no
HOSTNAME=lxcora03
NOZEROCONF=yes
[root@lxcora03 ~]#
Ensure /dev/shm is in /etc/fstab File
Add a mount entry to /etc/fstab to ensure that there is a /dev/shm filesystem to satisfy cluster verification checks. Note that for this system the database will be using hugepages, so this filesystem will not be needed for that purpose, but still it should be present and is needed for cluster verification steps. Add the required line to /etc/fstab in the container and run "mount -a" to have it take effect.
[root@lxcora03 ~]# cat /etc/fstab
tmpfs /dev/shm tmpfs rw,exec,size=3500m 0 0
tme-srv2567.vmem.org:/shared_config /shared_config nfs rw,bg,hard,nointr,tcp,vers=3,timeo=600,rsize=32768,wsize=32768,actimeo=0 0 0
tme-srv2567.vmem.org:/shared_grid /shared_grid nfs rw,bg,hard,nointr,tcp,vers=3,timeo=600,rsize=32768,wsize=32768,actimeo=0 0 0
tme-srv2567.vmem.org:/u00 /u00 nfs rw,bg,hard,nointr,tcp,vers=3,timeo=600,rsize=32768,wsize=32768,actimeo=0 0 0
tme-srv2567.vmem.org:/shared_data /shared_data nfs rw,bg,hard,nointr,tcp,vers=3,timeo=600,rsize=32768,wsize=32768,actimeo=0 0 0
# tme-srv2567.vmem.org:/dev/mapper /shared_storage nfs rw,bg,hard,nointr,tcp,vers=3,timeo=600,rsize=32768,wsize=32768,actimeo=0 0 0
[root@lxcora03 ~]# df -TH
Filesystem Type Size Used Avail Use% Mounted on
tmpfs tmpfs 13G 0 13G 0% /dev/shm
tme-srv2567.vmem.org:/shared_config
nfs 53G 35G 16G 70% /shared_config
tme-srv2567.vmem.org:/shared_grid
nfs 53G 35G 16G 70% /shared_grid
tme-srv2567.vmem.org:/u00
nfs 148G 63M 141G 1% /u00
tme-srv2567.vmem.org:/shared_data
nfs 317G 66M 303G 1% /shared_data
[root@lxcora03 ~]#
Add Swap Space if Needed
In this case, the swap space check failed as shown below. It will be necessary to extend the swap partition, or add a swapfile.
Check: Swap space
Node Name Available Required Status
------------ ------------------------ ------------------------ ----------
lxcora03 11.7969GB (1.2369916E7KB) 16GB (1.6777216E7KB) failed
Result: Swap space check failed
Disable avahi-daemon in LXC Container
There was an intermittent problem with LXC containers sometimes losing DNS resolution for www addresses, such as "google.com". it is believed that this was due to avahi-daemon running on the host server. Stop the avahi-daemon service and chkconfig off as shown below.
[OEL 6.3][~][root@tme-srv2567]# chkconfig avahi-daemon off
[OEL 6.3][~][root@tme-srv2567]# service avahi-daemon stop
Run no-passwd ssh Script
Create and run a script to test no-password ssh is working for the "grid" user. It will be necessary to setup no-password ssh prior to running this test. Once the no-password ssh is setup among the "grid" users on the LXC nodes, run this script until the output is similar to that shown below.
[grid@lxcora02 ~]$ cat test-nopwd.sh
ssh lxcora03 date
ssh lxcora02 date
ssh lxcora01 date
ssh localhost date
ssh 127.0.0.1 date
ssh lxcora03.vmem.org date
ssh lxcora02.vmem.org date
ssh lxcora01.vmem.org date
ssh 10.207.39.71 date
ssh 10.207.39.72 date
ssh 10.207.39.73 date
[grid@lxcora02 ~]$ ./test-nopwd.sh
Sat Nov 22 23:31:33 EST 2014
Sat Nov 22 23:31:35 EST 2014
Sat Nov 22 23:31:36 EST 2014
Sat Nov 22 23:31:38 EST 2014
Sat Nov 22 23:31:38 EST 2014
Sat Nov 22 23:31:39 EST 2014
Sat Nov 22 23:31:40 EST 2014
Sat Nov 22 23:31:41 EST 2014
Sat Nov 22 23:31:42 EST 2014
Sat Nov 22 23:31:42 EST 2014
Sat Nov 22 23:31:42 EST 2014
[grid@lxcora02 ~]$
For example, as shown below.
[grid@lxcora02 ~]$ scp -p test-nopwd.sh grid@lxcora01:/home/grid/.
test-nopwd.sh 100% 239 0.2KB/s 00:00
[grid@lxcora02 ~]$ scp -p test-nopwd.sh grid@lxcora03:/home/grid/.
test-nopwd.sh 100% 239 0.2KB/s 00:00
[grid@lxcora02 ~]$ ssh lxcora01
Last login: Sat Nov 22 23:23:32 2014 from 10.207.39.73
[grid@lxcora01 ~]$ ./test-nopwd.sh
Sat Nov 22 23:34:48 EST 2014
Sat Nov 22 23:34:49 EST 2014
The authenticity of host 'lxcora01 (10.207.39.72)' can't be established.
RSA key fingerprint is f5:2f:c5:25:c9:24:47:fd:ca:e6:3d:01:36:4c:02:49.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'lxcora01,10.207.39.72' (RSA) to the list of known hosts.
Sat Nov 22 23:34:51 EST 2014
Sat Nov 22 23:34:53 EST 2014
Sat Nov 22 23:34:53 EST 2014
Sat Nov 22 23:34:55 EST 2014
The authenticity of host 'lxcora02.vmem.org (10.207.39.73)' can't be established.
RSA key fingerprint is f5:2f:c5:25:c9:24:47:fd:ca:e6:3d:01:36:4c:02:49.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'lxcora02.vmem.org' (RSA) to the list of known hosts.
Sat Nov 22 23:34:57 EST 2014
The authenticity of host 'lxcora01.vmem.org (10.207.39.72)' can't be established.
RSA key fingerprint is f5:2f:c5:25:c9:24:47:fd:ca:e6:3d:01:36:4c:02:49.
Are you sure you want to continue connecting (yes/no)? yes
Warning: Permanently added 'lxcora01.vmem.org' (RSA) to the list of known hosts.
Sat Nov 22 23:34:59 EST 2014
Sat Nov 22 23:34:59 EST 2014
Sat Nov 22 23:34:59 EST 2014
Sat Nov 22 23:34:59 EST 2014
[grid@lxcora01 ~]$ ./test-nopwd.sh
Sat Nov 22 23:35:03 EST 2014
Sat Nov 22 23:35:04 EST 2014
Sat Nov 22 23:35:06 EST 2014
Sat Nov 22 23:35:08 EST 2014
Sat Nov 22 23:35:08 EST 2014
Sat Nov 22 23:35:09 EST 2014
Sat Nov 22 23:35:10 EST 2014
Sat Nov 22 23:35:11 EST 2014
Sat Nov 22 23:35:11 EST 2014
Sat Nov 22 23:35:11 EST 2014
Sat Nov 22 23:35:12 EST 2014
[grid@lxcora01 ~]$
Accessing Cluster EM Express GUI from Remote
An SSH tunnel can be used to access the EM Express GUI management page for the cluster. Below is shown how this is done from Ubuntu 14.04.1 laptop terminal session. Putty could be used to do similar. The step to unlock XDB account only needs to be done once. On subsequent connections to the EM Express, simply establish tunnel and then connect on local webpage on local machine at "https://localhost:8080/em".
gstanden@vmem1:~$ ssh -L 8080:lxc1-scan.gns1.vmem.org:5500 root@tme-srv2567.eng.vmem.int
root@tme-srv2567.eng.vmem.int's password:
Last login: Tue Nov 25 17:09:09 2014 from 10.12.56.21
[OEL 6.3][~][root@tme-srv2567]# ssh root@lxcora01
Last login: Tue Nov 25 19:53:16 2014 from 10.207.39.1
[root@lxcora01 ~]# su - oracle
[oracle@lxcora01 ~]$ sqlplus "/ as sysdba"
SQL*Plus: Release 12.1.0.2.0 Production on Tue Nov 25 20:18:50 2014
Copyright (c) 1982, 2014, Oracle. All rights reserved.
Connected to:
Oracle Database 12c Enterprise Edition Release 12.1.0.2.0 - 64bit Production
With the Partitioning, Real Application Clusters, Automatic Storage Management, OLAP,
Advanced Analytics and Real Application Testing options
SQL> alter user xdb account unlock;
User altered.
SQL>
Convert KVM Guest to Use virtio-blk-data-plane
Once the KVM guest is built, the backing files for the guest should be converted to virtio-blk-data-plane for best performance, as shown below.
[OEL 6.6][~][root@tme-srv2567]# virsh dumpxml kvmora01
<domain type='kvm' id='6' xmlns:qemu='http://libvirt.org/schemas/domain/qemu/1.0'>
<name>kvmora01</name>
<uuid>292b6b57-bce5-c587-006a-12d2ba88a97a</uuid>
<memory unit='KiB'>2097152</memory>
<currentMemory unit='KiB'>2097152</currentMemory>
<vcpu placement='static'>2</vcpu>
<os>
<type arch='x86_64' machine='rhel6.6.0'>hvm</type>
<boot dev='hd'/>
</os>
<features>
<acpi/>
<apic/>
<pae/>
</features>
<clock offset='utc'/>
<on_poweroff>destroy</on_poweroff>
<on_reboot>restart</on_reboot>
<on_crash>restart</on_crash>
<devices>
<emulator>/usr/libexec/qemu-kvm</emulator>
<disk type='file' device='disk'>
<driver name='qemu' type='raw' cache='none' io='native'/>
<source file='/home/lib/libvirt/images/kvmora01-00.img'/>
<target dev='vda' bus='virtio'/>
<alias name='virtio-disk0'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x06' function='0x0'/>
</disk>
<disk type='block' device='cdrom'>
<driver name='qemu' type='raw'/>
<target dev='hdc' bus='ide'/>
<readonly/>
<alias name='ide0-1-0'/>
<address type='drive' controller='0' bus='1' target='0' unit='0'/>
</disk>
<controller type='usb' index='0' model='ich9-ehci1'>
<alias name='usb0'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x7'/>
</controller>
<controller type='usb' index='0' model='ich9-uhci1'>
<alias name='usb0'/>
<master startport='0'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x0' multifunction='on'/>
</controller>
<controller type='usb' index='0' model='ich9-uhci2'>
<alias name='usb0'/>
<master startport='2'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x1'/>
</controller>
<controller type='usb' index='0' model='ich9-uhci3'>
<alias name='usb0'/>
<master startport='4'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x05' function='0x2'/>
</controller>
<controller type='ide' index='0'>
<alias name='ide0'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x01' function='0x1'/>
</controller>
<interface type='bridge'>
<mac address='52:54:00:85:d9:9e'/>
<source bridge='sw1'/>
<vlan>
<tag id='10'/>
</vlan>
<virtualport type='openvswitch'>
<parameters interfaceid='2b7b6afa-21cb-4c6d-e291-61feb3dffe5e'/>
</virtualport>
<target dev='s1'/>
<model type='virtio'/>
<alias name='net0'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x03' function='0x0'/>
</interface>
<serial type='pty'>
<source path='/dev/pts/0'/>
<target port='0'/>
<alias name='serial0'/>
</serial>
<console type='pty' tty='/dev/pts/0'>
<source path='/dev/pts/0'/>
<target type='serial' port='0'/>
<alias name='serial0'/>
</console>
<input type='tablet' bus='usb'>
<alias name='input0'/>
</input>
<input type='mouse' bus='ps2'/>
<graphics type='vnc' port='5900' autoport='yes' listen='127.0.0.1'>
<listen type='address' address='127.0.0.1'/>
</graphics>
<sound model='ich6'>
<alias name='sound0'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x04' function='0x0'/>
</sound>
<video>
<model type='cirrus' vram='9216' heads='1'/>
<alias name='video0'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x02' function='0x0'/>
</video>
<memballoon model='virtio'>
<alias name='balloon0'/>
<address type='pci' domain='0x0000' bus='0x00' slot='0x07' function='0x0'/>
</memballoon>
</devices>
<qemu:commandline>
<qemu:arg value='-set'/>
<qemu:arg value='device.virtio-disk0.scsi=off'/>
<qemu:arg value='-set'/>
<qemu:arg value='device.virtio-disk0.x-data-plane=on'/>
</qemu:commandline>
</domain>
[OEL 6.6][~][root@tme-srv2567]# virsh dumpxml kvmora01
Restart the KVM guest and then confirm that virtio-blk-data-plane is being used as shown below.
[OEL 6.6][~][root@tme-srv2567]# sudo virsh qemu-monitor-command --hmp kvmora01 'info qtree' | grep x-data
dev-prop: x-data-plane = on
[OEL 6.6][~][root@tme-srv2567]#