Now, we can create the first node of our RAC.
We will create the new VM with 2GB of RAM and with 4 network interfaces (I will try to do the bonding).
Here the steps for creating the new VM:
Here the steps for creating the new VM:
I will name my 1'st node rac11gnode1
I will create 25GB disk for the /, /boot and swap.
Here is the basic configuration that was created.
Now, I have added additional 1GB of RAM to the virtual server:
I have changed the Network Adapter to "Bridged", so I will be able to connect to internet.
I will add another Network devices, as I need another one for the interconnect.
As you can see on the next picture, I have added another 35 GB disk as I want to test the software raid configuration and another 2 Network adapters as I want also try the bonding.
VM is ready, so we can start wit the installation of the oracle linux.
I will name my server rac11gnode1.example.com
As I will not use the DHCP, I will configure the eth0 manually. It will be the public interface.
eth1 interface will be configured for the private interconnect:
I will create custom fs layout..
Here, the 2 disks that I will use for the RAID:
Here you can see the final layout. I have created raid device md0 which will be used for the /boot filesystem and raid device md1 which will be used for the / and swap. As the /boot cannot be placed on the LVM, I have created only LVM for the / and swap.
After the FS layout is configured, I have finished the creation of the VM.
So the server is ready and now we can configure it.
Here the file systems:
[root@rac11gnode1 ~]# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/vg_rac11gnode1-LogVol01
22G 2.1G 19G 11% /
tmpfs 1001M 0 1001M 0% /dev/shm
/dev/md0 194M 50M 135M 28% /boot
Network configuration:
[root@rac11gnode1 ~]# ifconfig
eth0 Link encap:Ethernet HWaddr 00:0C:29:C3:DA:50
inet addr:192.168.0.112 Bcast:192.168.0.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:fec3:da50/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:665 errors:0 dropped:0 overruns:0 frame:0
TX packets:234 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:51000 (49.8 KiB) TX bytes:33305 (32.5 KiB)
eth1 Link encap:Ethernet HWaddr 00:0C:29:C3:DA:5A
inet addr:10.0.1.2 Bcast:10.0.1.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:fec3:da5a/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:392 errors:0 dropped:0 overruns:0 frame:0
TX packets:25 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:26385 (25.7 KiB) TX bytes:4035 (3.9 KiB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:4 errors:0 dropped:0 overruns:0 frame:0
TX packets:4 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:336 (336.0 b) TX bytes:336 (336.0 b)
DNS resolution is working:
[root@rac11gnode1 ~]# nslookup rac11gnode1
Server: 192.168.0.111
Address: 192.168.0.111#53
Name: rac11gnode1.example.com
Address: 192.168.0.112
Here is the output of the ifconfig after bondig the interfaces:
[root@rac11gnode1 ~]# ifconfig
bond0 Link encap:Ethernet HWaddr 00:0C:29:C3:DA:50
inet addr:192.168.0.112 Bcast:192.168.0.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:fec3:da50/64 Scope:Link
UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1
RX packets:823 errors:0 dropped:371 overruns:0 frame:0
TX packets:87 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:104889 (102.4 KiB) TX bytes:13175 (12.8 KiB)
bond1 Link encap:Ethernet HWaddr 00:0C:29:C3:DA:5A
inet addr:10.0.1.2 Bcast:10.0.1.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:fec3:da5a/64 Scope:Link
UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1
RX packets:739 errors:0 dropped:365 overruns:0 frame:0
TX packets:25 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:95019 (92.7 KiB) TX bytes:4035 (3.9 KiB)
eth0 Link encap:Ethernet HWaddr 00:0C:29:C3:DA:50
UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
RX packets:457 errors:0 dropped:0 overruns:0 frame:0
TX packets:101 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:58715 (57.3 KiB) TX bytes:15155 (14.7 KiB)
eth1 Link encap:Ethernet HWaddr 00:0C:29:C3:DA:5A
UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
RX packets:374 errors:0 dropped:0 overruns:0 frame:0
TX packets:25 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:49030 (47.8 KiB) TX bytes:4035 (3.9 KiB)
eth2 Link encap:Ethernet HWaddr 00:0C:29:C3:DA:50
UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
RX packets:371 errors:0 dropped:371 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:46504 (45.4 KiB) TX bytes:0 (0.0 b)
eth3 Link encap:Ethernet HWaddr 00:0C:29:C3:DA:5A
UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
RX packets:365 errors:0 dropped:365 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:45989 (44.9 KiB) TX bytes:0 (0.0 b)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 b) TX bytes:0 (0.0 b)
Configuration looks OK, but the tests were not successfull. I have to check, if the bonding is working in the VMware.
I have added another 4 20GB disks, so I can use them to create software RAID1 for the /oracle and /grid filesystems:
So the server is ready and now we can configure it.
Here the file systems:
[root@rac11gnode1 ~]# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/vg_rac11gnode1-LogVol01
22G 2.1G 19G 11% /
tmpfs 1001M 0 1001M 0% /dev/shm
/dev/md0 194M 50M 135M 28% /boot
Network configuration:
[root@rac11gnode1 ~]# ifconfig
eth0 Link encap:Ethernet HWaddr 00:0C:29:C3:DA:50
inet addr:192.168.0.112 Bcast:192.168.0.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:fec3:da50/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:665 errors:0 dropped:0 overruns:0 frame:0
TX packets:234 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:51000 (49.8 KiB) TX bytes:33305 (32.5 KiB)
eth1 Link encap:Ethernet HWaddr 00:0C:29:C3:DA:5A
inet addr:10.0.1.2 Bcast:10.0.1.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:fec3:da5a/64 Scope:Link
UP BROADCAST RUNNING MULTICAST MTU:1500 Metric:1
RX packets:392 errors:0 dropped:0 overruns:0 frame:0
TX packets:25 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:26385 (25.7 KiB) TX bytes:4035 (3.9 KiB)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:4 errors:0 dropped:0 overruns:0 frame:0
TX packets:4 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:336 (336.0 b) TX bytes:336 (336.0 b)
DNS resolution is working:
[root@rac11gnode1 ~]# nslookup rac11gnode1
Server: 192.168.0.111
Address: 192.168.0.111#53
Name: rac11gnode1.example.com
Address: 192.168.0.112
Here is the output of the ifconfig after bondig the interfaces:
[root@rac11gnode1 ~]# ifconfig
bond0 Link encap:Ethernet HWaddr 00:0C:29:C3:DA:50
inet addr:192.168.0.112 Bcast:192.168.0.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:fec3:da50/64 Scope:Link
UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1
RX packets:823 errors:0 dropped:371 overruns:0 frame:0
TX packets:87 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:104889 (102.4 KiB) TX bytes:13175 (12.8 KiB)
bond1 Link encap:Ethernet HWaddr 00:0C:29:C3:DA:5A
inet addr:10.0.1.2 Bcast:10.0.1.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:fec3:da5a/64 Scope:Link
UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1
RX packets:739 errors:0 dropped:365 overruns:0 frame:0
TX packets:25 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:95019 (92.7 KiB) TX bytes:4035 (3.9 KiB)
eth0 Link encap:Ethernet HWaddr 00:0C:29:C3:DA:50
UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
RX packets:457 errors:0 dropped:0 overruns:0 frame:0
TX packets:101 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:58715 (57.3 KiB) TX bytes:15155 (14.7 KiB)
eth1 Link encap:Ethernet HWaddr 00:0C:29:C3:DA:5A
UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
RX packets:374 errors:0 dropped:0 overruns:0 frame:0
TX packets:25 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:49030 (47.8 KiB) TX bytes:4035 (3.9 KiB)
eth2 Link encap:Ethernet HWaddr 00:0C:29:C3:DA:50
UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
RX packets:371 errors:0 dropped:371 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:46504 (45.4 KiB) TX bytes:0 (0.0 b)
eth3 Link encap:Ethernet HWaddr 00:0C:29:C3:DA:5A
UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
RX packets:365 errors:0 dropped:365 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:45989 (44.9 KiB) TX bytes:0 (0.0 b)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 b) TX bytes:0 (0.0 b)
Configuration looks OK, but the tests were not successfull. I have to check, if the bonding is working in the VMware.
I have added another 4 20GB disks, so I can use them to create software RAID1 for the /oracle and /grid filesystems:
Here my /etc/fstab configuration file:
[root@rac11gnode1 ~]# cat /etc/fstab
#
# /etc/fstab
# Created by anaconda on Mon Apr 1 17:47:19 2013
#
# Accessible filesystems, by reference, are maintained under '/dev/disk'
# See man pages fstab(5), findfs(8), mount(8) and/or blkid(8) for more info
#
/dev/mapper/vg_rac11gnode1-LogVol01 / ext4 defaults 1 1
UUID=7c5dbe51-e844-4330-9cf7-00b2321c6a2e /boot ext4 defaults 1 2
/dev/mapper/vg_rac11gnode1-LogVol00 swap swap defaults 0 0
tmpfs /dev/shm tmpfs defaults 0 0
devpts /dev/pts devpts gid=5,mode=620 0 0
sysfs /sys sysfs defaults 0 0
proc /proc proc defaults 0 0
/dev/md2 /oracle ext4 defaults 1 2
/dev/md3 /grid ext4 defaults 1 2
Output of the df -h:
[root@rac11gnode1 ~]# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/vg_rac11gnode1-LogVol01
22G 3.2G 18G 16% /
tmpfs 1001M 0 1001M 0% /dev/shm
/dev/md0 194M 94M 90M 52% /boot
/dev/md2 20G 172M 19G 1% /oracle
/dev/md3 20G 172M 19G 1% /grid
I have used the same procedure to create the second node: rac11gnode2.example.com.
Here is the output of the ifconfig on the rac11gnode2:
[root@rac11gnode2 log]# ifconfig
bond0 Link encap:Ethernet HWaddr 00:0C:29:0B:05:39
inet addr:192.168.0.113 Bcast:192.168.0.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:fe0b:539/64 Scope:Link
UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1
RX packets:1125 errors:0 dropped:482 overruns:0 frame:0
TX packets:140 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:129564 (126.5 KiB) TX bytes:17156 (16.7 KiB)
bond1 Link encap:Ethernet HWaddr 00:0C:29:0B:05:43
inet addr:10.0.1.3 Bcast:10.0.1.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:fe0b:543/64 Scope:Link
UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1
RX packets:994 errors:0 dropped:476 overruns:0 frame:0
TX packets:26 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:115076 (112.3 KiB) TX bytes:4106 (4.0 KiB)
eth0 Link encap:Ethernet HWaddr 00:0C:29:0B:05:39
UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
RX packets:655 errors:0 dropped:0 overruns:0 frame:0
TX packets:152 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:77566 (75.7 KiB) TX bytes:19164 (18.7 KiB)
eth1 Link encap:Ethernet HWaddr 00:0C:29:0B:05:43
UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
RX packets:518 errors:0 dropped:0 overruns:0 frame:0
TX packets:26 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:62801 (61.3 KiB) TX bytes:4106 (4.0 KiB)
eth2 Link encap:Ethernet HWaddr 00:0C:29:0B:05:39
UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
RX packets:482 errors:0 dropped:482 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:52790 (51.5 KiB) TX bytes:0 (0.0 b)
eth3 Link encap:Ethernet HWaddr 00:0C:29:0B:05:43
UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
RX packets:476 errors:0 dropped:476 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:52275 (51.0 KiB) TX bytes:0 (0.0 b)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 b) TX bytes:0 (0.0 b)
And here the output of the df -h:
[root@rac11gnode2 log]# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/vg_rac11gnode2-LogVol01
22G 3.4G 18G 17% /
tmpfs 1001M 0 1001M 0% /dev/shm
/dev/md0 194M 94M 90M 52% /boot
/dev/md2 20G 172M 19G 1% /oracle
/dev/md3 20G 172M 19G 1% /grid
Now, when the 2 servers are ready, we can configure the OS and create the users:
[root@rac11gnode1 ~]# groupadd -g 500 oinstall
[root@rac11gnode1 ~]# groupadd -g 501 asmadmin
[root@rac11gnode1 ~]# groupadd -g 502 asmdba
[root@rac11gnode1 ~]# groupadd -g 503 asmoper
[root@rac11gnode1 ~]# useradd -m -g oinstall -G asmadmin,asmdba,asmoper -d /home/grid -s /bin/bash -c "Grid Infrastructure owner" grid
[root@rac11gnode1 ~]# id grid
uid=500(grid) gid=500(oinstall) groups=500(oinstall),501(asmadmin),502(asmdba),503(asmoper)
[root@rac11gnode1 ~]# passwd grid
Changing password for user grid.
New password:
Retype new password:
passwd: all authentication tokens updated successfully.
[root@rac11gnode1 ~]# groupadd -g 504 dba
[root@rac11gnode1 ~]# groupadd -g 506 oper
[root@rac11gnode1 ~]# useradd -m -g oinstall -G dba,oper,asmdba -d /home/oracle -s /bin/bash -c "Oracle software owner" oracle
[root@rac11gnode1 ~]# id oracle
uid=501(oracle) gid=500(oinstall) groups=500(oinstall),502(asmdba),504(dba),506(oper)
[root@rac11gnode1 ~]# passwd oracle
Changing password for user oracle.
New password:
Retype new password:
passwd: all authentication tokens updated successfully.
Install following packages:
Edit the /etc/sysctl.conf file and add following kernel parameters:
#Oracle specific stuff:
kernel.shmmax=4294967259
kernel.shmall=2097152
kernel.shmmni=4096
kernel.sem = 250 32000 100 128
fs.file-max=6815744
net.ipv4.ip_local_port_range=9000 65500
net.core.rmem_default=262144
net.core.rmem_max=4194304
net.core.wmem_default=262144
net.core.wmem_max=1048576
fs.aio-max-nr=1048576
Add user specific limits to the /etc/security/limits.conf:
oracle stuff:
oracle soft nofile 131072
oracle hard nofile 131072
oracle soft nproc 131072
oracle hard nproc 131072
oracle soft core unlimited
oracle hard core unlimited
oracle soft memlock 50000000
oracle hard memlock 50000000
grid soft nofile 131072
grid hard nofile 131072
grid soft nproc 131072
grid hard nproc 131072
grid soft core unlimited
grid hard core unlimited
grid soft memlock 50000000
grid hard memlock 50000000
[root@rac11gnode1 ~]# cat /etc/fstab
#
# /etc/fstab
# Created by anaconda on Mon Apr 1 17:47:19 2013
#
# Accessible filesystems, by reference, are maintained under '/dev/disk'
# See man pages fstab(5), findfs(8), mount(8) and/or blkid(8) for more info
#
/dev/mapper/vg_rac11gnode1-LogVol01 / ext4 defaults 1 1
UUID=7c5dbe51-e844-4330-9cf7-00b2321c6a2e /boot ext4 defaults 1 2
/dev/mapper/vg_rac11gnode1-LogVol00 swap swap defaults 0 0
tmpfs /dev/shm tmpfs defaults 0 0
devpts /dev/pts devpts gid=5,mode=620 0 0
sysfs /sys sysfs defaults 0 0
proc /proc proc defaults 0 0
/dev/md2 /oracle ext4 defaults 1 2
/dev/md3 /grid ext4 defaults 1 2
Output of the df -h:
[root@rac11gnode1 ~]# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/vg_rac11gnode1-LogVol01
22G 3.2G 18G 16% /
tmpfs 1001M 0 1001M 0% /dev/shm
/dev/md0 194M 94M 90M 52% /boot
/dev/md2 20G 172M 19G 1% /oracle
/dev/md3 20G 172M 19G 1% /grid
I have used the same procedure to create the second node: rac11gnode2.example.com.
Here is the output of the ifconfig on the rac11gnode2:
[root@rac11gnode2 log]# ifconfig
bond0 Link encap:Ethernet HWaddr 00:0C:29:0B:05:39
inet addr:192.168.0.113 Bcast:192.168.0.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:fe0b:539/64 Scope:Link
UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1
RX packets:1125 errors:0 dropped:482 overruns:0 frame:0
TX packets:140 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:129564 (126.5 KiB) TX bytes:17156 (16.7 KiB)
bond1 Link encap:Ethernet HWaddr 00:0C:29:0B:05:43
inet addr:10.0.1.3 Bcast:10.0.1.255 Mask:255.255.255.0
inet6 addr: fe80::20c:29ff:fe0b:543/64 Scope:Link
UP BROADCAST RUNNING MASTER MULTICAST MTU:1500 Metric:1
RX packets:994 errors:0 dropped:476 overruns:0 frame:0
TX packets:26 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:115076 (112.3 KiB) TX bytes:4106 (4.0 KiB)
eth0 Link encap:Ethernet HWaddr 00:0C:29:0B:05:39
UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
RX packets:655 errors:0 dropped:0 overruns:0 frame:0
TX packets:152 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:77566 (75.7 KiB) TX bytes:19164 (18.7 KiB)
eth1 Link encap:Ethernet HWaddr 00:0C:29:0B:05:43
UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
RX packets:518 errors:0 dropped:0 overruns:0 frame:0
TX packets:26 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:62801 (61.3 KiB) TX bytes:4106 (4.0 KiB)
eth2 Link encap:Ethernet HWaddr 00:0C:29:0B:05:39
UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
RX packets:482 errors:0 dropped:482 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:52790 (51.5 KiB) TX bytes:0 (0.0 b)
eth3 Link encap:Ethernet HWaddr 00:0C:29:0B:05:43
UP BROADCAST RUNNING SLAVE MULTICAST MTU:1500 Metric:1
RX packets:476 errors:0 dropped:476 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:1000
RX bytes:52275 (51.0 KiB) TX bytes:0 (0.0 b)
lo Link encap:Local Loopback
inet addr:127.0.0.1 Mask:255.0.0.0
inet6 addr: ::1/128 Scope:Host
UP LOOPBACK RUNNING MTU:16436 Metric:1
RX packets:0 errors:0 dropped:0 overruns:0 frame:0
TX packets:0 errors:0 dropped:0 overruns:0 carrier:0
collisions:0 txqueuelen:0
RX bytes:0 (0.0 b) TX bytes:0 (0.0 b)
And here the output of the df -h:
[root@rac11gnode2 log]# df -h
Filesystem Size Used Avail Use% Mounted on
/dev/mapper/vg_rac11gnode2-LogVol01
22G 3.4G 18G 17% /
tmpfs 1001M 0 1001M 0% /dev/shm
/dev/md0 194M 94M 90M 52% /boot
/dev/md2 20G 172M 19G 1% /oracle
/dev/md3 20G 172M 19G 1% /grid
Now, when the 2 servers are ready, we can configure the OS and create the users:
[root@rac11gnode1 ~]# groupadd -g 500 oinstall
[root@rac11gnode1 ~]# groupadd -g 501 asmadmin
[root@rac11gnode1 ~]# groupadd -g 502 asmdba
[root@rac11gnode1 ~]# groupadd -g 503 asmoper
[root@rac11gnode1 ~]# useradd -m -g oinstall -G asmadmin,asmdba,asmoper -d /home/grid -s /bin/bash -c "Grid Infrastructure owner" grid
[root@rac11gnode1 ~]# id grid
uid=500(grid) gid=500(oinstall) groups=500(oinstall),501(asmadmin),502(asmdba),503(asmoper)
[root@rac11gnode1 ~]# passwd grid
Changing password for user grid.
New password:
Retype new password:
passwd: all authentication tokens updated successfully.
[root@rac11gnode1 ~]# groupadd -g 504 dba
[root@rac11gnode1 ~]# groupadd -g 506 oper
[root@rac11gnode1 ~]# useradd -m -g oinstall -G dba,oper,asmdba -d /home/oracle -s /bin/bash -c "Oracle software owner" oracle
[root@rac11gnode1 ~]# id oracle
uid=501(oracle) gid=500(oinstall) groups=500(oinstall),502(asmdba),504(dba),506(oper)
[root@rac11gnode1 ~]# passwd oracle
Changing password for user oracle.
New password:
Retype new password:
passwd: all authentication tokens updated successfully.
Install following packages:
- binutils-2.17.50.0.6
- compat-libstdc++-33-3.2.3
- compat-libstdc++-33-3.2.3 (32 bit)
- elfutils-libelf-0.125
- elfutils-libelf-devel-0.125
- elfutils-libelf-devel-static-0.125
- gcc-4.1.2
- gcc-c++-4.1.2
- glibc-2.5-24
- glibc-2.5-24 (32 bit)
- glibc-common-2.5
- glibc-devel-2.5
- glibc-devel-2.5 (32 bit)
- glibc-headers-2.5
- ksh-20060214
- libaio-0.3.106
- libaio-0.3.106 (32 bit)
- libaio-devel-0.3.106
- libaio-devel-0.3.106 (32 bit)
- libgcc-4.1.2
- libgcc-4.1.2 (32 bit)
- libstdc++-4.1.2
- libstdc++-4.1.2 (32 bit)
- libstdc++-devel 4.1.2
- make-3.81
- sysstat-7.0.2
- unixODBC-2.2.11
- unixODBC-2.2.11 (32 bit)
- unixODBC-devel-2.2.11
- unixODBC-devel-2.2.11 (32 bit)
Edit the /etc/sysctl.conf file and add following kernel parameters:
#Oracle specific stuff:
kernel.shmmax=4294967259
kernel.shmall=2097152
kernel.shmmni=4096
kernel.sem = 250 32000 100 128
fs.file-max=6815744
net.ipv4.ip_local_port_range=9000 65500
net.core.rmem_default=262144
net.core.rmem_max=4194304
net.core.wmem_default=262144
net.core.wmem_max=1048576
fs.aio-max-nr=1048576
Add user specific limits to the /etc/security/limits.conf:
oracle stuff:
oracle soft nofile 131072
oracle hard nofile 131072
oracle soft nproc 131072
oracle hard nproc 131072
oracle soft core unlimited
oracle hard core unlimited
oracle soft memlock 50000000
oracle hard memlock 50000000
grid soft nofile 131072
grid hard nofile 131072
grid soft nproc 131072
grid hard nproc 131072
grid soft core unlimited
grid hard core unlimited
grid soft memlock 50000000
grid hard memlock 50000000