Forums | Aggregator | Books | Industry News | Firefox Plugins | Social | Links

Comments

Oracle Database 11g Release 2 RAC On Linux Using VMware Server 2 - This article describes the installation of Oracle Database 11g release 2 (11.2) RAC on Linux (Oracle Enterprise Linux 5) using VMware Server 2 with no additional shared disk devices.



Niall Litchfield said...

nice article again Tim. I tend these days not to manually configure kernel limits and packages but let the Oracle validated rpm do it for me. http://oss.oracle.com/el5/oracle-validated/

Tim... said...

Hi.

I guess I should get with the now and use it. I just get nervous about using something with a date of "30-Mar-2009" for a product that has just been released. :)

Cheers

Tim...

lesio said...

Great article. You are Simply the Best.

Eric said...

Might want to check out my 4-node 11gR2 video; 4GB Ram for the host, dual core notebook... VMWare Fusion as the VM platform.

http://www.youtube.com/watch?v=dByvabeVXf0

Cheers!
Eric

syed said...

i have successfully install 2 rac. i used 4gig ram and allocate 1024 meg RAM for each node. the instance is very slow. how much memory can i allocate to each node improve the performance
Thanks in advance
syed

Tim... said...

Hi.

If it is a 32-bit host system, I wouldn't allocate any more memory.

If it is a 64-bit host system, you could maybe allocate another 512M of memory to each node, leaving 1G for the host OS.

Remember, a lot of the speed problem will be down to running the host and 2 VMs off a single disk, and CPU will probably be a factor also.

This type of setup is just for playing with RAC. It is not a production solution unless you have lots of hardware, like separate disk arrays for each VM and lots of CPUs.

Cheers

Tim...

Karthik said...

Tim,

Could find 'NO' bettet document than this for RAC install on VM, hats off to you for sharing this.

- Karthik

Abdelfettah said...

Very good article, Thanks a lot.

karthik said...

Grid infrastructure got stuck and did not copy any files to rac2 node.

any clue?


Jos said...

Tim,

Thanks again for this great document !! My test 11g cluster is up and running.

Also some credits to Oracle, this install was so much easier than the 10.2 version.

- Jos , Den Haag

Manny said...

Thanks so much for this

Anybody figured out solution to all the disk problems when using Windows as HOST instead of Linux?

Thanks

Tim... said...

Andre: I'm deleting your comments because they are huge, containing cut & pastes of the original article and in most cases I think they are irrelevant and confusing to other readers.

To summarize your points:

1) "rpm -Uvh elfutils-libelf-devel-0.*" gives errors. Your fix seems pointless since you can do the same easier by switching to "rpm -Uvh elfutils-libelf-devel-* ". I've changed the article to include this fix, not yours.

2) "service ntp restart" is typo. I corrected with "service ntpd restart"

3) You have dependency issues when installing AMSLib. Your issues are based around the fact you are using the Xen kernel, which is not the standard for a VMware installation, so your issues are not related to this article and the approach it uses, so I've deleted that post. If you use the standard kernel the article works fine.

Note. I ran through the installation this morning using OEL 5.4 (I originally used OEL 5.3). I've amended the article to show the kernel versions and ASM installation for 5.4. You'll see it works fine and there is no mention of Xen in the running kernel. :)

Cheers

Tim...

lopyuan said...

Why does not ssh configuration?
my.oiloem@gmail.com

Tim... said...

Hi.

If you check out the grind installation you will see that the SSH configuration is done there, so you don't need to do it manually before.

Cheers

Tim...

Rafiq said...

Tim,

Thanks for putting a good article for Linux as host operating system.

Any article for Windows 7 ultimate as host operating system and vmware 7.0 workstation.

Tim... said...

Hi.

I don't use Windows, so the answer is no. :(

Cheers

Tim...

Lesio said...

Have You got plans to start using VirtualBox ?

Tim... said...

Hi.

I use it on my laptop. Unfortunately it doesn't support disk sharing between VMs, so you can only do NFS RAC installations, not ASM ones.

Cheers

Tim...

Lesio said...

Yes You are right but small article with iscsi openfiler 3 virtual box machines would be nice :) and trendy :o)

Tim... said...

Jeffrey Hunter has done one of those I think.

Cheers

Tim...

Ron said...

Tim
I have used nfs to supply disks for ASM.
In the NFS directory create some "disks".
These can then be presented to ASM as devices.
I use VMware workstation and this is my work around the disk sharing.

$dd if=/dev/zero of=file_dsk1 bs=1k count=10000000
$dd if=/dev/zero of=file_dsk2 bs=1k count=10000000
$dd if=/dev/zero of=file_dsk3 bs=1k count=10000000
$dd if=/dev/zero of=file_dsk4 bs=1k count=10000000
$dd if=/dev/zero of=file_dsk5 bs=1k count=10000000
$dd if=/dev/zero of=file_dsk6 bs=1k count=10000000
$dd if=/dev/zero of=file_dsk7 bs=1k count=10000000
$dd if=/dev/zero of=file_dsk8 bs=1k count=10000000

Nafey said...

I just finished installing and configuring 11gR2 RAC, using this article. Nice post as usual.

I used the Oracle validated RPM, but still i had to change some of the semaphore settings.

Tom said...

Hi,

did anybody try to use host system win vista and on the guest linux. i still have problem to mount shared devices on the linux.
Regards,
Tom

Andrei said...

Hi,

Database configuration Assistant failed with the following errors:

ORA-19624: operation failed, retry possible
ORA-19870: error while restoring backup piece /u01/app/oracle.../Seed_Database.dbf
ORA-19504: failed to create file "+DATA"
ORA-17502: ksfdcre:4 Failed to create file +DATA
.....
ORA-15055: unable to connect to ASM instance
ORA-27300: os system dependent operation:invalid_egid failed with status: 1
ORA 27301: OS failure message: Operation not permitted
....

Somebody has any idea what's wrong?

Thanks,
Andrei







Tim... said...

Hi.

That looks pretty awful. It's not started an ASM instance, which means any subsequent operation to create the database will fail.

My first suggestion would be to confirm ASM is running before attempting a database creation.


Please don;t ask questions here. That's what the forum is for. These comments are just for things like pointing out typos etc.

Cheers

Tim...

Suchi said...

Hi,

Can you please let me know which updates you are using with OEL? This document mention about OEL 5 only but no update details.

Earlier I was trying to use OEL 5 update 5 but it creates problem for WEB Access VM , I read some where that this is happend after OEL 5 update 3. so please confirm me which update I have to use with OEL.

Thanks...

Tim... said...

Hi.

I wronte the article against 5.4:

[root@rac1 ~]# cat /etc/redhat-release
Red Hat Enterprise Linux Server release 5.4 (Tikanga)
[root@rac1 ~]#

Cheers

Tim...

Suchi said...

Hi Tim,

Thanks for the information.

Is this same setup worked on OEL5.3? Do you have any idea?

Don't you face any VM webaccess crash issue with OEL 5.4?

Thanks...

Tim... said...

Hi.

I've done it on 5.3 and 5.4 with no problems. Never tried 5.5.

Cheers

Tim...

Suchi said...

Thanks again for reply.

I hv gone through OEL 5.5 and facing issue in VM WEBACCESS service (ServiceNotAvailableException: web service not available)at every few mins. when googling I came to know that this is might be because of 5.5. So just think to take one step back and verify.

find the below link from google and apply solution1 and 2 both one by one but no luck :(
http://webalution.com/techshare/2009/11/16/vmware-server-2-web-access-connection-loss-vmware-hostd-crash-workarounds/


Anyways I'll try on OEL5.2 now and let you know it success or not.

Thanks...



Tim... said...

Hi.

Sorry. I misunderstood. You are talking about a VMware on OEL5.5 issue, not an Oracle on 5.5. issue. :)

Yes. I did have this problem with my host on anything over 5.3. The solution is pretty simple though.

http://www.oracle-base.com/blog/2009/12/15/vmware-server-2-x-on-centos-5-4-problems/

Cheers

Tim...

Zoran said...

Hi,

Thank you for this great Article!!!

I want to know, what other configuration should I do for my network to work (I have done everything you said, but I get "Destination host unreachable").

My Host and guests os are OEL 5.5

Got one physical ethernet adapter (not connected to anything, planning to connect it directly to my laptop).

Thank you in advance!

Zoran

Tim... said...

Hi.

The bridged connections rely on the fact you are connected to a network. What's more, there must be a default gateway for the network or it won't work.

If you are not using a real network, you will have to try with the host-only adapters, rather than bridged. I've never done this, but I've heard it works.

Cheers

Tim...

Amit Kumar said...

Here my redhat VM on two different ESX server but both are in same subnet and i am able to ping both VM's from both VM's.

Everything going fine but when i ran the root.sh on rac2 machine then root.sh show some failed messages i.e.

====================================================
Preparing packages for installation...
cvuqdisk-1.0.7-1
Configure Oracle Grid Infrastructure for a Cluster ... failed
=====================================================

Root.sh also not identified the rac1 node on rac2 machine

i have executed the below command

./olsnodes
rac1

But it shows the only one node instead of two node.

Please check the attached output of root.sh which was ran on rac2 vm

Please let me know if i have miss anything.

Thanks,
-Amit

bassam said...

i got this error when trying to run root.sh on 1st node:

Waiting for the Oracle CRSD and EVMD to start
Timed out waiting for the CRS stack to start.

Any ideas?
thanks in advance

Farooq said...

I am trying to install clusterware 11gR2 on EL 5. I don't wanna use the ASMLib. But during the installation I am unable to view the disks for ASM. I also tried changing the Disk Discovery Path for disks, but it didn't work. I have read somewhere that i need to change the ownership of the disks to oracle:oinstall.

Though the procedure worked for me, but still it does not seem appropriate to me. I just wanna make sure that am i doing it right, so if there is some other workaround.

Cheers,
Farooq

Tim... said...

Hi.

Changing the discovery string is correct. That is how you tell ASM where the disks are.

In 11gR2 you definitely need to use ASMLib. From 10gR2 onwards it is the recommended approach. It also means you don;t have to alter the discovery string.

Cheers

Tim...

DaHoracle said...

Muito bom o artigo.

David said...

Hi Tim,

I am wondering how many network cards needed on the physical host machine for RAC installation on OEL 5.5 with 2 nodes? (I assume scan IPs are also public).

Public IPs: 2 (one for each node)
Private IPs: 2 (one for each node)
Virtual IPs: 2 (one for each node)
Scan IPs: 3 (always 3, regardless of number of RAC nodes).

Thanks for your help.

David said...

Hi Tim,

Could you please tell what Linux your host OS is?

Thank you,

David

Tim... said...

Hi.

For the VMware RAc you only need 1 physical network card on the host machine. When you create the VMs you create each with 2 virtual network cards. 1 for public addresses, 1 for private addresses.

It's all explained in the article.

Cheers

Tim...

Tim... said...

Hi.

By the way, I use CentOS 5 for my OS. It's a RHEL5 clone. I've done this installation on all versions from 5.3 to 5.5.

Now I've stopped using VMware Server and I use VirtualBox.

http://www.oracle-base.com/articles/11g/OracleDB11gR2RACInstallationOnOEL5UsingVirtualBox.php

It's free and I think it's easier to use than VMware Server.

Cheers

Tim...

David said...

Hi Tim,
Thank you so much for your help! But I have one more question on running the RAC on our corporate network:
Do those 3 SCAN IPs need be mapped to one Full qualified domain name in our Corporate DNS server? i.e. I need to send a request to our IT department to configure the DNS server by providing 3 Static IP addresses and a Virtual Hostname, then the FQDN will be used for clients to connect to the RAC. May I know if my understanding is correct?

Best regards,
-David

Tim... said...

Hi.

Yes. You have to have a a fully qualified name for the SCAN and that must point to 3 IP addresses in a round-robin. On BIND I configure it like this:

http://www.oracle-base.com/articles/linux/DnsConfigurationForSCAN.php

Cheers

Tim...

David said...

Hi Tim,

If I run the RAC on our corporate network using the corporate DNS server, when (which phase of the install)and how can I define those three SCAN IPs and the corresponding hostname?

Best regards,
-David

Tim... said...

For ths SCAN to get consifured correctly during the installation you need to have it done before you start the grid installation.

Cheers

Tim...

Arup Nanda said...

Excellent article, as always, Tim. Question: why did you define both the network adaptors as "Bridged"? Shoudn't the interconnect (eth1) be defined as "HostOnly"?

Tim... said...

Hi.

The only reason I used bridged for everything is it makes it function like a "real" network card as far as the OS is concerned. It isn't using NAT or being forced onto the host-only network.

I'm sure it will function just fine with host-only, but if you were in a situation where you wanted to run nodes on different host servers (using real shared storage), the nodes would not be able to talk to each other if they were using host only.

If I needed to run a RAC demo while not connected to network, then I would have to use host-only, but for machines at home, I always use bridged.

Cheers

Tim...

Mike said...

Hi Tim,

Great Article. I am using OEL 5.5.

My /u01/app/11.2.0/grid/root.sh takes about 15-20 minutes to run. Is that normal? Host OS = Windows 7 , with a Quad Core CPU and 4gb of memory.

The first node normally runs ok, and then the second node complains after evmd has started, about timeouts.....

Just want to know if the length of time taken to run is normal or whether I should be troubleshooting performance issues...

Thanks

Mike

Tim... said...

Hi.

You have 4G of RAM on the host. You need 2G of RAM for each VM. That means you are leaving 0G RAM for the host. Can you not guess why it is so slow? You are probably doing all host OS operations using swap.

I said at the start of the article, "I completed this installation on a Quad-Core processor with 8G of memory". By my thinking, you are going to need at least 6G RAM on your host to make this work at any sort of speed.

Cheers

Tim...

Jyoti said...

Hi Tim,

I have 16GB RAM in my Lenovo w510 workstation. I installed OEL 64-bit and VMware 64-bit rpm by following your article. I created my first RAC1 node but getting an unusal error. I follow exact steps and select 64-bit OEL5 LINUX version. When I am trying to boot with 64-bit DVD getting an error that my CPU does not support 64 bit and long mode. It it is true then my host system is already 64-bit and running 64-bit vmware.

Is there any tweak needs to be done in VMware Server to resolve this issue. Please advise.

I like your site and simplcity in your articles.

Thanks
Jyoti

Tim... said...

Hi.

See my comment on the forum:

http://www.oracle-base.com/forums/viewtopic.php?f=1&p=30294#p30294

Cheers

Tim...

Lazar said...

Hi tim I installed OEL5 and 11g R2 Infrastructure on with no problem on VM Ware server 2.0.2 (Windows7 host). The issue comes once I start RAC installation. Everything works fine untill of middle of DB creation. Then bot VM instances failed. The error is:
NOT_IMPLEMENTED ... bugNr=41568
I've read that solution/work around would be put following line in both vmware instance vmx file
reslck.timeout="1200"

But this didn't help at all.
Another suggestion from below link didn't help at all VMWare instances craches with the same error http://www.stress-free.co.nz/vmware_server_20_optimisations

Do you have any suggestion?
Thanks,
Lazar

syed said...

Hi tim,
I am trying to install 11gR2 on window 7 host using vmware 7.1 workstation and oe linux 5.4 guest. Now i am having issue whole installing vmware tool . the package is showing vmware tool 8.4.5 -324285.tar.gz. when i try to install . itsay no package is for install. any idea
thanks
syed

syed said...

i have figure it out. there is bug with vm workstation 7.1 while instaling the vmtool for linux guest. the vmtool file create a folder with space (forma). so just copy the the file to tmp folder and unzip and untar and install will work.
thanks
syed

kelvin said...

hi thank u 4 the note man
but i have some issue with SCAN how will i be able to configure that without using DNS

Tim... said...

Hi.

If the SCAN does not work you can still access the nodes using the VIPs in your tnsnames.ora file as you would any RAC prior to 11.2.

Cheers

Tim...

kelvin said...

still not able to resolve scan and i don't want to use dns and dhcp

Tim... said...

Hi.

If you have single entry in the /etc/hosts file for the SCAN it will install and work, but you will not have the SCAN functionality working properly, as stated in the article.

If you have any specific questions, please post them in the forum, not here.

Cheers

Tim...

john said...


Preparing to launch Oracle Universal Installer from /tmp/OraInstall2011-05-30_03-28-30AM. Please wait ...
Error in writing to directory /tmp/OraInstall2011-05-30_03-28-30AM. Please ensure that this directory is writable and has atleast 60 MB of disk space. Installation cannot continue.

john said...

i trying to install oracle dba in rhel5.4 but i got errors ..plz slove and send to john97009@gmail.com
Preparing to launch Oracle Universal Installer from /tmp/OraInstall2011-05-30_03-28-30AM. Please wait ...
Error in writing to directory /tmp/OraInstall2011-05-30_03-28-30AM. Please ensure that this directory is writable and has atleast 60 MB of disk space. Installation cannot continue.

Tim... said...

Hi.

1) No questions in the comments. That's what the forum is for!

2) The error message is telling you exactly what yo do.

Cheers

Tim...

young said...

I follow this doc to implement ..

I don't Install VMware Client Tools then did create share disk ..,


I got error msg : can't create share disk when execute below item

., something wrong for this condition ???

-:) said...

Tnx man. It is very useful for me.

Ivo said...

Hi Tim,
Everything was going smoothly untill...
[root@rac1 rpm]# rpm -iv cvuqdisk-1.0.9-1.rpm
error: Failed dependencies:
libc.so.6(GLIBC_2.2)(64bit) is needed by cvuqdisk-1.0.9-1.s390x

I installed Enterprise-R5-U6-Server-x86_64 and was using linux.zseries64_11gR2_grid to install cvuqdisk.
Which version did you use? Or is there something else wrong?

Tim... said...

Hi.

Not sure why you are using Linux for zseries, when you are doing an x86_64 linux installation on VMware. :)

I just used the rpm that came with the x86_64 grid installation media.

Cheers

Tim...

saikumar said...

Hi Tim,
I followed your article and tried to install but during the grid installation( while execute the root.sh on second node) i got error like the ora.scan1.vip was failed becoz that scan ip was already used in the network,here i noticed ip was already used..so do i need to change the scan ip after cloned the first node which i used as second node??please suggest ( saikumar.ft@gmail.com)

Tim... said...

Hi.

No. Setting should be the same on both servers. Scan listener will only start on one server unless you use proper DNS config.

Never seen show-stopper errors by using hosts file. Only the error shown in the article. Safer to use DNS.

Cheers

Tim...

tjay said...

Hi Tim


root.sh successfully executed on node1 however, I am getting below error on node2.

Any idea what the issue might be ?

CRS-2676: Start of 'ora.cssd' on 'rac2' succeeded
CRS-2672: Attempting to start 'ora.ctssd' on 'rac2'
CRS-2676: Start of 'ora.ctssd' on 'rac2' succeeded
Disk Group DATA already exists. Cannot be created again
Configuration of ASM failed, see logs for details

Tim... said...

Hi.

Read the big red writing above. Questions in the forum.

Cheers

Tim...

tjay said...

Thanks Tim,
Ive posted my question in the forum.
Sorry for the inconvinience

Brij said...

Very well written article.thanks for taking out time and crafting this useful doc.

Jay said...

so no tech talk here ha?

Tim... said...

Hi.

The forum is a better place for questions and discussions. :)

Cheers

Tim...

Shawn said...

Machine Config: Dell T300, 24GB RAM, 1 cpu quad core-64bit-VT capable
Oracle VM VirtualBox 4.3.2
Host OS : Windows Server 2012
Guest OS Oracle Linux 5.7

My Oracle Linux installation is failing with a message:
Your CPU does not support long mode. Try 32 bit...

CAN SOMEONE HELP?


Tim... said...

Hi.

Check in the BIOS that VT support is actually enabled. Some BIOS have it disabled by default.

Cheers

Tim...

DO NOT ask technical questions here! They will be deleted!

These comments should relate to the contents of a specific article. Constructive criticism is good. Advertising and offensive comments are bad and will be deleted!

Add your comments here.
Name
Comment
(max 400 chars - plain text)