Forums | Aggregator | Books | Industry News | Firefox Plugins | Social | Links

Comments

Oracle 10g RAC On Linux Using VMware Server - This article describes the installation of Oracle 10g release 2 (10.2.0.1) RAC on Linux (CentOS 4) using VMware Server with no additional shared disk devices.



Stefano said...

This article captured my intention but you should improve its quality describing all the necessary actions e.g. setup of SSH or RSH for Oracle Clusterware. I prefer the article "Building a laptop RAC" from Dizwell combined with official guide Part Number B14203-08.

Stefano Cinquegranelli
stecinq@yahoo.com
9i OCP
Roma - Italy

Tim... said...

Hi.

The article already includes the installation and configuration of RSH. As for SSH, this is installed by default on this version of Linux, so I don't really see how you can need more information.

Both myself and others have completed the installation with no additional information, so I guess you've either missed out some steps, or made some mistakes. Anyway, If you prefer Howards document, then by all means use that, although it is actually a different installation. Howard runs two instances on a single virtual machine. Mine uses two virtual machines, one instance on each.

Cheers

Tim...

Stefano said...

Hi Tim.

I was able to install but, as you predicted, with some troubles. You don't tell that CentOS has two versions of rsh or how to check whether rsh and user equivalence are working properly while Howard's article does. Unfortunately, this was my very first approach with CentOS and RAC 10g.

My compliments for becoming Ace of the year and thanks for sharing your expertise with us.
Regards.

Stefano

Tim... said...

Hi.

Thanks for the compliments. :)

The installation instructions given in the article install both rsh and rsh-server. If you follow the instructions as they are written, you will have installed both. I'll add a comment in the article to say so.

If you set up the user equivalence as instructed, it will work. I think where you may be confused is in setting up user equivalence SSH for. This is only necessary if you don't want to use rlogin to copy files between nodes during the installation. Personally, I'm not so paranoid about security on a a test cluster using VMware, so I went for the simpler rlogin approach. The SSH setup is not necessary to get the system working.

Cheers

Tim...

vish said...

Tim,

thanks for such a good article. I was trying to install it and the crs installation fails every time saying "Cluster verification failed". I have synchronized the time between the host and the guest OS and it worked prefectly after that.

Here is what i got from

http://www.oracle.com/technology/pub/articles/chan-ubl-vmware.html

to synchronize the time between the nodes.

------------------------

Synchronize Guest OS time with Host OS. When installing the Oracle Clusterware and Oracle Database software, the Oracle installer will initially install the software on the local node and then remotely copies the software to the remote node. If the date and time of both RAC nodes are not synchronized, you will likely receive errors similar to the one below.

"/bin/tar: ./inventory/Components21/oracle.ordim.server/10.2.0.1.0: time
stamp 2006-11-04 06:24:04 is 25 s in the future"

To ensure a successful Oracle RAC installation, the time on the virtual machines has to synchronize with the host machine. Perform the steps below to synchronize the time as the root user.

1. Execute “vmware-toolbox” to bring up the VMware Tools Properties window. Under the Options tab, select Time synchronization between the virtual machine and the host operating system. You should find the tools.syncTime = "TRUE" parameter appended to the virtual machine configuration file, d:\vm\rac\rac1\Red Hat Enterprise Linux 4.vmx.
2. Edit /boot/grub/grub.conf and add the options, "clock=pit nosmp noapic nolapic" to the line that reads kernel /boot/. You have added the options to both kernels. You are only required to make the change to your specific kernel.

#boot=/dev/sda
default=0
timeout=5
splashimage=(hd0,0)/boot/grub/splash.xpm.gz
hiddenmenu
title Enterprise (2.6.9-42.0.0.0.1.ELsmp)
root (hd0,0)
kernel /boot/vmlinuz-2.6.9-42.0.0.0.1.ELsmp ro
root=LABEL=/ rhgb quiet clock=pit nosmp noapic nolapic
initrd /boot/initrd-2.6.9-42.0.0.0.1.ELsmp.img
title Enterprise-up (2.6.9-42.0.0.0.1.EL)
root (hd0,0)
kernel /boot/vmlinuz-2.6.9-42.0.0.0.1.EL ro root=LABEL=/
rhgb quiet clock=pit nosmp noapic nolapic
initrd /boot/initrd-2.6.9-42.0.0.0.1.EL.img

3. Reboot rac1.

# reboot

----------------

Just an FYI for someone out there who might be getting the same error.

Again, thanks for such a good article Tim. keep up the good work.

Regards,
vish.
http://oracleplz.blogspot.com/

Philani said...

This is the error i get when i try to install an agent in the enterprise manager grid control:

this is the error massage: SSH User equivalence is not set up on the remote nodes

Tim... said...

Hi.

Questions in the forum please, not in the comments. It says that in big letters!

This is not an article about installing Grid Control, it's an article about installing RAC on VMware for messing about.

I've not tried adding Grid Control into the mix, and quite frankly, I wouldn't bother on this type of test system.

If you read the article, you'll notice I'm using RSH for inter-node communication, not SSH. As a result, I've not bothered to set up SSH User equivalence because I don't need it. If you want to use SSH you will need to set it up. A process which is explained in the Oracle installation documentation.

Cheers

Tim...

Boban said...

Hi Tim

I never installed an Oracl RAC before, but with your help I did within one day... with some litle problems :)

thanks a lot for sharing your expertise with

Cheers
Boban

Richard said...

Great article!

It works "as advertised" and I highly recommend it.

Nayyar Ahmad said...

Very cool article, i am just having error while running clusterware installer.
$./runinstaller

"Error in writing to directory /tmp/OraInstall. Please ensure that this
directory is writable and has atleast 60 MB of disk space. Installation
cannot continue."

any idea !

TIA

Tim... said...

Hi.

Please ask questions on the forum!

Without meaning to sound stupid, have you checked the amount of free space in the /tmp directory? Is it writable for your user?

Cheers

Tim...

Linus said...

Thanks for an excellent article, worked like a charm!
Cheers
Linus

Anil Chanda said...

Very good article. I tested this on RHEL3U9 (runlevel 3) with OCFS1/ASMLIB/ASM works good with less load on system. (Laptop).

A Big Thank you. :-)




Ben Prusinski said...

Tim,

I could not get the CRS software to work when I ran the CRS runinstaller. It failed on the VIP even though Oracle is supposed to use VIPCA script after CRS installation to configure the two VIPs. So I am not sure how to get past this issue?

Tim... said...

Questions in the forum not in the comments!

The CRS installer will fail if the ping test for the public and private networks. In addition, the virtual IP address must be on the same subnet (xxx.xxx.xxx.0) as the public address.

If you've followed my article, this should be a problem. If you've altered any addresses, you've probably made a mistake.

If this needs any followup, please add it to the forum. I don't deal with technical questions here.

Cheers

Tim...

Walter said...

Fabulous effort. Apparently windows can't handle to processes writing to the same file well which is why the cluster falls over. You need to create a third machine as a NAS to do the IO for the nodes.

mmpdba said...

Great help in creating vm!

Thanks a lot.

balbir said...

Very good article Tim...it helped me a lot ... i am a new dba and this article was helpful...however i have one problem.. i have made the RAC machines and is ready to install oracle clusterware but the clusterware and databse installation files that i downloaded are on my c drive , how can i copy them to RAC1 machine...Pls Help....

~jb said...

Hi Tim,
Excellent article, very well explained.
I went to a lot of issues to install the Cluster, now it seems to work ^^ the most blocking issue was time drifitng and hosts not well sync'd, you should add some tips in your procedure ;)

Next step will be to setup the db on top of the cluster.

Thanks again!

ardee said...

Hello

Is this Solution Oracle certified?

Thanks

oravn.com said...

Found 2 mistakes from your article:

1. Run the following commands and add them the /etc/rc.local file.

chown oracle:oinstall /dev/raw/raw1
chown oracle:oinstall /dev/raw/raw2
chown oracle:oinstall /dev/raw/raw3
chown oracle:oinstall /dev/raw/raw4
chown oracle:oinstall /dev/raw/raw5

=> This command use the Unix syntax,
on Linux, change to:

chown oracle.oinstall /dev/raw/raw1
chown oracle.oinstall /dev/raw/raw2
chown oracle.oinstall /dev/raw/raw3
chown oracle.oinstall /dev/raw/raw4
chown oracle.oinstall /dev/raw/raw5

2. Login as the oracle user and add the following lines at the end of the .bash_profile file.

This line:

PATH=/usr/sbin:$PATH; export PATH

I think, you want to overwrite the PATH order to run rsh/rlogin commands !?

But, on CentOS4, we can locate rsh/rlogin from /usr/bin
=> So, this line must change to:

PATH=/usr/bin:$PATH; export PATH


aki said...

Hi,

I am having some trouble starting both VM's.

1 starts ok but when I try to start second one, VM fails and it complains about orc.vmdk file and not being able to create a lock on that file.

"Cannot open the disk 'H:\VMWare_Virtual_Data\shared\orc.vmdk' or one of the snapshot disks it depends on. Reason: Failed to lock the file."

Norm said...

Thanks very much for all of the work that you put into documenting this procedure. It greatly simplified setting up an inexpensive test system.

Iqbal Aulakh said...

Hi Tim

First of all, i want to appreciate you to put RAC Creation documents and are awasome.

Just want to add one thing, if you feels it will help more.

During the cluvfy.sh script execution, it will give some erros, which can be ignored (error related to VIP Interface and for the compat* packages.

Here are the details
=====================================

ERROR:
Could not find a suitable set of interfaces for VIPs.

Result: Node connectivity check failed.
this error can be safely ignored.

The last set of errors that can be ignored deal with specific RPM package versions that do not exist in RHEL4 Update 5. For example:


compat-gcc-7.3-2.96.128
compat-gcc-c++-7.3-2.96.128
compat-libstdc++-7.3-2.96.128
compat-libstdc++-devel-7.3-2.96.128

While these specific packages are listed as missing in the CVU report, please ensure that the correct versions of the compat-* packages are installed on both of the Oracle RAC nodes in the cluster. For example, in RHEL4 Update 5, these would be:


compat-gcc-32-3.2.3-47.3
compat-gcc-32-c++-3.2.3-47.3
compat-libstdc++-33-3.2.3-47.3
compat-libstdc++-296-2.96-132.7.2


Thanks
Iqbal

Anonymous said...

Many steps are missing. We can't install following the steps given. It is frustating to have some steps missed having given step by step

Thanks.

Tim... said...

Hi.

I've done this installation many times. No steps are missing. It works fine.

Cheers

Tim...

Anonymous said...

Tim,

1.When I followed the exact steps it complained that disks are not configured for cluster installation. For that we may have to establish user equivalency.
2.runcluvfy have to be run after extracting from the software disk. Otherwise it complains no such file.
3. Some how I was not able to see root.sh and other scripts by the root user.But able to see by Oracle user.

Regards.

Tim... said...

Hi.

1) I don't get this problem.
2) Don't understand what you mean by this. Running runcluvfy is not a mandatory step.
3) Doesn't make sense at all. How can root not be able to see files. Sounds very fishy to me.

Sounds like you have something fundamentally wrong with your disk setup. I've done this installation many times and never experienced any of these problems.

Cheers

Tim...

Tim... said...

Just another thought. Many people have had problems with setting up shared disks when they are using Windows as the host OS. I never use Windows as the host OS, so I would not see these sort of issues.

Cheers

Tim...

anonymous said...

Thanks for your input.

1. 3rd step, unless I repeat the whole process again, I can't confrim.

2.When we are following the step by step procedure, when a script is not found it creates doubt where went wrong.

3. I don't know host make difference.

Regards.

Tim... said...

There is nothing in the VMware documentation to suggest the host OS should make a difference, but I've heard plenty of people have problems when using Windows as the host OS, who then switch to Linux as the host OS and install it all fine.

As I said before, I never use Windows as the host OS, so I can't comment on this from experience.

Forgot to mention, the user equivalence is unnecessary as this install uses RSH, not SSH for the remote operations. Both methods are supported for 10g and RSH is the one I used in this guide.

So in summary, if you are using 10g on RHEL4 (or a clone) with VMware 1.x this should be fine and has done repeatedly for me.

Cheers

Tim...

Anonymous said...

Thank you, Tim.

Regards.

Nirav said...

Nice job friend!

Thank you for sparing time for helpful blog to all..! Appreciate it.


Marcelo C. Martins said...

Hi Tim

I'm trying to install 10GR2 RAC on VMWARE ESX, but I', having problem in configuring shared disks. I tried the configurations you used in VMWARE SERVER but it didn't work. Do you have any tips for my configuration ?

Thanks a lot

Nikhil Mistry said...

Hi Tim,
I want your guidence selecting a hardware for this home project, I want to use RAC witht three node for database and also want to use same PC for add some oracle Application nodes too. can you suggest Hardware requirements including firewire or netcard etc, also can I get bye choosing common Pc over the Server?

Tim... said...

Questions in the forum please...

That's a lot of nodes, so it will require a lot of resource, even when it is doing very little. I think you may need something bigger than a 2 CPU box for that. Problem is I have no idea what your workload is and what performance you need/expect.

Looks like a server job to me though.

If you have any more questions, please open a thread on my forum.

Cheers

Tim...

Babu said...

Very nice article....

Uspeed said...

I stumble upon this architect, but why you want to use RAC in one server? It does not solve any purpose from infrastructure standpoint. Correct me if I am wrong

Tim... said...

Hi.

It's not a production solution, but some people want to play with RAC at home, or demo it, so it's handy to be able to run it on a laptop. :)

Cheers

Tim...

Dominica said...

Hi Tim,

Thank you for this article. I am so confuse about how to install RAC on virtual machine before reading your article. I have not tried yet, but thank you for your time to make this article. Now, the whole process is much clear to me.

Dominica L.

nishanth said...

can you please get me the syntax for checking LINUX VERSION and bits of OCA and OCP ..

to: n439@ymail.com

Tim... said...

Hi.

Linux version: # cat /proc/version

Bits of OCA/OCP? You need to buy study guides, or use the online manuals to learn that stuff. Trading copyright material is a crime, so please don't ask people on this site to supply you with copyright material.

Cheers

Tim...

AdrianaMILLER said...

One understands that today's life is very expensive, however people need money for different stuff and not every one earns enough cash. Therefore to receive quick loan and sba loan would be a proper way out.
Prepared Statement Error: Table './oraclebasecms/cms_page_comment_uuids' is marked as crashed and should be repaired