This forum is currently locked. You can't register or post questions at this time. (read more)

SPACE CONSUMPTION ON NODE 1 INCREASES BUT NOT ON NODE 2

Questions relating to Oracle Real Application Clusters (RAC) and Clusterware.

Moderator: Tim...

1982
Senior Member
Posts: 72
Joined: Mon Apr 07, 2014 3:53 pm

SPACE CONSUMPTION ON NODE 1 INCREASES BUT NOT ON NODE 2

Postby 1982 » Thu Apr 24, 2014 6:31 am

Hi Tim,

I am Trying to configure Oracle RAC using ASM Storage by following your post http://www.oracle-base.com/articles/11g ... ualbox.php

When i am on the screen where Files setup is running, I am trying to check the space on the drives where the files are going to copy means /u01/app/11.2.0 on both nodes.

On Node 1 the size is going to increase for grid directory. But when i am checking the same directory of Grid on node 2 it remains the same i.e 16 every time where on node 1 there is increased value for the same directory means files are continuously copying on that directory but not on node2. Why is it happening as there is no prior error generated.


As i am using VMWARE WORKSTATION 7 with RHEL 5 and 11.2.0.1.0 DB Version


Kindly guide over the same.

Tim...
Site Admin
Posts: 18437
Joined: Mon Nov 01, 2004 5:56 pm
Location: England, UK
Contact:

Re: SPACE CONSUMPTION ON NODE 1 INCREASES BUT NOT ON NODE 2

Postby Tim... » Thu Apr 24, 2014 6:38 am

Hi.

Both the GI and DB installations follow the following pattern:

- Install and link all the software on node 1.
- Copy everything across to node 2.

As a result, no space will be used on node 2 until the operations on node 1 are complete. You can see this in the installer. The copy to the other nodes is only done during the "Perform remote operations" phase.

Image

Cheers

Tim...
Tim...
Oracle ACE Director
Oracle ACE of the Year 2006 - Oracle Magazine Editors Choice Awards
OakTable Member
OCP DBA 7.3, 8, 8i, 9i, 10g, 11g
OCP Advanced PL/SQL Developer
Oracle Database: SQL Certified Expert
My website: http://www.oracle-base.com
My blog: http://www.oracle-base.com/blog

1982
Senior Member
Posts: 72
Joined: Mon Apr 07, 2014 3:53 pm

Re: SPACE CONSUMPTION ON NODE 1 INCREASES BUT NOT ON NODE 2

Postby 1982 » Thu Apr 24, 2014 8:14 am

But in case of Configuring Oracle RAC using NFS the space consumption is there. Meas files which are copied in grid home are simultaneously copied on the second node grid home.


Please guide over the same

Tim...
Site Admin
Posts: 18437
Joined: Mon Nov 01, 2004 5:56 pm
Location: England, UK
Contact:

Re: SPACE CONSUMPTION ON NODE 1 INCREASES BUT NOT ON NODE 2

Postby Tim... » Thu Apr 24, 2014 8:21 am

Hi.

Certainly, if there is a shared home, then they should be visible on both sides.

If you can't see the stuff on the second node, it sounds like you've not setup your shared storage properly...

To test this, write a file from one node. Can you see that file from the other node?

Cheers

Tim...
Tim...
Oracle ACE Director
Oracle ACE of the Year 2006 - Oracle Magazine Editors Choice Awards
OakTable Member
OCP DBA 7.3, 8, 8i, 9i, 10g, 11g
OCP Advanced PL/SQL Developer
Oracle Database: SQL Certified Expert
My website: http://www.oracle-base.com
My blog: http://www.oracle-base.com/blog

1982
Senior Member
Posts: 72
Joined: Mon Apr 07, 2014 3:53 pm

Re: SPACE CONSUMPTION ON NODE 1 INCREASES BUT NOT ON NODE 2

Postby 1982 » Thu Apr 24, 2014 8:41 am

by using oracleasm listdisks i am able to get the lists of disks on both nodes. What extra i need to do

Tim...
Site Admin
Posts: 18437
Joined: Mon Nov 01, 2004 5:56 pm
Location: England, UK
Contact:

Re: SPACE CONSUMPTION ON NODE 1 INCREASES BUT NOT ON NODE 2

Postby Tim... » Thu Apr 24, 2014 8:54 am

Hi.

I am confused... You are talking about presenting NFS files to ASM. You can do that, but that's got nothing to do with the GI installation. That can not be in ASM. That must be on either local storage or a cluster file system. You can do this on an NFS share if you like, but that installation *must* be on a conventional file system on that share. It will *never* be in ASM.

With this in mind, what question are you actually asking here? If sounds like you are asking about the GI installation, but then you are talking about ASM, which has nothing to do with the space used for the GI installation...

Cheers

Tim...
Tim...
Oracle ACE Director
Oracle ACE of the Year 2006 - Oracle Magazine Editors Choice Awards
OakTable Member
OCP DBA 7.3, 8, 8i, 9i, 10g, 11g
OCP Advanced PL/SQL Developer
Oracle Database: SQL Certified Expert
My website: http://www.oracle-base.com
My blog: http://www.oracle-base.com/blog

1982
Senior Member
Posts: 72
Joined: Mon Apr 07, 2014 3:53 pm

Re: SPACE CONSUMPTION ON NODE 1 INCREASES BUT NOT ON NODE 2

Postby 1982 » Thu Apr 24, 2014 8:59 am

Sorry for the confusion. Actually prior to this configuration i configure Oracle RAC with NFS Storage where on both node the space is consumed during the file copy duration.
during the Grid Installation space is consumed on node one in GRID HOME and also not on node 2

Now i am configuring Oracle RAC with ASM storage but what i am checking during the Grid Installation space is consumed on node one in GRID HOME but not on node 2. Why

Tim...
Site Admin
Posts: 18437
Joined: Mon Nov 01, 2004 5:56 pm
Location: England, UK
Contact:

Re: SPACE CONSUMPTION ON NODE 1 INCREASES BUT NOT ON NODE 2

Postby Tim... » Thu Apr 24, 2014 10:33 am

Hi.

I've read your last post 3 times and I really don't understand what you are saying. You seem to be contradicting yourself mid-sentence... :(

Please tell me:

1) The ORACLE_HOME of the GI installation.
2) Confirm if the location from (1) is on the local machine or on an NFS mount.

Cheers

Tim...
Tim...
Oracle ACE Director
Oracle ACE of the Year 2006 - Oracle Magazine Editors Choice Awards
OakTable Member
OCP DBA 7.3, 8, 8i, 9i, 10g, 11g
OCP Advanced PL/SQL Developer
Oracle Database: SQL Certified Expert
My website: http://www.oracle-base.com
My blog: http://www.oracle-base.com/blog

1982
Senior Member
Posts: 72
Joined: Mon Apr 07, 2014 3:53 pm

Re: SPACE CONSUMPTION ON NODE 1 INCREASES BUT NOT ON NODE 2

Postby 1982 » Thu Apr 24, 2014 12:20 pm

Srry again for the same,

I created 5 ASM disks in a folder named Storage on local hdd on host OS which is on WINDOWS 7. After that i followed your blog in which asm disks creation is used and specifying SCSI label for each local disk. Currently there is no NFS as i already mentioned this time i am following your blog where ASM disk creation is used to configure the Oracle RAC.

Kinldy help over the same

GRID_HOME=/u01/app/11.2.0/grid
ORACLE_HOME=$DB_HOME
DB_HOME=$ORACLE_BASE/product/11.2.0/db_1

Tim...
Site Admin
Posts: 18437
Joined: Mon Nov 01, 2004 5:56 pm
Location: England, UK
Contact:

Re: SPACE CONSUMPTION ON NODE 1 INCREASES BUT NOT ON NODE 2

Postby Tim... » Thu Apr 24, 2014 2:35 pm

Hi.

OK. So if no NFS is being used, then the GI installation is not shared between both nodes. They each have their own local GI installation.

So going back to what I said previously...

- The GI is installed and lined on node 1. Node 2 will see no growth in disk usage during this time.
- The "Perform remote operations" phase is when the GI software is copied from node 1 to node 2. It is only now you will see the disk space in the GI home start to fill up on node 2.

This is completely different to what you did previously with NFS, where the GI was installed on shared storage, so you could see it from both nodes.

Cheers

Tim...
Tim...
Oracle ACE Director
Oracle ACE of the Year 2006 - Oracle Magazine Editors Choice Awards
OakTable Member
OCP DBA 7.3, 8, 8i, 9i, 10g, 11g
OCP Advanced PL/SQL Developer
Oracle Database: SQL Certified Expert
My website: http://www.oracle-base.com
My blog: http://www.oracle-base.com/blog

1982
Senior Member
Posts: 72
Joined: Mon Apr 07, 2014 3:53 pm

Re: SPACE CONSUMPTION ON NODE 1 INCREASES BUT NOT ON NODE 2

Postby 1982 » Thu Apr 24, 2014 4:12 pm

Means i need to go with installation as it is currently running. But for node 2 what i need to do


Wheather configuration is done automatically on node 2 or not

Tim...
Site Admin
Posts: 18437
Joined: Mon Nov 01, 2004 5:56 pm
Location: England, UK
Contact:

Re: SPACE CONSUMPTION ON NODE 1 INCREASES BUT NOT ON NODE 2

Postby Tim... » Thu Apr 24, 2014 7:03 pm

Hi.

Continue with installation. Once it completes you will have all software on all nodes. That the remote operations bit is all about...

Cheers

Tim...
Tim...
Oracle ACE Director
Oracle ACE of the Year 2006 - Oracle Magazine Editors Choice Awards
OakTable Member
OCP DBA 7.3, 8, 8i, 9i, 10g, 11g
OCP Advanced PL/SQL Developer
Oracle Database: SQL Certified Expert
My website: http://www.oracle-base.com
My blog: http://www.oracle-base.com/blog

1982
Senior Member
Posts: 72
Joined: Mon Apr 07, 2014 3:53 pm

Re: SPACE CONSUMPTION ON NODE 1 INCREASES BUT NOT ON NODE 2

Postby 1982 » Thu Apr 24, 2014 8:15 pm

Thanks Time for your reply,

I run the installation and after that run the orainstRoot.sh and /u01/app/11.2.0/grid/root.sh script on both nodes/ On node one everything is working fine. But on Node 2 i am getting error whine running /u01/app/11.2.0/grid/root.sh script.
Error is:-

[root@ol5-112-rac2 grid]# sh /u01/app/11.2.0/grid/root.sh
Running Oracle 11g root.sh script...

The following environment variables are set as:
ORACLE_OWNER= oracle
ORACLE_HOME= /u01/app/11.2.0/grid

Enter the full pathname of the local bin directory: [/usr/local/bin]:
Copying dbhome to /usr/local/bin ...
Copying oraenv to /usr/local/bin ...
Copying coraenv to /usr/local/bin ...


Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root.sh script.
Now product-specific root actions will be performed.
2014-04-25 01:14:18: Parsing the host name
2014-04-25 01:14:18: Checking for super user privileges
2014-04-25 01:14:18: User has super user privileges
Using configuration parameter file: /u01/app/11.2.0/grid/crs/install/crsconfig_params
Creating trace directory
LOCAL ADD MODE
Creating OCR keys for user 'root', privgrp 'root'..
Operation successful.
Adding daemon to inittab
CRS-4123: Oracle High Availability Services has been started.
ohasd is starting
CRS-4402: The CSS daemon was started in exclusive mode but found an active CSS daemon on node ol5-112-rac1, number 1, and is terminating
An active cluster was found during exclusive startup, restarting to join the cluster
CRS-2672: Attempting to start 'ora.mdnsd' on 'ol5-112-rac2'
CRS-2676: Start of 'ora.mdnsd' on 'ol5-112-rac2' succeeded
CRS-2672: Attempting to start 'ora.gipcd' on 'ol5-112-rac2'
CRS-2676: Start of 'ora.gipcd' on 'ol5-112-rac2' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'ol5-112-rac2'
CRS-2676: Start of 'ora.gpnpd' on 'ol5-112-rac2' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'ol5-112-rac2'
CRS-2676: Start of 'ora.cssdmonitor' on 'ol5-112-rac2' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'ol5-112-rac2'
CRS-2672: Attempting to start 'ora.diskmon' on 'ol5-112-rac2'
CRS-2676: Start of 'ora.diskmon' on 'ol5-112-rac2' succeeded
CRS-2676: Start of 'ora.cssd' on 'ol5-112-rac2' succeeded
CRS-2672: Attempting to start 'ora.ctssd' on 'ol5-112-rac2'
CRS-2676: Start of 'ora.ctssd' on 'ol5-112-rac2' succeeded
CRS-2672: Attempting to start 'ora.drivers.acfs' on 'ol5-112-rac2'
CRS-2676: Start of 'ora.drivers.acfs' on 'ol5-112-rac2' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'ol5-112-rac2'
CRS-2676: Start of 'ora.asm' on 'ol5-112-rac2' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'ol5-112-rac2'
CRS-2676: Start of 'ora.crsd' on 'ol5-112-rac2' succeeded
CRS-2672: Attempting to start 'ora.evmd' on 'ol5-112-rac2'
CRS-2676: Start of 'ora.evmd' on 'ol5-112-rac2' succeeded
Timed out waiting for the CRS stack to start.

[root@ol5-112-rac2 bin]# ./crsctl check crs
CRS-4638: Oracle High Availability Services is online
CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4530: Communications failure contacting Cluster Synchronization Services daemon
CRS-4534: Cannot communicate with Event Manager



[root@ol5-112-rac1 bin]# ./crsctl check cluster -all
**************************************************************
ol5-112-rac1:
CRS-4537: Cluster Ready Services is online
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************
ol5-112-rac2:
CRS-4535: Cannot communicate with Cluster Ready Services
CRS-4529: Cluster Synchronization Services is online
CRS-4533: Event Manager is online
**************************************************************

Permission on ASM Disks is as below:-
For node 2:-

[root@ol5-112-rac2 disks]# ls -lrt
total 0
brwxrwxrwx 1 oracle dba 8, 17 Apr 25 00:20 DISK1
brwxrwxrwx 1 oracle dba 8, 33 Apr 25 00:20 DISK2
brwxrwxrwx 1 oracle dba 8, 49 Apr 25 00:20 DISK3
brwxrwxrwx 1 oracle dba 8, 65 Apr 25 00:20 DISK4
brwxrwxrwx 1 oracle dba 8, 81 Apr 25 00:20 DISK5

For Node 1:-

brwxrwxrwx 1 oracle dba 8, 17 Apr 25 00:20 DISK1
brwxrwxrwx 1 oracle dba 8, 33 Apr 25 00:20 DISK2
brwxrwxrwx 1 oracle dba 8, 49 Apr 25 00:20 DISK3
brwxrwxrwx 1 oracle dba 8, 65 Apr 25 00:20 DISK4
brwxrwxrwx 1 oracle dba 8, 81 Apr 25 00:20 DISK5


Kindly suggest over the same

Tim...
Site Admin
Posts: 18437
Joined: Mon Nov 01, 2004 5:56 pm
Location: England, UK
Contact:

Re: SPACE CONSUMPTION ON NODE 1 INCREASES BUT NOT ON NODE 2

Postby Tim... » Thu Apr 24, 2014 8:36 pm

Tim...
Oracle ACE Director
Oracle ACE of the Year 2006 - Oracle Magazine Editors Choice Awards
OakTable Member
OCP DBA 7.3, 8, 8i, 9i, 10g, 11g
OCP Advanced PL/SQL Developer
Oracle Database: SQL Certified Expert
My website: http://www.oracle-base.com
My blog: http://www.oracle-base.com/blog

1982
Senior Member
Posts: 72
Joined: Mon Apr 07, 2014 3:53 pm

Re: SPACE CONSUMPTION ON NODE 1 INCREASES BUT NOT ON NODE 2

Postby 1982 » Fri Apr 25, 2014 5:24 am

nks Tim for the update,

But afer i checking the disk permission and granting 775 permission to user on disks drom both node . Now i am getting

INS-20702
Description: Unexpected internal driver error during the grid installation

My DB Version :- 11.2.0.1.0

Kindly advice over the same


Return to “Oracle RAC and Clusterware”

Who is online

Users browsing this forum: No registered users and 2 guests

cron