This forum is currently locked. You can't register or post questions at this time. (read more)

configure ASM Disks for 12c RAC

Questions relating to Oracle Real Application Clusters (RAC) and Clusterware.

Moderator: Tim...

harvarinder
Member
Posts: 2
Joined: Wed Jul 31, 2013 3:36 am

configure ASM Disks for 12c RAC

Postby harvarinder » Wed Jul 31, 2013 3:58 am

Hi Tim,

I am trying to install oracle 12c RAC using your http://www.oracle-base.com/articles/12c/oracle-db-12cr1-rac-installation-on-oracle-linux-6-using-virtualbox.php

But I am not able to setup the asm disks properly.

I am using RHEL6.3 Virtualbox 4.2.16 on Windows 7 Enterprise.

When i issue

Code: Select all

# /sbin/partprobe /dev/sdb1


I notice that the recently created /dev/sdb1 get disappeared, but I can still run following commands with success.

# /sbin/udevadm test /block/sdb/sdb1
# /sbin/udevadm control --reload-rules
# /sbin/start_udev
[root@rac1 ~]# ls -al /dev/asm*
brw-rw----. 1 oracle dba 8, 17 Jul 31 13:45 /dev/asm-disk1

because of my pre check of installation give a warning that unable to find UUID , can you help.

Thanks
--harvey

Tim...
Site Admin
Posts: 18437
Joined: Mon Nov 01, 2004 5:56 pm
Location: England, UK
Contact:

Re: configure ASM Disks for 12c RAC

Postby Tim... » Wed Jul 31, 2013 1:30 pm

Hi.

First, let me start by saying I've never done one of these installations using Windows 7 as a host OS. It should work fine, but I can;t make any guarantees. I usually use Linux as my host OS, but I know others that use Windows 7, so let's assume that is not the problem. :)

The UDEV stuff is common to pretty much all the RHEL and OL version 6 spins (6.1, 6.2, 6.3, 6.4 etc). I used 6.4, but I would not expect a problem with 6.3.

I'm a little confused. The UDEV rule must be working as the "/dev/asm-disk1" rule visible, so I'm not sure what you mean by "unable to find UUID".

Cheers

Tim...
Tim...
Oracle ACE Director
Oracle ACE of the Year 2006 - Oracle Magazine Editors Choice Awards
OakTable Member
OCP DBA 7.3, 8, 8i, 9i, 10g, 11g
OCP Advanced PL/SQL Developer
Oracle Database: SQL Certified Expert
My website: http://www.oracle-base.com
My blog: http://www.oracle-base.com/blog

harvarinder
Member
Posts: 2
Joined: Wed Jul 31, 2013 3:36 am

Re: configure ASM Disks for 12c RAC

Postby harvarinder » Thu Aug 01, 2013 2:58 am

Hi Tim,

First of all thanks for trying to help me out and answering my queries.

I am doing all sorts of things to make it work. Now I am using kmod-oracelasm to make sure that the disks are okay. Below are some of the results from my node1
[root@rac1 ~]# oracleasm listdisks
ASM1
[root@rac1 ~]# oracleasm querydisk -p ASM1
Disk "ASM1" is a valid ASM disk
/dev/sdb1: LABEL="ASM1" TYPE="oracleasm"
[root@rac1 ~]#
[root@rac1 ~]# oracleasm configure
ORACLEASM_ENABLED=true
ORACLEASM_UID=oracle
ORACLEASM_GID=dba
ORACLEASM_SCANBOOT=true
ORACLEASM_SCANORDER=""
ORACLEASM_SCANEXCLUDE=""
ORACLEASM_USE_LOGICAL_BLOCK_SIZE="false"
[root@rac1 ~]#
[root@rac1 ~]# id oracle
uid=54321(oracle) gid=54321(oinstall) groups=54321(oinstall),501(vboxsf),54322(dba)
[root@rac1 ~]# ls -la /dev/oracleasm/disks/
total 0
drwxr-xr-x. 1 root root 0 Aug 1 10:57 .
drwxr-xr-x. 4 root root 0 Aug 1 10:57 ..
brw-rw----. 1 oracle dba 8, 17 Aug 1 10:59 ASM1
[root@rac1 ~]#


While installation when I get on to "Create ASM Disk Group" screen I can see following message in my installlog

INFO: Redirecting to route <matched>.
INFO: Get view named [ASMDiskGroupCreationUI]
INFO: View for [ASMDiskGroupCreationUI] is oracle.install.ivw.crs.view.ASMDiskGroupCreationGUI@30056042
INFO: Initializing view <ASMDiskGroupCreationUI> at state <CreateASMDiskGroup>
WARNING: SRVCTL not found as there is no Grid Infrastructure home on the box.
INFO: Executing [/tmp/OraInstall2013-08-01_11-04-28AM/ext/bin/kfod, nohdr=true, verbose=true, disks=all, status=true, op=disks]
with environment variables {TERM=xterm, JAVA_HOME=, IMSETTINGS_MODULE=none, MODULEPATH=/usr/share/Modules/modulefiles:/etc/modulefiles, SESSION_MANAGER=local/unix:@/tmp/.ICE-unix/2588,unix/unix:/tmp/.ICE-unix/2588, GNOME_DESKTOP_SESSION_ID=this-is-deprecated, IMSETTINGS_INTEGRATE_DESKTOP=yes, MAIL=/var/spool/mail/oracle, GDMSESSION=gnome, XDG_SESSION_COOKIE=70697b9e4b6bd3134776c4a300000017-1375319045.518080-364837605, PWD=/media/sf_vshare/linuxamd64_12c_grid_1of2/grid, HOSTNAME=rac1.localdomain, CVS_RSH=ssh, BASE_PATH=/usr/sbin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/usr/bin:/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/oracle/bin, G_BROKEN_FILENAMES=1, DB_HOME=/u01/app/oracle/product/12.1.0.1/db_1, NLSPATH=/usr/dt/lib/nls/msg/%L/%N.cat, ORACLE_HOSTNAME=rac1.localdomain, GNOME_KEYRING_SOCKET=/tmp/keyring-wlJRsy/socket, GRID_HOME=/u01/app/12.1.0.1/grid, GDM_KEYBOARD_LAYOUT=us, TMPDIR=/tmp, HISTSIZE=1000, TMP=/tmp, PATH=/usr/bin:/usr/ccs/bin:/u01/app/12.1.0.1/grid/bin:/usr/sbin:/usr/lib64/qt-3.3/bin:/usr/local/bin:/usr/bin:/bin:/usr/local/sbin:/usr/sbin:/sbin:/home/oracle/bin:/media/sf_vshare/linuxamd64_12c_grid_1of2/grid/install, QTLIB=/usr/lib64/qt-3.3/lib, XAUTHORITY=/var/run/gdm/auth-for-oracle-OXA6ja/database, GDM_LANG=en_US.UTF-8, WINDOWPATH=1, USERNAME=oracle, SSH_ASKPASS=/usr/libexec/openssh/gnome-ssh-askpass, MODULESHOME=/usr/share/Modules, ORACLE_HOME=/tmp/OraInstall2013-08-01_11-04-28AM/ext/bin, SHLVL=3, XFILESEARCHPATH=/usr/dt/app-defaults/%L/Dt, ORACLE_BASE=/u01/app/oracle, COLORTERM=gnome-terminal, QT_IM_MODULE=xim, LOGNAME=oracle, WINDOWID=23068676, _=/media/sf_vshare/linuxamd64_12c_grid_1of2/grid/install/.oui, XMODIFIERS=@im=none, QTDIR=/usr/lib64/qt-3.3, SSH_AUTH_SOCK=/tmp/keyring-wlJRsy/socket.ssh, LD_LIBRARY_PATH=/tmp/OraInstall2013-08-01_11-04-28AM/ext/bin/../lib, DBUS_SESSION_BUS_ADDRESS=unix:abstract=/tmp/dbus-PcvlILgNdt,guid=4935d1ab7f8d4b81abb0c86700000198, SHELL=/bin/bash, module=() { eval `/usr/bin/modulecmd bash $*`
}, GNOME_KEYRING_PID=2579, ORACLE_TERM=xterm, GTK_RC_FILES=/etc/gtk/gtkrc:/home/oracle/.gtkrc-1.2-gnome2, ORACLE_UNQNAME=CDBRAC, CLASSPATH=, DESKTOP_SESSION=gnome, QTINC=/usr/lib64/qt-3.3/include, LC_ALL=, DISPLAY=:0.0, USER=oracle, HOME=/home/oracle, HISTCONTROL=ignoredups, LESSOPEN=|/usr/bin/lesspipe.sh %s, ORACLE_SID=+ASM1, LOADEDMODULES=, LS_COLORS=rs=0:di=01;34:ln=01;36:mh=00:pi=40;33:so=01;35:do=01;35:bd=40;33;01:cd=40;33;01:or=40;31;01:mi=01;05;37;41:su=37;41:sg=30;43:ca=30;41:tw=30;42:ow=34;42:st=37;44:ex=01;32:*.tar=01;31:*.tgz=01;31:*.arj=01;31:*.taz=01;31:*.lzh=01;31:*.lzma=01;31:*.tlz=01;31:*.txz=01;31:*.zip=01;31:*.z=01;31:*.Z=01;31:*.dz=01;31:*.gz=01;31:*.lz=01;31:*.xz=01;31:*.bz2=01;31:*.tbz=01;31:*.tbz2=01;31:*.bz=01;31:*.tz=01;31:*.deb=01;31:*.rpm=01;31:*.jar=01;31:*.rar=01;31:*.ace=01;31:*.zoo=01;31:*.cpio=01;31:*.7z=01;31:*.rz=01;31:*.jpg=01;35:*.jpeg=01;35:*.gif=01;35:*.bmp=01;35:*.pbm=01;35:*.pgm=01;35:*.ppm=01;35:*.tga=01;35:*.xbm=01;35:*.xpm=01;35:*.tif=01;35:*.tiff=01;35:*.png=01;35:*.svg=01;35:*.svgz=01;35:*.mng=01;35:*.pcx=01;35:*.mov=01;35:*.mpg=01;35:*.mpeg=01;35:*.m2v=01;35:*.mkv=01;35:*.ogm=01;35:*.mp4=01;35:*.m4v=01;35:*.mp4v=01;35:*.vob=01;35:*.qt=01;35:*.nuv=01;35:*.wmv=01;35:*.asf=01;35:*.rm=01;35:*.rmvb=01;35:*.flc=01;35:*.avi=01;35:*.fli=01;35:*.flv=01;35:*.gl=01;35:*.dl=01;35:*.xcf=01;35:*.xwd=01;35:*.yuv=01;35:*.cgm=01;35:*.emf=01;35:*.axv=01;35:*.anx=01;35:*.ogv=01;35:*.ogx=01;35:*.aac=01;36:*.au=01;36:*.flac=01;36:*.mid=01;36:*.midi=01;36:*.mka=01;36:*.mp3=01;36:*.mpc=01;36:*.ogg=01;36:*.ra=01;36:*.wav=01;36:*.axa=01;36:*.oga=01;36:*.spx=01;36:*.xspf=01;36:, ORBIT_SOCKETDIR=/tmp/orbit-oracle, LANG=en_US.UTF-8}
INFO: Starting Output Reader Threads for process /tmp/OraInstall2013-08-01_11-04-28AM/ext/bin/kfod
INFO: Parsing 5114 CANDIDATE ORCL:ASM1
INFO: Parsing KFOD-00311: Error scanning device /dev/sda
INFO: Parsing ORA-27041: unable to open file
INFO: Parsing Linux-x86_64 Error: 13: Permission denied
INFO: Parsing Additional information: 42
INFO: Parsing Additional information: 140735457374176
INFO: Parsing KFOD-00311: Error scanning device /dev/sdb
INFO: Parsing ORA-27041: unable to open file
INFO: Parsing Linux-x86_64 Error: 13: Permission denied
INFO: Parsing Additional information: 42
INFO: Parsing Additional information: 140735457374176
INFO: Parsing KFOD-00311: Error scanning device /dev/sda1
INFO: Parsing ORA-27041: unable to open file
INFO: The process /tmp/OraInstall2013-08-01_11-04-28AM/ext/bin/kfod exited with code 0
INFO: Waiting for output processor threads to exit.
INFO: Parsing Linux-x86_64 Error: 13: Permission denied
INFO: Parsing Additional information: 42
INFO: Parsing Additional information: 140735457374176
INFO: Parsing KFOD-00311: Error scanning device /dev/sda2
INFO: Parsing ORA-27041: unable to open file
INFO: Parsing Linux-x86_64 Error: 13: Permission denied
INFO: Parsing Additional information: 42
INFO: Parsing Additional information: 140735457374176
INFO: Parsing KFOD-00311: Error scanning device /dev/sda3
INFO: Parsing ORA-27041: unable to open file
INFO: Parsing Linux-x86_64 Error: 13: Permission denied
INFO: Parsing Additional information: 42
INFO: Parsing Additional information: 140735457374176
INFO: Parsing KFOD-00311: Error scanning device /dev/sdb1
INFO: Parsing ORA-27041: unable to open file
INFO: Parsing Linux-x86_64 Error: 13: Permission denied
INFO: Parsing Additional information: 42
INFO: Parsing Additional information: 140735457374176
INFO: Parsing KFOD-00316: Error acquiring ASM discovery string: ORA-29780: unable to connect to GPnP daemon [CLSGPNP_ERR]
INFO: Output processor threads exited.


and I select ORCL:ASM1 there redundency : External AU: 1M Then next next next to "Perform Prerequisite Checks" where I am getting a warning for ASM disks which is says

Device Checks for ASM - This is a pre-check to verify if the specified devices meet the requirements for configuration through the Oracle Universal Storage Manager Configuration Assistant.

Verification WARNING result on node: rac1  Details:
 - 
Cannot verify the shared state for device /dev/oracleasm/disks/ASM1 due to Universally Unique Identifiers (UUIDs) not being found, or different values being found, for this device across nodes: [rac1, rac2]  - Cause: Cause Of Problem Not Available  - Action: User Action Not Available

Verification WARNING result on node: rac2  Details:
 - 
Cannot verify the shared state for device /dev/oracleasm/disks/ASM1 due to Universally Unique Identifiers (UUIDs) not being found, or different values being found, for this device across nodes: [rac1, rac2]  - Cause: Cause Of Problem Not Available  - Action: User Action Not Available


Now if I look at install log I can see :

INFO: *********************************************
INFO: Device Checks for ASM: This is a pre-check to verify if the specified devices meet the requirements for configuration through the Oracle Universal Storage Manager Configuration Assistant.
INFO: Severity:IGNORABLE
INFO: OverallStatus:WARNING
INFO: -----------------------------------------------
INFO: Verification Result for Node:rac2
WARNING: Result values are not available for this verification task
INFO: *********************************************


.
.
.
Little further down

INFO: ****************** CVU Error logs ******************
INFO: FINE: [Task.perform:479]
TaskASMDeviceChecks:Device Checks for ASM[TASKASMDEVICECHECKS]:TASK_START
INFO: FINE: [Task.perform:500]
m_nodeList='rac1,rac2'
INFO: INFO: [VerificationUtil.getLocalHost:1009] LongHostName: rac1.localdomain, HostName: rac1
INFO: FINE: [VerificationCommand.execute:290]
Output: '<CV_VAL>/dev/oracleasm/disks/ASM1</CV_VAL><CV_VRES>0</CV_VRES><CV_LOG>Exectask: asm device path retrieval was successful</CV_LOG><CV_CMDLOG><CV_INITCMD>/tmp/CVU_12.1.0.1.0_oracle/exectask -getasmdevpath ORCL:ASM1 </CV_INITCMD></CV_CMDLOG><CV_ERES>0</CV_ERES>'
INFO: INFO: [VerificationUtil.getLocalHost:1009] LongHostName: rac1.localdomain, HostName: rac1
INFO: INFO: [VerificationUtil.getLocalHost:1009] LongHostName: rac1.localdomain, HostName: rac1
INFO: FINE: [VerificationCommand.execute:290]
Output: '<CV_VAL><PACKAGE><NAME,cvuqdisk><ARCH,x86_64><VERSION,1.0.9-1></PACKAGE>
</CV_VAL><CV_VRES>0</CV_VRES><CV_LOG>Exectask: Package information retrieval successful</CV_LOG><CV_CMDLOG><CV_INITCMD>/tmp/CVU_12.1.0.1.0_oracle/exectask -chkpackage cvuqdisk </CV_INITCMD><CV_CMD>/bin/rpm -q --queryformat '<PACKAGE><NAME,%{NAME}><ARCH,%{ARCH}><VERSION,%{VERSION}-%{RELEASE}></PACKAGE>' cvuqdisk | /bin/sort -u</CV_CMD><CV_CMDOUT> <PACKAGE><NAME,cvuqdisk><ARCH,x86_64><VERSION,1.0.9-1></PACKAGE></CV_CMDOUT><CV_CMDSTAT>0</CV_CMDSTAT></CV_CMDLOG><CV_ERES>0</CV_ERES>'
INFO: FINE: [VerificationCommand.execute:290]
Output: '<CV_VAL><PACKAGE><NAME,cvuqdisk><ARCH,x86_64><VERSION,1.0.9-1></PACKAGE>
</CV_VAL><CV_VRES>0</CV_VRES><CV_LOG>Exectask: Package information retrieval successful</CV_LOG><CV_CMDLOG><CV_INITCMD>/tmp/CVU_12.1.0.1.0_oracle/exectask -chkpackage cvuqdisk </CV_INITCMD><CV_CMD>/bin/rpm -q --queryformat '<PACKAGE><NAME,%{NAME}><ARCH,%{ARCH}><VERSION,%{VERSION}-%{RELEASE}></PACKAGE>' cvuqdisk | /bin/sort -u</CV_CMD><CV_CMDOUT> <PACKAGE><NAME,cvuqdisk><ARCH,x86_64><VERSION,1.0.9-1></PACKAGE></CV_CMDOUT><CV_CMDSTAT>0</CV_CMDSTAT></CV_CMDLOG><CV_ERES>0</CV_ERES>'
INFO: FINE: [TypeFinder.getStorageInstance:198] crsHome is NULL
INFO: FINE: [TypeFinder.getStorageInstance:274] TYPEFINDER:getStorageInstance: path[/dev/oracleasm/disks/ASM1] StorageInfo: null
INFO: FINE: [TypeFinder.getStorageInstance:319] path: '/dev/oracleasm/disks/ASM1' NOT on ASM
INFO: INFO: [VerificationUtil.getLocalHost:1009] LongHostName: rac1.localdomain, HostName: rac1
INFO: FINE: [TypeFinder.getStorageInstance:319] path: '/dev/oracleasm/disks/ASM1' NOT on ASM
INFO: INFO: [VerificationUtil.getLocalHost:1009] LongHostName: rac1.localdomain, HostName: rac1
INFO: FINE: [VerificationCommand.execute:290]
Output: '<CV_VAL><BEGIN_STTYPE><STTYPE,DISK><ACCESS,4294967295><REALPATH,/dev/sdb1><PREFNAME,/dev/sdb1><ENDSTTYPE><DISK><DISK_NAME>/dev/oracleasm/disks/ASM1</DISK_NAME><DISK_SIGNATURE></DISK_SIGNATURE><NUMPARTS>0</NUMPARTS><DISK_STATE>1</DISK_STATE><DISK_SIZE>5362849792</DISK_SIZE><DISK_OWNER>oracle</DISK_OWNER><DISK_GROUP>dba</DISK_GROUP><DISK_PERMISSIONS>0660</DISK_PERMISSIONS></DISK></CV_VAL><CV_VRES>0</CV_VRES><CV_LOG>Exectask:getstorage success.</CV_LOG><CV_CMDLOG><CV_INITCMD>/tmp/CVU_12.1.0.1.0_oracle/exectask -getstorage /dev/oracleasm/disks/ASM1 </CV_INITCMD><CV_CMD>realpath /dev/oracleasm/disks/ASM1</CV_CMD><CV_CMDOUT> /dev/oracleasm/disks/ASM1</CV_CMDOUT><CV_CMDSTAT>0</CV_CMDSTAT><CV_CMD>stat /dev/oracleasm/disks/ASM1</CV_CMD><CV_CMDOUT> stat.st_mode:61B0</CV_CMDOUT><CV_CMDSTAT>0</CV_CMDSTAT><CV_CMD>fopen /proc/partitions</CV_CMD><CV_CMDOUT> 8 0 52428800 sda
8 16 5242880 sdb
</CV_CMDOUT><CV_CMDSTAT>0</CV_CMDSTAT><CV_CMD>popen /bin/grep alias /etc/multipath.conf 2>/dev/null</CV_CMD><CV_CMDOUT></CV_CMDOUT><CV_CMDSTAT>512</CV_CMDSTAT><CV_CMD>popen /bin/rpm -qi cvuqdisk 2>/dev/null</CV_CMD><CV_CMDOUT> cvuqdiskVersion: 1.0.9-1</CV_CMDOUT><CV_CMDSTAT>0</CV_CMDSTAT><CV_CMD>popen /usr/sbin/cvuqdisk -sign2 /dev/sdb1 2>/dev/null</CV_CMD><CV_CMDOUT></CV_CMDOUT><CV_CMDSTAT>256</CV_CMDSTAT><CV_CMD>popen /bin/rpm -qi cvuqdisk 2>/dev/null</CV_CMD><CV_CMDOUT> cvuqdiskVersion: 1.0.9-1</CV_CMDOUT><CV_CMDSTAT>0</CV_CMDSTAT><CV_CMD>popen /usr/sbin/cvuqdisk -sign /dev/sdb1 2>/dev/null</CV_CMD><CV_CMDOUT></CV_CMDOUT><CV_CMDSTAT>512</CV_CMDSTAT><CV_CMD>popen /bin/rpm -qi cvuqdisk 2>/dev/null</CV_CMD><CV_CMDOUT> cvuqdiskVersion: 1.0.9-1</CV_CMDOUT><CV_CMDSTAT>0</CV_CMDSTAT><CV_CMD>popen /usr/sbin/cvuqdisk -size /dev/oracleasm/disks/ASM1 2>/dev/null</CV_CMD><CV_CMDOUT> 5237158
</CV_CMDOUT><CV_CMDSTAT>0</CV_CMDSTAT><CV_CMD>stat /dev/oracleasm/disks/ASM1</CV_CMD><CV_CMDOUT> 0660</CV_CMDOUT><CV_CMDSTAT>0</CV_CMDSTAT><CV_CMD>stat /dev/oracleasm/disks/ASM1</CV_CMD><CV_CMDOUT> stat.st_uid: 54321</CV_CMDOUT><CV_CMDSTAT>0</CV_CMDSTAT><CV_CMD>getpwuid 54321</CV_CMD><CV_CMDOUT> owner: oracle</CV_CMDOUT><CV_CMDSTAT>0</CV_CMDSTAT><CV_CMD>stat /dev/oracleasm/disks/ASM1</CV_CMD><CV_CMDOUT> stat.st_gid: 54322</CV_CMDOUT><CV_CMDSTAT>0</CV_CMDSTAT><CV_CMD>getgrgid 54322</CV_CMD><CV_CMDOUT> group: dba</CV_CMDOUT><CV_CMDSTAT>0</CV_CMDSTAT></CV_CMDLOG><CV_ERES>0</CV_ERES>'
INFO: FINE: [VerificationCommand.execute:290]
Output: '<CV_VAL><BEGIN_STTYPE><STTYPE,DISK><ACCESS,4294967295><REALPATH,/dev/sdb1><PREFNAME,/dev/sdb1><ENDSTTYPE><DISK><DISK_NAME>/dev/oracleasm/disks/ASM1</DISK_NAME><DISK_SIGNATURE></DISK_SIGNATURE><NUMPARTS>0</NUMPARTS><DISK_STATE>1</DISK_STATE><DISK_SIZE>5362849792</DISK_SIZE><DISK_OWNER>oracle</DISK_OWNER><DISK_GROUP>dba</DISK_GROUP><DISK_PERMISSIONS>0660</DISK_PERMISSIONS></DISK></CV_VAL><CV_VRES>0</CV_VRES><CV_LOG>Exectask:getstorage success.</CV_LOG><CV_CMDLOG><CV_INITCMD>/tmp/CVU_12.1.0.1.0_oracle/exectask -getstorage /dev/oracleasm/disks/ASM1 </CV_INITCMD><CV_CMD>realpath /dev/oracleasm/disks/ASM1</CV_CMD><CV_CMDOUT> /dev/oracleasm/disks/ASM1</CV_CMDOUT><CV_CMDSTAT>0</CV_CMDSTAT><CV_CMD>stat /dev/oracleasm/disks/ASM1</CV_CMD><CV_CMDOUT> stat.st_mode:61B0</CV_CMDOUT><CV_CMDSTAT>0</CV_CMDSTAT><CV_CMD>fopen /proc/partitions</CV_CMD><CV_CMDOUT> 8 0 52428800 sda
8 16 5242880 sdb
</CV_CMDOUT><CV_CMDSTAT>0</CV_CMDSTAT><CV_CMD>popen /bin/grep alias /etc/multipath.conf 2>/dev/null</CV_CMD><CV_CMDOUT></CV_CMDOUT><CV_CMDSTAT>512</CV_CMDSTAT><CV_CMD>popen /bin/rpm -qi cvuqdisk 2>/dev/null</CV_CMD><CV_CMDOUT> cvuqdiskVersion: 1.0.9-1</CV_CMDOUT><CV_CMDSTAT>0</CV_CMDSTAT><CV_CMD>popen /usr/sbin/cvuqdisk -sign2 /dev/sdb1 2>/dev/null</CV_CMD><CV_CMDOUT></CV_CMDOUT><CV_CMDSTAT>256</CV_CMDSTAT><CV_CMD>popen /bin/rpm -qi cvuqdisk 2>/dev/null</CV_CMD><CV_CMDOUT> cvuqdiskVersion: 1.0.9-1</CV_CMDOUT><CV_CMDSTAT>0</CV_CMDSTAT><CV_CMD>popen /usr/sbin/cvuqdisk -sign /dev/sdb1 2>/dev/null</CV_CMD><CV_CMDOUT></CV_CMDOUT><CV_CMDSTAT>512</CV_CMDSTAT><CV_CMD>popen /bin/rpm -qi cvuqdisk 2>/dev/null</CV_CMD><CV_CMDOUT> cvuqdiskVersion: 1.0.9-1</CV_CMDOUT><CV_CMDSTAT>0</CV_CMDSTAT><CV_CMD>popen /usr/sbin/cvuqdisk -size /dev/oracleasm/disks/ASM1 2>/dev/null</CV_CMD><CV_CMDOUT> 5237158
</CV_CMDOUT><CV_CMDSTAT>0</CV_CMDSTAT><CV_CMD>stat /dev/oracleasm/disks/ASM1</CV_CMD><CV_CMDOUT> 0660</CV_CMDOUT><CV_CMDSTAT>0</CV_CMDSTAT><CV_CMD>stat /dev/oracleasm/disks/ASM1</CV_CMD><CV_CMDOUT> stat.st_uid: 54321</CV_CMDOUT><CV_CMDSTAT>0</CV_CMDSTAT><CV_CMD>getpwuid 54321</CV_CMD><CV_CMDOUT> owner: oracle</CV_CMDOUT><CV_CMDSTAT>0</CV_CMDSTAT><CV_CMD>stat /dev/oracleasm/disks/ASM1</CV_CMD><CV_CMDOUT> stat.st_gid: 54322</CV_CMDOUT><CV_CMDSTAT>0</CV_CMDSTAT><CV_CMD>getgrgid 54322</CV_CMD><CV_CMDOUT> group: dba</CV_CMDOUT><CV_CMDSTAT>0</CV_CMDSTAT></CV_CMDLOG><CV_ERES>0</CV_ERES>'
INFO: INFO: [VerifyStorage.isSharedInternal:312]

Name: /dev/sdb1
Node: rac1
Path: /dev/sdb1
OrigPath: /dev/oracleasm/disks/ASM1
Type: Disk
Size: 5237158.0 KB
Free: -1.0 B
Owner: oracle Group: dba Perms: 0660
Signature:
| isCD[false] | vendor[null] | isCertain[false] | numPartitions[0] | policy[false] | lock[false] | isOnASM[false]
INFO: INFO: [VerifyStorage.isSharedInternal:312]

Name: /dev/sdb1
Node: rac2
Path: /dev/sdb1
OrigPath: /dev/oracleasm/disks/ASM1
Type: Disk
Size: 5237158.0 KB
Free: -1.0 B
Owner: oracle Group: dba Perms: 0660
Signature:
| isCD[false] | vendor[null] | isCertain[false] | numPartitions[0] | policy[false] | lock[false] | isOnASM[false]
INFO: INFO: [VerifyStorage.isSharedInternal:347] Checking for consistency of StorageInfo details
INFO: INFO: [VerifyStorage.isSharedInternal:372] _st_:after calling TypeFindergetStorageInstance
Name: /dev/sdb1
Node: rac1
Path: /dev/sdb1
OrigPath: /dev/oracleasm/disks/ASM1
Type: Disk
Size: 5237158.0 KB
Free: -1.0 B
Owner: oracle Group: dba Perms: 0660
Signature:
| isCD[false] | vendor[null] | isCertain[false] | numPartitions[0] | policy[false] | lock[false] | isOnASM[false]
INFO: INFO: [VerifyStorage.isSharedInternal:383] _st_:about to call strategy.isShared
INFO: ERROR: [ResultSet.addErrorDescription:1072] rac2:Cannot verify the shared state for device /dev/sdb1 due to Universally Unique Identifiers (UUIDs) not being found, or different values being found, for this device across nodes:
The problem occurred on nodes:
rac1,rac2
INFO: ERROR: [Result.addErrorDescription:607] Cannot verify the shared state for device /dev/oracleasm/disks/ASM1 due to Universally Unique Identifiers (UUIDs) not being found, or different values being found, for this device across nodes:
[rac1, rac2]
INFO: ERROR: [Result.addErrorDescription:607] Cannot verify the shared state for device /dev/oracleasm/disks/ASM1 due to Universally Unique Identifiers (UUIDs) not being found, or different values being found, for this device across nodes:
[rac1, rac2]
INFO: ERROR: [Result.addErrorDescription:618] Cannot verify the shared state for device /dev/oracleasm/disks/ASM1 due to Universally Unique Identifiers (UUIDs) not being found, or different values being found, for this device across nodes:
[rac1, rac2]
INFO: ERROR: [Result.addErrorDescription:618] Cannot verify the shared state for device /dev/oracleasm/disks/ASM1 due to Universally Unique Identifiers (UUIDs) not being found, or different values being found, for this device across nodes:
[rac1, rac2]
INFO: FINE: [Task.perform:580]
TaskASMDeviceChecks:Device Checks for ASM[TASKASMDEVICECHECKS]:TASK_SUMMARY:WARNING:IGNORABLE:WARNING
ERRORMSG(rac2): Cannot verify the shared state for device /dev/oracleasm/disks/ASM1 due to Universally Unique Identifiers (UUIDs) not being found, or different values being found, for this device across nodes:
[rac1, rac2]
ERRORMSG(rac1): Cannot verify the shared state for device /dev/oracleasm/disks/ASM1 due to Universally Unique Identifiers (UUIDs) not being found, or different values being found, for this device across nodes:
[rac1, rac2]
INFO: *************** End of CVU Error logs ***************
INFO: All forked task are completed at state performChecks
INFO: Completed background operations
INFO: Moved to state <performChecks>
INFO: Expected and Actual value not found
INFO: Expected and Actual value not found


Now I can proceed with this warning, but I will get something like https://forums.oracle.com/thread/2558691 on node2.

From above messages it looks like this is related to the permission of oracle user but I can not see any difference. On thing is getting me and that is if I use UDEV or oracleasm both give me the same results.

[root@rac1 ~]# id oracle
uid=54321(oracle) gid=54321(oinstall) groups=54321(oinstall),501(vboxsf),54322(dba)
[root@rac1 ~]# ssh rac2 id oracle
root@rac2's password:
uid=54321(oracle) gid=54321(oinstall) groups=54321(oinstall),501(vboxsf),54322(dba)
[root@rac1 ~]#


I can only think of the following reasons and those are:
1. Some issues in my permissions (Which I can not find)
2. Bug in Oracle 12c (Other people are able to use this with Virtual Box)
3. Issues in Virtualbox (less likely)

Most probably it is permissions, but would be great if I can get some help. I have tried installation many time following your http://www.oracle-base.com/articles/12c/oracle-db-12cr1-rac-installation-on-oracle-linux-6-using-virtualbox.phpeven did the installation or whole setup many times.

it will be good if you can get something out of this.

--Harvey

Tim...
Site Admin
Posts: 18437
Joined: Mon Nov 01, 2004 5:56 pm
Location: England, UK
Contact:

Re: configure ASM Disks for 12c RAC

Postby Tim... » Thu Aug 01, 2013 11:09 am

Hi.

I really can't see why you would be having a problem. I've done this installation several times following the article and I never get shared disk problems.

I know Yury from Pythian did a run through of a RAC installation using Windows 7 64-bit as a host. Perhaps you can see some Windows-specific stuff in there that makes a difference.

http://www.slideshare.net/yvelikanov/or ... 0-23587496

I can certainly see he does something different with the UDEV rules on the second node to me. You can see he mentioned it in the changelog at the top. I've never needed to do this, so it may be something specific to using as Windows host??

Cheers

Tim...
Tim...
Oracle ACE Director
Oracle ACE of the Year 2006 - Oracle Magazine Editors Choice Awards
OakTable Member
OCP DBA 7.3, 8, 8i, 9i, 10g, 11g
OCP Advanced PL/SQL Developer
Oracle Database: SQL Certified Expert
My website: http://www.oracle-base.com
My blog: http://www.oracle-base.com/blog


Return to “Oracle RAC and Clusterware”

Who is online

Users browsing this forum: No registered users and 3 guests

cron