How to install Oracle RAC 12.1.0.2 Standard Edition 2 (SE2) in silent mode on Oracle Linux 6.7 with VirtualBox – Part 2

This post documents how to install a 2-node Oracle RAC cluster with Oracle 12.1.0.2 SE2 on Oracle Linux 6.7 (OL6) with VirtualBox (VBOX) 5.0.4 on Windows 8.1.

Part 1 details Linux installation and configuration and part 2 details Oracle software installation (Grid Infrastructure (GI), Oracle Database) and database creation.

In this article GIMR stands for Grid Infrastructure Management Repository.

Disclaimer: this is only an example that can be used to setup a lab or test system: it is not designed to be used for production purpose.

Grid Infrastructure silent installation

I have created ORACLE_BASE and ORACLE_HOME target directories on both nodes:

# mkdir -p /u01/app/base
# chown oracle:dba /u01/app/base
# mkdir -p  /u01/app/12.1.0.2/grid
# chown oracle:oinstall /u01/app/12.1.0.2/grid
# chmod -R 775 /u01

I have created /etc/oraInst.loc to define Oracle Inventory location on both nodes:

# mkdir  /u01/app/oraInventory
# cat /etc/oraInst.loc
inventory_loc=/u01/app/oraInventory
inst_group=oinstall
# ls -al /u01/app/oraInventory
total 0
drwxr-xr-x 2 root root  6 Apr  6 14:16 .
drwxrwxr-x 5 root root 51 Apr  6 14:16 ..
# chown oracle:oinstall /u01/app/oraInventory
#

I have created following script to run OUI in silent mode:

rm -rf /u01/app/oraInventory/*
rm -rf /tmp/Ora*
rm -rf /tmp/deinstall*
rm -rf /tmp/CVU*
cd grid
export DISTRIB=`pwd`
./runInstaller -silent         \
       -responseFile $DISTRIB/response/grid_install.rsp        \
       INVENTORY_LOCATION=/u01/app/oraInventory                \
       SELECTED_LANGUAGES=en                                   \
       oracle.install.option=CRS_CONFIG                        \
       ORACLE_BASE=/u01/app/base/                              \
       ORACLE_HOME=/u01/app/12.1.0.2/grid                      \
       oracle.install.asm.OSDBA=dba                            \
       oracle.install.asm.OSOPER=dba                           \
       oracle.install.asm.OSASM=dba                            \
       oracle.install.crs.config.gpnp.scanName=ol6toc-scan.localdomain \
       oracle.install.crs.config.gpnp.scanPort=1521            \
       oracle.install.crs.config.clusterName=ol6toc            \
       oracle.install.crs.config.gpnp.configureGNS=false       \
       oracle.install.crs.config.clusterNodes=ol6tocn1:ol6tocn1-vip,ol6tocn2:ol6tocn2-vip \
       oracle.install.crs.config.networkInterfaceList=eth0:192.168.56.0:1,eth1:192.168.43.0:2 \
       oracle.install.crs.config.storageOption=ASM_STORAGE     \
       oracle.install.crs.config.useIPMI=false                 \
       oracle.install.asm.SYSASMPassword=oracle12c              \
       oracle.install.asm.diskGroup.diskDiscoveryString=ORCL:ASM* \
       oracle.install.asm.diskGroup.name=OCRVD                 \
       oracle.install.asm.diskGroup.disks=ORCL:ASM1            \
       oracle.install.asm.diskGroup.redundancy=EXTERNAL        \
       oracle.install.asm.monitorPassword=oracle12c            \
       -waitForCompletion                           

The above script is using following variables defined in ./grid/response/grid_install.rsp response file:

parameter name description
INVENTORY_LOCATION Directory where Oracle Inventory will be stored. Must match /etc/oraInst.loc contents.
oracle.install.option Must be set to CRS_CONFIG for Grid Infrastructure for cluster.
oracle.install.crs.config.gpnp.scanName Must be set to DNS alias for the 3 SCAN listener adresses.
oracle.install.crs.config.gpnp.scanPort Must be to set to TCP port to be used by SCAN listener.
oracle.install.crs.config.clusterName No dependency for this name. Will be used as PDB name in GIMR database and returned by cemutlo command.
oracle.install.crs.config.gpnp.configureGNS Must be set to FALSE to not use Grid Naming Service (GNS).
oracle.install.crs.config.clusterNodes Must be set to public-hostname:vip-hostname comma separated host name list (excluding flex ASM case).
oracle.install.crs.config.networkInterfaceList Must be set to network-interface:network-interface-subnet:network-interface_type comma separated strings
where network-interface_type must be set to 1 for public interface and to 2 for private interface (interconnect).
oracle.install.crs.config.storageOption Set to ASM_STORAGE for OCR and voting disk.
oracle.install.crs.config.useIPMI Must be set to FALSE to not use Intelligent Power Management Interface.
oracle.install.asm.SYSASMPassword Must be set to SYS password for ASM instance.
oracle.install.asm.diskGroup.diskDiscoveryString Used to set ASM instance ASM_DISKSTRING parameter.
oracle.install.asm.diskGroup.name Name of ASM disk group used for OCR, voting disk and GIMR database.
oracle.install.asm.diskGroup.disks Comma separated ASM disk names list to be used for above ASM disk group.
oracle.install.asm.diskGroup.redundancy Disk group redundancy used by above ASM disk group.
oracle.install.asm.monitorPassword Must be set to ASMSNMP password for ASM instance.

Running this script has given following output:

Starting Oracle Universal Installer...

Checking Temp space: must be greater than 415 MB.   Actual 26946 MB    Passed
Checking swap space: must be greater than 150 MB.   Actual 3967 MB    Passed
Preparing to launch Oracle Universal Installer from /tmp/OraInstall2015-09-13_01-07-30PM. Please wait ...
[WARNING] [INS-30011] The SYS password entered does not conform to the Oracle recommended standards.
   CAUSE: Oracle recommends that the password entered should be at least 8 characters in length, contain at least 1 uppercase character, 1 lower case character and 1 digit [0-9].
   ACTION: Provide a password that conforms to the Oracle recommended standards.
[WARNING] [INS-30011] The ASMSNMP password entered does not conform to the Oracle recommended standards.
   CAUSE: Oracle recommends that the password entered should be at least 8 characters in length, contain at least 1 uppercase character, 1 lower case character and 1 digit [0-9].
   ACTION: Provide a password that conforms to the Oracle recommended standards.
[WARNING] [INS-41808] Possible invalid choice for OSASM Group.
   CAUSE: The name of the group you selected for the OSASM group is commonly used to grant other system privileges (For example: asmdba, asmoper, dba, oper).
   ACTION: Oracle recommends that you designate asmadmin as the OSASM group.
[WARNING] [INS-41809] Possible invalid choice for OSDBA Group.
   CAUSE: The group name you selected as the OSDBA for ASM group is commonly used for Oracle Database administrator privileges.
   ACTION: Oracle recommends that you designate asmdba as the OSDBA for ASM group, and that the group should not be the same group as an Oracle Database OSDBA group.
[WARNING] [INS-41810] Possible invalid choice for OSOPER Group.
   CAUSE: The group name you selected as the OSOPER for ASM group is commonly used for Oracle Database administrator privileges.
   ACTION: Oracle recommends that you designate asmoper as the OSOPER for ASM group, and that the group should not be the same group as an Oracle Database OSOPER group.
[WARNING] [INS-41813] OSDBA for ASM, OSOPER for ASM, and OSASM are the same OS group.
   CAUSE: The group you selected for granting the OSDBA for ASM group for database access, and the OSOPER for ASM group for startup and shutdown of Oracle ASM, is the same group as the OSASM group, whose members have SYSASM privileges on Oracle ASM.
   ACTION: Choose different groups as the OSASM, OSDBA for ASM, and OSOPER for ASM groups.
[WARNING] [INS-13014] Target environment does not meet some optional requirements.
   CAUSE: Some of the optional prerequisites are not met. See logs for details. /u01/app/oraInventory/logs/installActions2015-09-13_01-07-30PM.log
   ACTION: Identify the list of failed prerequisite checks from the log: /u01/app/oraInventory/logs/installActions2015-09-13_01-07-30PM.log. Then either from the log file or from installation manual find the appropriate configuration to meet the prerequisites and fix it manually.
You can find the log of this install session at:
 /u01/app/oraInventory/logs/installActions2015-09-13_01-07-30PM.log
The installation of Oracle Grid Infrastructure 12c was successful.
Please check '/u01/app/oraInventory/logs/silentInstall2015-09-13_01-07-30PM.log' for more details.

As a root user, execute the following script(s):
        1. /u01/app/12.1.0.2/grid/root.sh

Execute /u01/app/12.1.0.2/grid/root.sh on the following nodes:
[ol6tocn1, ol6tocn2]

Run the script on the local node first. After successful completion, you can start the script in parallel on all other nodes.

Successfully Setup Software.
As install user, execute the following script to complete the configuration.
        1. /u01/app/12.1.0.2/grid/cfgtoollogs/configToolAllCommands RESPONSE_FILE=

        Note:
        1. This script must be run on the same host from where installer was run.
        2. This script needs a small password properties file for configuration assistants that require passwords (refer to install guide documentation).


I have ignored above INS-XXX warnings and following failed prerequisites:

INFO: ------------------List of failed Tasks------------------
INFO: *********************************************
INFO: Package: cvuqdisk-1.0.9-1: This is a prerequisite condition to test whether the package "cvuqdisk-1.0.9-1" is available on the system.
INFO: Severity:IGNORABLE
INFO: OverallStatus:VERIFICATION_FAILED
INFO: *********************************************
INFO: Physical Memory: This is a prerequisite condition to test whether the system has at least 4GB (4194304.0KB) of total physical memory.
INFO: Severity:IGNORABLE
INFO: OverallStatus:VERIFICATION_FAILED
INFO: -----------------End of failed Tasks List----------------

On first cluster node I have run root.sh:

# /u01/app/12.1.0.2/grid/root.sh
Check /u01/app/12.1.0.2/grid/install/root_ol6tocn1.localdomain_2015-09-13_13-26-40.log for the output of root script
#

Corresponding log is:

# cat /u01/app/12.1.0.2/grid/install/root_ol6tocn1.localdomain_2015-09-13_13-26-40.log
Performing root user operation.

The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME=  /u01/app/12.1.0.2/grid
   Copying dbhome to /usr/local/bin ...
   Copying oraenv to /usr/local/bin ...
   Copying coraenv to /usr/local/bin ...


Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Using configuration parameter file: /u01/app/12.1.0.2/grid/crs/install/crsconfig_params
2015/09/13 13:26:41 CLSRSC-4001: Installing Oracle Trace File Analyzer (TFA) Collector.

2015/09/13 13:27:10 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.

2015/09/13 13:27:11 CLSRSC-363: User ignored prerequisites during installation

OLR initialization - successful
  root wallet
  root wallet cert
  root cert export
  peer wallet
  profile reader wallet
  pa wallet
  peer wallet keys
  pa wallet keys
  peer cert request
  pa cert request
  peer cert
  pa cert
  peer root cert TP
  profile reader root cert TP
  pa root cert TP
  peer pa cert TP
  pa peer cert TP
  profile reader pa cert TP
  profile reader peer cert TP
  peer user cert
  pa user cert
2015/09/13 13:27:57 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.conf'

CRS-4133: Oracle High Availability Services has been stopped.
CRS-4123: Oracle High Availability Services has been started.
CRS-4133: Oracle High Availability Services has been stopped.
CRS-4123: Oracle High Availability Services has been started.
CRS-2672: Attempting to start 'ora.evmd' on 'ol6tocn1'
CRS-2672: Attempting to start 'ora.mdnsd' on 'ol6tocn1'
CRS-2676: Start of 'ora.mdnsd' on 'ol6tocn1' succeeded
CRS-2676: Start of 'ora.evmd' on 'ol6tocn1' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'ol6tocn1'
CRS-2676: Start of 'ora.gpnpd' on 'ol6tocn1' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'ol6tocn1'
CRS-2672: Attempting to start 'ora.gipcd' on 'ol6tocn1'
CRS-2676: Start of 'ora.cssdmonitor' on 'ol6tocn1' succeeded
CRS-2676: Start of 'ora.gipcd' on 'ol6tocn1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'ol6tocn1'
CRS-2672: Attempting to start 'ora.diskmon' on 'ol6tocn1'
CRS-2676: Start of 'ora.diskmon' on 'ol6tocn1' succeeded
CRS-2676: Start of 'ora.cssd' on 'ol6tocn1' succeeded

ASM created and started successfully.

Disk Group OCRVD created successfully.

CRS-2672: Attempting to start 'ora.crf' on 'ol6tocn1'
CRS-2672: Attempting to start 'ora.storage' on 'ol6tocn1'
CRS-2676: Start of 'ora.storage' on 'ol6tocn1' succeeded
CRS-2676: Start of 'ora.crf' on 'ol6tocn1' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'ol6tocn1'
CRS-2676: Start of 'ora.crsd' on 'ol6tocn1' succeeded
CRS-4256: Updating the profile
Successful addition of voting disk 6f18d0a5baa04f90bfe558af71f5224c.
Successfully replaced voting disk group with +OCRVD.
CRS-4256: Updating the profile
CRS-4266: Voting file(s) successfully replaced
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
 1. ONLINE   6f18d0a5baa04f90bfe558af71f5224c (ORCL:ASM1) [OCRVD]
Located 1 voting disk(s).
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'ol6tocn1'
CRS-2673: Attempting to stop 'ora.crsd' on 'ol6tocn1'
CRS-2677: Stop of 'ora.crsd' on 'ol6tocn1' succeeded
CRS-2673: Attempting to stop 'ora.crf' on 'ol6tocn1'
CRS-2673: Attempting to stop 'ora.mdnsd' on 'ol6tocn1'
CRS-2673: Attempting to stop 'ora.gpnpd' on 'ol6tocn1'
CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'ol6tocn1'
CRS-2677: Stop of 'ora.drivers.acfs' on 'ol6tocn1' succeeded
CRS-2677: Stop of 'ora.crf' on 'ol6tocn1' succeeded
CRS-2673: Attempting to stop 'ora.ctssd' on 'ol6tocn1'
CRS-2673: Attempting to stop 'ora.evmd' on 'ol6tocn1'
CRS-2673: Attempting to stop 'ora.storage' on 'ol6tocn1'
CRS-2677: Stop of 'ora.gpnpd' on 'ol6tocn1' succeeded
CRS-2677: Stop of 'ora.mdnsd' on 'ol6tocn1' succeeded
CRS-2677: Stop of 'ora.storage' on 'ol6tocn1' succeeded
CRS-2673: Attempting to stop 'ora.asm' on 'ol6tocn1'
CRS-2677: Stop of 'ora.ctssd' on 'ol6tocn1' succeeded
CRS-2677: Stop of 'ora.evmd' on 'ol6tocn1' succeeded
CRS-2677: Stop of 'ora.asm' on 'ol6tocn1' succeeded
CRS-2673: Attempting to stop 'ora.cluster_interconnect.haip' on 'ol6tocn1'
CRS-2677: Stop of 'ora.cluster_interconnect.haip' on 'ol6tocn1' succeeded
CRS-2673: Attempting to stop 'ora.cssd' on 'ol6tocn1'
CRS-2677: Stop of 'ora.cssd' on 'ol6tocn1' succeeded
CRS-2673: Attempting to stop 'ora.gipcd' on 'ol6tocn1'
CRS-2677: Stop of 'ora.gipcd' on 'ol6tocn1' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'ol6tocn1' has completed
CRS-4133: Oracle High Availability Services has been stopped.
CRS-4123: Starting Oracle High Availability Services-managed resources
CRS-2672: Attempting to start 'ora.mdnsd' on 'ol6tocn1'
CRS-2672: Attempting to start 'ora.evmd' on 'ol6tocn1'
CRS-2676: Start of 'ora.evmd' on 'ol6tocn1' succeeded
CRS-2676: Start of 'ora.mdnsd' on 'ol6tocn1' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'ol6tocn1'
CRS-2676: Start of 'ora.gpnpd' on 'ol6tocn1' succeeded
CRS-2672: Attempting to start 'ora.gipcd' on 'ol6tocn1'
CRS-2676: Start of 'ora.gipcd' on 'ol6tocn1' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'ol6tocn1'
CRS-2676: Start of 'ora.cssdmonitor' on 'ol6tocn1' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'ol6tocn1'
CRS-2672: Attempting to start 'ora.diskmon' on 'ol6tocn1'
CRS-2676: Start of 'ora.diskmon' on 'ol6tocn1' succeeded
CRS-2676: Start of 'ora.cssd' on 'ol6tocn1' succeeded
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'ol6tocn1'
CRS-2672: Attempting to start 'ora.ctssd' on 'ol6tocn1'
CRS-2676: Start of 'ora.ctssd' on 'ol6tocn1' succeeded
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'ol6tocn1' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'ol6tocn1'
CRS-2676: Start of 'ora.asm' on 'ol6tocn1' succeeded
CRS-2672: Attempting to start 'ora.storage' on 'ol6tocn1'
CRS-2676: Start of 'ora.storage' on 'ol6tocn1' succeeded
CRS-2672: Attempting to start 'ora.crf' on 'ol6tocn1'
CRS-2676: Start of 'ora.crf' on 'ol6tocn1' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'ol6tocn1'
CRS-2676: Start of 'ora.crsd' on 'ol6tocn1' succeeded
CRS-6023: Starting Oracle Cluster Ready Services-managed resources
CRS-6017: Processing resource auto-start for servers: ol6tocn1
CRS-6016: Resource auto-start has completed for server ol6tocn1
CRS-6024: Completed start of Oracle Cluster Ready Services-managed resources
CRS-4123: Oracle High Availability Services has been started.
2015/09/13 13:33:35 CLSRSC-343: Successfully started Oracle Clusterware stack

CRS-2672: Attempting to start 'ora.OCRVD.dg' on 'ol6tocn1'
CRS-2676: Start of 'ora.OCRVD.dg' on 'ol6tocn1' succeeded
Preparing packages for installation...
cvuqdisk-1.0.9-1
2015/09/13 13:35:18 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded

#

I have run root.sh on cluster node 2:

# /u01/app/12.1.0.2/grid/root.sh
Check /u01/app/12.1.0.2/grid/install/root_ol6tocn2.localdomain_2015-09-13_13-38-36.log for the output of root script

Corresponding log is :

# cat /u01/app/12.1.0.2/grid/install/root_ol6tocn2.localdomain_2015-09-13_13-38-36.log
Performing root user operation.

The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME=  /u01/app/12.1.0.2/grid
   Copying dbhome to /usr/local/bin ...
   Copying oraenv to /usr/local/bin ...
   Copying coraenv to /usr/local/bin ...


Creating /etc/oratab file...
Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
Using configuration parameter file: /u01/app/12.1.0.2/grid/crs/install/crsconfig_params
2015/09/13 13:38:37 CLSRSC-4001: Installing Oracle Trace File Analyzer (TFA) Collector.

2015/09/13 13:39:07 CLSRSC-4002: Successfully installed Oracle Trace File Analyzer (TFA) Collector.

2015/09/13 13:39:08 CLSRSC-363: User ignored prerequisites during installation

OLR initialization - successful
2015/09/13 13:40:25 CLSRSC-330: Adding Clusterware entries to file 'oracle-ohasd.conf'

CRS-4133: Oracle High Availability Services has been stopped.
CRS-4123: Oracle High Availability Services has been started.
CRS-4133: Oracle High Availability Services has been stopped.
CRS-4123: Oracle High Availability Services has been started.
CRS-2791: Starting shutdown of Oracle High Availability Services-managed resources on 'ol6tocn2'
CRS-2673: Attempting to stop 'ora.drivers.acfs' on 'ol6tocn2'
CRS-2677: Stop of 'ora.drivers.acfs' on 'ol6tocn2' succeeded
CRS-2793: Shutdown of Oracle High Availability Services-managed resources on 'ol6tocn2' has completed
CRS-4133: Oracle High Availability Services has been stopped.
CRS-4123: Starting Oracle High Availability Services-managed resources
CRS-2672: Attempting to start 'ora.mdnsd' on 'ol6tocn2'
CRS-2672: Attempting to start 'ora.evmd' on 'ol6tocn2'
CRS-2676: Start of 'ora.evmd' on 'ol6tocn2' succeeded
CRS-2676: Start of 'ora.mdnsd' on 'ol6tocn2' succeeded
CRS-2672: Attempting to start 'ora.gpnpd' on 'ol6tocn2'
CRS-2676: Start of 'ora.gpnpd' on 'ol6tocn2' succeeded
CRS-2672: Attempting to start 'ora.gipcd' on 'ol6tocn2'
CRS-2676: Start of 'ora.gipcd' on 'ol6tocn2' succeeded
CRS-2672: Attempting to start 'ora.cssdmonitor' on 'ol6tocn2'
CRS-2676: Start of 'ora.cssdmonitor' on 'ol6tocn2' succeeded
CRS-2672: Attempting to start 'ora.cssd' on 'ol6tocn2'
CRS-2672: Attempting to start 'ora.diskmon' on 'ol6tocn2'
CRS-2676: Start of 'ora.diskmon' on 'ol6tocn2' succeeded
CRS-2676: Start of 'ora.cssd' on 'ol6tocn2' succeeded
CRS-2672: Attempting to start 'ora.cluster_interconnect.haip' on 'ol6tocn2'
CRS-2672: Attempting to start 'ora.ctssd' on 'ol6tocn2'
CRS-2676: Start of 'ora.ctssd' on 'ol6tocn2' succeeded
CRS-2676: Start of 'ora.cluster_interconnect.haip' on 'ol6tocn2' succeeded
CRS-2672: Attempting to start 'ora.asm' on 'ol6tocn2'
CRS-2676: Start of 'ora.asm' on 'ol6tocn2' succeeded
CRS-2672: Attempting to start 'ora.storage' on 'ol6tocn2'
CRS-2676: Start of 'ora.storage' on 'ol6tocn2' succeeded
CRS-2672: Attempting to start 'ora.crf' on 'ol6tocn2'
CRS-2676: Start of 'ora.crf' on 'ol6tocn2' succeeded
CRS-2672: Attempting to start 'ora.crsd' on 'ol6tocn2'
CRS-2676: Start of 'ora.crsd' on 'ol6tocn2' succeeded
CRS-6017: Processing resource auto-start for servers: ol6tocn2
CRS-2673: Attempting to stop 'ora.LISTENER_SCAN1.lsnr' on 'ol6tocn1'
CRS-2672: Attempting to start 'ora.net1.network' on 'ol6tocn2'
CRS-2677: Stop of 'ora.LISTENER_SCAN1.lsnr' on 'ol6tocn1' succeeded
CRS-2676: Start of 'ora.net1.network' on 'ol6tocn2' succeeded
CRS-2673: Attempting to stop 'ora.scan1.vip' on 'ol6tocn1'
CRS-2672: Attempting to start 'ora.ons' on 'ol6tocn2'
CRS-2677: Stop of 'ora.scan1.vip' on 'ol6tocn1' succeeded
CRS-2672: Attempting to start 'ora.scan1.vip' on 'ol6tocn2'
CRS-2676: Start of 'ora.scan1.vip' on 'ol6tocn2' succeeded
CRS-2672: Attempting to start 'ora.LISTENER_SCAN1.lsnr' on 'ol6tocn2'
CRS-2676: Start of 'ora.ons' on 'ol6tocn2' succeeded
CRS-2676: Start of 'ora.LISTENER_SCAN1.lsnr' on 'ol6tocn2' succeeded
CRS-6016: Resource auto-start has completed for server ol6tocn2
CRS-6024: Completed start of Oracle Cluster Ready Services-managed resources
CRS-4123: Oracle High Availability Services has been started.
2015/09/13 13:44:29 CLSRSC-343: Successfully started Oracle Clusterware stack

Preparing packages for installation...
cvuqdisk-1.0.9-1
2015/09/13 13:44:46 CLSRSC-325: Configure Oracle Grid Infrastructure for a Cluster ... succeeded

#

I have checked that GI is running on both cluster nodes:

$ . oraenv
ORACLE_SID = [oracle] ? +ASM1
The Oracle base has been set to /u01/app/base
$ crsctl stat res -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.LISTENER.lsnr
               ONLINE  ONLINE       ol6tocn1                 STABLE
               ONLINE  ONLINE       ol6tocn2                 STABLE
ora.OCRVD.dg
               ONLINE  ONLINE       ol6tocn1                 STABLE
               ONLINE  ONLINE       ol6tocn2                 STABLE
ora.asm
               ONLINE  ONLINE       ol6tocn1                 Started,STABLE
               ONLINE  ONLINE       ol6tocn2                 Started,STABLE
ora.net1.network
               ONLINE  ONLINE       ol6tocn1                 STABLE
               ONLINE  ONLINE       ol6tocn2                 STABLE
ora.ons
               ONLINE  ONLINE       ol6tocn1                 STABLE
               ONLINE  ONLINE       ol6tocn2                 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       ol6tocn2                 STABLE
ora.LISTENER_SCAN2.lsnr
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.LISTENER_SCAN3.lsnr
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.MGMTLSNR
      1        OFFLINE OFFLINE                               STABLE
ora.cvu
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.oc4j
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.ol6tocn1.vip
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.ol6tocn2.vip
      1        ONLINE  ONLINE       ol6tocn2                 STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       ol6tocn2                 STABLE
ora.scan2.vip
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.scan3.vip
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
--------------------------------------------------------------------------------
$

I have checked that OCR and voting disks have been created in the right disk group named +OCRVD:

$ ocrcheck
Status of Oracle Cluster Registry is as follows :
         Version                  :          4
         Total space (kbytes)     :     409568
         Used space (kbytes)      :       1496
         Available space (kbytes) :     408072
         ID                       : 1224152755
         Device/File Name         :     +OCRVD
                                    Device/File integrity check succeeded

                                    Device/File not configured

                                    Device/File not configured

                                    Device/File not configured

                                    Device/File not configured

         Cluster registry integrity check succeeded

         Logical corruption check bypassed due to non-privileged user

$ crsctl query css votedisk
##  STATE    File Universal Id                File Name Disk group
--  -----    -----------------                --------- ---------
 1. ONLINE   6f18d0a5baa04f90bfe558af71f5224c (ORCL:ASM1) [OCRVD]
Located 1 voting disk(s).
$

I have run the last GI configuration scripts after creating the required response file that contains SYS password and ASMSNMP password for ASM instance:

$ cat p.r
oracle.assistants.asm|S_ASMPASSWORD=oracle12c
oracle.assistants.asm|S_ASMMONITORPASSWORD=oracle12c

I have run it with oracle user account:

$ /u01/app/12.1.0.2/grid/cfgtoollogs/configToolAllCommands RESPONSE_FILE=p.r

Running this script generates a large log file with many INFO and WARNING messages.
The most important message is the one displayed at the end:

...
You can see the log file: /u01/app/12.1.0.2/grid/cfgtoollogs/oui/configActions2015-09-13_01-54-20-PM.log

I have ignored all warnings and checked in the second log file
that each plug-in has been successfully performed with:

$ grep plug-in  /u01/app/12.1.0.2/grid/cfgtoollogs/oui/configActions2015-09-13_01-54-20-PM.log
The plug-in Update CRS flag in Inventory is running
The plug-in Update CRS flag in Inventory has successfully been performed
The plug-in Oracle Net Configuration Assistant is running
The plug-in Oracle Net Configuration Assistant has successfully been performed
The plug-in Automatic Storage Management Configuration Assistant is running
The plug-in Automatic Storage Management Configuration Assistant has successfully been performed
The plug-in Creating Container Database for Oracle Grid Infrastructure Management Repository is running
The plug-in Creating Container Database for Oracle Grid Infrastructure Management Repository has successfully been performed
The plug-in Setting up Oracle Grid Infrastructure Management Repository is running
The plug-in Setting up Oracle Grid Infrastructure Management Repository has successfully been performed
The plug-in MGMT Configuration Assistant is running
The plug-in MGMT Configuration Assistant has successfully been performed
The plug-in Oracle Cluster Verification Utility is running
The plug-in Oracle Cluster Verification Utility has successfully been performed
$

I have checked that the ora.MGMTLSNR and ora.mgmtdb resources are now online:

$ crsctl stat res -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.LISTENER.lsnr
               ONLINE  ONLINE       ol6tocn1                 STABLE
               ONLINE  ONLINE       ol6tocn2                 STABLE
ora.OCRVD.dg
               ONLINE  ONLINE       ol6tocn1                 STABLE
               ONLINE  ONLINE       ol6tocn2                 STABLE
ora.asm
               ONLINE  ONLINE       ol6tocn1                 Started,STABLE
               ONLINE  ONLINE       ol6tocn2                 Started,STABLE
ora.net1.network
               ONLINE  ONLINE       ol6tocn1                 STABLE
               ONLINE  ONLINE       ol6tocn2                 STABLE
ora.ons
               ONLINE  ONLINE       ol6tocn1                 STABLE
               ONLINE  ONLINE       ol6tocn2                 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       ol6tocn2                 STABLE
ora.LISTENER_SCAN2.lsnr
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.LISTENER_SCAN3.lsnr
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.MGMTLSNR
      1        ONLINE  ONLINE       ol6tocn1                 169.254.72.152 192.1
                                                             68.43.41,STABLE
ora.cvu
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.mgmtdb
      1        ONLINE  ONLINE       ol6tocn1                 Open,STABLE
ora.oc4j
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.ol6tocn1.vip
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.ol6tocn2.vip
      1        ONLINE  ONLINE       ol6tocn2                 STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       ol6tocn2                 STABLE
ora.scan2.vip
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.scan3.vip
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
--------------------------------------------------------------------------------
$

ora.MGMTDB is the new GIMR database that is mandatory with Oracle RAC 12.1.0.2:
this database and its listener have specific clusterware resource types:

$ crsctl status resource ora.mgmtdb
NAME=ora.mgmtdb
TYPE=ora.mgmtdb.type
TARGET=ONLINE
STATE=ONLINE on ol6tocn1

$ crsctl status resource ora.MGMTLSNR
NAME=ora.MGMTLSNR
TYPE=ora.mgmtlsnr.type
TARGET=ONLINE
STATE=ONLINE on ol6tocn1

$

This new database instance is named -MGMTDB (note the ‘-‘ !) on first cluster node. I have set the right environment with:

$ . oraenv
ORACLE_SID = [+ASM1] ? -MGMTDB
The Oracle base remains unchanged with value /u01/app/base

I have connected with SQL*Plus to check database properties:

$ sqlplus / as sysdba

SQL*Plus: Release 12.1.0.2.0 Production on Sun Sep 13 14:17:35 2015

Copyright (c) 1982, 2014, Oracle.  All rights reserved.


Connected to:
Oracle Database 12c Enterprise Edition Release 12.1.0.2.0 - 64bit Production
With the Partitioning, Automatic Storage Management and Advanced Analytics options

SQL> select name, cdb from v$database;

NAME      CDB
--------- ---
_MGMTDB   YES

SQL> show parameter instance_name

NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
instance_name                        string      -MGMTDB
SQL> select con_id, name from v$pdbs;

    CON_ID NAME
---------- ------------------------------
         2 PDB$SEED
         3 OL6TOC

SQL> column name format a110
SQL> set linesize 120
SQL> select name from v$datafile union select name from v$tempfile;

NAME
--------------------------------------------------------------------------------------------------------------
+OCRVD/_MGMTDB/DATAFILE/sysaux.257.890315769
+OCRVD/_MGMTDB/DATAFILE/system.258.890315791
+OCRVD/_MGMTDB/DATAFILE/undotbs1.259.890315807
+OCRVD/_MGMTDB/FD9AC0F7C36E4438E043B6A9E80A24D5/DATAFILE/pdbseed_temp012015-09-13_01-58-13-pm.dbf
+OCRVD/_MGMTDB/FD9AC0F7C36E4438E043B6A9E80A24D5/DATAFILE/sysaux.266.890315875
+OCRVD/_MGMTDB/FD9AC0F7C36E4438E043B6A9E80A24D5/DATAFILE/system.265.890315875
+OCRVD/_MGMTDB/FD9B43BF6A646F8CE043B6A9E80A2815/DATAFILE/ol6toc_temp012015-09-13_02-04-30-pm.dbf
+OCRVD/_MGMTDB/FD9B43BF6A646F8CE043B6A9E80A2815/DATAFILE/sysaux.271.890316173
+OCRVD/_MGMTDB/FD9B43BF6A646F8CE043B6A9E80A2815/DATAFILE/sysgridhomedata.272.890316173
+OCRVD/_MGMTDB/FD9B43BF6A646F8CE043B6A9E80A2815/DATAFILE/sysmgmtdata.269.890316173
+OCRVD/_MGMTDB/FD9B43BF6A646F8CE043B6A9E80A2815/DATAFILE/sysmgmtdatadb.273.890316173

NAME
--------------------------------------------------------------------------------------------------------------
+OCRVD/_MGMTDB/FD9B43BF6A646F8CE043B6A9E80A2815/DATAFILE/system.270.890316173
+OCRVD/_MGMTDB/FD9B43BF6A646F8CE043B6A9E80A2815/DATAFILE/users.274.890316173
+OCRVD/_MGMTDB/TEMPFILE/temp.264.890315869

14 rows selected.

SQL> select name from v$controlfile;

NAME
--------------------------------------------------------------------------------------------------------------
+OCRVD/_MGMTDB/CONTROLFILE/current.260.890315849

SQL> select member from v$logfile;

MEMBER
------------------------------------------------------------------------------------------------------------------------
+OCRVD/_MGMTDB/ONLINELOG/group_3.263.890315857
+OCRVD/_MGMTDB/ONLINELOG/group_2.262.890315855
+OCRVD/_MGMTDB/ONLINELOG/group_1.261.890315853

SQL> archive log list;
Database log mode              No Archive Mode
Automatic archival             Disabled
Archive destination            /u01/app/12.1.0.2/grid/dbs/arch
Oldest online log sequence     3
Current log sequence           5
SQL>

_MGMTDB is a multitenant database with 1 pluggable database using cluster name as name and using OCR and voting disk group storage.

Oracle Database SE2 silent installation

I have uploaded and unzipped the media files in /stage directory:

$ ls -al *se2*
-rw-r--r-- 1 oracle oinstall 1673591558 Sep 14 19:41 linuxamd64_12102_database_se2_1of2.zip
-rw-r--r-- 1 oracle oinstall 1015358809 Sep 14 19:42 linuxamd64_12102_database_se2_2of2.zip
$ unzip linuxamd64_12102_database_se2_1of2.zip
$ unzip linuxamd64_12102_database_se2_2of2.zip

I have created Oracle Home directory on both nodes:

# mkdir -p /u01/app/12.1.0.2/se2
# chown oracle:dba /u01/app/12.1.0.2/se2

On first node I have run following script:

cd database
export DISTRIB=`pwd`
./runInstaller -silent \
   -responseFile $DISTRIB/response/db_install.rsp      \
   oracle.install.option=INSTALL_DB_SWONLY             \
   CLUSTER_NODES=ol6tocn1,ol6tocn2                     \
   UNIX_GROUP_NAME=oinstall                            \
   INVENTORY_LOCATION=/u01/app/oraInventory            \
   SELECTED_LANGUAGES=en                               \
   ORACLE_HOME=/u01/app/12.1.0.2/se2                   \
   ORACLE_BASE=/u01/app/base                           \
   oracle.install.db.InstallEdition=SE2                \
   oracle.install.db.isCustomInstall=false             \
   oracle.install.db.DBA_GROUP=dba                     \
   oracle.install.db.OPER_GROUP=dba                    \
   oracle.install.db.BACKUPDBA_GROUP=dba               \
   oracle.install.db.DGDBA_GROUP=dba                   \
   oracle.install.db.KMDBA_GROUP=dba                   \
   SECURITY_UPDATES_VIA_MYORACLESUPPORT=false          \
   DECLINE_SECURITY_UPDATES=true                       \
   -waitForCompletion

I have ignored following failed prerequisite:

INFO: ------------------List of failed Tasks------------------
INFO: *********************************************
INFO: Maximum locked memory check: Check maximum locked memory setting on the system
INFO: Severity:IGNORABLE
INFO: OverallStatus:VERIFICATION_FAILED
INFO: -----------------End of failed Tasks List----------------

Running this script has produced following output:

Starting Oracle Universal Installer...

Checking Temp space: must be greater than 500 MB.   Actual 14233 MB    Passed
Checking swap space: must be greater than 150 MB.   Actual 3962 MB    Passed
Preparing to launch Oracle Universal Installer from /tmp/OraInstall2015-09-14_07-55-34PM. Please wait ...
[WARNING] [INS-32018] The selected Oracle home is outside of Oracle base.
   ACTION: Oracle recommends installing Oracle software within the Oracle base directory. Adjust the Oracle home or Oracle base accordingly.
[WARNING] [INS-13014] Target environment does not meet some optional requirements.
   CAUSE: Some of the optional prerequisites are not met. See logs for details. /u01/app/oraInventory/logs/installActions2015-09-14_07-55-34PM.log
   ACTION: Identify the list of failed prerequisite checks from the log: /u01/app/oraInventory/logs/installActions2015-09-14_07-55-34PM.log. Then either from the log file or from installation manual find the appropriate configuration to meet the prerequisites and fix it manually.
You can find the log of this install session at:
 /u01/app/oraInventory/logs/installActions2015-09-14_07-55-34PM.log
The installation of Oracle Database 12c was successful.
Please check '/u01/app/oraInventory/logs/silentInstall2015-09-14_07-55-34PM.log' for more details.

As a root user, execute the following script(s):
        1. /u01/app/12.1.0.2/se2/root.sh

Execute /u01/app/12.1.0.2/se2/root.sh on the following nodes:
[ol6tocn1, ol6tocn2]


Successfully Setup Software.
$

I have run root.sh on first node …

# /u01/app/12.1.0.2/se2/root.sh
Check /u01/app/12.1.0.2/se2/install/root_ol6tocn1.localdomain_2015-09-14_20-22-53.log for the output of root script
# cat /u01/app/12.1.0.2/se2/install/root_ol6tocn1.localdomain_2015-09-14_20-22-53.log
Performing root user operation.

The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME=  /u01/app/12.1.0.2/se2
   Copying dbhome to /usr/local/bin ...
   Copying oraenv to /usr/local/bin ...
   Copying coraenv to /usr/local/bin ...

Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
#

… and on second node:

# /u01/app/12.1.0.2/se2/root.sh
Check /u01/app/12.1.0.2/se2/install/root_ol6tocn2.localdomain_2015-09-14_20-23-44.log for the output of root script
# cat /u01/app/12.1.0.2/se2/install/root_ol6tocn2.localdomain_2015-09-14_20-23-44.log
Performing root user operation.

The following environment variables are set as:
    ORACLE_OWNER= oracle
    ORACLE_HOME=  /u01/app/12.1.0.2/se2
   Copying dbhome to /usr/local/bin ...
   Copying oraenv to /usr/local/bin ...
   Copying coraenv to /usr/local/bin ...

Entries will be added to the /etc/oratab file as needed by
Database Configuration Assistant when a database is created
Finished running generic part of root script.
Now product-specific root actions will be performed.
#

Fast Recovery Area (FRA) disk group creation

I have switched to oracle account to create FRA disk group that will be used for database creation.

First I have set current instance to ASM instance on first cluster node:

$ . oraenv
ORACLE_SID = [oracle] ? +ASM1
The Oracle base has been set to /u01/app/base
$

I have connected to ASM instance and created disk group using second disk device created during OS configuration steps:

$ sqlplus / as sysasm

SQL*Plus: Release 12.1.0.2.0 Production on Mon Sep 14 20:25:26 2015

Copyright (c) 1982, 2014, Oracle.  All rights reserved.


Connected to:
Oracle Database 12c Enterprise Edition Release 12.1.0.2.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options

SQL> show parameter string

NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
asm_diskstring                       string      ORCL:ASM*

SQL> create diskgroup FRA external redundancy disk 'ORCL:ASM2';

Diskgroup created.

SQL>

I have checked that disk group resource ora.FRA.dg has been added to OCR:

$ crsctl stat res -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.FRA.dg
               ONLINE  ONLINE       ol6tocn1                 STABLE
               OFFLINE OFFLINE      ol6tocn2                 STABLE
ora.LISTENER.lsnr
               ONLINE  ONLINE       ol6tocn1                 STABLE
               ONLINE  ONLINE       ol6tocn2                 STABLE
ora.OCRVD.dg
               ONLINE  ONLINE       ol6tocn1                 STABLE
               ONLINE  ONLINE       ol6tocn2                 STABLE
ora.asm
               ONLINE  ONLINE       ol6tocn1                 Started,STABLE
               ONLINE  ONLINE       ol6tocn2                 Started,STABLE
ora.net1.network
               ONLINE  ONLINE       ol6tocn1                 STABLE
               ONLINE  ONLINE       ol6tocn2                 STABLE
ora.ons
               ONLINE  ONLINE       ol6tocn1                 STABLE
               ONLINE  ONLINE       ol6tocn2                 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.LISTENER_SCAN2.lsnr
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.LISTENER_SCAN3.lsnr
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.MGMTLSNR
      1        ONLINE  ONLINE       ol6tocn1                 169.254.72.152 192.1
                                                             68.43.41,STABLE
ora.cvu
      1        ONLINE  ONLINE       ol6tocn2                 STABLE
ora.mgmtdb
      1        ONLINE  ONLINE       ol6tocn1                 Open,STABLE
ora.oc4j
      1        ONLINE  ONLINE       ol6tocn2                 STABLE
ora.ol6tocn1.vip
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.ol6tocn2.vip
      1        ONLINE  ONLINE       ol6tocn2                 STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.scan2.vip
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.scan3.vip
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
--------------------------------------------------------------------------------
$

I have started disk group on cluster node 2:

$ srvctl start diskgroup -diskgroup FRA
$ srvctl status diskgroup -diskgroup FRA
Disk Group FRA is running on ol6tocn2,ol6tocn1

Database files disk group creation

I have run similar steps for last ASM disk group.

$ sqlplus / as sysasm

SQL*Plus: Release 12.1.0.2.0 Production on Mon Sep 14 20:30:06 2015

Copyright (c) 1982, 2014, Oracle.  All rights reserved.


Connected to:
Oracle Database 12c Enterprise Edition Release 12.1.0.2.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options

SQL> create diskgroup DATA external redundancy disk 'ORCL:ASM3';

Diskgroup created.

SQL> Disconnected from Oracle Database 12c Enterprise Edition Release 12.1.0.2.0 - 64bit Production
With the Real Application Clusters and Automatic Storage Management options
$ crsctl stat res -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.DATA.dg
               ONLINE  ONLINE       ol6tocn1                 STABLE
               OFFLINE OFFLINE      ol6tocn2                 STABLE
ora.FRA.dg
               ONLINE  ONLINE       ol6tocn1                 STABLE
               ONLINE  ONLINE       ol6tocn2                 STABLE
ora.LISTENER.lsnr
               ONLINE  ONLINE       ol6tocn1                 STABLE
               ONLINE  ONLINE       ol6tocn2                 STABLE
ora.OCRVD.dg
               ONLINE  ONLINE       ol6tocn1                 STABLE
               ONLINE  ONLINE       ol6tocn2                 STABLE
ora.asm
               ONLINE  ONLINE       ol6tocn1                 Started,STABLE
               ONLINE  ONLINE       ol6tocn2                 Started,STABLE
ora.net1.network
               ONLINE  ONLINE       ol6tocn1                 STABLE
               ONLINE  ONLINE       ol6tocn2                 STABLE
ora.ons
               ONLINE  ONLINE       ol6tocn1                 STABLE
               ONLINE  ONLINE       ol6tocn2                 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.LISTENER_SCAN2.lsnr
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.LISTENER_SCAN3.lsnr
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.MGMTLSNR
      1        ONLINE  ONLINE       ol6tocn1                 169.254.72.152 192.1
                                                             68.43.41,STABLE
ora.cvu
      1        ONLINE  ONLINE       ol6tocn2                 STABLE
ora.mgmtdb
      1        ONLINE  ONLINE       ol6tocn1                 Open,STABLE
ora.oc4j
      1        ONLINE  ONLINE       ol6tocn2                 STABLE
ora.ol6tocn1.vip
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.ol6tocn2.vip
      1        ONLINE  ONLINE       ol6tocn2                 STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.scan2.vip
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.scan3.vip
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
--------------------------------------------------------------------------------
$ srvctl start diskgroup -diskgroup DATA
$ srvctl status diskgroup -diskgroup DATA
Disk Group DATA is running on ol6tocn2,ol6tocn1
$ crsctl stat res -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.DATA.dg
               ONLINE  ONLINE       ol6tocn1                 STABLE
               ONLINE  ONLINE       ol6tocn2                 STABLE
ora.FRA.dg
               ONLINE  ONLINE       ol6tocn1                 STABLE
               ONLINE  ONLINE       ol6tocn2                 STABLE
ora.LISTENER.lsnr
               ONLINE  ONLINE       ol6tocn1                 STABLE
               ONLINE  ONLINE       ol6tocn2                 STABLE
ora.OCRVD.dg
               ONLINE  ONLINE       ol6tocn1                 STABLE
               ONLINE  ONLINE       ol6tocn2                 STABLE
ora.asm
               ONLINE  ONLINE       ol6tocn1                 Started,STABLE
               ONLINE  ONLINE       ol6tocn2                 Started,STABLE
ora.net1.network
               ONLINE  ONLINE       ol6tocn1                 STABLE
               ONLINE  ONLINE       ol6tocn2                 STABLE
ora.ons
               ONLINE  ONLINE       ol6tocn1                 STABLE
               ONLINE  ONLINE       ol6tocn2                 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.LISTENER_SCAN2.lsnr
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.LISTENER_SCAN3.lsnr
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.MGMTLSNR
      1        ONLINE  ONLINE       ol6tocn1                 169.254.72.152 192.1
                                                             68.43.41,STABLE
ora.cvu
      1        ONLINE  ONLINE       ol6tocn2                 STABLE
ora.mgmtdb
      1        ONLINE  ONLINE       ol6tocn1                 Open,STABLE
ora.oc4j
      1        ONLINE  ONLINE       ol6tocn2                 STABLE
ora.ol6tocn1.vip
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.ol6tocn2.vip
      1        ONLINE  ONLINE       ol6tocn2                 STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.scan2.vip
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.scan3.vip
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
--------------------------------------------------------------------------------

All disk groups are now started on each cluster node.

I have changed disk groups compatibility to make sure that I can create a 12.1.0.2 database.

I have run using a SYSASM connection to local ASM instance:

SQL> select name, compatibility, database_compatibility from v$asm_diskgroup;


NAME                           COMPATIBILITY   DATABASE_COMPATIBILITY
------------------------------ --------------- ------------------------------------------------------------
OCRVD                          12.1.0.0.0      10.1.0.0.0
FRA                            10.1.0.0.0      10.1.0.0.0
DATA                           10.1.0.0.0      10.1.0.0.0


SQL>  alter diskgroup DATA set attribute 'compatible.asm'='12.1.0.0';

Diskgroup altered.

SQL> alter diskgroup DATA set attribute 'compatible.rdbms'='12.1.0.0';

Diskgroup altered.

SQL>  alter diskgroup FRA set attribute 'compatible.asm'='12.1.0.0';

Diskgroup altered.

SQL>  alter diskgroup FRA set attribute 'compatible.rdbms'='12.1.0.0';

Diskgroup altered.

SQL> select name, compatibility, database_compatibility from v$asm_diskgroup;

NAME                           COMPATIBILITY   DATABASE_COMPATIBILITY
------------------------------ --------------- ------------------------------
OCRVD                          12.1.0.0.0      10.1.0.0.0
FRA                            12.1.0.0.0      12.1.0.0.0
DATA                           12.1.0.0.0      12.1.0.0.0

SQL>

Silent RAC database creation

I have run following script to a container database named SE2RAC with 1 pluggable database named pdb:

/u01/app/12.1.0.2/se2/bin/dbca \
 -silent \
 -nodelist ol6tocn1,ol6tocn2 \
 -createDatabase \
 -templateName General_Purpose.dbc   \
 -gdbName SE2RAC \
 -createAsContainerDatabase true \
 -numberOfPdbs 1 \
 -pdbName pdb \
 -pdbadminUsername pdba \
 -pdbadminPassword oracle12c \
 -SysPassword oracle12c \
 -SystemPassword oracle12c \
 -emConfiguration NONE \
 -storageType ASM \
 -asmSysPassword oracle12c \
 -diskGroupName DATA \
 -characterSet AL32UTF8 \
 -totalMemory 1024 \
 -recoveryGroupName FRA

This script has printed following output:

Copying database files
1% complete
2% complete
23% complete
Creating and starting Oracle instance
24% complete
27% complete
28% complete
29% complete
32% complete
35% complete
36% complete
38% complete
Creating cluster database views
40% complete
54% complete
Completing Database Creation
56% complete
58% complete
65% complete
72% complete
77% complete
Creating Pluggable Databases
81% complete
100% complete
Look at the log file "/u01/app/base/cfgtoollogs/dbca/SE2RAC/SE2RAC.log" for further details.

I have fixed /etc/oratab on both nodes to replace database name with instance name on first node …:

$ tail -n3 /etc/oratab
+ASM1:/u01/app/12.1.0.2/grid:N          # line added by Agent
-MGMTDB:/u01/app/12.1.0.2/grid:N                # line added by Agent
SE2RAC1:/u01/app/12.1.0.2/se2:N         # line added by Agent

… and on node 2:

$ tail -n3 /etc/oratab
-MGMTDB:/u01/app/12.1.0.2/grid:N                # line added by Agent
+ASM2:/u01/app/12.1.0.2/grid:N          # line added by Agent
SE2RAC2:/u01/app/12.1.0.2/se2:N         # line added by Agent

I have connected to database instance to check database files location and some database properties:

SQL> select con_id, name from v$datafile order by 1;

    CON_ID NAME
---------- --------------------------------------------------------------------------------
         1 +DATA/SE2RAC/DATAFILE/system.258.890426577
         1 +DATA/SE2RAC/DATAFILE/sysaux.257.890426531
         1 +DATA/SE2RAC/DATAFILE/undotbs1.260.890426623
         1 +DATA/SE2RAC/DATAFILE/users.259.890426623
         1 +DATA/SE2RAC/DATAFILE/undotbs2.268.890427371
         2 +DATA/SE2RAC/1A39DC2FE24C7067E053B6A9E80A29BF/DATAFILE/sysaux.265.890426751
         2 +DATA/SE2RAC/1A39DC2FE24C7067E053B6A9E80A29BF/DATAFILE/system.266.890426751
         3 +DATA/SE2RAC/1FBABB29FD2E3604E0532938A8C02046/DATAFILE/sysaux.273.890427897
         3 +DATA/SE2RAC/1FBABB29FD2E3604E0532938A8C02046/DATAFILE/system.272.890427883
         3 +DATA/SE2RAC/1FBABB29FD2E3604E0532938A8C02046/DATAFILE/users.275.890427995

10 rows selected.

SQL>
SQL> select con_id, name from v$controlfile order by 1;

    CON_ID NAME
---------- --------------------------------------------------------------------------------
         0 +FRA/SE2RAC/CONTROLFILE/current.256.890426681
         0 +DATA/SE2RAC/CONTROLFILE/current.261.890426679

SQL> column member format a50
SQL> select l.con_id, l.group#, l.thread#, lf.member
from v$log l, v$logfile lf
where l.group# = lf.group#
order by 1,2;  2    3    4

    CON_ID     GROUP#    THREAD# MEMBER
---------- ---------- ---------- --------------------------------------------------
         0          1          1 +FRA/SE2RAC/ONLINELOG/group_1.257.890426687
         0          1          1 +DATA/SE2RAC/ONLINELOG/group_1.262.890426685
         0          2          1 +FRA/SE2RAC/ONLINELOG/group_2.258.890426695
         0          2          1 +DATA/SE2RAC/ONLINELOG/group_2.263.890426691
         0          3          2 +DATA/SE2RAC/ONLINELOG/group_3.269.890427537
         0          3          2 +FRA/SE2RAC/ONLINELOG/group_3.259.890427541
         0          4          2 +DATA/SE2RAC/ONLINELOG/group_4.270.890427543
         0          4          2 +FRA/SE2RAC/ONLINELOG/group_4.260.890427545

8 rows selected.


SQL> set linesize 120
SQL> column name format a30
SQL> column parameter format a40
SQL> column value format a20
SQL> select * from v$version;

BANNER                                                                               CON_ID
-------------------------------------------------------------------------------- ----------
Oracle Database 12c Standard Edition Release 12.1.0.2.0 - 64bit Production                0
PL/SQL Release 12.1.0.2.0 - Production                                                    0
CORE    12.1.0.2.0      Production                                                                0
TNS for Linux: Version 12.1.0.2.0 - Production                                            0
NLSRTL Version 12.1.0.2.0 - Production                                                    0

SQL> select name, cdb from v$database;

NAME                           CDB
------------------------------ ---
SE2RAC                         YES

SQL> select con_id, name from v$pdbs;

    CON_ID NAME
---------- ------------------------------
         2 PDB$SEED
         3 PDB

SQL> show parameter inmemory

NAME                                 TYPE        VALUE
------------------------------------ ----------- ------------------------------
inmemory_clause_default              string
inmemory_force                       string      DEFAULT
inmemory_max_populate_servers        integer     0
inmemory_query                       string      ENABLE
inmemory_size                        big integer 0
inmemory_trickle_repopulate_servers_ integer     1
percent
optimizer_inmemory_aware             boolean     TRUE
SQL> select * from v$option where parameter like '%Mem%';

PARAMETER                                VALUE                    CON_ID
---------------------------------------- -------------------- ----------
In-Memory Column Store                   FALSE                         0
In-Memory Aggregation                    FALSE                         0

SQL> select * from v$option where value='TRUE';

PARAMETER                                VALUE                    CON_ID
---------------------------------------- -------------------- ----------
Objects                                  TRUE                          0
Real Application Clusters                TRUE                          0
Connection multiplexing                  TRUE                          0
Connection pooling                       TRUE                          0
Database queuing                         TRUE                          0
Incremental backup and recovery          TRUE                          0
Instead-of triggers                      TRUE                          0
Parallel load                            TRUE                          0
Proxy authentication/authorization       TRUE                          0
Plan Stability                           TRUE                          0
Coalesce Index                           TRUE                          0

PARAMETER                                VALUE                    CON_ID
---------------------------------------- -------------------- ----------
Automatic Storage Management             TRUE                          0
Transparent Application Failover         TRUE                          0
Sample Scan                              TRUE                          0
Java                                     TRUE                          0
OLAP Window Functions                    TRUE                          0
Flashback Data Archive                   TRUE                          0
DICOM                                    TRUE                          0
XStream                                  TRUE                          0

19 rows selected.

SQL> select * from v$option where value='FALSE';

PARAMETER                                VALUE                    CON_ID
---------------------------------------- -------------------- ----------
Partitioning                             FALSE                         0
Advanced replication                     FALSE                         0
Bit-mapped indexes                       FALSE                         0
Parallel backup and recovery             FALSE                         0
Parallel execution                       FALSE                         0
Point-in-time tablespace recovery        FALSE                         0
Fine-grained access control              FALSE                         0
Change Data Capture                      FALSE                         0
Online Index Build                       FALSE                         0
Managed Standby                          FALSE                         0
Materialized view rewrite                FALSE                         0

PARAMETER                                VALUE                    CON_ID
---------------------------------------- -------------------- ----------
Database resource manager                FALSE                         0
Spatial                                  FALSE                         0
Export transportable tablespaces         FALSE                         0
Fast-Start Fault Recovery                FALSE                         0
Duplexed backups                         FALSE                         0
Block Media Recovery                     FALSE                         0
Fine-grained Auditing                    FALSE                         0
Application Role                         FALSE                         0
Enterprise User Security                 FALSE                         0
Oracle Data Guard                        FALSE                         0
Oracle Label Security                    FALSE                         0

PARAMETER                                VALUE                    CON_ID
---------------------------------------- -------------------- ----------
OLAP                                     FALSE                         0
Basic Compression                        FALSE                         0
Join index                               FALSE                         0
Trial Recovery                           FALSE                         0
Advanced Analytics                       FALSE                         0
Online Redefinition                      FALSE                         0
Streams Capture                          FALSE                         0
File Mapping                             FALSE                         0
Block Change Tracking                    FALSE                         0
Flashback Table                          FALSE                         0
Flashback Database                       FALSE                         0

PARAMETER                                VALUE                    CON_ID
---------------------------------------- -------------------- ----------
Transparent Data Encryption              FALSE                         0
Backup Encryption                        FALSE                         0
Unused Block Compression                 FALSE                         0
Oracle Database Vault                    FALSE                         0
Result Cache                             FALSE                         0
SQL Plan Management                      FALSE                         0
SecureFiles Encryption                   FALSE                         0
Real Application Testing                 FALSE                         0
Active Data Guard                        FALSE                         0
Server Flash Cache                       FALSE                         0
Advanced Compression                     FALSE                         0

PARAMETER                                VALUE                    CON_ID
---------------------------------------- -------------------- ----------
Deferred Segment Creation                FALSE                         0
Unified Auditing                         FALSE                         0
Management Database                      FALSE                         0
I/O Server                               FALSE                         0
ASM Proxy Instance                       FALSE                         0
Exadata Discovery                        FALSE                         0
Data Mining                              FALSE                         0
Global Data Services                     FALSE                         0
Adaptive Execution Plans                 FALSE                         0
Table Clustering                         FALSE                         0
Zone Maps                                FALSE                         0

PARAMETER                                VALUE                    CON_ID
---------------------------------------- -------------------- ----------
Real Application Security                FALSE                         0
Privilege Analysis                       FALSE                         0
Data Redaction                           FALSE                         0
Cross Transportable Backups              FALSE                         0
Cache Fusion Lock Accelerator            FALSE                         0
Snapshot time recovery                   FALSE                         0
Heat Map                                 FALSE                         0
Automatic Data Optimization              FALSE                         0
Transparent Sensitive Data Protection    FALSE                         0
In-Memory Column Store                   FALSE                         0
Advanced Index Compression               FALSE                         0

PARAMETER                                VALUE                    CON_ID
---------------------------------------- -------------------- ----------
In-Memory Aggregation                    FALSE                         0

67 rows selected.

SQL> column comp_name format a35
SQL> column version format a12
SQL> column status format a10
SQL> select comp_name, version, status from dba_registry;

COMP_NAME                           VERSION      STATUS
----------------------------------- ------------ ----------
Oracle Database Vault               12.1.0.2.0   VALID
Oracle Application Express          4.2.5.00.08  VALID
Oracle Label Security               12.1.0.2.0   VALID
Spatial                             12.1.0.2.0   OPTION OFF
Oracle Multimedia                   12.1.0.2.0   VALID
Oracle Text                         12.1.0.2.0   VALID
Oracle Workspace Manager            12.1.0.2.0   VALID
Oracle XML Database                 12.1.0.2.0   VALID
Oracle Database Catalog Views       12.1.0.2.0   VALID
Oracle Database Packages and Types  12.1.0.2.0   VALID
JServer JAVA Virtual Machine        12.1.0.2.0   VALID

COMP_NAME                           VERSION      STATUS
----------------------------------- ------------ ----------
Oracle XDK                          12.1.0.2.0   VALID
Oracle Database Java Packages       12.1.0.2.0   VALID
OLAP Analytic Workspace             12.1.0.2.0   OPTION OFF
Oracle OLAP API                     12.1.0.2.0   OPTION OFF
Oracle Real Application Clusters    12.1.0.2.0   VALID

16 rows selected.

SQL>

The only differences with a single instance SE2 database created on file system are ASM and RAC options.

I have exited SQL*Plus and check database configuration OCR:

$ srvctl config database -d SE2RAC
Database unique name: SE2RAC
Database name: SE2RAC
Oracle home: /u01/app/12.1.0.2/se2
Oracle user: oracle
Spfile: +DATA/SE2RAC/PARAMETERFILE/spfile.271.890427549
Password file: +DATA/SE2RAC/PASSWORD/pwdse2rac.256.890426495
Domain:
Start options: open
Stop options: immediate
Database role: PRIMARY
Management policy: AUTOMATIC
Server pools:
Disk Groups: FRA,DATA
Mount point paths:
Services:
Type: RAC
Start concurrency:
Stop concurrency:
OSDBA group: dba
OSOPER group: dba
Database instances: SE2RAC1,SE2RAC2
Configured nodes: ol6tocn1,ol6tocn2
Database is administrator managed
$

Note that password file is by default stored in database disk group.

I have also checked that crsctl displays now all resources including the new cluster database:

$ . oraenv
ORACLE_SID = [SE2RAC1] ? +ASM1
The Oracle base remains unchanged with value /u01/app/base
$ crsctl stat res -t
--------------------------------------------------------------------------------
Name           Target  State        Server                   State details
--------------------------------------------------------------------------------
Local Resources
--------------------------------------------------------------------------------
ora.DATA.dg
               ONLINE  ONLINE       ol6tocn1                 STABLE
               ONLINE  ONLINE       ol6tocn2                 STABLE
ora.FRA.dg
               ONLINE  ONLINE       ol6tocn1                 STABLE
               ONLINE  ONLINE       ol6tocn2                 STABLE
ora.LISTENER.lsnr
               ONLINE  ONLINE       ol6tocn1                 STABLE
               ONLINE  ONLINE       ol6tocn2                 STABLE
ora.OCRVD.dg
               ONLINE  ONLINE       ol6tocn1                 STABLE
               ONLINE  ONLINE       ol6tocn2                 STABLE
ora.asm
               ONLINE  ONLINE       ol6tocn1                 Started,STABLE
               ONLINE  ONLINE       ol6tocn2                 Started,STABLE
ora.net1.network
               ONLINE  ONLINE       ol6tocn1                 STABLE
               ONLINE  ONLINE       ol6tocn2                 STABLE
ora.ons
               ONLINE  ONLINE       ol6tocn1                 STABLE
               ONLINE  ONLINE       ol6tocn2                 STABLE
--------------------------------------------------------------------------------
Cluster Resources
--------------------------------------------------------------------------------
ora.LISTENER_SCAN1.lsnr
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.LISTENER_SCAN2.lsnr
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.LISTENER_SCAN3.lsnr
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.MGMTLSNR
      1        ONLINE  ONLINE       ol6tocn1                 169.254.72.152 192.1
                                                             68.43.41,STABLE
ora.cvu
      1        ONLINE  ONLINE       ol6tocn2                 STABLE
ora.mgmtdb
      1        ONLINE  ONLINE       ol6tocn1                 Open,STABLE
ora.oc4j
      1        ONLINE  ONLINE       ol6tocn2                 STABLE
ora.ol6tocn1.vip
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.ol6tocn2.vip
      1        ONLINE  ONLINE       ol6tocn2                 STABLE
ora.scan1.vip
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.scan2.vip
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.scan3.vip
      1        ONLINE  ONLINE       ol6tocn1                 STABLE
ora.se2rac.db
      1        ONLINE  ONLINE       ol6tocn1                 Open,STABLE
      2        ONLINE  ONLINE       ol6tocn2                 Open,STABLE
--------------------------------------------------------------------------------
$

Note that some cluster resources are displayed in alphabetical order.

I have also rebooted both cluster node to check to each resource is started automatically: this is the case after 6 minutes.

The 2-node RAC 12.1.0.2 SE2 cluster on Oracle Linux 6.7 is now ready.

Advertisements
Post a comment or leave a trackback: Trackback URL.

Leave a Reply

Fill in your details below or click an icon to log in:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out / Change )

Twitter picture

You are commenting using your Twitter account. Log Out / Change )

Facebook photo

You are commenting using your Facebook account. Log Out / Change )

Google+ photo

You are commenting using your Google+ account. Log Out / Change )

Connecting to %s

%d bloggers like this: