集群中增加节点大致分为4个步骤：前期准备阶段、新节点加入集群（安装GI软件）、新节点安装DB软件、给新节点分配实例。

IP配置、系统内核配置、安装RPM包、SHELL限制、分配用户和组、配置用户环境变量、目录创建及授权、配置互信等等一些前期环境准。

[root@vastdata2~]#mkdir-p/u01/app/gridmkdir-p/u01/app/11.2.0/gridmkdir-p/u01/app/oraclechown-Roracle:oinstall/u01chown-Rgrid:oinstall/u01/app/gridchown-Rgrid:oinstall/u01/app/11.2.0chmod-R775/u01二. 新节点加入集群（安装GI软件）(1) 对新节点做安装前的检查

[grid@vastdata4~]$cluvfystage-postnodedel-nvastdata3-verbosePerformingpost-checksfornoderemovalCheckingCRSintegrity...ClusterwareversionconsistencypassedTheOracleClusterwareishealthyonnode"vastdata4"CRSintegritycheckpassedResult:NoderemovalcheckpassedPost-checkfornoderemovalwassuccessful.[grid@vastdata4~]$[grid@vastdata4~]$[grid@vastdata4~]$[grid@vastdata4~]$[grid@vastdata4~]$[grid@vastdata4~]$[grid@vastdata4~]$[grid@vastdata4~]$cluvfystage-prenodeadd-nvastdata3-verbosePerformingpre-checksfornodeadditionCheckingnodereachability...Check:Nodereachabilityfromnode"vastdata4"DestinationNodeReachable?------------------------------------------------------------vastdata3yesResult:Nodereachabilitycheckpassedfromnode"vastdata4"Checkinguserequivalence...Check:Userequivalenceforuser"grid"NodeNameStatus------------------------------------------------------------vastdata3passedResult:Userequivalencecheckpassedforuser"grid"CheckingCRSintegrity...ClusterwareversionconsistencypassedTheOracleClusterwareishealthyonnode"vastdata4"CRSintegritycheckpassedCheckingsharedresources...CheckingCRShomelocation..."/u01/app/11.2.0/grid"issharedResult:SharedresourcescheckfornodeadditionpassedCheckingnodeconnectivity...Checkinghostsconfigfile...NodeNameStatus------------------------------------------------------------vastdata3passedvastdata4passedVerificationofthehostsconfigfilesuccessfulInterfaceinformationfornode"vastdata3"NameIPAddressSubnetGatewayDef.GatewayHWAddressMTU-----------------------------------------------------------------------------------------eth0192.168.0.11192.168.0.00.0.0.0UNKNOWN08:00:27:D3:55:CB1500eth210.0.0.210.0.0.00.0.0.0UNKNOWN08:00:27:B4:C3:C71500eth310.0.0.310.0.0.00.0.0.0UNKNOWN08:00:27:02:BD:9A1500Interfaceinformationfornode"vastdata4"NameIPAddressSubnetGatewayDef.GatewayHWAddressMTU-----------------------------------------------------------------------------------------eth0192.168.0.12192.168.0.00.0.0.0UNKNOWN08:00:27:EF:F6:151500eth0192.168.0.33192.168.0.00.0.0.0UNKNOWN08:00:27:EF:F6:151500eth0192.168.0.35192.168.0.00.0.0.0UNKNOWN08:00:27:EF:F6:151500eth0192.168.0.23192.168.0.00.0.0.0UNKNOWN08:00:27:EF:F6:151500eth0192.168.0.34192.168.0.00.0.0.0UNKNOWN08:00:27:EF:F6:151500eth210.0.0.410.0.0.00.0.0.0UNKNOWN08:00:27:82:3A:571500eth2169.254.17.92169.254.0.00.0.0.0UNKNOWN08:00:27:82:3A:571500eth310.0.0.510.0.0.00.0.0.0UNKNOWN08:00:27:4C:5D:391500eth3169.254.236.167169.254.128.00.0.0.0UNKNOWN08:00:27:4C:5D:391500Check:Nodeconnectivityforinterface"eth0"SourceDestinationConnected?----------------------------------------------------------------------------vastdata3[192.168.0.11]vastdata4[192.168.0.12]yesvastdata3[192.168.0.11]vastdata4[192.168.0.33]yesvastdata3[192.168.0.11]vastdata4[192.168.0.35]yesvastdata3[192.168.0.11]vastdata4[192.168.0.23]yesvastdata3[192.168.0.11]vastdata4[192.168.0.34]yesvastdata4[192.168.0.12]vastdata4[192.168.0.33]yesvastdata4[192.168.0.12]vastdata4[192.168.0.35]yesvastdata4[192.168.0.12]vastdata4[192.168.0.23]yesvastdata4[192.168.0.12]vastdata4[192.168.0.34]yesvastdata4[192.168.0.33]vastdata4[192.168.0.35]yesvastdata4[192.168.0.33]vastdata4[192.168.0.23]yesvastdata4[192.168.0.33]vastdata4[192.168.0.34]yesvastdata4[192.168.0.35]vastdata4[192.168.0.23]yesvastdata4[192.168.0.35]vastdata4[192.168.0.34]yesvastdata4[192.168.0.23]vastdata4[192.168.0.34]yesResult:Nodeconnectivitypassedforinterface"eth0"Check:TCPconnectivityofsubnet"192.168.0.0"SourceDestinationConnected?----------------------------------------------------------------------------vastdata4:192.168.0.12vastdata3:192.168.0.11passedvastdata4:192.168.0.12vastdata4:192.168.0.33passedvastdata4:192.168.0.12vastdata4:192.168.0.35passedvastdata4:192.168.0.12vastdata4:192.168.0.23passedvastdata4:192.168.0.12vastdata4:192.168.0.34passedResult:TCPconnectivitycheckpassedforsubnet"192.168.0.0"Check:Nodeconnectivityforinterface"eth2"SourceDestinationConnected?----------------------------------------------------------------------------vastdata3[10.0.0.2]vastdata3[10.0.0.3]yesvastdata3[10.0.0.2]vastdata4[10.0.0.4]yesvastdata3[10.0.0.2]vastdata4[10.0.0.5]yesvastdata3[10.0.0.3]vastdata4[10.0.0.4]yesvastdata3[10.0.0.3]vastdata4[10.0.0.5]yesvastdata4[10.0.0.4]vastdata4[10.0.0.5]yesResult:Nodeconnectivitypassedforinterface"eth2"Check:TCPconnectivityofsubnet"10.0.0.0"SourceDestinationConnected?----------------------------------------------------------------------------vastdata4:10.0.0.4vastdata3:10.0.0.2passedvastdata4:10.0.0.4vastdata3:10.0.0.3passedvastdata4:10.0.0.4vastdata4:10.0.0.5passedResult:TCPconnectivitycheckpassedforsubnet"10.0.0.0"Check:Nodeconnectivityforinterface"eth3"Checkingsubnetmaskconsistency...Subnetmaskconsistencycheckpassedforsubnet"192.168.0.0".Subnetmaskconsistencycheckpassedforsubnet"10.0.0.0".Subnetmaskconsistencycheckpassed.Result:NodeconnectivitycheckpassedCheckingmulticastcommunication...Checkingsubnet"192.168.0.0"formulticastcommunicationwithmulticastgroup"230.0.1.0"...Checkofsubnet"192.168.0.0"formulticastcommunicationwithmulticastgroup"230.0.1.0"passed.Checkingsubnet"10.0.0.0"formulticastcommunicationwithmulticastgroup"230.0.1.0"...Checkofsubnet"10.0.0.0"formulticastcommunicationwithmulticastgroup"230.0.1.0"passed.Checkofmulticastcommunicationpassed.Check:TotalmemoryNodeNameAvailableRequiredStatus----------------------------------------------------------------------vastdata42.8198GB(2956724.0KB)1.5GB(1572864.0KB)passedvastdata32.8198GB(2956724.0KB)1.5GB(1572864.0KB)passedResult:TotalmemorycheckpassedCheck:AvailablememoryNodeNameAvailableRequiredStatus----------------------------------------------------------------------vastdata41.3675GB(1433912.0KB)50MB(51200.0KB)passedvastdata32.6447GB(2773172.0KB)50MB(51200.0KB)passedResult:AvailablememorycheckpassedCheck:SwapspaceNodeNameAvailableRequiredStatus----------------------------------------------------------------------vastdata46GB(6291448.0KB)2.8198GB(2956724.0KB)passedvastdata36GB(6291448.0KB)2.8198GB(2956724.0KB)passedResult:SwapspacecheckpassedCheck:Freediskspacefor"vastdata4:/u01/app/11.2.0/grid,vastdata4:/tmp"PathNodeNameMountpointAvailableRequiredStatus----------------------------------------------------------------------------/u01/app/11.2.0/gridvastdata4/5.2812GB7.5GBfailed/tmpvastdata4/5.2812GB7.5GBfailedResult:Freediskspacecheckfailedfor"vastdata4:/u01/app/11.2.0/grid,vastdata4:/tmp"Check:Freediskspacefor"vastdata3:/u01/app/11.2.0/grid,vastdata3:/tmp"PathNodeNameMountpointAvailableRequiredStatus----------------------------------------------------------------------------/u01/app/11.2.0/gridvastdata3/15.7051GB7.5GBpassed/tmpvastdata3/15.7051GB7.5GBpassedResult:Freediskspacecheckpassedfor"vastdata3:/u01/app/11.2.0/grid,vastdata3:/tmp"Check:Userexistencefor"grid"NodeNameStatusComment------------------------------------------------------------vastdata4passedexists(1100)vastdata3passedexists(1100)CheckingformultipleuserswithUIDvalue1100Result:CheckformultipleuserswithUIDvalue1100passedResult:Userexistencecheckpassedfor"grid"Check:RunlevelNodeNamerunlevelRequiredStatus----------------------------------------------------------------------vastdata453,5passedvastdata353,5passedResult:RunlevelcheckpassedCheck:Hardlimitsfor"maximumopenfiledescriptors"NodeNameTypeAvailableRequiredStatus--------------------------------------------------------------------vastdata4hard6553665536passedvastdata3hard6553665536passedResult:Hardlimitscheckpassedfor"maximumopenfiledescriptors"Check:Softlimitsfor"maximumopenfiledescriptors"NodeNameTypeAvailableRequiredStatus--------------------------------------------------------------------vastdata4soft10241024passedvastdata3soft10241024passedResult:Softlimitscheckpassedfor"maximumopenfiledescriptors"Check:Hardlimitsfor"maximumuserprocesses"NodeNameTypeAvailableRequiredStatus--------------------------------------------------------------------vastdata4hard1638416384passedvastdata3hard1638416384passedResult:Hardlimitscheckpassedfor"maximumuserprocesses"Check:Softlimitsfor"maximumuserprocesses"NodeNameTypeAvailableRequiredStatus--------------------------------------------------------------------vastdata4soft20472047passedvastdata3soft20472047passedResult:Softlimitscheckpassedfor"maximumuserprocesses"Check:SystemarchitectureNodeNameAvailableRequiredStatus----------------------------------------------------------------------vastdata4x86_64x86_64passedvastdata3x86_64x86_64passedResult:SystemarchitecturecheckpassedCheck:KernelversionNodeNameAvailableRequiredStatus----------------------------------------------------------------------vastdata42.6.32-431.el6.x86_642.6.32passedvastdata32.6.32-431.el6.x86_642.6.32passedResult:KernelversioncheckpassedCheck:Kernelparameterfor"semmsl"NodeNameCurrentConfiguredRequiredStatusComment----------------------------------------------------------------------------vastdata4250250250passedvastdata3250250250passedResult:Kernelparametercheckpassedfor"semmsl"Check:Kernelparameterfor"semmns"NodeNameCurrentConfiguredRequiredStatusComment----------------------------------------------------------------------------vastdata4320003200032000passedvastdata3320003200032000passedResult:Kernelparametercheckpassedfor"semmns"Check:Kernelparameterfor"semopm"NodeNameCurrentConfiguredRequiredStatusComment----------------------------------------------------------------------------vastdata4100100100passedvastdata3100100100passedResult:Kernelparametercheckpassedfor"semopm"Check:Kernelparameterfor"semmni"NodeNameCurrentConfiguredRequiredStatusComment----------------------------------------------------------------------------vastdata4128128128passedvastdata3128128128passedResult:Kernelparametercheckpassedfor"semmni"Check:Kernelparameterfor"shmmax"NodeNameCurrentConfiguredRequiredStatusComment----------------------------------------------------------------------------vastdata468719476736687194767361513842688passedvastdata368719476736687194767361513842688passedResult:Kernelparametercheckpassedfor"shmmax"Check:Kernelparameterfor"shmmni"NodeNameCurrentConfiguredRequiredStatusComment----------------------------------------------------------------------------vastdata4409640964096passedvastdata3409640964096passedResult:Kernelparametercheckpassedfor"shmmni"Check:Kernelparameterfor"shmall"NodeNameCurrentConfiguredRequiredStatusComment----------------------------------------------------------------------------vastdata4429496729642949672962097152passedvastdata3429496729642949672962097152passedResult:Kernelparametercheckpassedfor"shmall"Check:Kernelparameterfor"file-max"NodeNameCurrentConfiguredRequiredStatusComment----------------------------------------------------------------------------vastdata4681574468157446815744passedvastdata3681574468157446815744passedResult:Kernelparametercheckpassedfor"file-max"Check:Kernelparameterfor"ip_local_port_range"NodeNameCurrentConfiguredRequiredStatusComment----------------------------------------------------------------------------vastdata4between9000.0&65500.0between9000.0&65500.0between9000.0&65500.0passedvastdata3between9000.0&65500.0between9000.0&65500.0between9000.0&65500.0passedResult:Kernelparametercheckpassedfor"ip_local_port_range"Check:Kernelparameterfor"rmem_default"NodeNameCurrentConfiguredRequiredStatusComment----------------------------------------------------------------------------vastdata4262144262144262144passedvastdata3262144262144262144passedResult:Kernelparametercheckpassedfor"rmem_default"Check:Kernelparameterfor"rmem_max"NodeNameCurrentConfiguredRequiredStatusComment----------------------------------------------------------------------------vastdata4419430441943044194304passedvastdata3419430441943044194304passedResult:Kernelparametercheckpassedfor"rmem_max"Check:Kernelparameterfor"wmem_default"NodeNameCurrentConfiguredRequiredStatusComment----------------------------------------------------------------------------vastdata4262144262144262144passedvastdata3262144262144262144passedResult:Kernelparametercheckpassedfor"wmem_default"Check:Kernelparameterfor"wmem_max"NodeNameCurrentConfiguredRequiredStatusComment----------------------------------------------------------------------------vastdata4104857610485761048576passedvastdata3104857610485761048576passedResult:Kernelparametercheckpassedfor"wmem_max"Check:Kernelparameterfor"aio-max-nr"NodeNameCurrentConfiguredRequiredStatusComment----------------------------------------------------------------------------vastdata4104857610485761048576passedvastdata3104857610485761048576passedResult:Kernelparametercheckpassedfor"aio-max-nr"Check:Packageexistencefor"binutils"NodeNameAvailableRequiredStatus----------------------------------------------------------------------vastdata4binutils-2.20.51.0.2-5.36.el6binutils-2.20.51.0.2passedvastdata3binutils-2.20.51.0.2-5.36.el6binutils-2.20.51.0.2passedResult:Packageexistencecheckpassedfor"binutils"Check:Packageexistencefor"compat-libcap1"NodeNameAvailableRequiredStatus----------------------------------------------------------------------vastdata4compat-libcap1-1.10-1compat-libcap1-1.10passedvastdata3compat-libcap1-1.10-1compat-libcap1-1.10passedResult:Packageexistencecheckpassedfor"compat-libcap1"Check:Packageexistencefor"compat-libstdc++-33(x86_64)"NodeNameAvailableRequiredStatus----------------------------------------------------------------------vastdata4compat-libstdc++-33(x86_64)-3.2.3-69.el6compat-libstdc++-33(x86_64)-3.2.3passedvastdata3compat-libstdc++-33(x86_64)-3.2.3-69.el6compat-libstdc++-33(x86_64)-3.2.3passedResult:Packageexistencecheckpassedfor"compat-libstdc++-33(x86_64)"Check:Packageexistencefor"libgcc(x86_64)"NodeNameAvailableRequiredStatus----------------------------------------------------------------------vastdata4libgcc(x86_64)-4.4.7-4.el6libgcc(x86_64)-4.4.4passedvastdata3libgcc(x86_64)-4.4.7-4.el6libgcc(x86_64)-4.4.4passedResult:Packageexistencecheckpassedfor"libgcc(x86_64)"Check:Packageexistencefor"libstdc++(x86_64)"NodeNameAvailableRequiredStatus----------------------------------------------------------------------vastdata4libstdc++(x86_64)-4.4.7-4.el6libstdc++(x86_64)-4.4.4passedvastdata3libstdc++(x86_64)-4.4.7-4.el6libstdc++(x86_64)-4.4.4passedResult:Packageexistencecheckpassedfor"libstdc++(x86_64)"Check:Packageexistencefor"libstdc++-devel(x86_64)"NodeNameAvailableRequiredStatus----------------------------------------------------------------------vastdata4libstdc++-devel(x86_64)-4.4.7-4.el6libstdc++-devel(x86_64)-4.4.4passedvastdata3libstdc++-devel(x86_64)-4.4.7-4.el6libstdc++-devel(x86_64)-4.4.4passedResult:Packageexistencecheckpassedfor"libstdc++-devel(x86_64)"Check:Packageexistencefor"sysstat"NodeNameAvailableRequiredStatus----------------------------------------------------------------------vastdata4sysstat-9.0.4-22.el6sysstat-9.0.4passedvastdata3sysstat-9.0.4-22.el6sysstat-9.0.4passedResult:Packageexistencecheckpassedfor"sysstat"Check:Packageexistencefor"gcc"NodeNameAvailableRequiredStatus----------------------------------------------------------------------vastdata4gcc-4.4.7-4.el6gcc-4.4.4passedvastdata3gcc-4.4.7-4.el6gcc-4.4.4passedResult:Packageexistencecheckpassedfor"gcc"Check:Packageexistencefor"gcc-c++"NodeNameAvailableRequiredStatus----------------------------------------------------------------------vastdata4gcc-c++-4.4.7-4.el6gcc-c++-4.4.4passedvastdata3gcc-c++-4.4.7-4.el6gcc-c++-4.4.4passedResult:Packageexistencecheckpassedfor"gcc-c++"Check:Packageexistencefor"ksh"NodeNameAvailableRequiredStatus----------------------------------------------------------------------vastdata4ksh-20120801-10.el6ksh-20100621passedvastdata3ksh-20120801-10.el6ksh-20100621passedResult:Packageexistencecheckpassedfor"ksh"Check:Packageexistencefor"make"NodeNameAvailableRequiredStatus----------------------------------------------------------------------vastdata4make-3.81-20.el6make-3.81passedvastdata3make-3.81-20.el6make-3.81passedResult:Packageexistencecheckpassedfor"make"Check:Packageexistencefor"glibc(x86_64)"NodeNameAvailableRequiredStatus----------------------------------------------------------------------vastdata4glibc(x86_64)-2.12-1.132.el6glibc(x86_64)-2.12passedvastdata3glibc(x86_64)-2.12-1.132.el6glibc(x86_64)-2.12passedResult:Packageexistencecheckpassedfor"glibc(x86_64)"Check:Packageexistencefor"glibc-devel(x86_64)"NodeNameAvailableRequiredStatus----------------------------------------------------------------------vastdata4glibc-devel(x86_64)-2.12-1.132.el6glibc-devel(x86_64)-2.12passedvastdata3glibc-devel(x86_64)-2.12-1.132.el6glibc-devel(x86_64)-2.12passedResult:Packageexistencecheckpassedfor"glibc-devel(x86_64)"Check:Packageexistencefor"libaio(x86_64)"NodeNameAvailableRequiredStatus----------------------------------------------------------------------vastdata4libaio(x86_64)-0.3.107-10.el6libaio(x86_64)-0.3.107passedvastdata3libaio(x86_64)-0.3.107-10.el6libaio(x86_64)-0.3.107passedResult:Packageexistencecheckpassedfor"libaio(x86_64)"Check:Packageexistencefor"libaio-devel(x86_64)"NodeNameAvailableRequiredStatus----------------------------------------------------------------------vastdata4libaio-devel(x86_64)-0.3.107-10.el6libaio-devel(x86_64)-0.3.107passedvastdata3libaio-devel(x86_64)-0.3.107-10.el6libaio-devel(x86_64)-0.3.107passedResult:Packageexistencecheckpassedfor"libaio-devel(x86_64)"CheckingformultipleuserswithUIDvalue0Result:CheckformultipleuserswithUIDvalue0passedCheck:CurrentgroupIDResult:CurrentgroupIDcheckpassedStartingcheckforconsistencyofprimarygroupofrootuserNodeNameStatus------------------------------------------------------------vastdata4passedvastdata3passedCheckforconsistencyofrootuser'sprimarygrouppassedCheckingOCRintegrity...OCRintegritycheckpassedCheckingOracleClusterVotingDiskconfiguration...OracleClusterVotingDiskconfigurationcheckpassedCheck:TimezoneconsistencyResult:TimezoneconsistencycheckpassedStartingClocksynchronizationchecksusingNetworkTimeProtocol(NTP)...NTPConfigurationfilecheckstarted...NetworkTimeProtocol(NTP)configurationfilenotfoundonanyofthenodes.OracleClusterTimeSynchronizationService(CTSS)canbeusedinsteadofNTPfortimesynchronizationontheclusternodesNoNTPDaemonsorServiceswerefoundtoberunningResult:ClocksynchronizationcheckusingNetworkTimeProtocol(NTP)passedCheckingtomakesureuser"grid"isnotin"root"groupNodeNameStatusComment------------------------------------------------------------vastdata4passeddoesnotexistvastdata3passeddoesnotexistResult:User"grid"isnotpartof"root"group.CheckpassedCheckingconsistencyoffile"/etc/resolv.conf"acrossnodesCheckingthefile"/etc/resolv.conf"tomakesureonlyoneofdomainandsearchentriesisdefinedFile"/etc/resolv.conf"doesnothavebothdomainandsearchentriesdefinedCheckingifdomainentryinfile"/etc/resolv.conf"isconsistentacrossthenodes...domainentryinfile"/etc/resolv.conf"isconsistentacrossnodesCheckingifsearchentryinfile"/etc/resolv.conf"isconsistentacrossthenodes...searchentryinfile"/etc/resolv.conf"isconsistentacrossnodesCheckingfile"/etc/resolv.conf"tomakesurethatonlyonesearchentryisdefinedAllnodeshaveonesearchentrydefinedinfile"/etc/resolv.conf"Checkingallnodestomakesurethatsearchentryis"us.oracle.com"asfoundonnode"vastdata4"Allnodesoftheclusterhavesamevaluefor'search'CheckingDNSresponsetimeforanunreachablenodeNodeNameStatus------------------------------------------------------------vastdata4passedvastdata3passedTheDNSresponsetimeforanunreachablenodeiswithinacceptablelimitonallnodesFile"/etc/resolv.conf"isconsistentacrossnodesCheckingintegrityofnameserviceswitchconfigurationfile"/etc/nsswitch.conf"...Checkingif"hosts"entryinfile"/etc/nsswitch.conf"isconsistentacrossnodes...Checkingfile"/etc/nsswitch.conf"tomakesurethatonlyone"hosts"entryisdefinedMorethanone"hosts"entrydoesnotexistinany"/etc/nsswitch.conf"fileCheckforintegrityofnameserviceswitchconfigurationfile"/etc/nsswitch.conf"passedPre-checkfornodeadditionwassuccessful.(2) 检查集群内节点状态

[grid@vastdata4~]$olsnodes-tvastdata4Unpinned(3) 给新的节点安装GI软件

[grid@vastdata4~]$/u01/app/11.2.0/grid/oui/bin/addNode.sh-silent"CLUSTER_NEW_NODES={vastdata3}""CLUSTER_NEW_VIRTUAL_HOSTNAMES={vastdata3-vip}"Performingpre-checksfornodeadditionCheckingnodereachability...Nodereachabilitycheckpassedfromnode"vastdata4"Checkinguserequivalence...Userequivalencecheckpassedforuser"grid"CheckingCRSintegrity...ClusterwareversionconsistencypassedCRSintegritycheckpassedCheckingsharedresources...CheckingCRShomelocation..."/u01/app/11.2.0/grid"issharedSharedresourcescheckfornodeadditionpassedCheckingnodeconnectivity...Checkinghostsconfigfile...VerificationofthehostsconfigfilesuccessfulCheck:Nodeconnectivityforinterface"eth0"Nodeconnectivitypassedforinterface"eth0"TCPconnectivitycheckpassedforsubnet"192.168.0.0"Check:Nodeconnectivityforinterface"eth2"Nodeconnectivitypassedforinterface"eth2"TCPconnectivitycheckpassedforsubnet"10.0.0.0"Check:Nodeconnectivityforinterface"eth3"Checkingsubnetmaskconsistency...Subnetmaskconsistencycheckpassedforsubnet"192.168.0.0".Subnetmaskconsistencycheckpassedforsubnet"10.0.0.0".Subnetmaskconsistencycheckpassed.NodeconnectivitycheckpassedCheckingmulticastcommunication...Checkingsubnet"192.168.0.0"formulticastcommunicationwithmulticastgroup"230.0.1.0"...Checkofsubnet"192.168.0.0"formulticastcommunicationwithmulticastgroup"230.0.1.0"passed.Checkingsubnet"10.0.0.0"formulticastcommunicationwithmulticastgroup"230.0.1.0"...Checkofsubnet"10.0.0.0"formulticastcommunicationwithmulticastgroup"230.0.1.0"passed.Checkofmulticastcommunicationpassed.TotalmemorycheckpassedAvailablememorycheckpassedSwapspacecheckpassedFreediskspacecheckfailedfor"vastdata4:/u01/app/11.2.0/grid,vastdata4:/tmp"Checkfailedonnodes:vastdata4Freediskspacecheckpassedfor"vastdata3:/u01/app/11.2.0/grid,vastdata3:/tmp"CheckformultipleuserswithUIDvalue1100passedUserexistencecheckpassedfor"grid"RunlevelcheckpassedHardlimitscheckpassedfor"maximumopenfiledescriptors"Softlimitscheckpassedfor"maximumopenfiledescriptors"Hardlimitscheckpassedfor"maximumuserprocesses"Softlimitscheckpassedfor"maximumuserprocesses"SystemarchitecturecheckpassedKernelversioncheckpassedKernelparametercheckpassedfor"semmsl"Kernelparametercheckpassedfor"semmns"Kernelparametercheckpassedfor"semopm"Kernelparametercheckpassedfor"semmni"Kernelparametercheckpassedfor"shmmax"Kernelparametercheckpassedfor"shmmni"Kernelparametercheckpassedfor"shmall"Kernelparametercheckpassedfor"file-max"Kernelparametercheckpassedfor"ip_local_port_range"Kernelparametercheckpassedfor"rmem_default"Kernelparametercheckpassedfor"rmem_max"Kernelparametercheckpassedfor"wmem_default"Kernelparametercheckpassedfor"wmem_max"Kernelparametercheckpassedfor"aio-max-nr"Packageexistencecheckpassedfor"binutils"Packageexistencecheckpassedfor"compat-libcap1"Packageexistencecheckpassedfor"compat-libstdc++-33(x86_64)"Packageexistencecheckpassedfor"libgcc(x86_64)"Packageexistencecheckpassedfor"libstdc++(x86_64)"Packageexistencecheckpassedfor"libstdc++-devel(x86_64)"Packageexistencecheckpassedfor"sysstat"Packageexistencecheckpassedfor"gcc"Packageexistencecheckpassedfor"gcc-c++"Packageexistencecheckpassedfor"ksh"Packageexistencecheckpassedfor"make"Packageexistencecheckpassedfor"glibc(x86_64)"Packageexistencecheckpassedfor"glibc-devel(x86_64)"Packageexistencecheckpassedfor"libaio(x86_64)"Packageexistencecheckpassedfor"libaio-devel(x86_64)"CheckformultipleuserswithUIDvalue0passedCurrentgroupIDcheckpassedStartingcheckforconsistencyofprimarygroupofrootuserCheckforconsistencyofrootuser'sprimarygrouppassedCheckingOCRintegrity...OCRintegritycheckpassedCheckingOracleClusterVotingDiskconfiguration...OracleClusterVotingDiskconfigurationcheckpassedTimezoneconsistencycheckpassedStartingClocksynchronizationchecksusingNetworkTimeProtocol(NTP)...NTPConfigurationfilecheckstarted...NoNTPDaemonsorServiceswerefoundtoberunningClocksynchronizationcheckusingNetworkTimeProtocol(NTP)passedUser"grid"isnotpartof"root"group.CheckpassedCheckingconsistencyoffile"/etc/resolv.conf"acrossnodesFile"/etc/resolv.conf"doesnothavebothdomainandsearchentriesdefineddomainentryinfile"/etc/resolv.conf"isconsistentacrossnodessearchentryinfile"/etc/resolv.conf"isconsistentacrossnodesAllnodeshaveonesearchentrydefinedinfile"/etc/resolv.conf"TheDNSresponsetimeforanunreachablenodeiswithinacceptablelimitonallnodesFile"/etc/resolv.conf"isconsistentacrossnodesCheckingintegrityofnameserviceswitchconfigurationfile"/etc/nsswitch.conf"...Checkforintegrityofnameserviceswitchconfigurationfile"/etc/nsswitch.conf"passedCheckingVIPconfiguration.CheckingVIPSubnetconfiguration.CheckforVIPSubnetconfigurationpassed.CheckingVIPreachabilityCheckforVIPreachabilitypassed.Pre-checkfornodeadditionwassuccessful.StartingOracleUniversalInstaller...Checkingswapspace:mustbegreaterthan500MB.Actual6143MBPassedOracleUniversalInstaller,Version11.2.0.4.0ProductionCopyright(C)1999,2013,Oracle.Allrightsreserved.Performingteststoseewhethernodesvastdata3areavailable...............................................................100%Done..-----------------------------------------------------------------------------ClusterNodeAdditionSummaryGlobalSettingsSource:/u01/app/11.2.0/gridNewNodesSpaceRequirementsNewNodesvastdata3/:Required4.61GB:Available14.62GBInstalledProductsProductNamesOracleGridInfrastructure11g11.2.0.4.0JavaDevelopmentKit1.5.0.51.10InstallerSDKComponent11.2.0.4.0OracleOne-OffPatchInstaller11.2.0.3.4OracleUniversalInstaller11.2.0.4.0OracleRACRequiredSupportFiles-HAS11.2.0.4.0OracleUSMDeconfiguration11.2.0.4.0OracleConfigurationManagerDeconfiguration10.3.1.0.0EnterpriseManagerCommonCoreFiles10.2.0.4.5OracleDBCADeconfiguration11.2.0.4.0OracleRACDeconfiguration11.2.0.4.0OracleQualityofServiceManagement(Server)11.2.0.4.0InstallationPluginFiles11.2.0.4.0UniversalStorageManagerFiles11.2.0.4.0OracleTextRequiredSupportFiles11.2.0.4.0AutomaticStorageManagementAssistant11.2.0.4.0OracleDatabase11gMultimediaFiles11.2.0.4.0OracleMultimediaJavaAdvancedImaging11.2.0.4.0OracleGlobalizationSupport11.2.0.4.0OracleMultimediaLocatorRDBMSFiles11.2.0.4.0OracleCoreRequiredSupportFiles11.2.0.4.0BaliShare1.1.18.0.0OracleDatabaseDeconfiguration11.2.0.4.0OracleQualityofServiceManagement(Client)11.2.0.4.0Expatlibraries2.0.1.0.1OracleContainersforJava11.2.0.4.0PerlModules5.10.0.0.1SecureSocketLayer11.2.0.4.0OracleJDBC/OCIInstantClient11.2.0.4.0OracleMultimediaClientOption11.2.0.4.0LDAPRequiredSupportFiles11.2.0.4.0CharacterSetMigrationUtility11.2.0.4.0PerlInterpreter5.10.0.0.2PL/SQLEmbeddedGateway11.2.0.4.0OLAPSQLScripts11.2.0.4.0DatabaseSQLScripts11.2.0.4.0OracleExtendedWindowingToolkit3.4.47.0.0SSLRequiredSupportFilesforInstantClient11.2.0.4.0SQL*PlusFilesforInstantClient11.2.0.4.0OracleNetRequiredSupportFiles11.2.0.4.0OracleDatabaseUserInterface2.2.13.0.0RDBMSRequiredSupportFilesforInstantClient11.2.0.4.0RDBMSRequiredSupportFilesRuntime11.2.0.4.0XMLParserforJava11.2.0.4.0OracleSecurityDeveloperTools11.2.0.4.0OracleWalletManager11.2.0.4.0EnterpriseManagerpluginCommonFiles11.2.0.4.0PlatformRequiredSupportFiles11.2.0.4.0OracleJFCExtendedWindowingToolkit4.2.36.0.0RDBMSRequiredSupportFiles11.2.0.4.0OracleIceBrowser5.2.3.6.0OracleHelpForJava4.2.9.0.0EnterpriseManagerCommonFiles10.2.0.4.5DeinstallationTool11.2.0.4.0OracleJavaClient11.2.0.4.0ClusterVerificationUtilityFiles11.2.0.4.0OracleNotificationService(eONS)11.2.0.4.0OracleLDAPadministration11.2.0.4.0ClusterVerificationUtilityCommonFiles11.2.0.4.0OracleClusterwareRDBMSFiles11.2.0.4.0OracleLocaleBuilder11.2.0.4.0OracleGlobalizationSupport11.2.0.4.0BuildtoolsCommonFiles11.2.0.4.0HASCommonFiles11.2.0.4.0SQL*PlusRequiredSupportFiles11.2.0.4.0XDKRequiredSupportFiles11.2.0.4.0AgentRequiredSupportFiles10.2.0.4.5ParserGeneratorRequiredSupportFiles11.2.0.4.0PrecompilerRequiredSupportFiles11.2.0.4.0InstallationCommonFiles11.2.0.4.0RequiredSupportFiles11.2.0.4.0OracleJDBC/THINInterfaces11.2.0.4.0OracleMultimediaLocator11.2.0.4.0OracleMultimedia11.2.0.4.0AssistantCommonFiles11.2.0.4.0OracleNet11.2.0.4.0PL/SQL11.2.0.4.0HASFilesforDB11.2.0.4.0OracleRecoveryManager11.2.0.4.0OracleDatabaseUtilities11.2.0.4.0OracleNotificationService11.2.0.3.0SQL*Plus11.2.0.4.0OracleNetcaClient11.2.0.4.0OracleAdvancedSecurity11.2.0.4.0OracleJVM11.2.0.4.0OracleInternetDirectoryClient11.2.0.4.0OracleNetListener11.2.0.4.0ClusterReadyServicesFiles11.2.0.4.0OracleDatabase11g11.2.0.4.0-----------------------------------------------------------------------------Instantiatingscriptsforaddnode(Monday,February25,20191:00:48AMEST).1%Done.InstantiationofaddnodescriptscompleteCopyingtoremotenodes(Monday,February25,20191:00:54AMEST)...............................................................................................96%Done.HomecopiedtonewnodesSavinginventoryonnodes(Monday,February25,20191:04:42AMEST).100%Done.SaveinventorycompleteWARNING:Anewinventoryhasbeencreatedononeormorenodesinthissession.However,ithasnotyetbeenregisteredasthecentralinventoryofthissystem.Toregisterthenewinventorypleaserunthescriptat'/u01/app/oraInventory/orainstRoot.sh'withrootprivilegesonnodes'vastdata3'.Ifyoudonotregistertheinventory,youmaynotbeabletoupdateorpatchtheproductsyouinstalled.Thefollowingconfigurationscriptsneedtobeexecutedasthe"root"userineachnewclusternode.Eachscriptinthelistbelowisfollowedbyalistofnodes./u01/app/oraInventory/orainstRoot.sh#Onnodesvastdata3/u01/app/11.2.0/grid/root.sh#Onnodesvastdata3Toexecutetheconfigurationscripts:1.Openaterminalwindow2.Loginas"root"3.RunthescriptsineachclusternodeTheClusterNodeAdditionof/u01/app/11.2.0/gridwassuccessful.Pleasecheck'/tmp/silentInstall.log'formoredetails.

[root@vastdata4~]#cat/tmp/silentInstall.logsilentInstall.logsNativeVolName:/u01/app/11.2.0/grid/install/m_asNodeArray:vastdata4,vastdata3m_sLocalNode:vastdata4WARNING:Anewinventoryhasbeencreatedononeormorenodesinthissession.However,ithasnotyetbeenregisteredasthecentralinventoryofthissystem.Toregisterthenewinventorypleaserunthescriptat'/u01/app/oraInventory/orainstRoot.sh'withrootprivilegesonnodes'vastdata3'.Ifyoudonotregistertheinventory,youmaynotbeabletoupdateorpatchtheproductsyouinstalled.Thefollowingconfigurationscriptsneedtobeexecutedasthe"root"userineachnewclusternode.Eachscriptinthelistbelowisfollowedbyalistofnodes./u01/app/oraInventory/orainstRoot.sh#Onnodesvastdata3/u01/app/11.2.0/grid/root.sh#Onnodesvastdata3Toexecutetheconfigurationscripts:1.Openaterminalwindow2.Loginas"root"3.RunthescriptsineachclusternodeTheClusterNodeAdditionof/u01/app/11.2.0/gridwassuccessful.------------------------------------------------------------------------------------------------------------------------------------[root@vastdata3~]#/u01/app/oraInventory/orainstRoot.shCreatingtheOracleinventorypointerfile(/etc/oraInst.loc)Changingpermissionsof/u01/app/oraInventory.Addingread,writepermissionsforgroup.Removingread,write,executepermissionsforworld.Changinggroupnameof/u01/app/oraInventorytooinstall.Theexecutionofthescriptiscomplete.[root@vastdata3~]#/u01/app/11.2.0/grid/root.shPerformingrootuseroperationforOracle11gThefollowingenvironmentvariablesaresetas:ORACLE_OWNER=gridORACLE_HOME=/u01/app/11.2.0/gridEnterthefullpathnameofthelocalbindirectory:[/usr/local/bin]:Thecontentsof"dbhome"havenotchanged.Noneedtooverwrite.Thecontentsof"oraenv"havenotchanged.Noneedtooverwrite.Thecontentsof"coraenv"havenotchanged.Noneedtooverwrite.Entrieswillbeaddedtothe/etc/oratabfileasneededbyDatabaseConfigurationAssistantwhenadatabaseiscreatedFinishedrunninggenericpartofrootscript.Nowproduct-specificrootactionswillbeperformed.Usingconfigurationparameterfile:/u01/app/11.2.0/grid/crs/install/crsconfig_paramsUserignoredPrerequisitesduringinstallationInstallingTraceFileAnalyzerOLRinitialization-successfulAddingClusterwareentriestoupstartCRS-4402:TheCSSdaemonwasstartedinexclusivemodebutfoundanactiveCSSdaemononnodevastdata4,number2,andisterminatingAnactiveclusterwasfoundduringexclusivestartup,restartingtojointheclusterclscfg:EXISTINGconfigurationversion5detected.clscfg:version5is11gRelease2.SuccessfullyaccumulatednecessaryOCRkeys.CreatingOCRkeysforuser'root',privgrp'root'..Operationsuccessful.Preparingpackagesforinstallation...cvuqdisk-1.0.9-1ConfigureOracleGridInfrastructureforaCluster...succeeded(4) 节点添加后的检查

[grid@vastdata4~]$cluvfystage-postnodeadd-nvastdata3-verbosePerformingpost-checksfornodeadditionCheckingnodereachability...Check:Nodereachabilityfromnode"vastdata4"DestinationNodeReachable?------------------------------------------------------------vastdata3yesResult:Nodereachabilitycheckpassedfromnode"vastdata4"Checkinguserequivalence...Check:Userequivalenceforuser"grid"NodeNameStatus------------------------------------------------------------vastdata3passedResult:Userequivalencecheckpassedforuser"grid"Checkingclusterintegrity...NodeName------------------------------------vastdata3vastdata4ClusterintegritycheckpassedCheckingCRSintegrity...ClusterwareversionconsistencypassedTheOracleClusterwareishealthyonnode"vastdata4"TheOracleClusterwareishealthyonnode"vastdata3"CRSintegritycheckpassedCheckingsharedresources...CheckingCRShomelocation..."/u01/app/11.2.0/grid"isnotsharedResult:SharedresourcescheckfornodeadditionpassedCheckingnodeconnectivity...Checkinghostsconfigfile...NodeNameStatus------------------------------------------------------------vastdata4passedvastdata3passedVerificationofthehostsconfigfilesuccessfulInterfaceinformationfornode"vastdata4"NameIPAddressSubnetGatewayDef.GatewayHWAddressMTU-----------------------------------------------------------------------------------------eth0192.168.0.12192.168.0.00.0.0.0UNKNOWN08:00:27:EF:F6:151500eth0192.168.0.33192.168.0.00.0.0.0UNKNOWN08:00:27:EF:F6:151500eth0192.168.0.35192.168.0.00.0.0.0UNKNOWN08:00:27:EF:F6:151500eth0192.168.0.23192.168.0.00.0.0.0UNKNOWN08:00:27:EF:F6:151500eth210.0.0.410.0.0.00.0.0.0UNKNOWN08:00:27:82:3A:571500eth2169.254.17.92169.254.0.00.0.0.0UNKNOWN08:00:27:82:3A:571500eth310.0.0.510.0.0.00.0.0.0UNKNOWN08:00:27:4C:5D:391500eth3169.254.236.167169.254.128.00.0.0.0UNKNOWN08:00:27:4C:5D:391500Interfaceinformationfornode"vastdata3"NameIPAddressSubnetGatewayDef.GatewayHWAddressMTU-----------------------------------------------------------------------------------------eth0192.168.0.11192.168.0.00.0.0.0UNKNOWN08:00:27:D3:55:CB1500eth0192.168.0.34192.168.0.00.0.0.0UNKNOWN08:00:27:D3:55:CB1500eth0192.168.0.22192.168.0.00.0.0.0UNKNOWN08:00:27:D3:55:CB1500eth210.0.0.210.0.0.00.0.0.0UNKNOWN08:00:27:B4:C3:C71500eth2169.254.73.97169.254.0.00.0.0.0UNKNOWN08:00:27:B4:C3:C71500eth310.0.0.310.0.0.00.0.0.0UNKNOWN08:00:27:02:BD:9A1500eth3169.254.222.114169.254.128.00.0.0.0UNKNOWN08:00:27:02:BD:9A1500Check:Nodeconnectivityforinterface"eth0"SourceDestinationConnected?----------------------------------------------------------------------------vastdata4[192.168.0.12]vastdata4[192.168.0.33]yesvastdata4[192.168.0.12]vastdata4[192.168.0.35]yesvastdata4[192.168.0.12]vastdata4[192.168.0.23]yesvastdata4[192.168.0.12]vastdata3[192.168.0.11]yesvastdata4[192.168.0.12]vastdata3[192.168.0.34]yesvastdata4[192.168.0.12]vastdata3[192.168.0.22]yesvastdata4[192.168.0.33]vastdata4[192.168.0.35]yesvastdata4[192.168.0.33]vastdata4[192.168.0.23]yesvastdata4[192.168.0.33]vastdata3[192.168.0.11]yesvastdata4[192.168.0.33]vastdata3[192.168.0.34]yesvastdata4[192.168.0.33]vastdata3[192.168.0.22]yesvastdata4[192.168.0.35]vastdata4[192.168.0.23]yesvastdata4[192.168.0.35]vastdata3[192.168.0.11]yesvastdata4[192.168.0.35]vastdata3[192.168.0.34]yesvastdata4[192.168.0.35]vastdata3[192.168.0.22]yesvastdata4[192.168.0.23]vastdata3[192.168.0.11]yesvastdata4[192.168.0.23]vastdata3[192.168.0.34]yesvastdata4[192.168.0.23]vastdata3[192.168.0.22]yesvastdata3[192.168.0.11]vastdata3[192.168.0.34]yesvastdata3[192.168.0.11]vastdata3[192.168.0.22]yesvastdata3[192.168.0.34]vastdata3[192.168.0.22]yesResult:Nodeconnectivitypassedforinterface"eth0"Check:TCPconnectivityofsubnet"192.168.0.0"SourceDestinationConnected?----------------------------------------------------------------------------vastdata4:192.168.0.12vastdata4:192.168.0.33passedvastdata4:192.168.0.12vastdata4:192.168.0.35passedvastdata4:192.168.0.12vastdata4:192.168.0.23passedvastdata4:192.168.0.12vastdata3:192.168.0.11passedvastdata4:192.168.0.12vastdata3:192.168.0.34passedvastdata4:192.168.0.12vastdata3:192.168.0.22passedResult:TCPconnectivitycheckpassedforsubnet"192.168.0.0"Check:Nodeconnectivityforinterface"eth2"SourceDestinationConnected?----------------------------------------------------------------------------vastdata4[10.0.0.4]vastdata4[10.0.0.5]yesvastdata4[10.0.0.4]vastdata3[10.0.0.2]yesvastdata4[10.0.0.4]vastdata3[10.0.0.3]yesvastdata4[10.0.0.5]vastdata3[10.0.0.2]yesvastdata4[10.0.0.5]vastdata3[10.0.0.3]yesvastdata3[10.0.0.2]vastdata3[10.0.0.3]yesResult:Nodeconnectivitypassedforinterface"eth2"Check:TCPconnectivityofsubnet"10.0.0.0"SourceDestinationConnected?----------------------------------------------------------------------------vastdata4:10.0.0.4vastdata4:10.0.0.5passedvastdata4:10.0.0.4vastdata3:10.0.0.2passedvastdata4:10.0.0.4vastdata3:10.0.0.3passedResult:TCPconnectivitycheckpassedforsubnet"10.0.0.0"Check:Nodeconnectivityforinterface"eth3"Checkingsubnetmaskconsistency...Subnetmaskconsistencycheckpassedforsubnet"192.168.0.0".Subnetmaskconsistencycheckpassedforsubnet"10.0.0.0".Subnetmaskconsistencycheckpassed.Result:NodeconnectivitycheckpassedCheckingmulticastcommunication...Checkingsubnet"192.168.0.0"formulticastcommunicationwithmulticastgroup"230.0.1.0"...Checkofsubnet"192.168.0.0"formulticastcommunicationwithmulticastgroup"230.0.1.0"passed.Checkingsubnet"10.0.0.0"formulticastcommunicationwithmulticastgroup"230.0.1.0"...Checkofsubnet"10.0.0.0"formulticastcommunicationwithmulticastgroup"230.0.1.0"passed.Checkofmulticastcommunicationpassed.Checkingnodeapplicationexistence...CheckingexistenceofVIPnodeapplication(required)NodeNameRequiredRunning?Comment----------------------------------------------------------------------vastdata4yesyespassedvastdata3yesyespassedVIPnodeapplicationcheckpassedCheckingexistenceofNETWORKnodeapplication(required)NodeNameRequiredRunning?Comment----------------------------------------------------------------------vastdata4yesyespassedvastdata3yesyespassedNETWORKnodeapplicationcheckpassedCheckingexistenceofGSDnodeapplication(optional)NodeNameRequiredRunning?Comment----------------------------------------------------------------------vastdata4nonoexistsvastdata3nonoexistsGSDnodeapplicationisofflineonnodes"vastdata4,vastdata3"CheckingexistenceofONSnodeapplication(optional)NodeNameRequiredRunning?Comment----------------------------------------------------------------------vastdata4noyespassedvastdata3noyespassedONSnodeapplicationcheckpassedCheckingSingleClientAccessName(SCAN)...SCANNameNodeRunning?ListenerNamePortRunning?----------------------------------------------------------------------------vastdata-scan.us.oracle.comvastdata3trueLISTENER_SCAN11521truevastdata-scan.us.oracle.comvastdata4trueLISTENER_SCAN21521truevastdata-scan.us.oracle.comvastdata4trueLISTENER_SCAN31521trueCheckingTCPconnectivitytoSCANListeners...NodeListenerNameTCPconnectivity?------------------------------------------------------------vastdata4LISTENER_SCAN1yesvastdata4LISTENER_SCAN2yesvastdata4LISTENER_SCAN3yesTCPconnectivitytoSCANListenersexistsonallclusternodesCheckingnameresolutionsetupfor"vastdata-scan.us.oracle.com"...Checkingintegrityofnameserviceswitchconfigurationfile"/etc/nsswitch.conf"...Checkingif"hosts"entryinfile"/etc/nsswitch.conf"isconsistentacrossnodes...Checkingfile"/etc/nsswitch.conf"tomakesurethatonlyone"hosts"entryisdefinedMorethanone"hosts"entrydoesnotexistinany"/etc/nsswitch.conf"fileCheckforintegrityofnameserviceswitchconfigurationfile"/etc/nsswitch.conf"passedSCANNameIPAddressStatusComment----------------------------------------------------------------------vastdata-scan.us.oracle.com192.168.0.33passedvastdata-scan.us.oracle.com192.168.0.34passedvastdata-scan.us.oracle.com192.168.0.35passedVerificationofSCANVIPandListenersetuppassedCheckingtomakesureuser"grid"isnotin"root"groupNodeNameStatusComment------------------------------------------------------------vastdata3passeddoesnotexistResult:User"grid"isnotpartof"root"group.CheckpassedCheckingifClusterwareisinstalledonallnodes...CheckofClusterwareinstallpassedCheckingifCTSSResourceisrunningonallnodes...Check:CTSSResourcerunningonallnodesNodeNameStatus------------------------------------------------------------vastdata3passedResult:CTSSresourcecheckpassedQueryingCTSSfortimeoffsetonallnodes...Result:QueryofCTSSfortimeoffsetpassedCheckCTSSstatestarted...Check:CTSSstateNodeNameState------------------------------------------------------------vastdata3ActiveCTSSisinActivestate.Proceedingwithcheckofclocktimeoffsetsonallnodes...ReferenceTimeOffsetLimit:1000.0msecsCheck:ReferenceTimeOffsetNodeNameTimeOffsetStatus------------------------------------------------------------vastdata30.0passedTimeoffsetiswithinthespecifiedlimitsonthefollowingsetofnodes:"[vastdata3]"Result:CheckofclocktimeoffsetspassedOracleClusterTimeSynchronizationServicescheckpassedPost-checkfornodeadditionwassuccessful.(5) 检查集群内节点状态

[grid@vastdata4~]$olsnodes-tvastdata3Unpinnedvastdata4Unpinned(6) 检查集群资源状态

[grid@vastdata4~]$crsctlstatres-t--------------------------------------------------------------------------------NAMETARGETSTATESERVERSTATE_DETAILS--------------------------------------------------------------------------------LocalResources--------------------------------------------------------------------------------ora.DATA.dgONLINEONLINEvastdata3ONLINEONLINEvastdata4ora.FRA.dgONLINEONLINEvastdata3ONLINEONLINEvastdata4ora.LISTENER.lsnrONLINEONLINEvastdata3ONLINEONLINEvastdata4ora.asmONLINEONLINEvastdata3StartedONLINEONLINEvastdata4Startedora.gsdOFFLINEOFFLINEvastdata3OFFLINEOFFLINEvastdata4ora.net1.networkONLINEONLINEvastdata3ONLINEONLINEvastdata4ora.onsONLINEONLINEvastdata3ONLINEONLINEvastdata4ora.registry.acfsONLINEONLINEvastdata3ONLINEONLINEvastdata4--------------------------------------------------------------------------------ClusterResources--------------------------------------------------------------------------------ora.LISTENER_SCAN1.lsnr1ONLINEONLINEvastdata3ora.LISTENER_SCAN2.lsnr1ONLINEONLINEvastdata4ora.LISTENER_SCAN3.lsnr1ONLINEONLINEvastdata4ora.cvu1ONLINEONLINEvastdata4ora.oc4j1ONLINEONLINEvastdata4ora.prod.db2ONLINEONLINEvastdata4Openora.scan1.vip1ONLINEONLINEvastdata3ora.scan2.vip1ONLINEONLINEvastdata4ora.scan3.vip1ONLINEONLINEvastdata4ora.vastdata3.vip1ONLINEONLINEvastdata3ora.vastdata4.vip1ONLINEONLINEvastdata4三. 新节点安装DB软件

[oracle@vastdata4~]$$ORACLE_HOME/oui/bin/addNode.sh-silent"CLUSTER_NEW_NODES={vastdata3}"Performingpre-checksfornodeadditionCheckingnodereachability...Nodereachabilitycheckpassedfromnode"vastdata4"Checkinguserequivalence...Userequivalencecheckpassedforuser"oracle"WARNING:Node"vastdata3"alreadyappearstobepartofclusterPre-checkfornodeadditionwassuccessful.StartingOracleUniversalInstaller...Checkingswapspace:mustbegreaterthan500MB.Actual6143MBPassedOracleUniversalInstaller,Version11.2.0.4.0ProductionCopyright(C)1999,2013,Oracle.Allrightsreserved.Performingteststoseewhethernodesvastdata3areavailable...............................................................100%Done...-----------------------------------------------------------------------------ClusterNodeAdditionSummaryGlobalSettingsSource:/u01/app/oracle/product/11.2.0/db_1NewNodesSpaceRequirementsNewNodesvastdata3/:Required4.34GB:Available10.59GBInstalledProductsProductNamesOracleDatabase11g11.2.0.4.0JavaDevelopmentKit1.5.0.51.10InstallerSDKComponent11.2.0.4.0OracleOne-OffPatchInstaller11.2.0.3.4OracleUniversalInstaller11.2.0.4.0OracleUSMDeconfiguration11.2.0.4.0OracleConfigurationManagerDeconfiguration10.3.1.0.0OracleDBCADeconfiguration11.2.0.4.0OracleRACDeconfiguration11.2.0.4.0OracleDatabaseDeconfiguration11.2.0.4.0OracleConfigurationManagerClient10.3.2.1.0OracleConfigurationManager10.3.8.1.0OracleODBCDriverforInstantClient11.2.0.4.0LDAPRequiredSupportFiles11.2.0.4.0SSLRequiredSupportFilesforInstantClient11.2.0.4.0BaliShare1.1.18.0.0OracleExtendedWindowingToolkit3.4.47.0.0OracleJFCExtendedWindowingToolkit4.2.36.0.0OracleRealApplicationTesting11.2.0.4.0OracleDatabaseVaultJ2EEApplication11.2.0.4.0OracleLabelSecurity11.2.0.4.0OracleDataMiningRDBMSFiles11.2.0.4.0OracleOLAPRDBMSFiles11.2.0.4.0OracleOLAPAPI11.2.0.4.0PlatformRequiredSupportFiles11.2.0.4.0OracleDatabaseVaultoption11.2.0.4.0OracleRACRequiredSupportFiles-HAS11.2.0.4.0SQL*PlusRequiredSupportFiles11.2.0.4.0OracleDisplayFonts9.0.2.0.0OracleIceBrowser5.2.3.6.0OracleJDBCServerSupportPackage11.2.0.4.0OracleSQLDeveloper11.2.0.4.0OracleApplicationExpress11.2.0.4.0XDKRequiredSupportFiles11.2.0.4.0RDBMSRequiredSupportFilesforInstantClient11.2.0.4.0SQLJRuntime11.2.0.4.0DatabaseWorkspaceManager11.2.0.4.0RDBMSRequiredSupportFilesRuntime11.2.0.4.0OracleGlobalizationSupport11.2.0.4.0ExadataStorageServer11.2.0.1.0ProvisioningAdvisorFramework10.2.0.4.3EnterpriseManagerDatabasePlugin--RepositorySupport11.2.0.4.0EnterpriseManagerRepositoryCoreFiles10.2.0.4.5EnterpriseManagerDatabasePlugin--AgentSupport11.2.0.4.0EnterpriseManagerGridControlCoreFiles10.2.0.4.5EnterpriseManagerCommonCoreFiles10.2.0.4.5EnterpriseManagerAgentCoreFiles10.2.0.4.5RDBMSRequiredSupportFiles11.2.0.4.0regexp2.1.9.0.0AgentRequiredSupportFiles10.2.0.4.5Oracle11gWarehouseBuilderRequiredFiles11.2.0.4.0OracleNotificationService(eONS)11.2.0.4.0OracleTextRequiredSupportFiles11.2.0.4.0ParserGeneratorRequiredSupportFiles11.2.0.4.0OracleDatabase11gMultimediaFiles11.2.0.4.0OracleMultimediaJavaAdvancedImaging11.2.0.4.0OracleMultimediaAnnotator11.2.0.4.0OracleJDBC/OCIInstantClient11.2.0.4.0OracleMultimediaLocatorRDBMSFiles11.2.0.4.0PrecompilerRequiredSupportFiles11.2.0.4.0OracleCoreRequiredSupportFiles11.2.0.4.0SampleSchemaData11.2.0.4.0OracleStarterDatabase11.2.0.4.0OracleMessageGatewayCommonFiles11.2.0.4.0OracleXMLQuery11.2.0.4.0XMLParserforOracleJVM11.2.0.4.0OracleHelpForJava4.2.9.0.0InstallationPluginFiles11.2.0.4.0EnterpriseManagerCommonFiles10.2.0.4.5Expatlibraries2.0.1.0.1DeinstallationTool11.2.0.4.0OracleQualityofServiceManagement(Client)11.2.0.4.0PerlModules5.10.0.0.1JAccelerator(COMPANION)11.2.0.4.0OracleContainersforJava11.2.0.4.0PerlInterpreter5.10.0.0.2OracleNetRequiredSupportFiles11.2.0.4.0SecureSocketLayer11.2.0.4.0OracleUniversalConnectionPool11.2.0.4.0OracleJDBC/THINInterfaces11.2.0.4.0OracleMultimediaClientOption11.2.0.4.0OracleJavaClient11.2.0.4.0CharacterSetMigrationUtility11.2.0.4.0OracleCodeEditor1.2.1.0.0IPL/SQLEmbeddedGateway11.2.0.4.0OLAPSQLScripts11.2.0.4.0DatabaseSQLScripts11.2.0.4.0OracleLocaleBuilder11.2.0.4.0OracleGlobalizationSupport11.2.0.4.0SQL*PlusFilesforInstantClient11.2.0.4.0RequiredSupportFiles11.2.0.4.0OracleDatabaseUserInterface2.2.13.0.0OracleODBCDriver11.2.0.4.0OracleNotificationService11.2.0.3.0XMLParserforJava11.2.0.4.0OracleSecurityDeveloperTools11.2.0.4.0OracleWalletManager11.2.0.4.0ClusterVerificationUtilityCommonFiles11.2.0.4.0OracleClusterwareRDBMSFiles11.2.0.4.0OracleUIX2.2.24.6.0EnterpriseManagerpluginCommonFiles11.2.0.4.0HASCommonFiles11.2.0.4.0PrecompilerCommonFiles11.2.0.4.0InstallationCommonFiles11.2.0.4.0OracleHelpfortheWeb2.0.14.0.0OracleLDAPadministration11.2.0.4.0BuildtoolsCommonFiles11.2.0.4.0AssistantCommonFiles11.2.0.4.0OracleRecoveryManager11.2.0.4.0PL/SQL11.2.0.4.0GenericConnectivityCommonFiles11.2.0.4.0OracleDatabaseGatewayforODBC11.2.0.4.0OracleProgrammer11.2.0.4.0OracleDatabaseUtilities11.2.0.4.0EnterpriseManagerAgent10.2.0.4.5SQL*Plus11.2.0.4.0OracleNetcaClient11.2.0.4.0OracleMultimediaLocator11.2.0.4.0OracleCallInterface(OCI)11.2.0.4.0OracleMultimedia11.2.0.4.0OracleNet11.2.0.4.0OracleXMLDevelopmentKit11.2.0.4.0OracleInternetDirectoryClient11.2.0.4.0DatabaseConfigurationandUpgradeAssistants11.2.0.4.0OracleJVM11.2.0.4.0OracleAdvancedSecurity11.2.0.4.0OracleNetListener11.2.0.4.0OracleEnterpriseManagerConsoleDB11.2.0.4.0HASFilesforDB11.2.0.4.0OracleText11.2.0.4.0OracleNetServices11.2.0.4.0OracleDatabase11g11.2.0.4.0OracleOLAP11.2.0.4.0OracleSpatial11.2.0.4.0OraclePartitioning11.2.0.4.0EnterpriseEditionOptions11.2.0.4.0-----------------------------------------------------------------------------Instantiatingscriptsforaddnode(Monday,February25,20191:20:38AMEST).1%Done.InstantiationofaddnodescriptscompleteCopyingtoremotenodes(Monday,February25,20191:20:44AMEST)...............................................................................................96%Done.HomecopiedtonewnodesSavinginventoryonnodes(Monday,February25,20191:26:47AMEST).100%Done.SaveinventorycompleteWARNING:Thefollowingconfigurationscriptsneedtobeexecutedasthe"root"userineachnewclusternode.Eachscriptinthelistbelowisfollowedbyalistofnodes./u01/app/oracle/product/11.2.0/db_1/root.sh#Onnodesvastdata3Toexecutetheconfigurationscripts:1.Openaterminalwindow2.Loginas"root"3.RunthescriptsineachclusternodeTheClusterNodeAdditionof/u01/app/oracle/product/11.2.0/db_1wassuccessful.Pleasecheck'/tmp/silentInstall.log'formoredetails.

[oracle@vastdata4~]$cat/tmp/silentInstall.logsilentInstall.logsNativeVolName:/u01/app/11.2.0/grid/install/m_asNodeArray:vastdata4,vastdata3m_sLocalNode:vastdata4WARNING:Anewinventoryhasbeencreatedononeormorenodesinthissession.However,ithasnotyetbeenregisteredasthecentralinventoryofthissystem.Toregisterthenewinventorypleaserunthescriptat'/u01/app/oraInventory/orainstRoot.sh'withrootprivilegesonnodes'vastdata3'.Ifyoudonotregistertheinventory,youmaynotbeabletoupdateorpatchtheproductsyouinstalled.Thefollowingconfigurationscriptsneedtobeexecutedasthe"root"userineachnewclusternode.Eachscriptinthelistbelowisfollowedbyalistofnodes./u01/app/oraInventory/orainstRoot.sh#Onnodesvastdata3/u01/app/11.2.0/grid/root.sh#Onnodesvastdata3Toexecutetheconfigurationscripts:1.Openaterminalwindow2.Loginas"root"3.RunthescriptsineachclusternodeTheClusterNodeAdditionof/u01/app/11.2.0/gridwassuccessful.------------------------------------------------------------------------------------------------------------------------------------[root@vastdata3~]#/u01/app/oraInventory/orainstRoot.shCreatingtheOracleinventorypointerfile(/etc/oraInst.loc)Changingpermissionsof/u01/app/oraInventory.Addingread,writepermissionsforgroup.Removingread,write,executepermissionsforworld.Changinggroupnameof/u01/app/oraInventorytooinstall.Theexecutionofthescriptiscomplete.[root@vastdata3~]#/u01/app/11.2.0/grid/root.shPerformingrootuseroperationforOracle11gThefollowingenvironmentvariablesaresetas:ORACLE_OWNER=gridORACLE_HOME=/u01/app/11.2.0/gridEnterthefullpathnameofthelocalbindirectory:[/usr/local/bin]:Thecontentsof"dbhome"havenotchanged.Noneedtooverwrite.Thecontentsof"oraenv"havenotchanged.Noneedtooverwrite.Thecontentsof"coraenv"havenotchanged.Noneedtooverwrite.Entrieswillbeaddedtothe/etc/oratabfileasneededbyDatabaseConfigurationAssistantwhenadatabaseiscreatedFinishedrunninggenericpartofrootscript.Nowproduct-specificrootactionswillbeperformed.Usingconfigurationparameterfile:/u01/app/11.2.0/grid/crs/install/crsconfig_paramsUserignoredPrerequisitesduringinstallationInstallingTraceFileAnalyzerConfigureOracleGridInfrastructureforaCluster...succeeded四. 给新节点分配实例1. 检查RAC下所有实例状态

[oracle@vastdata4~]$srvctlstatusdatabase-dPROD-fInstancePROD2isrunningonnodevastdata4[oracle@vastdata4~]$srvctlconfigdatabase-dPROD-aDatabaseuniquename:PRODDatabasename:PRODOraclehome:/u01/app/oracle/product/11.2.0/db_1Oracleuser:oracleSpfile:+DATA/PROD/spfilePROD.oraDomain:Startoptions:openStopoptions:immediateDatabaserole:PRIMARYManagementpolicy:AUTOMATICServerpools:PRODDatabaseinstances:PROD2DiskGroups:DATA,FRAMountpointpaths:Services:Type:RACDatabaseisenabledDatabaseisadministratormanaged2. 为新增节点分配实例

[oracle@vastdata4~]$dbca-silent-addInstance-gdbNamePROD-nodelistvastdata3-instanceNamePROD1-sysDBAUserNamesys-sysDBAPasswordoracleAddinginstance1%complete2%complete6%complete13%complete20%complete26%complete33%complete40%complete46%complete53%complete66%completeCompletinginstancemanagement.76%complete100%completeLookatthelogfile"/u01/app/oracle/cfgtoollogs/dbca/PROD/PROD.log"forfurtherdetails.[oracle@vastdata4~]$srvctlconfigdatabase-dPROD-aDatabaseuniquename:PRODDatabasename:PRODOraclehome:/u01/app/oracle/product/11.2.0/db_1Oracleuser:oracleSpfile:+DATA/PROD/spfilePROD.oraDomain:Startoptions:openStopoptions:immediateDatabaserole:PRIMARYManagementpolicy:AUTOMATICServerpools:PRODDatabaseinstances:PROD1,PROD2DiskGroups:DATA,FRAMountpointpaths:Services:Type:RACDatabaseisenabledDatabaseisadministratormanaged3. 检查集群资源状态

[grid@vastdata4~]$crsctlstatres-t--------------------------------------------------------------------------------NAMETARGETSTATESERVERSTATE_DETAILS--------------------------------------------------------------------------------LocalResources--------------------------------------------------------------------------------ora.DATA.dgONLINEONLINEvastdata3ONLINEONLINEvastdata4ora.FRA.dgONLINEONLINEvastdata3ONLINEONLINEvastdata4ora.LISTENER.lsnrONLINEONLINEvastdata3ONLINEONLINEvastdata4ora.asmONLINEONLINEvastdata3StartedONLINEONLINEvastdata4Startedora.gsdOFFLINEOFFLINEvastdata3OFFLINEOFFLINEvastdata4ora.net1.networkONLINEONLINEvastdata3ONLINEONLINEvastdata4ora.onsONLINEONLINEvastdata3ONLINEONLINEvastdata4ora.registry.acfsONLINEONLINEvastdata3ONLINEONLINEvastdata4--------------------------------------------------------------------------------ClusterResources--------------------------------------------------------------------------------ora.LISTENER_SCAN1.lsnr1ONLINEONLINEvastdata3ora.LISTENER_SCAN2.lsnr1ONLINEONLINEvastdata4ora.LISTENER_SCAN3.lsnr1ONLINEONLINEvastdata4ora.cvu1ONLINEONLINEvastdata4ora.oc4j1ONLINEONLINEvastdata4ora.prod.db1ONLINEONLINEvastdata3Open2ONLINEONLINEvastdata4Openora.scan1.vip1ONLINEONLINEvastdata3ora.scan2.vip1ONLINEONLINEvastdata4ora.scan3.vip1ONLINEONLINEvastdata4ora.vastdata3.vip1ONLINEONLINEvastdata3ora.vastdata4.vip1ONLINEONLINEvastdata44.检查新添加节点数据库的运行情况

[oracle@vastdata3~]$sqlplus/assysdbaSQL*Plus:Release11.2.0.4.0ProductiononMonFeb2501:44:562019Copyright(c)1982,2013,Oracle.Allrightsreserved.Connectedto:OracleDatabase11gEnterpriseEditionRelease11.2.0.4.0-64bitProductionWiththePartitioning,RealApplicationClusters,AutomaticStorageManagement,OLAP,DataMiningandRealApplicationTestingoptionsSQL>selectcount(*)fromtab;COUNT(*)----------4987

如有转载，请标明出处。