R12.2 Apps DBA. Powered by Blogger.

Collecting adop and fs_clone log files R12.2

, , , , No comments :
SOLUTION:
To debug Online Patching issues which utilize the adop (AD Online Patching) tool we need to collect adop log files located in the <INSTALL BASE>/fs_ne/EBSapps/log/adop directory
e.g. /u01/PROD/fs_ne/EBSapps/log/adop
Each cycle of adop creates a subdirectory corresponding to the patch session ID, e.g.
/u01/PROD/fs_ne/EBSapps/log/adop/1
/u01/PROD/fs_ne/EBSapps/log/adop/2
etc
When running adop the on-screen terminal output will mention which adop session ID  is in use.
e.g. /u01/PROD/fs_ne/EBSapps/log/adop/9/apply_20121011_024437
Online Patching Log Analyzer Utility (this new feature is delivered by AD and TXK C Delta 4 patches)
This utility analyzes adop log directories for errors and warnings, and displays messages to help the user quickly identify any problems that may have occurred during an adop run. It thereby offers an alternative to reviewing log files manually.
The Log Analyzer utility can be run without options:
    To scan all log directories of the latest adop session for errors:
    $ adopscanlog
The utility can also be run with various options. Examples include:
    To scan log directories relating to the latest run of adop in the latest session:
    $ adopscanlog -latest=yes
    To scan log directories relating to the latest run of the specified phase, in the latest session:
    $ adopscanlog -latest=yes -phase=<phase_name>
    To scan all log directories of a given session (represented by a session_id) for errors:
    $ adopscanlog -session_id=<number>
    To see a complete list of supported parameters:
    $ adopscanlog -help
STEP 1:  Obtain all of the log files within the session ID directory. It is best to obtain a zip of the entire directory.
e.g. obtain a zip of /u01/PROD/fs_ne/EBSapps/log/adop/9
The session ID directory will contain:
a) A trace file for each phase;
e.g.
adop_20130316_085026.log 
adop_20130316_091340.log 
adop_20130316_210950.log 
b) Logs grouped in phase directories
e.g.
prepare_20130316_085026
apply_20130316_091340 
cutover_20130316_210950 
You can see the timestamps match between each log directory and the respective trace file.
prepare_20130316_085026 directory matches adop_20130316_085026.log
apply_20130316_091340 directory matches adop_20130316_091340.log
etc
The same goes for fs_clone activities. i.e. you will see something like this
fs_clone_20130319_233614 --> this is a directory
adop_20130319_233614.log
In almost all cases, when debugging an adop failure the patch log directory will contain the information you need to determine root cause
e.g.
/u01/PROD/fs_ne/EBSapps/log/adop/2/cutover_20130316_210950/
In some cases the onscreen error will indicate which subroutine has failed. You will likely find a subdirectory containing log files which matches the failing routine. This should be where you focus your attention
e.g.
/u01/PROD/fs_ne/EBSapps/log/adop/2/cutover_20130316_210950/VIS_ufc/TXK_CTRL_forceshutdown_Sat_Mar_16_21_14_02_2013
STEP 2: Run the following SQL statements
This will show you the status for each adop phase along with its corresponding session id. This is effectively a history of online patching in an environment.
a) select ADOP_SESSION_ID,PREPARE_STATUS,APPLY_STATUS,FINALIZE_STATUS,CUTOVER_STATUS,CLEANUP_STATUS,ABORT_STATUS,STATUS,ABANDON_FLAG,NODE_NAME from AD_ADOP_SESSIONS order by ADOP_SESSION_ID;
Note:
       Y denotes that the phase is done
       N denotes that the phase has not been completed
       X denotes that the phase is not applicable
       R denotes that the phase is running (in progress)
       F denotes that the phase has failed
       P (is applicable only to APPLY phase) denotes at least one patch is already applied for the session id
       C denotes that the status of this ADOP session has completed
Note: Numerical statuses are only relevant for the cutover phase...
These status values are updated when a step has completed, and are as follows:
N denotes that the phase has not been completed
0 denotes that cutover/force_shutdown has started
1 denotes the "force_shutdown" step has successfully executed
3 denotes the "db_cutover" step has successfully executed
4 denotes the "fs_cutover" step has successfully executed
6 denotes the "force_startup" step has successfully executed 
Y denotes that the phase is done
cutover statuses
cutover_status='Y' 'COMPLETED'
cutover_status not in ('N','Y','X') and status='F' 'FAILED'
cutover_status='0' 'CUTOVER STARTED'
cutover_status='1' 'SERVICES SHUTDOWN COMPLETED'
cutover_status='3' 'DB CUTOVER COMPLETED'
cutover_status='D' 'FLIP SNAPSHOTS COMPLETED'
cutover_status='4' 'FS CUTOVER COMPLETED'
cutover_status='5' 'ADMIN STARTUP COMPLETED'
cutover_status='6' 'SERVICES STARTUP COMPLETED'
cutover_status='N' 'NOT STARTED'
cutover_status='X' 'NOT APPLICABLE'
STEP 3: Check the current status of the adop cycle
Source the run filesystem environment file and run command
adop -status
usage
adop -status  generates a summary report
adop -status <sessionID> generates a summary report for that session ID
adop -status -detail generates a detailed report
 STEP 4: Check AD and TXK C Patch levels
 SELECT codelevel FROM AD_TRACKABLE_ENTITIES WHERE abbreviation in ('txk','ad');
STEP 5: Check middle tier technology patch levels
/u01/VIS/fs1/EBSapps/appl/ad/12.0.0/sql> perl $FND_TOP/patch/115/bin/TXKScript.pl -script=/u01/VIS/fs1/EBSapps/appl/fnd/12.0.0/patch/115/bin/txkInventory.pl -txktop=$APPLTMP -contextfile=$CONTEXT_FILE -appspass=apps -outfile=/tmp/Inventory_Report.html
Appendix
A.1 General problems with Finalize phase and Abort command
For phase=finalize issues run the following command and attach the adzdshowlog.out file generated:
sqlplus <apps_schema_name>/<apps_Schema_password> @$AD_TOP/sql/ADZDSHOWLOG.sql
Note: the contents of the table will be truncated every time cleanup/prepare phase is run.
Older log information is stored in adzdshowlog.out
or
select * from ad_zd_logs order by log_sequence desc;
A.2 'Duplicate keys found' during Finalize
ERROR at line 1:
ORA-20001: Error: while calling ad_zd.finalize .ORA-01452: cannot CREATE UNIQUE
INDEX; duplicate keys found
ORA-06512: at line 8
Run the following:
sqlplus <apps_schema_name>/<apps_Schema_password> @$AD_TOP/sql/ADZDSHOWLOG.sql
The output will highlight the unique index which is failing. You can then use the following sql to identify the duplicate key values
select <list of columns for which unique index creation failed>, count(*)
from <schema_name>.<table_name> group by <list of columns again> having count(*)>1
e.g.
select REPRESENTATION_CODE, TRX_NUMBER#2, ORG_ID, count(*) from OKL.OKL_TRX_CONTRACTS_ALL group by REPRESENTATION_CODE, TRX_NUMBER#2, ORG_ID having count(*)>1
A.3 Problems with Online Enablement
For failed attempts at Online Enablement i.e. failures of patch 13543062, gather the following information:
1. Patch log
2. Worker logs
3. Output of
select * from ad_zd_logs order by log_sequence desc;
4. output from:
@$AD_TOP/sql/ADZDSHOWDDLS.sql
If enablement appears to be having performance issues or seems to have hanged you can run the following script to determine if enablement is progressing or has hanged:
select count(1) from ad_zd_logs;
Run the scripts every 5 or  10 minutes. If the count is increasing then enablement is progressing.If enablement is progressing but very slowly ensure the DB initialization parameters are set as per the DB 11.2.0.3 and 12.2 requirements.
A.4 To show which patches were applied in each ADOP_SESSION_ID (patching cycle)
select * from ad_adop_session_patches order by end_date desc;
or
set pagesize 200;
set linesize 160;
column adop_session_id format 999999999999;
column bug_number format a15;
column status format a15;
column applied_file_system_base format a23;
column patch_file_system_base format a23;
column adpatch_options format a15;
column node_name format a15;
column end_date format a15;
column clone_status format a15;
select ADOP_SESSION_ID, BUG_NUMBER, STATUS, APPLIED_FILE_SYSTEM_BASE, PATCH_FILE_SYSTEM_BASE, ADPATCH_OPTIONS, NODE_NAME, END_DATE, CLONE_STATUS
from ad_adop_session_patches
order by end_date desc;
Note: STATUS
N - Not Applied In the current node but applied in other nodes
R - Patch Application is going on.
H - Patch failed in the middle. (Hard Failure)
F - Patch failed in the middle but user tried to skip some failures.
S - Patch Application succeeded after skipping the failed jobs.
Y - Patch Application succeeded.
C - Reserved for clone and config_clone. Indicates clone completed
A.5 Issues with FS_CLONE
a) select ADOP_SESSION_ID,BUG_NUMBER,CLONE_STATUS,STATUS,NODE_NAME from AD_ADOP_SESSION_PATCHES order by ADOP_SESSION_ID;
b) sqlplus <apps_schema_name>/<apps_Schema_password> @$AD_TOP/sql/ADZDSHOWLOG.sql
c) following files/dirs
$COMMON_TOP/clone/FMW/logs/CLONE<timestamp>.error
$COMMON_TOP/clone/FMW/logs/CLONE<timestamp>.log
A zip of files $INST_TOP/admin/log/clone directory
A zip of directory $APPLRGF/TXK/ohsCloneLog ( this captures cloning failures for OHS )
d) RUN and PATCH context files from all the nodes
e) if one of the scripts fails within fs_clone you can add some parameters and run it manually to obtain extra debug:
here are some examples
note the addition of -silent false and -debug true
/u01/applmgr/fs2/FMW_Home/oracle_common/bin/pasteConfig.sh -javaHome /u01/applmgr/fs2/EBSapps/comn/util/jdk64 -al /u01/applmgr/fs1/EBSapps/comn/clone/FMW/WLS/EBSdomain.jar -tdl /u01/applmgr/fs2/FMW_Home/user_projects/domains/EBS_domain_sa3 -tmw /u01/applmgr/fs2/FMW_Home -mpl /u01/applmgr/fs1/EBSapps/comn/clone/FMW/WLS/plan/moveplan.xml -ldl /u01/applmgr/fs1/inst/apps/sa3_spitfire2/admin/log/clone/wlsT2PApply -silent false -domainAdminPassword /u01/applmgr/fs1/EBSapps/comn/clone/FMW/tempinfo.txt -debug true
or
/oa12uat/R122/fs2/FMW_Home/oracle_common/bin/pasteConfig.sh -javaHome
/oa12uat/R122/fs2/EBSapps/comn/util/jdk32 -al
/oa12uat/R122/fs1/EBSapps/comn/clone/FMW/OHS/ohsarchive.jar -mpl
/oa12uat/R122/fs1/EBSapps/comn/clone/FMW/OHS/moveplan.xml -ldl
/oa12uat/R122/fs1/inst/apps/oa12uat_coreuatap01/admin/log/clone/ohsT2PApply
-silent false -tcn EBS_web_oa12uat -tih 
/oa12uat/R122/fs2/FMW_Home/webtier/instances/EBS_web_VIS_OHS1 -tinEBS_weVIS_OHS1 -toh /oa12uat/R122/fs2/FMW_Home/webtier -debug true
review the log and out files as well as the console output
A.6 ADOP Remote Invocation Issues and running ADOP on Multi Web Node Systems
Upload the following log files:
$APPL_TOP/admin/<SID>_patch/log/remote_execution_result.xml
$APPL_TOP/admin/<SID>/log/remote_execution_result.xml
Adop log directory corresponding to the failed adop id
Other key things to consider in multi web node instances.
- SSH should be enabled to allow communication from the primary node to the secondary nodes. Use txkRunSSHSetup.pl to enable SSH.
- If SSH is not enabled pay very special attention to the specific requirements for running adop in this case (see the maintenance guide)
- When patching ensure you copy patches to the patch home directory of all application tiers e.g. fs_ne/EBSapps/patch
- When debugging issues make sure to you review the adop logs on all application tiers

ASM Scripts

, , , , No comments :
ASM views:
VIEW            |ASM INSTANCE                                     |DB INSTANCE
----------------------------------------------------------------------------------------------------------
V$ASM_DISKGROUP |Describes a disk group (number, name, size       |Contains one row for every open ASM
                 |related info, state, and redundancy type)        |disk in the DB instance.
V$ASM_CLIENT    |Identifies databases using disk groups           |Contains no rows.
                 |managed by the ASM instance.                     |
V$ASM_DISK      |Contains one row for every disk discovered       |Contains rows only for disks in the
                 |by the ASM instance, including disks that        |disk groups in use by that DB instance.
                 |are not part of any disk group.                  |
V$ASM_FILE      |Contains one row for every ASM file in every     |Contains rows only for files that are
                |disk group mounted by the ASM instance.          |currently open in the DB instance.
V$ASM_TEMPLATE  |Contains one row for every template present in   |Contains no rows.
                 |every disk group mounted by the ASM instance.    |
V$ASM_ALIAS     |Contains one row for every alias present in      |Contains no rows.
                 |every disk group mounted by the ASM instance.    |
$ASM_OPERATION |Contains one row for every active ASM long       |Contains no rows.
                |running operation executing in the ASM instance. |

set wrap off
set lines 155 pages 9999
col "Group Name" for a6    Head "Group|Name"
col "Disk Name"  for a10
col "State"      for a10
col "Type"       for a10   Head "Diskgroup|Redundancy"
col "Total GB"   for 9,990 Head "Total|GB"
col "Free GB"    for 9,990 Head "Free|GB"
col "Imbalance"  for 99.9  Head "Percent|Imbalance"
col "Variance"   for 99.9  Head "Percent|Disk Size|Variance"
col "MinFree"    for 99.9  Head "Minimum|Percent|Free"
col "MaxFree"    for 99.9  Head "Maximum|Percent|Free"
col "DiskCnt"    for 9999  Head "Disk|Count"


 ASM Disk Groups
===============

SELECT g.group_number  "Group"
,      g.name          "Group Name"
,      g.state         "State"
,      g.type          "Type"
,      g.total_mb/1024 "Total GB"
,      g.free_mb/1024  "Free GB"
,      100*(max((d.total_mb-d.free_mb)/d.total_mb)-min((d.total_mb-d.free_mb)/d.total_mb))/max((d.total_mb-d.free_mb)/d.total_mb) "Imbalance"
,      100*(max(d.total_mb)-min(d.total_mb))/max(d.total_mb) "Variance"
,      100*(min(d.free_mb/d.total_mb)) "MinFree"
,      100*(max(d.free_mb/d.total_mb)) "MaxFree"
,      count(*)        "DiskCnt"
FROM v$asm_disk d, v$asm_diskgroup g
WHERE d.group_number = g.group_number and
d.group_number <> 0 and
d.state = 'NORMAL' and
d.mount_status = 'CACHED'
GROUP BY g.group_number, g.name, g.state, g.type, g.total_mb, g.free_mb
ORDER BY 1;

prompt ASM Disks In Use
prompt ================

col "Group"          for 999
col "Disk"           for 999
col "Header"         for a9
col "Mode"           for a8
col "State"          for a8
col "Created"        for a10          Head "Added To|Diskgroup"
--col "Redundancy"     for a10
--col "Failure Group"  for a10  Head "Failure|Group"
col "Path"           for a19
--col "ReadTime"       for 999999990    Head "Read Time|seconds"
--col "WriteTime"      for 999999990    Head "Write Time|seconds"
--col "BytesRead"      for 999990.00    Head "GigaBytes|Read"
--col "BytesWrite"     for 999990.00    Head "GigaBytes|Written"
col "SecsPerRead"    for 9.000        Head "Seconds|PerRead"
col "SecsPerWrite"   for 9.000        Head "Seconds|PerWrite"

select group_number  "Group"
,      disk_number   "Disk"
,      header_status "Header"
,      mode_status   "Mode"
,      state         "State"
,      create_date   "Created"
--,      redundancy    "Redundancy"
,      total_mb/1024 "Total GB"
,      free_mb/1024  "Free GB"
,      name          "Disk Name"
--,      failgroup     "Failure Group"
,      path          "Path"
--,      read_time     "ReadTime"
--,      write_time    "WriteTime"
--,      bytes_read/1073741824    "BytesRead"
--,      bytes_written/1073741824 "BytesWrite"
,      read_time/reads "SecsPerRead"
,      write_time/writes "SecsPerWrite"
from   v$asm_disk_stat
where header_status not in ('FORMER','CANDIDATE')
order by group_number
,        disk_number
/

Prompt File Types in Diskgroups
Prompt ========================
col "File Type"      for a16
col "Block Size"     for a5    Head "Block|Size"
col "Gb"             for 9990.00
col "Files"          for 99990
break on "Group Name" skip 1 nodup

select g.name                                   "Group Name"
,      f.TYPE                                   "File Type"
,      f.BLOCK_SIZE/1024||'k'                   "Block Size"
,      f.STRIPED
,        count(*)                               "Files"
,      round(sum(f.BYTES)/(1024*1024*1024),2)   "Gb"
from   v$asm_file f,v$asm_diskgroup g
where  f.group_number=g.group_number
group by g.name,f.TYPE,f.BLOCK_SIZE,f.STRIPED
order by 1,2;
clear break

 Instances currently accessing these diskgroups
 ==============================================
col "Instance" form a8
select c.group_number  "Group"
,      g.name          "Group Name"
,      c.instance_name "Instance"
from   v$asm_client c
,      v$asm_diskgroup g
where  g.group_number=c.group_number
/

prompt Free ASM disks and their paths
prompt ==============================
col "Disk Size"    form a9
select header_status                   "Header"
, mode_status                     "Mode"
, path                            "Path"
, lpad(round(os_mb/1024),7)||'Gb' "Disk Size"
from   v$asm_disk
where header_status in ('FORMER','CANDIDATE')
order by path
/

Current ASM disk operations
===========================
select *
from   v$asm_operation
/
This is how some of the changes look

Added To    Total   Free                                Seconds  Seconds
Group Disk Header    Mode     State    Diskgroup      GB     GB Disk Name  Path                PerRead PerWrite
----- ---- --------- -------- -------- ---------- ------ ------ ---------- ------------------- ------- --------
1    0 MEMBER    ONLINE   NORMAL   20-FEB-09      89     88 FRA_0000   /dev/oracle/disk388    .004     .002
1    1 MEMBER    ONLINE   NORMAL   31-MAY-10      89     88 FRA_0001   /dev/oracle/disk260    .002     .002
1    2 MEMBER    ONLINE   NORMAL   31-MAY-10      89     88 FRA_0002   /dev/oracle/disk260    .007     .002
2   15 MEMBER    ONLINE   NORMAL   04-MAR-10      89     29 DATA_0015  /dev/oracle/disk203    .012     .023

4 rows selected.

File Types in Diskgroups
========================

Group                   Block
Name   File Type        Size  STRIPE  Files       Gb
------ ---------------- ----- ------ ------ --------
DATA   CONTROLFILE      16k   FINE        1     0.01
DATAFILE         16k   COARSE    404  2532.58
ONLINELOG        1k    FINE        3     6.00
PARAMETERFILE    1k    COARSE      1     0.00
TEMPFILE         16k   COARSE     13   440.59

FRA    AUTOBACKUP       16k   COARSE      2     0.02
CONTROLFILE      16k   FINE        1     0.01
ONLINELOG        1k    FINE        3     6.00

start CD 12.2.0.48 with R12.2 Stage

, , No comments :
Oracle recommends to use the latest version of start CD for fresh EBS Installation.
Steps:
1) Verify the version of existing start CD
2) Rename/delete the existing start CD directory
3) Download and copy the patch into the existing stage area
4) unzip the patch and verify the version of start CD
1) Verify the version of existing start CD:
Each start CD Disk contains executable "RapidWizVersion", it will display the version of existing startCD.
[root@appnode2 rapidwiz]# pwd
/u11/R12.2_Stage/startCD/Disk1/rapidwiz
[root@appnode2 rapidwiz]# ls
bin            driver  File    jlib  oui       RapidWiz.cmd  RapidWizVersion      TechInstallers  unzip
ClientWiz.cmd  etc     images  jre   rapidwiz  RapidWiz.ini  RapidWizVersion.cmd  template        Xpatches
[root@appnode2 rapidwiz]# ./RapidWizVersion
Oracle E-Business Suite Rapid Install Wizard
Version 12.2.0.46
(c) Copyright 2000-2011 Oracle Corporation.  All rights reserved.
[root@appnode2 rapidwiz]#
2) Rename/delete the existing start CD directory
Rename or delete the existing start CD directory from the staging area. In my setup i just renamed it to startCD_46.
 3) Download and copy the patch into the existing stage area
login to support.oracle.com with a valid CSI account and download patch "18086193"
[root@appnode2 startCD_122_48]# cp p18086193_R12_GENERIC.zip  /u11/R12.2_Stage
4) unzip the patch and verify the version of start CD
- unzip the patch in the existing stage directory and patch will create new directory for startCD
[root@appnode2 R12.2_Stage]# ls
EBSInstallMedia  p18086193_R12_GENERIC.zip  startCD_46  TechInstallMedia  TechPatches
[root@appnode2 R12.2_Stage]# unzip -o p18086193_R12_GENERIC.zip
- Verify the version of startCD
Execute "RapidWizVersion" command from the new stratCD directory
[root@appnode2 startCD]# cd Disk1/
[root@appnode2 Disk1]# ls
doc  html  images  rapidwiz
[root@appnode2 Disk1]# cd rapidwiz/
[root@appnode2 rapidwiz]# ls
bin            driver  File    jlib  oui       RapidWiz.cmd  RapidWizVersion      TechInstallers  unzip
ClientWiz.cmd  etc     images  jre   rapidwiz  RapidWiz.ini  RapidWizVersion.cmd  template        Xpatches
[root@appnode2 rapidwiz]# ./RapidWizVersion
Oracle E-Business Suite Rapid Install Wizard
Version 12.2.0.48
(c) Copyright 2000-2011 Oracle Corporation.  All rights reserved.
[root@appnode2 rapidwiz]#
[root@appnode2 rapidwiz]# pwd
/u11/R12.2_Stage/startCD/Disk1/rapidwiz
[root@appnode2 rapidwiz]#
- copy patches from start CD (12.2.0.48) to staging area.
[root@erpnode3 bin]# ls
adaixchk.sh    addbptchk.sh  AFSCJAVS.pls    checkOS.sh     launch.exe   perl.exe           riwTDBup.cmd  runWizard.sh  WTPrereqs.cmd
adchkutl.cmd   adgetreg.exe  buildStage.cmd  filespace.exe  NMAKE.EXE    racvalidations.sh  riwTDBup.sh   stageData     WTPrereqs.sh
adchkutl.sh    adgetreg.pl   buildStage.sh   JNLSLib3.dll   orpass.sql   riwipu.sh          riwTDBup.sql  syspass.sql
addbptchk.cmd  AFSCJAV8.pls  checkOS.cmd     JNLSTool.dll   perl510.dll  riwperl.pl         riwTXdis.sh   WizOSD.dll
[root@erpnode3 bin]# pwd
/u01/R12_Stage/startCD/Disk1/rapidwiz/bin
[root@erpnode3 bin]# sh buildStage.sh
                     Copyright (c) 2002, 2013 Oracle Corporation
                        Redwood Shores, California, USA
                       Oracle E-Business Suite Rapid Install
                                Version 12.2.0
Press Enter to continue...
                      Build Stage Menu
   ------------------------------------------------------
   1.     Create new stage area
   2.     Copy patches to existing stage area
   3.     List files in TechPatches directory
   4.     Exit menu
   Enter your choice [4]: 2
- This option will copy all patches included in Start CD (12.2.0.48) into an existing Stage Area,
            Rapid Install Platform Menu
   ------------------------------------------------------
   1.    Oracle Solaris SPARC (64-bit)
   2.    Linux x86 (64-bit)
   3.    IBM AIX on Power Systems (64-bit)
   4.    HP-UX Itanium
   5.    Exit Menu
  Enter your choice [5]: 2
Directory /u01/R12_Stage/TechPatches
Stage Builder will now stage the one-off patches for Linux_x64...
Press Enter to continue...

adop an error occurred while generating Oracle Forms library files

, , No comments :
The following Oracle Forms objects did not generate successfully:
au      resource        MSCFNEXC.pll
au      resource        MSCFNSCW.pll
au      resource        MSCFTPEG.pll
An error occurred while generating Oracle Forms library files
Solution:
adop phase=apply patches=21937266 workers=8 flags=autoskip restart=yes
select BUG_NUMBER,CREATION_DATE,ARU_RELEASE_NAME,LANGUAGE from ad_bugs
where BUG_NUMBER in ('21955527','20971105','21680334','21972426','22025455');


adop prepare phase failed on master node

, , , , No comments :
-----------------------------
ERROR: The following required ports are in use:
-----------------------------
6802 : Managed Server Port 3
Corrective Action: Free the listed ports and retry the adop operation.
Completed execution : ADOPValidations.java
Solution: 
1. Shutdown all application services on all nodes.
2. Just start admin server (adadminsrvctl.sh start) on master node.
3. run again adop phase=prepare on master node.

Post cutover patching failed

, , , No comments :
[UNEXPECTED]Detected a failed session, which may be on master/shared master node.  
[UNEXPECTED]This session will also fail.  
[UNEXPECTED]Middle Tier services did not start on all nodes. Please see log files for more information.  
[UNEXPECTED]Cutover phase completed with errors/warnings.
Solution:  Manually bounce the failed node and re-initiate ADOP cutover.

Upgrade Oracle EBS R12.2.0 to R12.2.4

, , , , , No comments :
This post will be helpful for those who are performing a fresh Installation and planning to upgrade it  to R12.2.4.
The latest available version of start CD is R12.2.0.48 and it can be downloaded via patch "Patch 18086193 "
If you Install Oracle EBS using start CD R12.2.0.48 then you need to Install minimum number of patches in order to upgrade to R12.2.4
The below upgrade has been performed on a virtual machine configured with 12GB RAM and 6 core processors.
Environment: Oracle Enterprise Linux 5.7 (64-Bit)
EBS Version :  Oracle EBS R12.2.0 (using start CD 12.2.0.48)
The following are the list of patches need to be Installed on Oracle EBS Tech Stack components before proceeding with the upgrade:
If used other version of start CD during Installation then there will be some other patches you need to Install before proceeding with the upgrade.
The above list of patches are applicable and only available pre-requisites currently. This list might get also change in future.
So please refer MOS tech note "Oracle E-Business Suite Release 12.2: Consolidated List of Patches and Technology Bug Fixes (Doc ID 1594274.1)"  to check for latest updates,
These patch number are specific to Linux-64 bit. Different OS will have different patch numbers. So please refer above listed tech note.
References:
- Oracle E-Business Suite Release 12.2.4 Readme (Doc ID 1617458.1)
- Oracle E-Business Suite Release 12.2: Consolidated List of Patches and Technology Bug Fixes (Doc ID 1594274.1)
- Oracle E-Business Suite 12.2 Patching Technology Components Guide (Doc ID 1355068.1)
- Applying the Latest AD and TXK Release Update Packs to Oracle E-Business Suite Release 12.2 (Doc ID 1617461.1)
- R12.2: How To Create the Stage In Preparation For Installation (Doc ID 1596433.1)
R12.2.4 Upgrade Steps:
Prepare for upgrade
Upgrade
Post upgrade
Prepare for Upgrade:
1 - Install Oracle RDBMS patches:
Perform backup of database and RDBMS Oracle_Home before applying these patches.
[oraebs@appnode3 16989137]$ opatch apply
Oracle Interim Patch Installer version 11.2.0.3.0
Copyright (c) 2012, Oracle Corporation.  All rights reserved.
Oracle Home       : /u01/ora_test/11.2.0
Central Inventory : /u01/ora_prod/oraInventory
   from           : /u01/ora_test/11.2.0/oraInst.loc
OPatch version    : 11.2.0.3.0
OUI version       : 11.2.0.3.0
Log file location : /u01/ora_test/11.2.0/cfgtoollogs/opatch/16989137_Oct_28_2014_14_29_47/apply2014-10-28_14-29-47PM_1.log
Applying interim patch '16989137' to OH '/u01/ora_test/11.2.0'
Verifying environment and performing prerequisite checks...
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]:  Y
Backing up files...
Patching component oracle.ctx, 11.2.0.3.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.3.0...
Verifying the update...
Patch 16989137 successfully applied
Log file location: /u01/ora_test/11.2.0/cfgtoollogs/opatch/16989137_Oct_28_2014_14_29_47/apply2014-10-28_14-29-47PM_1.log
OPatch succeeded.
[oraebs@appnode3 16989137]$
[oraebs@appnode3 17875948]$ opatch apply
Oracle Interim Patch Installer version 11.2.0.3.0
Copyright (c) 2012, Oracle Corporation.  All rights reserved.
Oracle Home       : /u01/ora_test/11.2.0
Central Inventory : /u01/ora_prod/oraInventory
   from           : /u01/ora_test/11.2.0/oraInst.loc
OPatch version    : 11.2.0.3.0
OUI version       : 11.2.0.3.0
Log file location : /u01/ora_test/11.2.0/cfgtoollogs/opatch/17875948_Oct_28_2014_14_33_15/apply2014-10-28_14-33-15PM_1.log
Applying interim patch '17875948' to OH '/u01/ora_test/11.2.0'
Verifying environment and performing prerequisite checks...
Interim patch 17875948 is a superset of the patch(es) [  16587934 ] in the Oracle Home
OPatch will roll back the subset patches and apply the given patch.
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]:  Y
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/u01/ora_test/11.2.0')
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...
Rolling back interim patch '16587934' from OH '/u01/ora_test/11.2.0'
Patching component oracle.rdbms, 11.2.0.3.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.3.0...
RollbackSession removing interim patch '16587934' from inventory
OPatch back to application of the patch '17875948' after auto-rollback.
Patching component oracle.rdbms, 11.2.0.3.0...
Patching component oracle.rdbms.dbscripts, 11.2.0.3.0...
Verifying the update...
Patch 17875948 successfully applied
Log file location: /u01/ora_test/11.2.0/cfgtoollogs/opatch/17875948_Oct_28_2014_14_33_15/apply2014-10-28_14-33-15PM_1.log
OPatch succeeded.
[oraebs@appnode3 17875948]$
[oraebs@appnode3 17912217]$ opatch apply
Oracle Interim Patch Installer version 11.2.0.3.0
Copyright (c) 2012, Oracle Corporation.  All rights reserved.
Oracle Home       : /u01/ora_test/11.2.0
Central Inventory : /u01/ora_prod/oraInventory
   from           : /u01/ora_test/11.2.0/oraInst.loc
OPatch version    : 11.2.0.3.0
OUI version       : 11.2.0.3.0
Log file location : /u01/ora_test/11.2.0/cfgtoollogs/opatch/17912217_Oct_28_2014_14_38_04/apply2014-10-28_14-38-04PM_1.log
Applying interim patch '17912217' to OH '/u01/ora_test/11.2.0'
Verifying environment and performing prerequisite checks...
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]:  Y
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/u01/ora_test/11.2.0')
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...
Patching component oracle.rdbms, 11.2.0.3.0...
Verifying the update...
Patch 17912217 successfully applied
Log file location: /u01/ora_test/11.2.0/cfgtoollogs/opatch/17912217_Oct_28_2014_14_38_04/apply2014-10-28_14-38-04PM_1.log
OPatch succeeded.
[oraebs@appnode3 17912217]$
[oraebs@appnode3 18419770]$ opatch apply
Oracle Interim Patch Installer version 11.2.0.3.0
Copyright (c) 2012, Oracle Corporation.  All rights reserved.
Oracle Home       : /u01/ora_test/11.2.0
Central Inventory : /u01/ora_prod/oraInventory
   from           : /u01/ora_test/11.2.0/oraInst.loc
OPatch version    : 11.2.0.3.0
OUI version       : 11.2.0.3.0
Log file location : /u01/ora_test/11.2.0/cfgtoollogs/opatch/18419770_Oct_28_2014_14_40_02/apply2014-10-28_14-40-02PM_1.log
Applying interim patch '18419770' to OH '/u01/ora_test/11.2.0'
Verifying environment and performing prerequisite checks...
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]:  Y
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/u01/ora_test/11.2.0')
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...
Patching component oracle.rdbms, 11.2.0.3.0...
Verifying the update...
Patch 18419770 successfully applied
Log file location: /u01/ora_test/11.2.0/cfgtoollogs/opatch/18419770_Oct_28_2014_14_40_02/apply2014-10-28_14-40-02PM_1.log
OPatch succeeded.
[oraebs@appnode3 18419770]$
[oraebs@appnode3 18614015]$ pwd
/u01/patch_stage/database/DB/18614015
[oraebs@appnode3 18614015]$ opatch apply
Oracle Interim Patch Installer version 11.2.0.3.0
Copyright (c) 2012, Oracle Corporation.  All rights reserved.
Oracle Home       : /u01/ora_test/11.2.0
Central Inventory : /u01/ora_prod/oraInventory
   from           : /u01/ora_test/11.2.0/oraInst.loc
OPatch version    : 11.2.0.3.0
OUI version       : 11.2.0.3.0
Log file location : /u01/ora_test/11.2.0/cfgtoollogs/opatch/18614015_Oct_28_2014_14_42_00/apply2014-10-28_14-41-59PM_1.log
Applying interim patch '18614015' to OH '/u01/ora_test/11.2.0'
Verifying environment and performing prerequisite checks...
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]:  Y
Backing up files...
Patching component oracle.rdbms.dbscripts, 11.2.0.3.0...
Verifying the update...
Patch 18614015 successfully applied
Log file location: /u01/ora_test/11.2.0/cfgtoollogs/opatch/18614015_Oct_28_2014_14_42_00/apply2014-10-28_14-41-59PM_1.log
OPatch succeeded.
[oraebs@appnode3 18614015]$
[oraebs@appnode3 18685209]$ opatch apply
Oracle Interim Patch Installer version 11.2.0.3.0
Copyright (c) 2012, Oracle Corporation.  All rights reserved.
Oracle Home       : /u01/ora_test/11.2.0
Central Inventory : /u01/ora_prod/oraInventory
   from           : /u01/ora_test/11.2.0/oraInst.loc
OPatch version    : 11.2.0.3.0
OUI version       : 11.2.0.3.0
Log file location : /u01/ora_test/11.2.0/cfgtoollogs/opatch/18685209_Oct_28_2014_14_44_11/apply2014-10-28_14-44-10PM_1.log
Applying interim patch '18685209' to OH '/u01/ora_test/11.2.0'
Verifying environment and performing prerequisite checks...
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]:  Y
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/u01/ora_test/11.2.0')
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...
Patching component oracle.rdbms, 11.2.0.3.0...
Verifying the update...
Patch 18685209 successfully applied
Log file location: /u01/ora_test/11.2.0/cfgtoollogs/opatch/18685209_Oct_28_2014_14_44_11/apply2014-10-28_14-44-10PM_1.log
OPatch succeeded.
[oraebs@appnode3 18685209]$
As per footnote-11 patch "18259911" was Installed. So we need to rollback this patch first Installing patch "19078951".
[oraebs@appnode3 DB]$ opatch lsinventory | grep 18259911
Patch  18259911     : applied on Mon Oct 27 21:54:20 AST 2014
[oraebs@appnode3 DB]$ opatch lsinventory | grep 17461865
[oraebs@appnode3 DB]$
[oraebs@appnode3 DB]$ opatch rollback -id 18259911
Oracle Interim Patch Installer version 11.2.0.3.0
Copyright (c) 2012, Oracle Corporation.  All rights reserved.
Oracle Home       : /u01/ora_test/11.2.0
Central Inventory : /u01/ora_prod/oraInventory
   from           : /u01/ora_test/11.2.0/oraInst.loc
OPatch version    : 11.2.0.3.0
OUI version       : 11.2.0.3.0
Log file location : /u01/ora_test/11.2.0/cfgtoollogs/opatch/18259911_Oct_28_2014_14_53_03/rollback2014-10-28_14-53-03PM_1.log
RollbackSession rolling back interim patch '18259911' from OH '/u01/ora_test/11.2.0'
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/u01/ora_test/11.2.0')
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Patching component oracle.rdbms.rsf, 11.2.0.3.0...
Patching component oracle.rdbms, 11.2.0.3.0...
RollbackSession removing interim patch '18259911' from inventory
Log file location: /u01/ora_test/11.2.0/cfgtoollogs/opatch/18259911_Oct_28_2014_14_53_03/rollback2014-10-28_14-53-03PM_1.log
OPatch succeeded.
[oraebs@appnode3 DB]$
[oraebs@appnode3 19078951]$ opatch apply
Oracle Interim Patch Installer version 11.2.0.3.0
Copyright (c) 2012, Oracle Corporation.  All rights reserved.
Oracle Home       : /u01/ora_test/11.2.0
Central Inventory : /u01/ora_prod/oraInventory
   from           : /u01/ora_test/11.2.0/oraInst.loc
OPatch version    : 11.2.0.3.0
OUI version       : 11.2.0.3.0
Log file location : /u01/ora_test/11.2.0/cfgtoollogs/opatch/19078951_Oct_28_2014_15_00_03/apply2014-10-28_15-00-03PM_1.log
Applying interim patch '19078951' to OH '/u01/ora_test/11.2.0'
Verifying environment and performing prerequisite checks...
Interim patch 19078951 is a superset of the patch(es) [  14751895 12849688 ] in the Oracle Home
OPatch will roll back the subset patches and apply the given patch.
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]:  Y
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/u01/ora_test/11.2.0')
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...
Rolling back interim patch '14751895' from OH '/u01/ora_test/11.2.0'
Patching component oracle.rdbms, 11.2.0.3.0...
Patching component oracle.rdbms.rsf, 11.2.0.3.0...
RollbackSession removing interim patch '14751895' from inventory
Rolling back interim patch '12849688' from OH '/u01/ora_test/11.2.0'
Patching component oracle.rdbms, 11.2.0.3.0...
RollbackSession removing interim patch '12849688' from inventory
OPatch back to application of the patch '19078951' after auto-rollback.
Patching component oracle.rdbms.rsf, 11.2.0.3.0...
Patching component oracle.rdbms, 11.2.0.3.0...
Verifying the update...
Patch 19078951 successfully applied
Log file location: /u01/ora_test/11.2.0/cfgtoollogs/opatch/19078951_Oct_28_2014_15_00_03/apply2014-10-28_15-00-03PM_1.log
OPatch succeeded.
[oraebs@appnode3 19078951]$
= > Perform post Installation of all patches after applying all RDBMS Patches:
SQL> @?/sqlpatch/16989137/postinstall.sql
Session altered.
Grant succeeded.
Session altered.
Calling ctx/admin/driacc.plb on 28-OCT-14 03.06.10.208289 PM +03:00
Package body created.
SQL>
--------------------------------
@?/sqlpatch/17875948/postinstall.sql
Package body created.
No errors.
Calling rdbms/admin/prvtmet2.plb on 28-OCT-14 03.14.49.012276 PM +03:00
Package body created.
Calling rdbms/admin/catmet2.sql on 28-OCT-14 03.14.49.548401 PM +03:00
PL/SQL procedure successfully completed.
PL/SQL procedure successfully completed.
PL/SQL procedure successfully completed.
PL/SQL procedure successfully completed.
PL/SQL procedure successfully completed.
PL/SQL procedure successfully completed.
------------------------------------------
SQL>  @?/sqlpatch/18614015/postinstall.sql
Calling rdbms/admin/prvtutil.plb on 28-OCT-14 03.24.58.515625 PM +03:00
Package body created.
SQL>
2 - Install Oracle Fusion Middleware 11.1.1.6 patches
- Set oracle home for FMW (11.1.1.6)
[applint2@appnode3 ~]$ export ORACLE_HOME=/u01/appl_test/fs1/FMW_Home/webtier
[applint2@appnode3 ~]$ export PATH=/u01/appl_test/fs1/FMW_Home/webtier/OPatch:$PATH
- Verify the opatch is set from the proper Oracle Home
[applint2@appnode3 ~]$ opatch lsinventory
Oracle Interim Patch Installer version 11.1.0.9.9
Copyright (c) 2012, Oracle Corporation.  All rights reserved.
Oracle Home       : /u01/appl_test/fs1/FMW_Home/webtier
Central Inventory : /u01/ora_prod/oraInventory
   from           : /u01/appl_test/fs1/FMW_Home/webtier/oraInst.loc
OPatch version    : 11.1.0.9.9
OUI version       : 11.1.0.9.0
Log file location : /u01/appl_test/fs1/FMW_Home/webtier/cfgtoollogs/opatch/opatch2014-10-28_16-05-24PM_1.log
OPatch detects the Middleware Home as "/u01/appl_test/fs1/FMW_Home"
Lsinventory Output file location : /u01/appl_test/fs1/FMW_Home/webtier/cfgtoollogs/opatch/lsinv/lsinventory2014-10-28_16-05-24PM.txt
--------------------------------------------------------------------------------
Installed Top-level Products (1):
Oracle WebTier and Utilities CD                                      11.1.1.6.0
There are 1 products installed in this Oracle Home.
Interim patches (7) :
Patch  16199894     : applied on Tue Oct 28 02:29:40 AST 2014
Unique Patch ID:  16066707
   Created on 6 Mar 2013, 12:42:03 hrs US/Pacific
   Bugs fixed:
     16199894
Patch  14616819     : applied on Tue Oct 28 02:29:23 AST 2014
Unique Patch ID:  15565088
   Created on 11 Oct 2012, 12:30:28 hrs US/Pacific
   Bugs fixed:
     14616819
Patch  10638758     : applied on Tue Oct 28 02:29:05 AST 2014
Unique Patch ID:  14860855
   Created on 15 May 2012, 05:32:01 hrs PST8PDT
   Bugs fixed:
     10638758
Patch  17325559     : applied on Tue Oct 28 02:28:46 AST 2014
Unique Patch ID:  16698102
   Created on 19 Aug 2013, 16:11:34 hrs US/Pacific
   Bugs fixed:
     16856341, 13837241, 13025456, 14110089, 16021044, 14386112, 14345153
     14003476, 12959202
Patch  13643211     : applied on Tue Oct 28 02:28:27 AST 2014
Unique Patch ID:  14814441
   Created on 2 May 2012, 11:34:23 hrs
   Bugs fixed:
     13588565, 13104787, 13637410
Patch  12949905     : applied on Tue Oct 28 02:28:07 AST 2014
Unique Patch ID:  14148563
   Created on 29 Sep 2011, 11:48:28 hrs PST8PDT
   Bugs fixed:
     12949905
Patch  7695070      : applied on Tue Oct 28 02:27:50 AST 2014
Unique Patch ID:  11421601
   Created on 16 Jun 2009, 21:13:15 hrs PST8PDT
   Bugs fixed:
     7695070
--------------------------------------------------------------------------------
OPatch succeeded.
[applint2@appnode3 ~]$
- Apply patches on 11.1.1.6 FMW Home
[applint2@appnode3 ~]$ cd /u01/patch_stage/Apps/Pre_REQS_Apps/17639414
[applint2@appnode3 17639414]$ ls
etc  files  README.txt
[applint2@appnode3 17639414]$ opatch apply -jre $ORACLE_HOME/jdk/jre
Oracle Interim Patch Installer version 11.1.0.9.9
Copyright (c) 2012, Oracle Corporation.  All rights reserved.
Oracle Home       : /u01/appl_test/fs1/FMW_Home/webtier
Central Inventory : /u01/ora_prod/oraInventory
   from           : /u01/appl_test/fs1/FMW_Home/webtier/oraInst.loc
OPatch version    : 11.1.0.9.9
OUI version       : 11.1.0.9.0
Log file location : /u01/appl_test/fs1/FMW_Home/webtier/cfgtoollogs/opatch/17639414_Oct_28_2014_16_06_40/apply2014-10-28_16-06-39PM_1.log
OPatch detects the Middleware Home as "/u01/appl_test/fs1/FMW_Home"
Applying interim patch '17639414' to OH '/u01/appl_test/fs1/FMW_Home/webtier'
Verifying environment and performing prerequisite checks...
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]:  Y
Backing up files...
Patching component oracle.as.clone.ohs, 11.1.1.6.0...
Verifying the update...
Patch 17639414 successfully applied
Log file location: /u01/appl_test/fs1/FMW_Home/webtier/cfgtoollogs/opatch/17639414_Oct_28_2014_16_06_40/apply2014-10-28_16-06-39PM_1.log
OPatch succeeded.
[applint2@appnode3 17639414]$
[applint2@appnode3 18989444]$ opatch apply
Oracle Interim Patch Installer version 11.1.0.9.9
Copyright (c) 2012, Oracle Corporation.  All rights reserved.
Oracle Home       : /u01/appl_test/fs1/FMW_Home/oracle_common
Central Inventory : /u01/ora_prod/oraInventory
   from           : /u01/appl_test/fs1/FMW_Home/oracle_common/oraInst.loc
OPatch version    : 11.1.0.9.9
OUI version       : 11.1.0.9.0
Log file location : /u01/appl_test/fs1/FMW_Home/oracle_common/cfgtoollogs/opatch/18989444_Oct_28_2014_16_12_31/apply2014-10-28_16-12-31PM_1.log
OPatch detects the Middleware Home as "/u01/appl_test/fs1/FMW_Home"
Applying interim patch '18989444' to OH '/u01/appl_test/fs1/FMW_Home/oracle_common'
Verifying environment and performing prerequisite checks...
Interim patch 18989444 is a superset of the patch(es) [  13947608 ] in the Oracle Home
OPatch will roll back the subset patches and apply the given patch.
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]:  Y
Please shutdown Oracle instances running out of this ORACLE_HOME on the local system.
(Oracle Home = '/u01/appl_test/fs1/FMW_Home/oracle_common')
Is the local system ready for patching? [y|n]
y
User Responded with: Y
Backing up files...
Rolling back interim patch '13947608' from OH '/u01/appl_test/fs1/FMW_Home/oracle_common'
Patching component oracle.jrf.opss, 11.1.1.6.0...
RollbackSession removing interim patch '13947608' from inventory
OPatch back to application of the patch '18989444' after auto-rollback.
Patching component oracle.jrf.opss, 11.1.1.6.0...
Verifying the update...
Patch 18989444 successfully applied
Log file location: /u01/appl_test/fs1/FMW_Home/oracle_common/cfgtoollogs/opatch/18989444_Oct_28_2014_16_12_31/apply2014-10-28_16-12-31PM_1.log
OPatch succeeded.
[applint2@appnode3 18989444]$
[applint2@appnode3 19462638]$ opatch apply
Oracle Interim Patch Installer version 11.1.0.9.9
Copyright (c) 2012, Oracle Corporation.  All rights reserved.
Oracle Home       : /u01/appl_test/fs1/FMW_Home/oracle_common
Central Inventory : /u01/ora_prod/oraInventory
   from           : /u01/appl_test/fs1/FMW_Home/oracle_common/oraInst.loc
OPatch version    : 11.1.0.9.9
OUI version       : 11.1.0.9.0
Log file location : /u01/appl_test/fs1/FMW_Home/oracle_common/cfgtoollogs/opatch/19462638_Oct_28_2014_16_16_48/apply2014-10-28_16-16-47PM_1.log
OPatch detects the Middleware Home as "/u01/appl_test/fs1/FMW_Home"
Applying interim patch '19462638' to OH '/u01/appl_test/fs1/FMW_Home/oracle_common'
Verifying environment and performing prerequisite checks...
Interim patch 19462638 is a superset of the patch(es) [  14588599 ] in the Oracle Home
OPatch will roll back the subset patches and apply the given patch.
All checks passed.
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]:  Y
Backing up files...
Rolling back interim patch '14588599' from OH '/u01/appl_test/fs1/FMW_Home/oracle_common'
Patching component oracle.as.common.clone, 11.1.1.6.0...
Updating jar file "/u01/appl_test/fs1/FMW_Home/oracle_common/jlib/cloningclient.jar" with "/u01/appl_test/fs1/FMW_Home/oracle_common/.patch_storage/14588599_Sep_27_2012_15_42_28/files//jlib/cloningclient.jar/oracle/as/clone/cloner/component/j2ee/constants/J2EEIntrospectorConstants.class"
Updating jar file "/u01/appl_test/fs1/FMW_Home/oracle_common/jlib/cloningclient.jar" with "/u01/appl_test/fs1/FMW_Home/oracle_common/.patch_storage/14588599_Sep_27_2012_15_42_28/files//jlib/cloningclient.jar/oracle/as/clone/cloner/component/j2ee/introspector/SecurityPolicyIntrospector.class"
RollbackSession removing interim patch '14588599' from inventory
OPatch back to application of the patch '19462638' after auto-rollback.
Patching component oracle.as.common.clone, 11.1.1.6.0...
Verifying the update...
Patch 19462638 successfully applied
Log file location: /u01/appl_test/fs1/FMW_Home/oracle_common/cfgtoollogs/opatch/19462638_Oct_28_2014_16_16_48/apply2014-10-28_16-16-47PM_1.log
OPatch succeeded.
[applint2@appnode3 19462638]$
3 - Install Oracle 10.1.2.3 Forms & Reports Patches
- Set the Environment variable for 10.1.2 ORACLE HOME
[applint2@appnode3 18186693]$ pwd
/u01/patch_stage/Apps/Pre_REQS_Apps/18186693
[applint2@appnode3 18186693]$ opatch apply
Oracle Interim Patch Installer version 1.0.0.0.64
Copyright (c) 2011 Oracle Corporation. All Rights Reserved..
Oracle recommends you to use the latest OPatch version
and read the OPatch documentation available in the OPatch/docs
directory for usage. For information about the latest OPatch and
other support-related issues, refer to document ID 293369.1
available on My Oracle Support (https://myoraclesupport.oracle.com)
Oracle Home           : /u01/appl_test/fs1/EBSapps/10.1.2
Oracle Home Inventory : /u01/appl_test/fs1/EBSapps/10.1.2/inventory
Central Inventory     : /u01/ora_prod/oraInventory
   from               : /etc/oraInst.loc
OUI location          : /u01/appl_test/fs1/EBSapps/10.1.2/oui
OUI shared library    : /u01/appl_test/fs1/EBSapps/10.1.2/oui/lib/linux/liboraInstaller.so
Java location         : /u01/appl_test/fs1/EBSapps/10.1.2/jdk/jre/bin/java
Log file location     : /u01/appl_test/fs1/EBSapps/10.1.2/.patch_storage//*.log
Creating log file "/u01/appl_test/fs1/EBSapps/10.1.2/.patch_storage/18186693/Apply_18186693_10-28-2014_15-40-55.log"
Invoking fuser to check for active processes.
Patch "18186693" overlays " 14825718 ". Conflict check between them is skipped.
Subset patches:  17303472,
The fixes for Patch 17303472,  are included in the patch currently
being installed (18186693).  OPatch will roll back the subset patch(es) and
install the new patch (18186693).
Provide your email address to be informed of security issues, install and
initiate Oracle Configuration Manager. Easier for you if you use your My
Oracle Support Email address/User Name.
Visit http://www.oracle.com/support/policies.html for details.
Email address/User Name:
You have not provided an email address for notification of security issues.
Do you wish to remain uninformed of security issues ([Y]es, [N]o) [N]:  Y
Oracle Configuration Manager has been installed but not configured. OCM enables
Oracle to provide superior, proactive support for our customers. Oracle
strongly recommends customers configure OCM. To complete the configuration of
OCM, refer to the OCM Installation and Administration Guide
(http://www.oracle.com/technology/documentation/ocm.html).
Backing up comps.xml ...
OPatch detected non-cluster Oracle Home from the inventory and will patch the local system only.
Please shut down Oracle instances running out of this ORACLE_HOME
(Oracle Home = /u01/appl_test/fs1/EBSapps/10.1.2)
Is this system ready for updating?
Please respond Y|N >
Y
Rolling back patch 17303472...
Creating log file "/u01/appl_test/fs1/EBSapps/10.1.2/.patch_storage/17303472/RollBack_17303472_10-28-2014_15-41-47.log"
Rolling back with all-node mode.
OPatch detected non-cluster Oracle Home from the inventory and will patch the local system only.
Oracle instances have been shut down, proceeding with auto-rollback.
Removing patch 17303472...
Restoring archive files...
OPatch found "/u01/appl_test/fs1/EBSapps/10.1.2/.patch_storage/17303472/lib/ixdn.o_libix.a_opatch_new_17303472".  So, deleting the file from the archive.
OPatch found "/u01/appl_test/fs1/EBSapps/10.1.2/.patch_storage/17303472/lib/ixvw.o_libix.a_opatch_new_17303472".  So, deleting the file from the archive.
OPatch found "/u01/appl_test/fs1/EBSapps/10.1.2/.patch_storage/17303472/lib/ixwn.o_libix.a_opatch_new_17303472".  So, deleting the file from the archive.
Restoring copied files...
Running make for target  sharedlib.
Running make for target  install.
Running make for target sharedlibs.
Running make for target install.
Inventory is good and does not have any dangling patches.
Updating inventory...
Verifying patch...
Backing up comps.xml ...
OPatch succeeded.
[applint2@appnode3 18186693]$
4 - Install Oracle Weblogic server (10.3.6) Patches
- Copy and unzip Patches in weblogic server "cache_dir"
[applint2@appnode3 cache_dir]$ cp /u01/patch_stage/Apps/Pre_REQS_Apps/p17893334_1036_Generic.zip .
[applint2@appnode3 cache_dir]$ ls
32I2.jar  LL4G.jar                    patch-catalog_17260.xml  patch-catalog_18408.xml  patch-catalog_19461.xml  S9MN.jar  YHJK.jar
CIH8.jar  p17893334_1036_Generic.zip  patch-catalog_18030.xml  patch-catalog_19037.xml  patch-catalog_20352.xml  TTEM.jar  YIJF.jar
D33T.jar  patch-catalog_16936.xml     patch-catalog_18239.xml  patch-catalog_19345.xml  patch-catalog.xml        VFS8.jar
[applint2@appnode3 cache_dir]$
[applint2@appnode3 cache_dir]$ unzip p17893334_1036_Generic.zip
Archive:  p17893334_1036_Generic.zip
  inflating: 7FC9.jar              
  inflating: README.txt            
  inflating: patch-catalog_21169.xml
[applint2@appnode3 cache_dir]$
Install "7FC9.jar" jar file on weblogic server using bsu
- Set proper GUI enable display variable
- Execute script "bsu.sh" from FMW_HOME/utils/bsu
- This is the list of patch which is not applied on Server. Install this patch on weblogic Server
- The Patch has been successfully Installed
5 - Install EBS Application patches:
All application patches should be Installed using "adop" online patching utility.
- Install patch "17204589"
[applint2@appnode3 Pre_REQS_Apps]$ cp -rf 17204589 /u01/appl_test/fs_ne/EBSapps/patch
[applint2@appnode3 Pre_REQS_Apps]$ adop phase=apply patches=17204589 hotpatch=yes
Enter the APPS password:
Enter the SYSTEM password:
Enter the WLSADMIN password:
 Please wait. Validating credentials...
Enter the RUN file system context file name [/u01/appl_test/fs1/inst/apps/test_appnode3/appl/admin/test_appnode3.xml]:
- Install patch "18283295"
- Run "adgrants.sql" script on APPS schema from patch directory before Installing the patch.
[oraebs@appnode3 db_scripts]$ cp /u01/EBS_patches/Apps_pre_1224/18283295/admin/adgrants.sql .
[oraebs@appnode3 db_scripts]$ sqlplus /nolog
SQL*Plus: Release 11.2.0.3.0 Production on Tue Nov 4 21:13:14 2014
Copyright (c) 1982, 2011, Oracle.  All rights reserved.
SQL> @adgrants.sql APPS
Connected.
---------------------------------------------------
--- adgrants.sql started at 2014-11-04 21:13:26 ---
Creating PL/SQL profiler objects.
---------------------------------------------------
-- profload.sql started at 2014-11-04 21:13:26 ---
Package created.
Grant succeeded.
Synonym created.
Library created.
Package body created.
Testing for correct installation
SYS.DBMS_PROFILER successfully loaded.
PL/SQL procedure successfully completed.
-----------------------------------------------------
--- profload.sql completed at 2014-11-04 21:13:31 ---
--------------------------------------------------
--- proftab.sql started at 2014-11-04 21:13:31 ---
Table dropped.
Table dropped.
Table dropped.
Sequence dropped.
Table created.
Comment created.
Table created.
Comment created.
Table created.
Comment created.
Sequence created.
-----------------------------------------------------
--- profltab.sql completed at 2014-11-04 21:13:35 ---
Installing Hierarchical Profiler.
Table dropped.
Table dropped.
Table dropped.
Sequence dropped.
Table created.
Comment created.
Table created.
Comment created.
Table created.
Comment created.
Sequence created.
Package created.
Synonym created.
Grant succeeded.
Grant succeeded.
Grant succeeded.
Grant succeeded.
Loading Stylesheets if missing
PL/SQL procedure successfully completed.
Start of Creating AD_JAR context
PL/SQL procedure successfully completed.
End of Creating AD_JAR context
Creating PL/SQL Package AD_DBMS_METADATA.
Package created.
Package body created.
End of Creating PL/SQL Package AD_DBMS_METADATA.
Creating PL/SQL Package AD_ZD_SYS.
Package created.
Package body created.
End of Creating PL/SQL Package AD_ZD_SYS.
Start of giving grants. This may take few minutes.
PL/SQL procedure successfully completed.
Start of PURGE DBA_RECYCLEBIN.
PL/SQL procedure successfully completed.
End of PURGE DBA_RECYCLEBIN.
Commit complete.
Disconnected from Oracle Database 11g Enterprise Edition Release 11.2.0.3.0 - 64bit Production
With the Partitioning, OLAP, Data Mining and Real Application Testing options
[oraebs@appnode3 db_scripts]$
=> Install all remaining patches with adop patch utility.
=> Execute adop fs_clone to synchronize file systems
- Source environment variable for run file system
- Make sure admin server is up and running
[applint2@appnode3 appl_test]$ ls
EBSapps.env  fs1  fs2  fs_ne
[applint2@appnode3 appl_test]$ . EBSapps.env
  E-Business Suite Environment Information
  ----------------------------------------
  RUN File System           : /u01/appl_test/fs1/EBSapps/appl
  PATCH File System         : /u01/appl_test/fs2/EBSapps/appl
  Non-Editioned File System : /u01/appl_test/fs_ne
  DB Host: appnode3.oralabs.com  Service/SID: test
  E-Business Suite Environment Setting
  ------------------------------------
  - Enter [R/r] for sourcing Run File System Environment file, or
  - Enter [P/p] for sourcing Patch File System Environment file, or
  - Enter anything else to exit
  Please choose the environment file you wish to source [R/P]:R
  Sourcing the RUN File System ...
[applint2@appnode3 appl_test]$
[applint2@appnode3 appl_test]$ adop phase=fs_clone
Enter the APPS password:
Enter the SYSTEM password:
Enter the WLSADMIN password:
 Please wait. Validating credentials...
RUN file system context file: /u01/appl_test/fs1/inst/apps/test_appnode3/appl/admin/test_appnode3.xml
PATCH file system context file: /u01/appl_test/fs2/inst/apps/test_appnode3/appl/admin/test_appnode3.xml
Execute SYSTEM command : df /u01/appl_test/fs2
Worker count determination...
Validation successful. All expected nodes are listed in ADOP_VALID_NODES table.
------------------------------------------------------------------------
-----------------------------------------------------------------------------
Program :  completed @ Thu Nov  6 00:59:07 2014

        [EVENT]     [END   2014/11/06 00:59:07] CLONE Patch File System from Run File System
        [EVENT]     Calling task: "Releasing ports on appnode3"; script: "/u01/appl_test/fs1/inst/apps/test_appnode3/admin/install/txkCloneAcquirePort.pl"; args: " -option=close -server=appnode3.oralabs.com -ports=5565,7010,7610,7410,7210,7810,6109,6209 -log=/u01/appl_test/fs_ne/EBSapps/log/adop/7/fs_clone_20141105_201909/test_appnode3/txkCloneAcquirePort.log"
        [EVENT]     [START 2014/11/06 00:59:07] Releasing ports on appnode3
          [EVENT]     Calling: /u01/appl_test/fs1/inst/apps/test_appnode3/admin/install/txkCloneAcquirePort.pl
        [EVENT]     [END   2014/11/06 00:59:08] Releasing ports on appnode3
        [EVENT]     [START 2014/11/06 00:59:09] Check and Stop Patch FS Admin Server

You are running adadminsrvctl.sh version 120.10.12020000.9
Stopping WLS Admin Server...
Refer /u01/appl_test/fs2/inst/apps/test_appnode3/logs/appl/admin/log/adadminsrvctl.txt for details
adadminsrvctl.sh: exiting with status 0
adadminsrvctl.sh: check the logfile /u01/appl_test/fs2/inst/apps/test_appnode3/logs/appl/admin/log/adadminsrvctl.txt for more information ...
        [EVENT]     [END   2014/11/06 00:59:24] Check and Stop Patch FS Admin Server
        [EVENT]     [START 2014/11/06 00:59:25] Check and Stop Patch Node Manager
You are running adnodemgrctl.sh version 120.11.12020000.11
The Node Manager is already shutdown
adnodemgrctl.sh: exiting with status 2
adnodemgrctl.sh: check the logfile /u01/appl_test/fs2/inst/apps/test_appnode3/logs/appl/admin/log/adnodemgrctl.txt for more information ...
        [EVENT]     [END   2014/11/06 00:59:32] Check and Stop Patch Node Manager
    [EVENT]     [START 2014/11/06 00:59:32] Generating AD_ZD_LOGS Report
      [EVENT]     Report: /u01/appl_test/fs1/EBSapps/appl/ad/12.0.0/sql/ADZDSHOWLOG.sql
      [EVENT]     Output: /u01/appl_test/fs_ne/EBSapps/log/adop/7/fs_clone_20141105_201909/test_appnode3/adzdshowlog.out
    [EVENT]     [END   2014/11/06 00:59:59] Generating AD_ZD_LOGS Report
  [END   2014/11/06 00:59:59] adzdoptl.pl run
  adop phase=fs_clone - Completed Successfully
  Log file: /u01/appl_test/fs_ne/EBSapps/log/adop/7/adop_20141105_201909.log
adop exiting with status = 0 (Success)
Upgrade:
- Shutdown all application services
- Perform full application and database backup
- Install patch in a "downtime" mode
[applint2@appnode3 scripts]$ adadminsrvctl.sh stop
You are running adadminsrvctl.sh version 120.10.12020000.9
Enter the WebLogic Admin password:
Enter the APPS Schema password:
Stopping WLS Admin Server...
Refer /u01/appl_test/fs1/inst/apps/test_appnode3/logs/appl/admin/log/adadminsrvctl.txt for details
adadminsrvctl.sh: exiting with status 0
adadminsrvctl.sh: check the logfile /u01/appl_test/fs1/inst/apps/test_appnode3/logs/appl/admin/log/adadminsrvctl.txt for more information ...
[applint2@appnode3 scripts]$ adnodemgrctl.sh stop
You are running adnodemgrctl.sh version 120.11.12020000.11
Enter the WebLogic Admin password:
adnodemgrctl.sh: exiting with status 0
adnodemgrctl.sh: check the logfile /u01/appl_test/fs1/inst/apps/test_appnode3/logs/appl/admin/log/adnodemgrctl.txt for more information ...
[applint2@appnode3 scripts]$
- Check Release of existing system
- Start Installation of patch. I have used 12 workers and you can use it according to available resources.
[applint2@appnode3 patch]$ adop phase=apply apply_mode=downtime patches=17919161 workers=12
Enter the APPS password:
Enter the SYSTEM password:
Enter the WLSADMIN password:
 Please wait. Validating credentials...
RUN file system context file: /u01/appl_test/fs1/inst/apps/test_appnode3/appl/admin/test_appnode3.xml
PATCH file system context file: /u01/appl_test/fs2/inst/apps/test_appnode3/appl/admin/test_appnode3.xml
Execute SYSTEM command : df /u01/appl_test/fs2
Worker count determination...
Validation successful. All expected nodes are listed in ADOP_VALID_NODES table.
[START 2014/11/06 18:21:16] Check if services are down
  [STATEMENT]  Application services are down.
[END   2014/11/06 18:21:19] Check if services are down
[EVENT]     [START 2014/11/06 18:21:19] Performing database sanity checks
[EVENT]     [END   2014/11/06 18:21:19] Finished performing database sanity checks
  [START 2014/11/06 18:21:21] adzdoptl.pl run
    ADOP Session ID: 8
    Phase: apply
    Log file: /u01/appl_test/fs_ne/EBSapps/log/adop/8/adop_20141106_182058.log
    [START 2014/11/06 18:21:22] apply phase
        Calling: adpatch  workers=12   options=hotpatch     console=no interactive=no  defaultsfile=/u01/appl_test/fs1/EBSapps/appl/admin/test/adalldefaults.txt patchtop=/u01/appl_test/fs_ne/EBSapps/patch/17919161 driver=u17919161.drv logfile=u17919161.log
        ADPATCH Log directory: /u01/appl_test/fs_ne/EBSapps/log/adop/8/apply_20141106_182058/test_appnode3/17919161/log
        [EVENT]     [START 2014/11/07 13:09:22] Running finalize since in downtime mode
        [EVENT]     [END   2014/11/07 13:13:44] Running finalize since in downtime mode
          Calling: adpatch options=hotpatch,nocompiledb interactive=no console=no workers=12 restart=no abandon=yes defaultsfile=/u01/appl_test/fs1/EBSapps/appl/admin/test/adalldefaults.txt patchtop=/u01/appl_test/fs1/EBSapps/appl/ad/12.0.0/patch/115/driver logfile=cutover.log driver=ucutover.drv
          ADPATCH Log directory: /u01/appl_test/fs_ne/EBSapps/log/adop/8/apply_20141106_182058/test_appnode3/log
        [EVENT]     [START 2014/11/07 13:17:01] Running cutover since in downtime mode
        [EVENT]     [END   2014/11/07 13:17:01] Running cutover since in downtime mode
      [END   2014/11/07 13:17:02] apply phase
      [START 2014/11/07 13:17:02] Generating Post Apply Reports
        [EVENT]     [START 2014/11/07 13:17:03] Generating AD_ZD_LOGS Report
          [EVENT]     Report: /u01/appl_test/fs1/EBSapps/appl/ad/12.0.0/sql/ADZDSHOWLOG.sql

          [EVENT]     Output: /u01/appl_test/fs_ne/EBSapps/log/adop/8/apply_20141106_182058/test_appnode3/adzdshowlog.out

        [EVENT]     [END   2014/11/07 13:17:29] Generating AD_ZD_LOGS Report
      [END   2014/11/07 13:17:29] Generating Post Apply Reports
    [END   2014/11/07 13:17:29] adzdoptl.pl run
    adop phase=apply - Completed Successfully
    Log file: /u01/appl_test/fs_ne/EBSapps/log/adop/8/adop_20141106_182058.log
adop exiting with status = 0 (Success)
- After Successful Installation of Patch start all Application services:
[applint2@appnode3 appl_test]$ . EBSapps.env run
  E-Business Suite Environment Information
  ----------------------------------------
  RUN File System           : /u01/appl_test/fs1/EBSapps/appl
  PATCH File System         : /u01/appl_test/fs2/EBSapps/appl
  Non-Editioned File System : /u01/appl_test/fs_ne
  DB Host: appnode3.oralabs.com  Service/SID: test
  Sourcing the RUN File System ...
[applint2@appnode3 appl_test]$ adstrtal.sh apps/apps
- Execute cleanup and clone operations on file system
[applint2@appnode3 ~]$ adop phase=cleanup
Enter the APPS password:
Enter the SYSTEM password:
Enter the WLSADMIN password:
 Please wait. Validating credentials...
RUN file system context file: /u01/appl_test/fs1/inst/apps/test_appnode3/appl/admin/test_appnode3.xml
PATCH file system context file: /u01/appl_test/fs2/inst/apps/test_appnode3/appl/admin/test_appnode3.xml
Execute SYSTEM command : df /u01/appl_test/fs2
Worker count determination...
Validation successful. All expected nodes are listed in ADOP_VALID_NODES table.
[EVENT]     [START 2014/11/08 06:52:39] Performing database sanity checks
[EVENT]     [END   2014/11/08 06:52:40] Finished performing database sanity checks
  [START 2014/11/08 06:52:42] adzdoptl.pl run
    ADOP Session ID: 8
    Phase: cleanup
    Log file: /u01/appl_test/fs_ne/EBSapps/log/adop/8/adop_20141108_061727.log
    [START 2014/11/08 06:52:43] cleanup phase
      [EVENT]     [START 2014/11/08 06:52:44] Performing Cleanup steps
        [EVENT]     [START 2014/11/08 06:52:44] Running stored CLEANUP actions
          Calling: adpatch options=hotpatch,nocompiledb interactive=no console=no workers=6 restart=no abandon=yes defaultsfile=/u01/appl_test/fs1/EBSapps/appl/admin/test/adalldefaults.txt patchtop=/u01/appl_test/fs1/EBSapps/appl/ad/12.0.0/patch/115/driver logfile=cleanup.log driver=ucleanup.drv
          ADPATCH Log directory: /u01/appl_test/fs_ne/EBSapps/log/adop/8/cleanup_20141108_061727/test_appnode3/log
        [EVENT]     [END   2014/11/08 06:54:01] Running stored CLEANUP actions
        [START 2014/11/08 06:54:01] Generating All DDL Report
            [EVENT]     Report: /u01/appl_test/fs1/EBSapps/appl/ad/12.0.0/sql/ADZDALLDDLS.sql
            [EVENT]     Output: /u01/appl_test/fs_ne/EBSapps/log/adop/8/cleanup_20141108_061727/test_appnode3
        [END   2014/11/08 06:54:21] Generating All DDL Report
        [EVENT]     Calling cleanup in STANDARD mode
        [WARNING]   Cleanup may take a while. Please wait.
      [EVENT]     [END   2014/11/08 06:55:18] Performing Cleanup steps
    [END   2014/11/08 06:55:18] cleanup phase
    [EVENT]     [START 2014/11/08 06:55:19] Generating AD_ZD_LOGS Report
      [EVENT]     Report: /u01/appl_test/fs1/EBSapps/appl/ad/12.0.0/sql/ADZDSHOWLOG.sql
      [EVENT]     Output: /u01/appl_test/fs_ne/EBSapps/log/adop/8/cleanup_20141108_061727/test_appnode3/adzdshowlog.out
    [EVENT]     [END   2014/11/08 06:56:18] Generating AD_ZD_LOGS Report
  [END   2014/11/08 06:56:19] adzdoptl.pl run
  adop phase=cleanup - Completed Successfully
  Log file: /u01/appl_test/fs_ne/EBSapps/log/adop/8/adop_20141108_061727.log
adop exiting with status = 0 (Success)
[applint2@appnode3 ~]$
[applint2@appnode3 ~]$ adop phase=fs_clone
Enter the APPS password:
Enter the SYSTEM password:
Enter the WLSADMIN password:
 Please wait. Validating credentials...
RUN file system context file: /u01/appl_test/fs1/inst/apps/test_appnode3/appl/admin/test_appnode3.xml
PATCH file system context file: /u01/appl_test/fs2/inst/apps/test_appnode3/appl/admin/test_appnode3.xml
Execute SYSTEM command : df /u01/appl_test/fs2
Worker count determination...
Validation successful. All expected nodes are listed in ADOP_VALID_NODES table.
  [END   2014/11/08 12:45:52] adzdoptl.pl run
  adop phase=fs_clone - Completed Successfully
  Log file: /u01/appl_test/fs_ne/EBSapps/log/adop/9/adop_20141108_070728.log
adop exiting with status = 0 (Success)
[applint2@appnode3 ~]$
The upgrade form 12.2.0 to 12.2.4 completed.
- Verify the version of applications after upgrade:
Post Upgrade:
- Install online help patch "17919162" using adop
- verify all application services are up and running
- check the status of managed serves
All manged servers are up and running.

How To Change The Web Port in E-Business Suite R12.2 (Doc ID 1567661.1)

, , No comments :
Solution
The high level process is :
  - Launch EM Console
http://<s_wls_admin_host>.<s_wls_admin_domain>:<s_wls_adminport>/em)
- Login as weblogic admin user (s_wls_admin_user)
- Select the webtier instance from the Web Tier drop down
- Select the Oracle HTTP server component and Advanced Configuration
- Choose httpd.conf for example
- Modify the Listen port value
- Save the changes
- Run Context File Synchronization $AD_TOP/bin/adSyncContext.pl :
perl $AD_TOP/bin/adSyncContext.pl contextfile=$CONTEXT_FILE
- Manually update the $CONTEXT_FILE if old port values are still present
- Run autoconfig
- Check the value for s_login_page in the context file
- Also, context file should not have any references to old Listen port value
- Login to EBS and do some sanity testing
At the time this document was written the correct functionality is delivered by
$JAVA_TOP/oracle/apps/ad/context/UpdateContext.class
$AD_TOP/java/oracle/apps/ad/context/UpdateContext.class
versions 120.5.12020000.2 or higher delivered by Patch 16324606:R12.TXK.C which is included in 12.2.2
If you are on a lower version , such as
$Header UpdateContext.java 120.5 2011/06/03 20:26:17 jaedo ship $
then you need to manually check and update the derived context variables left unchanged in $CONTEXT_FILE
For instance , if old port was 8000 and new port is 8010 then :
grep 8000 $CONTEXT_FILE
         <chronosURL oa_var="s_chronosURL">http://<hostname>.<domainname>:8000/oracle_smp_chronos/oracle_smp_chronos_sdk.gif</chronosURL>
         <EndUserMonitoringURL oa_var="s_endUserMonitoringURL">http://<hostname>.<domainname>:8000/oracle_smp_chronos/oracle_smp_chronos_sdk.gif</EndUserMonitoringURL>
         <externURL oa_var="s_external_url">http://<hostname>.<domainname>:8000</externURL>
         <login_page oa_var="s_login_page">http://<hostname>.<domainname>:8000/OA_HTML/AppsLogin</login_page>
      <web_port oa_var="s_webport" oa_type="PORT" base="8000" step="1" range="-1" label="Web Listener Port">8010</web_port>
      <activewebport oa_var="s_active_webport" oa_type="DUP_PORT" base="8000" step="1" range="-1" label="Active Web Port">8010</activewebport>
so you need to update s_chronosURL , s_endUserMonitoringURL , s_external_url and s_login_page with new port number 8010

adop phase=cleanup Failed

, , , No comments :
Log: @ADZDSHOWLOG.sql "2015/05/14 19:21:47"
    [ERROR]     Failed to execute SQL statement :
       begin
        execute immediate 'alter session set DDL_LOCK_TIMEOUT = 600';
        ad_zd.cleanup('STANDARD');
      end;
    [ERROR]     Error Message :
    [UNEXPECTED]Error occurred while calling cleanup plsql API
    [UNEXPECTED]Cleanup phase completed with errors/warnings. Please check logfiles
[STATEMENT] Please run adopscanlog utility, using the command
"adopscanlog -latest=yes"
to get the list of the log files along with snippet of the error message corresponding to each log file.
adop exiting with status = 1 (Fail)
SQL> select count(*) from dba_obJects where status='INVALID' AND object_name like 'AD%';
  COUNT(*)
----------
         1
SQL> SQL> select object_name from dba_obJects where status='INVALID' AND object_name like 'AD%';
OBJECT_NAME
--------------------------------------------------------------------------------
AD_ZD_TABLE
SQL> alter package apps.AD_ZD_TABLE compile;
Warning: Package altered with compilation errors.
SQL> alter package apps.AD_ZD_TABLE compile body;
Warning: Package Body altered with compilation errors.
Solution:
SQL> @/ad_TXK_patches_delta_6/19197270/admin/adgrants.sql APPS
Connected.
then compile the object.
SQL> alter package apps.AD_ZD_TABLE compile;
Package altered.
SQL> alter package apps.AD_ZD_TABLE compile body;
Package body altered.

R12.2 Installation and upgrade to 12.2.4

, , , , , , , , , No comments :

SOA Installation and Configuration Oracle R12.2.4

, , No comments :
INTRODUCTION
This document provides a detailed approach to the installation and configuration of Oracle SOA suite 11g products for the Scale project at APDBA.
As part of Scale project, the following Oracle Components will be installed:
Oracle SOA Suite (SOA 11.1.1.7)
JRockit (jdk1.6.0_45-R28.2.7-4.1.0)
Weblogic (Weblogic 10.3.6)
RCU SOA 11.1.1.7

 1 Hardware Installation Prerequisites and Setup
N/A.
2 Software Installation Prerequisites and Setup
• Linux User appmstr on server where SOA is required to be installed.
• Shared Mount  /u12 of size 250 GB on the server where SOA is required to be installed.
• Temporary SYS access to install the Oracle RCU.
• Oracle DBA to enable auto extend for the schemas created and assign disk space as below.
FMW_SOAINFRA to 310 GB
                              FMW_ORASDPM to 30 GB
                              FMW_MDS to 30 GB
• Set the processes to minimum of 1000 for SOA alone.
Extract ofm_rcu_linux_11.1.1.7.0_64_disk1_1of1.zip  and run /rcuHome/bin/rcu 
Create Repository
Select 
Create (Create and Load component schemas into a database)
Click Next.
Database Connection Details
Select 
Database Type: Oracle Database
Host Name: <Database Scan Address>
Port: <Database Port>
Service Name: <Database Service Name>
Username: sys
Password: <Enter sys password>
Role: sysdba
Click Next
Select Components
Select
Create New Prefix:  fmw
AS Common Schemas – Metadata Services
AS Common Schemas – Enterprise Scheduler Service
SOA and BPM Infrastructure – SOA Infrastructure
SOA and BPM Infrastructure – User Messaging Service
Click Next
Schema Passwords
Select
Use same passwords for all schemas
Enter the password
Click Next 
Map Tablespaces
Change Temp Tablespace to temp
Click Next 
Summary
Click Create 
Completion Summary
Click Close.
Run ./jrockit-jdk1.6.0_45-R28.2.7-4.1.0-linux-x64.bin 
Welcome
Click Next 
Choose Product Installation Directories
Product Installation Directory: /u12/oracle/product/fmw/jrockit-jdk1.6.0_45
Click Next
Optional Components
Click Next
Installation Complete
Click Done.
Download wls1036_generic.jar and run the command below
java –jar wls1036_generic.jar
Welcome
Click Next
Choose Middleware Home Directory
Select
Create a new Middleware Home
Middleware Home Directory: /u12/oracle/products/fmw
Click Next
Choose Install Type
Select
Typical
Click Next
JDK Selection
Select
/u12/oracle/products/fmw/jrockit-jdk1.6.0_45
Click Next
Choose Product Installation Directories
Leave the defaults
Click Next
Installation Summary
Click Next
Installation Complete
Uncheck Run Quickstart
Click Done.
Unzip ofm_soa_generic_11.1.1.7.0_disk1_1of2.zip and ofm_soa_generic_11.1.1.7.0_disk1_2of2.zip to the same directory and run /Disk1/runInstaller
Specify Inventory Directory
Inventory Directory: /u12/oracle/products/fmw/oraInventory
Operating System Group Name: eip
Click Next
Inventory Location Confirmation Dialog
Check Continue Installation with Local Inventory
Welcome
Click Next
Prerequisite Checks
Click Next
Specify Installation Location
Oracle Middleware Home: /u12/oracle/products/fmw
Oracle Home Diretory: Oracle_SOA1
Click Next
Application Server
Select Weblogic Server
Click Next
Installation Summary
Click Install
Installation Progress
Click Next
Installation Complete
Click Finish.
Run ./config.sh from location /u03/oracle/products/fmw/Oracle_SOA1/common/bin
Welcome
Select Create New Weblogic Domain
Click Next
Select Domain Source
Select Oracle Enterprise Manager, Oracle JRF, Oracle WSM Policy Manager, Oracle Soa Suite.
Click Next
Specify Domain Name and Location
Domain Name: <domain_name>
Domain Location: /u12/oracle/config/domains
Application Location: /u12/oracle/config/applications/<domain_name>
Configure Administer User Name and Password
Name: weblogic
User Password: <password>
Click Next
Configure Server Start Mode and JDK
Select Production Mode
Click Next.
Configure JDBC Component Schema
Select Convert to GridLink
Click Next
Configure GridLink RAC Component Schema
Provide Service Listener, Port and TCP
Provide ONS Host and Port
Update Service Name
Update Username and Password.
Check Enable Fan
Click Next
Test JDBC Component Schema
Check for status
Click Next
Select Optional Configuration
Select
 Administration Server
Managed Servers, Clusters and Machines
Click Next
Configure the Administration Server
Select 
Name: soadomain
Listen Address: blank
Listen Port: 8010
Click Next
Configure Managed Servers
Name: soams1
Listen Address: blank
Listen Port: 8011
Click Next
Configure Machines
Name: LocalMachine
Node Manager Listen Address: localhost
Node Manager Listen Port: 5556
Click Next
Assign Servers to Machines
Add AdminServer and soams1 to LocalMachine
Click Next.
Configuration Summary
Click Create
End of Test Steps 

Subscribe to: Posts ( Atom )