Exadata 11.2.2.4.0 rolling update failed (Doc ID 1388511.1)

Last updated on MAY 13, 2013

Applies to:

Oracle Exadata Storage Server Software - Version: 11.2.2.4.0 and later   [Release: 11.2 and later ]
Information in this document applies to any platform.

Symptoms

While applying exadata 11.2.2.4.0 on cell nodes in ROLLING update fashion, patching activity will be stopped with following error messages for one or more cell nodes.

pdw1cel02: [ERROR] Patch failed. Cell version found OSS_11.2.0.3.0_LINUX.X64_101206.2 but expected OSS_11.2.0.3.0_LINUX.X64_110929
pdw1cel02:
pdw1cel02: [Version and state found] 11.2.2.2.0.101206.2 and success [Expected] 11.2.2.4.0.110929 and success
pdw1cel02: Examine the patchmgr log files and /root/_patch_hctap_/_p_/wait_out file on the cell.
pdw1cel02: Cell pdw1cel02 10.5.49.7
pdw1cel02: _EXIT_ERROR_Cell pdw1cel02 10.5.49.7 13:47-19-Nov:2011: Found: 11.2.2.2.0.101206.2 state success Expected: 11.2.2.4.0.110929 state success.

- There will not be any other errors/failure messages in following files except the above error message.
   patchmgr.stdout
   patchmgr.stderr

- There will be a message similar to the following in patchmgr.stdout indicates that patchmgr has done automatic rollback

pdw1cel02: /root/_patch_hctap_/patch_marker.txt: 17329 wait_post_rollback_activate
pdw1cel02: [DEBUG] End Various markers
pdw1cel02: _EXIT_WAIT_Cell pdw1cel02 10.5.49.7 13:45-19-Nov:2011: Wait for griddisks to activate after rollback.
.
.
.
pdw1cel02: _EXIT_PASS_Cell pdw1cel02 10.5.49.7 13:46-19-Nov:2011: Success activating grid disks after rollback.
.
.
.
pdw1cel02: [INFO] Wait for validations at first boot after upgrade to finish.
pdw1cel02: [INFO] Success activating grid disks after rollback.
pdw1cel02: Cell pdw1cel02 10.5.49.7
pdw1cel02: _EXIT_PASS_Cell pdw1cel02 10.5.49.7 13:46-19-Nov:2011: Success activating grid disks after rollback.
13:46-19-Nov:2011 4 Done pdw1cel02 : SUCCESS : Wait for cell to reboot and come online.
.
.
.


- Command "imageinfo" shows following output on cell nodes where patching activity has been failed with above error

# imageinfo
Kernel version: 2.6.18-194.3.1.0.3.el5 #1 SMP Tue Aug 31 22:41:13 EDT 2010 x86_64
Cell version: OSS_11.2.0.3.0_LINUX.X64_101206.2
Cell rpm version: cell-11.2.2.2.0_LINUX.X64_101206.2-1
Active image version: 11.2.2.2.0.101206.2
Active image activated: 2011-11-19 13:47:34 +0800
Active image status: success
Active system partition on device: /dev/md6
Active software partition on device: /dev/md8
In partition rollback: Impossible
Cell boot usb partition: /dev/sdac1
Cell boot usb version: 11.2.2.2.0.101206.2
Inactive image version: 11.2.2.4.0.110929
[WARNING] File not found /opt/oracle.cellos/patch/history/image.id.11.2.2.4.0.110929
Inactive system partition on device: /dev/md5
Inactive software partition on device: /dev/md7
Boot area has rollback archive for the version: undefined
Rollback to the inactive partitions: Impossible

It shows that old image version i.e "11.2.2.2.0" still available as ACTIVE version while new image version i.e "11.2.2.4.0" is on INACTIVE partition.

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms