My Oracle Support Banner

Exadata: RS-7445 [MS No Response On Startup] [It Will Be Restarted] (Doc ID 1646087.1)

Last updated on JULY 24, 2015

Applies to:

Oracle Exadata Storage Server Software - Version 11.2.3.2.1 to 11.2.3.3.0 [Release 11.2]
Information in this document applies to any platform.

Goal

RS process reports following error:

Incident 12 created, dump file: /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/log/diag/asm/cell/exacel02/incident/incdir_12/rstrc_7849_5_i12.trc
RS-7445 [MS no response on startup] [It will be restarted] [] [] [] [] [] [] [] [] [] []
Stoping MS: incarnation num: 8
kill the service MS with pid 31792 gracefully
waitpid_nohang: process 31792 exited with status

 

Further checking in ms-odl.trc file shows the following Java exception messages:

[2014-02-01T05:00:12.849+01:00] [ossmgmt] [NOTIFICATION] [] [ms.core.MSMetricPersistTimerTask] [tid: 14] [ecid: 10.218.34.199:76889:1391118817422:17,0] File /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/cellsrv/deploy/config/metrics/metrics_140125_05.gz is removed
[2014-02-01T06:00:15.248+01:00] [ossmgmt] [NOTIFICATION] [] [ms.core.MSMetricPersistTimerTask] [tid: 14] [ecid: 10.218.34.199:76889:1391118817422:17,0] File /opt/oracle/cell11.2.3.2.1_LINUX.X64_130109/cellsrv/deploy/config/metrics/metrics_140125_06.gz is removed
[2014-02-01T06:36:07.555+01:00] [ossmgmt] [NOTIFICATION] [] [common.hwadapter.bmcadp.BmcAdapterImpl] [tid: 14] [ecid: 10.218.34.199:76889:1391118817422:17,0] SEL count: 391 freespace: 9324 opers: 3
[2014-02-01T06:59:43.652+01:00] [ossmgmt] [ERROR] [] [ms.core.MSCommandHandler] [tid: 15] [ecid: 10.218.34.199:76889:1391234373670:235,0] java.lang.OutOfMemoryError: Java heap space[[

 

Checking the metrics for that time will show:

$OSSCONF/metrics/*

% grep KEY metrics_140421_18 |wc 
   24072   96288 3131247 

This shows 24072 metrics. This is too many for 11.2.3.3.0 and thats is why this out of memory exception occurs.

Solution

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.