My Oracle Support Banner

Unexpected reboot, SPSUN4V-8000-P3, Redstate has occurred. (Doc ID 2430436.1)

Last updated on AUGUST 02, 2018

Applies to:

SPARC T5-2 - Version All Versions and later
Information in this document applies to any platform.

Symptoms

---------------->  HOST - prtdiag -v

Sun System Firmware 9.3.0.b 2014/11/13 17:52                                               <<<< OLD firmware!

---------------->  HOST - Messages: Abrupt reboot

Jul 24 23:56:16 oracle-doc SC Alert: [ID 717381 daemon.notice] Audit | minor: oracle-doc-sc : Close Session : object = "/SP/sessions/XXXXXXX/type" : value = "shell" : success
Jul 25 00:51:51 oracle-doc genunix: [ID 540533 kern.notice] ^MSunOS Release 5.11 Version 11.2 64-bit
Jul 25 00:51:51 oracle-doc genunix: [ID 282658 kern.notice] Copyright (c) 1983, 2015, Oracle and/or its affiliates. All rights reserved.
Jul 25 00:51:51 oracle-doc genunix: [ID 678236 kern.info] Ethernet address = 0:XX:XX:XX:XX:XX

---------------->  HOST - fmdump -av

Jul 25 00:30:28.7163 XXXXXXXX-YYYY-XXXX-YYYY-XXXXXXXXXXX SPSUN4V-8000-P3 Diagnosed
 100%  fault.cpu.generic-sparc.inconsistent

       Problem in: hc://:chassis-serial=AAAA12345:chassis-name=SPARC T5-2:chassis-part=32939226+1+1:chassis-mfg=Oracle Corporation:host-id=XXXXXXX/chassis=0
          Affects: hc://:chassis-serial=AAAA12345:chassis-name=SPARC T5-2:chassis-part=32939226+1+1:chassis-mfg=Oracle Corporation:host-id=XXXXXXX/chassis=0
              FRU: hc://:chassis-serial=AAAA12345:chassis-name=SPARC T5-2:chassis-part=32939226+1+1:chassis-mfg=Oracle Corporation:host-id=XXXXXXX:fru-mfg=Oracle Corporation:fru-name=SPARC T5-2:fru-serial=AAAA12345:fru-part=32939226+1+1/chassis=0
     FRU Location: /SYS

Jul 25 10:18:05.0113 XXXXXXXX-YYYY-XXXX-YYYY-XXXXXXXXXXX SPSUN4V-8000-P3 Diagnosed
 100%  fault.cpu.generic-sparc.inconsistent

       Problem in: hc://:chassis-serial=AAAA12345:chassis-name=SPARC T5-2:chassis-part=32939226+1+1:chassis-mfg=Oracle Corporation:host-id=XXXXXXX/chassis=0
          Affects: hc://:chassis-serial=AAAA12345:chassis-name=SPARC T5-2:chassis-part=32939226+1+1:chassis-mfg=Oracle Corporation:host-id=XXXXXXX/chassis=0
              FRU: hc://:chassis-serial=AAAA12345:chassis-name=SPARC T5-2:chassis-part=32939226+1+1:chassis-mfg=Oracle Corporation:host-id=XXXXXXX:fru-mfg=Oracle Corporation:fru-name=SPARC T5-2:fru-serial=AAAA12345:fru-part=32939226+1+1/chassis=0
     FRU Location: /SYS

Jul 25 11:10:36.9446 XXXXXXXX-YYYY-XXXX-YYYY-XXXXXXXXXXX SPSUN4V-8000-P3 Diagnosed
 100%  fault.cpu.generic-sparc.inconsistent

       Problem in: hc://:chassis-serial=AAAA12345:chassis-name=SPARC T5-2:chassis-part=32939226+1+1:chassis-mfg=Oracle Corporation:host-id=XXXXXXX/chassis=0
          Affects: hc://:chassis-serial=AAAA12345:chassis-name=SPARC T5-2:chassis-part=32939226+1+1:chassis-mfg=Oracle Corporation:host-id=XXXXXXX/chassis=0
              FRU: hc://:chassis-serial=AAAA12345:chassis-name=SPARC T5-2:chassis-part=32939226+1+1:chassis-mfg=Oracle Corporation:host-id=XXXXXXX:fru-mfg=Oracle Corporation:fru-name=SPARC T5-2:fru-serial=AAAA12345:fru-part=32939226+1+1/chassis=0
     FRU Location: /SYS

----------------> ILOM - show /SP/logs/event/list

345    Wed Jul 25 00:24:47 2018  System    Log       minor
      Host: HV started
344    Wed Jul 25 00:17:16 2018  System    Log       minor
      Host: Powered On
343    Wed Jul 25 00:17:11 2018  IPMI      Log       minor
      ID =   1c : 07/25/2018 : 00:17:11 : System Boot Initiated : System Management Software : Host0: System Restart : Asserted
342    Wed Jul 25 00:17:11 2018  Power     On        major
      Power to /SYS has been turned on by: Shell session, Username:oracle-doc-sc
341    Wed Jul 25 00:00:46 2018  System    Log       minor
      Host: Standby
340    Wed Jul 25 00:00:46 2018  System    Log       minor
      Host: Error Standby
339    Wed Jul 25 00:00:44 2018  HOST      Log       critical
      cpu state data has been gathered
338    Tue Jul 24 23:59:52 2018  HOST      Log       critical
      Redstate has occurred. cpu state data is being gathered.
337    Tue Jul 24 23:59:45 2018  Fault     Fault     critical
      Fault detected at time = Tue Jul 24 23:59:45 2018. The suspect component: /SYS has fault.cpu.generic-sparc.inconsistent with probability=100. Refer to
      http://support.oracle.com/msg/SPSUN4V-8000-P3 for details.
336    Mon Apr 18 08:57:51 2016  System    Log       minor
      Host: Solaris running

----------------> ILOM - show faulty
Target                                          | Property                                               | Value
------------------------------------------------+--------------------------------------------------------+----------------------------------------------------------------------------------
/SP/faultmgmt/0                                 | fru                                                    | /SYS
/SP/faultmgmt/0/faults/0                        | class                                                  | fault.cpu.generic-sparc.inconsistent
/SP/faultmgmt/0/faults/0                        | sunw-msg-id                                            | SPSUN4V-8000-P3
/SP/faultmgmt/0/faults/0                        | component                                              | /SYS
/SP/faultmgmt/0/faults/0                        | uuid                                                   | XXXXXXXX-YYYY-XXXX-YYYY-XXXXXXXXXXX
/SP/faultmgmt/0/faults/0                        | timestamp                                              | 2018-07-24/23:59:45
/SP/faultmgmt/0/faults/0                        | fru_serial_number                                      | AAAA12345
/SP/faultmgmt/0/faults/0                        | fru_part_number                                        | 32939226+1+1
/SP/faultmgmt/0/faults/0                        | fru_name                                               | SPARC T5-2
/SP/faultmgmt/0/faults/0                        | fru_manufacturer                                       | Oracle Corporation
/SP/faultmgmt/0/faults/0                        | system_component_manufacturer                          | Oracle Corporation
/SP/faultmgmt/0/faults/0                        | system_component_name                                  | SPARC T5-2
/SP/faultmgmt/0/faults/0                        | system_component_part_number                           | 32939226+1+1
/SP/faultmgmt/0/faults/0                        | system_component_serial_number                         | AAAA12345
/SP/faultmgmt/0/faults/0                        | chassis_manufacturer                                   | Oracle Corporation
/SP/faultmgmt/0/faults/0                        | chassis_name                                           | SPARC T5-2
/SP/faultmgmt/0/faults/0                        | chassis_part_number                                    | 32939226+1+1
/SP/faultmgmt/0/faults/0                        | chassis_serial_number                                  | AAAA12345
/SP/faultmgmt/0/faults/0                        | system_manufacturer                                    | Oracle Corporation
/SP/faultmgmt/0/faults/0                        | system_name                                            | SPARC T5-2
/SP/faultmgmt/0/faults/0                        | system_part_number                                     | 32939226+1+1
/SP/faultmgmt/0/faults/0                        | system_serial_number                                   | AAAA12345

----------------> ILOM - fmadm faulty
------------------- ------------------------------------ -------------- --------
Time                UUID                                 msgid          Severity
------------------- ------------------------------------ -------------- --------
2018-07-24/23:59:45 XXXXXXXX-YYYY-XXXX-YYYY-XXXXXXXXXXX SPSUN4V-8000-P3 MAJOR

Problem Status    : open
Diag Engine       : fdd 1.0
System
  Manufacturer   : Oracle Corporation
  Name           : SPARC T5-2
  Part_Number    : 32939226+1+1
  Serial_Number  : AAAA12345

----------------------------------------
Suspect 1 of 1
  Fault class  : fault.cpu.generic-sparc.inconsistent                                                                        <<<<<< !!!
  Certainty    : 100%
  Affects      : /SYS
  Status       : faulted

  FRU
     Status            : faulty
     Location          : /SYS
     Manufacturer      : Oracle Corporation
     Name              : SPARC T5-2
     Part_Number       : 32939226+1+1
     Serial_Number     : AAAA12345
     Chassis
        Manufacturer   : Oracle Corporation
        Name           : SPARC T5-2
        Part_Number    : 32939226+1+1
        Serial_Number  : AAAA12345

Description : Software had detected an inconsistency in the telemetry.

Response    : No Automated Response.

Impact      : System performance may be affected.

Action      : Use 'fmadm faulty' to provide a more detailed view of this
             event. Please refer to the associated reference document at
             http://support.oracle.com/msg/SPSUN4V-8000-P3 for the latest
             service procedures and policies regarding this diagnosis.

----------------> ILOM - fmdump -ev

2018-01-29/04:25:12  ereport.chassis.software.core@/SYS/MB/SP
2018-03-22/16:57:19  ereport.chassis.software.core@/SYS/MB/SP
2018-05-14/06:11:31  ereport.chassis.software.core@/SYS/MB/SP
2018-07-05/17:26:46  ereport.chassis.software.core@/SYS/MB/SP
2018-07-24/23:59:44  ereport.cpu.generic-sparc.red-state@/SYS/MB/CM1/CMP                                <<<<< !
2018-07-24/23:59:45  ereport.cpu.generic-sparc.inconsistent@/SYS                                                 <<<<<
2018-07-24/23:59:45  ereport.cpu.generic-sparc.red-state@/SYS/MB/CM0/CMP                                <<<<< !
2018-07-24/23:59:45  ereport.cpu.generic-sparc.inconsistent@/SYS                                                 <<<<<

----------------> Console Logs

2018-07-25 06:47:07  1:8:7> ERROR:   Redstate trap occurred on socket 1 strand 71                       <<<<<< !
2018-07-25 06:47:07  0:9:0> ERROR:   Redstate trap occurred on socket 0 strand 72                       <<<<<< !
2018-07-25 06:47:07  1:8:7> NOTICE:

       Redstate handler finished

2018-07-25 06:47:07  0:9:0> NOTICE:

       Redstate handler finished

2018-07-25 06:47:12  0:9:0> NOTICE:  Waiting for poweroff or powercycle from the SP
2018-07-25 06:47:12  1:8:7> NOTICE:  Waiting for poweroff or powercycle from the SP
2018-07-25 07:00:47     SP> NOTICE:  Host is off

Changes

No changes, the platform firmware was not up-to-date.

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.