How to diagnose missing resources in SPARC CMT systems (Doc ID 2227574.1)

Last updated on DECEMBER 18, 2024

Applies to:

Sun SPARC Enterprise T5240 Server - Version All Versions and later
SPARC S7-2 - Version All Versions and later
SPARC T5-4 - Version All Versions and later
Sun SPARC Enterprise T1000 Server - Version Not Applicable and later
SPARC T4-2 - Version All Versions and later
Information in this document applies to any platform.

Goal

Description

In certain circumstances Solaris may not report all system resources as being available as a result of a fault (KM 1483194.1), end users manually disabling components (KM 1643464.1), or due to resource constraints applied by Oracle VM/LDoms as will be discussed in this document.

NOTE : SPARC T7 introduces Memory DIMM sparing which is enabled by default on fully populated systems. Please refer to KM 2037793.1 for more information.

Symptoms

OBP reports less memory than expected;

Alternatively check output from 'show components' to confirm if any devices are currently disabled;

In this example we should expect to see 262144MB of main memory as no modules are disabled or faulted, however OBP is reporting just 8GB;

SPARC T7-1, No Keyboard
Copyright (c) 1998, 2016, Oracle and/or its affiliates. All rights reserved.
OpenBoot 4.40.1, 8.0000 GB memory installed, Serial #XXXXXXXXX.
Ethernet address x:xx:xx:xx:xx:xx, Host ID: xxxxxxxx.

If already booted to Solaris various tools may report less memory, CPUs or I/O than expected;

# psrinfo
0 on-line since 01/25/2017 15:18:21
1 on-line since 01/25/2017 15:18:23
2 on-line since 01/25/2017 15:18:23
3 on-line since 01/25/2017 15:18:23
4 on-line since 01/25/2017 15:18:23
5 on-line since 01/25/2017 15:18:23
6 on-line since 01/25/2017 15:18:23
7 on-line since 01/25/2017 15:18:23
#

# prtdiag | grep "^Memory size"
Memory size: 8192 Megabytes
#

Verify whether the system is booting from factory default or a custom Oracle VM/LDoms configuration;

-> show /HOST/bootmode/ config

/HOST/bootmode
Properties:
config = someldomconfig <<<

This can also be verified from the POST logs during platform initialisation;

2017-01-25 15:12:26 0:00:0> NOTICE: Booting config = someldomconfig

And from within Solaris;

# ldm list-spconfig
factory-default
someldomconfig [current]
#

NOTE : If the system is missing resources when booted from the 'factory-default' configuration please contact Oracle Support for further assistance.

Use ldm to verify domain resource allocation and ensure this matches what the host is reporting as available. Using the same example as above we have 8 CPUs, 8GB memory and all I/O assigned to the primary domain;

# ldm list
NAME STATE FLAGS CONS VCPU MEMORY UTIL NORM UPTIME
primary active -n-cv- UART 8 8G 0.3% 0.3% 21m
#

# ldm list-io
NAME TYPE BUS DOMAIN STATUS
---- ---- --- ------ ------
pci_0 BUS pci_0 primary IOV
pci_1 BUS pci_1 primary IOV
pci_2 BUS pci_2 primary IOV
pci_3 BUS pci_3 primary IOV
pci_4 BUS pci_4 primary IOV
/SYS/MB/PCIE6 PCIE pci_0 primary EMP
/SYS/MB/SASHBA PCIE pci_0 primary OCC
/SYS/MB/PCIE4 PCIE pci_1 primary OCC
/SYS/MB/PCIE5 PCIE pci_1 primary EMP
/SYS/MB/NET0 PCIE pci_2 primary OCC
/SYS/MB/NET2 PCIE pci_2 primary OCC
/SYS/MB/PCIE2 PCIE pci_3 primary EMP
/SYS/MB/PCIE3 PCIE pci_3 primary OCC
/SYS/MB/PCIE1 PCIE pci_4 primary EMP
/SYS/MB/NET0/IOVNET.PF0 PF pci_2 primary
/SYS/MB/NET0/IOVNET.PF1 PF pci_2 primary
/SYS/MB/NET2/IOVNET.PF0 PF pci_2 primary
/SYS/MB/NET2/IOVNET.PF1 PF pci_2 primary
#

Use 'ldm list-devices' to confirm which specific resources are currently unallocated to a domain;

ldm list-devices cpu
ldm list-devices memory
ldm list-devices io

Solution

	To view full details, sign in with your My Oracle Support account.
	Don't have a My Oracle Support account? Click to get started!

In this Document

Goal

Solution

References

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.

How to diagnose missing resources in SPARC CMT systems (Doc ID 2227574.1)

Applies to:

Goal

Solution

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!