My Oracle Support Banner

How to Add Exadata Storage Servers Using 3 TB (or larger) Disks to an Existing Database Machine (Doc ID 1476336.1)

Last updated on OCTOBER 18, 2023

Applies to:

Oracle Exadata Storage Server Software - Version 11.2.2.4.2 and later
Linux x86-64

Goal

This procedure shows how to add new storage servers with 3 TB disks to existing disk groups composed of 2 TB disks.  The same procedure may be used to add 8 TB or 4 TB disks to existing 2TB or 3TB disks, keeping in mind that you'll see different sizes than those shown in the examples of this document.  This note only covers the storage configuration aspect of the grid disks and disk groups; for information on how to configure a storage cell and incorporate it into an existing cluster, please see the Oracle Exadata Storage Server Software User's Guide, "Configuring Exadata Storage Server Software" chapter.

Specifically, this note applies to the following scenario:

Please note the following restrictions when adding disks to Exadata:

  1. Within a disk group, you can only add the same kinds of disks as what already exists.  E.g., if you have a diskgroup with high capacity (HC) disks, then you can only add HC disks and similarly if you already have high performance (HP) disks you can only add HP disks
  2. When adding additional cells to a rack (as part of an expansion within a rack) or an additional storage expansion rack, you may add either HC or HP disks, but if the new disks are a different type from the existing ones, then you must add them to a new diskgroup containing only that disk type. E.g., your existing disks are HP and you add an HC storage expansion rack; the new disks must go into a new diskgroup
  3. The exception to restriction #2 is with X5 systems or higher.  In that case, the performance charactersitics of X5 HC disks and the additional amount of flash available will make it possible to combine X5 HC disks with existing HP disks and achieve similar performance.  This is only supported by making the grid disks of the X5 HC disks exactly the same size as the existing HP grid disks.  The remaining space on the X5 HC disks can be used to create a new disk group.

 

Solution

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Goal
Solution
 1. Ensure Cell Disks are Ready
 2. Create DATA and RECO grid disks on the 3TB disks at the same offsets found on the 2TB disks (outer tracks)
 3. Calculate the exact size for the additional 1TB grid disks on the new cells
 4. Create new grid disks with the additional space (approx 1TB) on all 12 disks of each new 3 TB cells
 5. Create the new DBFS_DG grid disks only on disks 3 through 12 of the new storage servers
 6. If Needed, create new 4 GB grid disks with the extra space on disks 3 through 12, and prefix the grid disk name as "EXTRA"
 7.  Validate that Grid Disks on all Cells are the Same Size
 8. Add the DBFS_DG grid disks to the existing DBFS_DG disk group; monitor to ensure rebalance finishes properly (supply the proper wildcard pattern for your system)
 9. Add the DATA and RECO grid disks to the existing DATA and RECO disk groups
 10. Create a new disk group to use the DATA2 grid disks
 11.  Validate that  DATA, RECO, and DBFS_DG contain disks from new cells and are exactly the correct size and match existing cells

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.