Oracle HSM: Release 6.1-03 Release is Now Available
(Doc ID 2328823.1)
Last updated on JANUARY 31, 2019
Applies to:Oracle Hierarchical Storage Manager (HSM) and StorageTek QFS Software - Version 6.1 and later
Information in this document applies to any platform.
The Oracle HSM (SAM-QFS) 6.1-03 release (build id 6.1.45) is now available out on the Oracle Software Delivery Cloud, as of December 21, 2017.
The previous HSM 6.1-02 release was pulled from the Oracle Software Delivery Cloud, on December 12th, 2017. Reference <Document 2337455.1> for information regarding that.
A complete listing of all the 6.1.X bugfixes can be found in the "README.txt" of the patch download bundle.
New Features in the 6.1-03 Release:
New Features in the 6.1-02 Release:
* Media migration between tape and cloud over network
Add cloud migration feature to support migrate data from local tapes to the Oracle Storage Cloud. A new cloud_timeout directive has been added to the migrationd.cmd configuration file to manage the cloud error. See the migrationd.cmd(4) man page for more information.
* Increase cloud/synthetic drive max CLOUD_DRIVES_MAX to larger number
The number of cloud drives/streams has been increased from 4 to 16.
* cloud encryption
Updated cloud libraries with client-side data encryption for data stored in the cloud. The key polices and access to the encryption keys are user controlled. The keystores supported by the cloud library are the Solaris PKCS#11 providers or a read only keystore file. See Important Notes below and the cloud(7) man page for more information.
* Allow Oracle HSM to connect to Swift to use it as a tier of storage
The cloud archive feature now supports connecting to a private OpenStack Swift in addition to the Oracle Storage Cloud. See cloud(7) and the documentation library for more details.
* Request for Oracle HSM / QFS to be qualified with Oracle Linux 7
This feature adds support for Oracle Linux 7 along with other products based on Red Hat Enterprise Linux 7.
* Provide Oracle HSM RPC specification file
Add an RPC specification file for customers wanting to use RPC calls in non-C applications.
* Staging Statistics API
Add an API to provide an estimate of how long a file will take to stage if offline, or how long it's been online. See sam_stage_status(3).
* Add LTO-7+ CRC32C CRC support
* pmv file system scan
Improved Periodic Media Validation (PMV) file system scan for finding files backed by bad blocks on tape. Update the sam_media_api(3) with PMV on-demand file system scan routines and media validation. Updated pmv shutdown routine to cancel media validations in the drive mount state.
* Media migration to support additional copies of tape.
Add add_copy n option to the migrate directive. migrate = [ add_copy n ] from src-type src-list to dstn-type dstn-list
Where n can be 0, 1, 2, 3 or 4. 0: additional copy is created using any empty slot. 1, 2, 3 or 4: copy number specified.
If no copy slot is available for 0 or copy is already created for 1 - 4, no copy will be done and the warning message is logged to the event log, /var/opt/SUNWsamfs/sammig/logfile.
* Query for Whether Archiver is Running
A sam_archiverd_status() function was added to the sam_media_api(3) to determine if archiving is stopped or running for a given filesystem; the function returns 0 if archiving is available for the given filesystem.
New Features in the 6.1-01 Release:
* Provide a REST API for libsam
* Media Validation API
This feature provides a libsam.so API to gather information about file systems, devices, media catalogs, media validation file defects, and the ablity to schedule on demand media validation. See the intro_libsam(3), sam_media_api(3), verifyd.cmd(4), tpverify(1M), and backto(1M) man pages for more information.
* Add Oracle Storage Cloud as an archive target
Add cloud archive feature. Synthetic/cloud library support added to talk to Oracle Storage Cloud. Both Archive Service and Object Service features of the Oracle Storage Cloud are supported. See the man pages cloud(7), sam-cloudd(1m), sam-robotsd(1m), mcf(4), samu(1m), and recycler.cmd(4) for more information.
New Features in the 6.1 Base Release:
* Fixity and enhanced ssum algorithms
This release adds additional message-digest algorithm hash functions that can be used when archiving and restoring to offline storage. See the ssum(1) and sam_ssum(3) man pages for usage of the new algorithms. Both the command and API call require that an 'a' option be specified to change from the default Oracle HSM checksum.
In addition, with support for additional message-digest algorithms, an option to support file fixity has been added to the command and API. With the fixity attribute set on a file, a file is made immutable after its message-digest hash value has been calculated. The file's hash value is checked when it is archived and restored to ensure that its contents have not been changed.
* Increased LUN sizes up to 128TiB-1
Disk LUNs 16 TiB (2^44 bytes) or larger but less than 128 TiB (2^47) can now be used by QFS. Filesystems that contain large luns cannot be mounted on versions prior to this release. Filesystems that do not contain large luns maintain compatibility with previous versions of QFS.
Large LUNs can also be added to existing filesystems through online or offline grow. In this case the filesystem can no longer be mounted on systems using earlier versions of QFS. A recent samfsdump/qfsfsdump before growing the filesystem is needed if the ability to use an earlier version of QFS is required.
* Optimize Small Extended Attributes Files
Small extended attribute files, those having a size less than or equal to 464 characters, are now stored in an extension inode instead of a block in the file system's data storage pool. Typically, extended attribute files are small so this feature reduces the amount of storage needed to store the file. In addition, the time needed to complete a 'samfsdump' is reduced if the file system's metadata is stored on faster devices than the data storage.
* Media migration functionality
A new daemon, sam-migrationd, provides the capability to migrate HSM archive media between different type.
The sam-migrationd daemon migrates tape volumes from one media to another. In general it is intended to migrate files from older tape media to newer so that the older media can be decomissioned. Previously, this kind of migration was done by marking files for rearchiving and letting the archiver and stager migrate the data.
The sam-migrationd does not use the archiver or stager. It copies archive copies from the migration source media to the target media directly without archiving or staging.
In addition, the sam-migrationd daemon supports two copy modes: server copy and direct copy. The server mode copies tape blocks via the metadata server. In server copy mode, the metadata server mounts source and destination tapes and copies the data through the metadata server. The copy will be performed a (tar) file at a time for server copy mode.
The direct copy mode copies tape blocks by the StorageTek T10000D Extended Copy feature. The Extended Copy feature copies data directly between two tape drives without passing the data through any server.
See the sam-migrationd(1M) and migration.cmd(4) man pages for more detail.
* Provide the HSM API calls on Linux platforms through RPC calls
The ability to perform SAM API calls on Linux using the RPC interface is provided in this release.
* Optimize small file archiving by issuing multiple async prefetches
This feature allows the archiver to begin reading multiple small files from the filesystem before they are encountered in the archive request. This allows more efficient scheduling and increases the parallelism of disk IO.
* Rolling upgrades
Normal policy for a rolling upgrade allows a Metadata Server (MDS) and client to differ by only one level. Typically this would mean that 6.1 would interoperate with 6.0 only. However, because the
6.0 release was nearly identical to the 5.4 release, the 6.1 release will accept a rolling upgrade from 5.4 also as a special case.
* Firmware level
In general, it is good practice to keep up to date on tape, library, and storage firmware. General improvements, bug fixes, and security patches are distributed routinely through new firmware releases.
Important: If you intend to use the media migration feature (new to this release) or the distributed I/O feature, contact Oracle service for advice on what firmware level to be using for the T10000D tape drives.
* Distributed I/O:
It is important to note when running distributed I/O, that datamover clients should not have the command "samd start" executed. The datamover daemon does not depend on the HSM daemons running, and if "samd start" is executed, it will cause unexpected conflicts with the underlying tape devices.
Also, only the MDS has a complete picture of the status, and so samu should be run from the MDS in order to get datamover status. The samu command on the datamover clients will not show tape drive status. This may be changed in a future release.
* Cloud Library:
To use the cloud library the JDK7 must be installed: pkg install developer/java/jdk-7
The latest version of JDK7 is available through My Oracle Support which requires support login.
To use the client-side data encryption the Java Cryptography Extension (JCE) Unlimited Strength Files 7 must be down loaded then installed into the
* Linux mount Command Options:
Beginning with Oracle HSM 6.1.2 release the "shared" option is optional for all mounts on Linux systems. For Oracle Linux 5 and 6, the "shared" option remains available. On Oracle Linux 7 the shared option is reserved for use by the system and should not be specified. See mount(8).
Oracle StorageTek SL4000 library (with 6.1-02 patch), for direct attach only.
Oracle StorageTek ACSLS 8.4.0
IBM LTO-7 tape drive, firmware version F8E0.
IBM Ultrium 8 Tape Drive (LTO-8).
IBM TS3500 tape library, firmware version F02b7800.
IBM TS4500 tape library, firmware version 12001300.
IBM TS1150 tape drive, firmware version 45201300.
To use the IBM TS1150 tape drive, update the st tape driver configuration by merging the following lines into the /kernel/drv/st.conf file, then running the 'update_drv st' command or rebooting the system.
tape-config-list = \
"IBM 03592E08", "IBM 03592E08 ", "CFGIBM03592E08";
CFGIBM03592E08 = 2,0x3B,0,0x1018619,4,0x54,0x54,0x55,0x55,3,60,1440,560,1320,760,760,46000;
For details on the previous HSM 6.1-01 patch release, see <Document 2240438.1>.
For details on the HSM 6.1 Base release, see <Document 2124212.1>.
To download the HSM 6.1-03 release:
Sign into the Oracle Software Delivery Cloud site and select 'All Categories' on the left side. In the box on the right type in "QFS" and it will provide different product name selections. Select "StorageTek QFS". Then select "Oracle Hierarchical Storage Manager Release 18.104.22.168.0". It will say "Added to Cart".
Click on the shopping cart icon that says "Selected Software". Then click on 'Platforms/Languages' and choose one of the Solaris 64-bit choices.
Scroll down on the page and click on 'Continue'. The next screen will show the Oracle Standard Terms and Restrictions. Scroll all the way down and check the box saying you've reviewed the terms and restrictions. Now click on 'Continue'. The next screen will show you have selected either "V974440-01.zip Replaces HSM 22.214.171.124.0 with HSM 126.96.36.199.0. This code removes one change from the previous file set., 253.6 MB" or "V974441-01.zip Replaces QFS 188.8.131.52.0 with QFS 184.108.40.206.0. This code removes one change from the previous file set., 218.2MB"
Click on 'Download'.
For assistance with upgrading to the 6.1-03 release:
After installation, this release will report itself with a build id of '6.1.45'.
The HSM 6.1-03 Release Notes can be found within the downloaded zip file, in a file titled "README.txt".
The entire Oracle HSM 6.1 documentation library can be found here. This is the same link as it's been for the HSM 6.1 documentation but the documents found there have been updated for the 6.1-03 release.
To view full details, sign in with your My Oracle Support account.
Don't have a My Oracle Support account? Click to get started!
In this Document
|New Features in the 6.1-03 Release:|
|New Features in the 6.1-02 Release:|
|New Features in the 6.1-01 Release:|
|New Features in the 6.1 Base Release:|
|To download the HSM 6.1-03 release:|
|For assistance with upgrading to the 6.1-03 release:|