Solaris Cluster Cannot Mount Shared Filesystem and Shows "Trying an overlay mount" and "is already mounted" (Doc ID 1003633.1)

Last updated on APRIL 06, 2017

Applies to:

Solaris Cluster - Version 3.0 to 4.3 [Release 3.0 to 4.3]
Oracle Solaris on SPARC (64-bit)
Oracle Solaris on x86-64 (64-bit)

Symptoms

It was attempted to failover a resource group to the second node in the Solaris Cluster. The data services could not start on the second node because it could not mount the HA shared filesystems because the filesystems were either already mounted, busy or had exceeded the allowable number of mount points.


On the node trying to bring up the data services:

Mar  5 05:58:14 nodeB Cluster.RGM.rgmd: [ID 707948 daemon.notice] launching method <hafoip_prenet_start> for resource <ncmdalclus001>, resource group <samba-rg>, timeout <300> seconds
Mar  5 05:58:14 nodeB Cluster.RGM.rgmd: [ID 148023 daemon.notice] method <hafoip_prenet_start> completed successfully for resource <ncmdalclus001>, resource group <samba-rg>
Mar  5 05:58:14 nodeB Cluster.RGM.rgmd: [ID 707948 daemon.notice] launching method <hastorageplus_prenet_start> for resource <samba-has-rs>, resource group <samba-rg>, timeout <1800> seconds
Mar  5 05:58:16 nodeB Cluster.Framework: [ID 801593 daemon.notice] stdout: becoming primary for samba
Mar  5 05:58:17 nodeB NWS.[reconfig]: [ID 702911 daemon.notice] starting: reconfig start samba
Mar  5 05:58:18 nodeB sv: [ID 443358 kern.info] sv Oct 23 2003 12:44:44 (revision 3.2, 3.2.0_5.9, 10.23.2003)
Mar  5 05:58:18 nodeB pseudo: [ID 129642 kern.info] pseudo-device: sv0
Mar  5 05:58:18 nodeB genunix: [ID 936769 kern.info] sv0 is /pseudo/sv@0
Mar  5 05:58:18 nodeB NWS.[reconfig:25scmhints]: [ID 702911 daemon.notice] Completing SCM startup: done
Mar  5 05:58:18 nodeB NWS.[reconfig]: [ID 702911 daemon.notice] completed: reconfig start samba
Mar  5 05:58:21 nodeB SC[SUNWscstp.prenet_start]:samba-rg:samba-has-rs: [ID 338915 user.error] Mount of /samba_dal/group failed. Trying an overlay mount. (32)
Mar  5 05:58:22 nodeB SC[SUNWscstp.prenet_start]:samba-rg:samba-has-rs: [ID 925320 user.error] Mount of /samba_dal/global failed. Trying an overlay mount. (32)
Mar  5 05:58:22 nodeB SC[SUNWscstp.prenet_start]:samba-rg:samba-has-rs: [ID 529540 user.error] mount: /dev/md/samba/dsk/d30 is already mounted, /samba_dal/global is busy,
Mar  5 05:58:22 nodeB or the allowable number of mount points has been exceeded
Mar  5 05:58:23 nodeB SC[SUNWscstp.prenet_start]:samba-rg:samba-has-rs: [ID 908802 user.error] Mount of /samba_dal/install failed. Trying an overlay mount. (32)
Mar  5 05:58:23 nodeB SC[SUNWscstp.prenet_start]:samba-rg:samba-has-rs: [ID 132463 user.error] mount: /dev/md/samba/dsk/d50 is already mounted, /samba_dal/install is busy,
Mar  5 05:58:23 nodeB or the allowable number of mount points has been exceeded



The 'fuser' command found no active processes on this mount point.  No one was in the directory and the filesystems were not already mounted on this node.  Tried removing the directory and recreating the directory mount point.  Then the filesystems would successfully mount.

When we rebooted, the filesystems could no longer be mounted, having the same problems as above.

Cause

Sign In with your My Oracle Support account

Don't have a My Oracle Support account? Click to get started

My Oracle Support provides customers with access to over a
Million Knowledge Articles and hundreds of Community platforms