My Oracle Support Banner

Rootupgrade was failing as ohasd startup failing with proas_amiwriter on startup (Doc ID 2706102.1)

Last updated on SEPTEMBER 03, 2020

Applies to:

Oracle Database - Enterprise Edition - Version 12.2.0.1 and later
Information in this document applies to any platform.

Symptoms

 While upgrading cluster to 12.1.0.2 to 19.7 , last node upgrade was failing while
starting up ohasd .

2020-08-30 15:33:18.248 : OCRSRV:433796864: proas_amiwriter: ctx is in some other state
2020-08-30 15:33:18.258 : OCRSRV:435898112: proas_amiwriter: ctx is in some other state
2020-08-30 15:33:18.266 : OCRSRV:437999360: proas_amiwriter: ctx is in some other state
2020-08-30 15:33:18.298 : OCRSRV:433796864: proas_amiwriter: ctx is in some other state
2020-08-30 15:33:18.309 : OCRSRV:435898112: proas_amiwriter: ctx is in some other state
2020-08-30 15:33:18.316 : OCRSRV:437999360: proas_amiwriter: ctx is in some other state
2020-08-30 15:33:18.348 : OCRSRV:433796864: proas_amiwriter: ctx is in some other state
OCRSRV:435898112: proas_open: proas_amiwriter returned [3]
OCRSRV:435898112: proas_open: returned [32]
2020-08-30 15:33:18.359 : OCRUTL:435898112: Time Elapsed 181
2020-08-30 15:33:18.359 : default:435898112: prou_print_lock_info:tid [435898112] t_lock_acq [0] t_lock_rel [0] t_lock_hld [0] t_lock_wait [0]
2020-08-30 15:33:18.359 : default:435898112: LIST_LOGS:[435898112]: 2020-08-30 15:30:17.977: proath_dump_request: RECEIVED MESSAGE FROM CLIENT: op_id:[3][PROA_OPEN] Keyname:[SYSTEM.crs.authloc] Nodenum:[0] Type:[2] Username:[root] Groupname:[root]
2020-08-30 15:33:18.359 : default:435898112: LIST_LOGS:[435898112]: 2020-08-30 15:30:17.977: major prot '2' : mnor prot '0': type '2' : op_id '3'
2020-08-30 15:33:18.359 : default:435898112: LIST_LOGS:[435898112]: 2020-08-30 15:30:17.977: Proc id '202703': Proc name 'CRSCTL'
2020-08-30 15:33:18.359 : default:435898112: LIST_LOGS:[435898112]: 2020-08-30 15:30:17.977: th_process_request: Calling proas_open
2020-08-30 15:33:18.359 : default:435898112: LIST_LOGS:[435898112]: 2020-08-30 15:33:18.359: prom_send: Before gipcSend
2020-08-30 15:33:18.359 : default:435898112: LIST_LOGS:[435898112]: 2020-08-30 15:33:18.359: prom_send: gipcSend suceeded
2020-08-30 15:33:18.359 : default:435898112: LIST_LOGS:[435898112]: 2020-08-30 15:33:18.359: th_process_request: Completed op [3] return [0]
2020-08-30 15:33:18.359 : default:435898112: LIST_LOGS:[435898112]: 2020-08-30 15:33:18.359: th_select_w_f_t: Processed request constr [0000000000000374] retval [0]
2020-08-30 15:33:18.366 : OCRSRV:437999360: proas_amiwriter: ctx is in some other state
2020-08-30 15:33:18.398 : OCRSRV:433796864: proas_amiwriter: ctx is in some other state
OCRSRV:431695616: proas_amiwriter: Using constant timeout with [3600] iterations.
2020-08-30 15:33:18.410 : OCRSRV:431695616: proas_amiwriter: ctx is in some other state
2020-08-30 15:33:18.416 : OCRSRV:437999360: proas_amiwriter: ctx is in some other state
2020-08-30 15:33:18.448 : OCRSRV:433796864: proas_amiwriter: ctx is in some other state
2020-08-30 15:33:18.460 : OCRSRV:431695616: proas_amiwriter: ctx is in some other state
2020-08-30 15:33:18.466 : OCRSRV:437999360: proas_amiwriter: ctx is in some other state
2020-08-30 15:33:18.498 : OCRSRV:433796864: proas_amiwriter: ctx is in some other state
2020-08-30 15:33:18.510 : OCRSRV:431695616: proas_amiwriter: ctx is in some other state
2020-08-30 15:33:18.516 : OCRSRV:437999360: proas_amiwriter: ctx is in some other state
2020-08-30 15:33:18.549 : OCRSRV:433796864: proas_amiwriter: ctx is in some other state
2020-08-30 15:33:18.560 : OCRSRV:431695616: proas_amiwriter: ctx is in some other state
2020-08-30 15:33:18.566 : OCRSRV:437999360: proas_amiwriter: ctx is in some other state

#0 0x00007f7926615e9d in nanosleep () from /lib64/libpthread.so.0
#1 0x00007f7920b0d736 in sltrusleep () from <19.7 GRID_HOME>/lib/libclntshcore.so.19.1
#2 0x00007f7926175ef8 in promsleep (millisec=50) at prom.c:1353
#3 0x00007f7926150937 in proas_amiwriter (cssctx=0x5648fc1c6b40, iamwriter=0x7f7919b9c808) at proas.c:1700
#4 0x00007f7926159982 in proas_open (procctx=0x5648fc1cf2e8, req_msg=0x5648fc1cf4c4, flags=0) at proas.c:4929
#5 0x00007f7926127c4f in proath_process_request (procctx=0x5648fc1cf2e8) at proath.c:9797
#6 0x00007f792612552b in proath_select_wait_for_request (arg=0x5648fc1c9ab8) at proath.c:9008
#7 0x00007f792660eea5 in start_thread () from /lib64/libpthread.so.0
#8 0x00007f791db748cd in clone () from /lib64/libc.so.6
Thread 1 (Thread 0x7f792b08a180 (LWP 202759)):
#0 0x00007f7926612a35 in pthread_cond_wait@@GLIBC_2.3.2 () from /lib64/libpthread.so.0
#1 0x00007f7920a325c2 in sltspcwait () from <19.7 GRID_HOME>/lib/libclntshcore.so.19.1
#2 0x00007f7924f6da67 in clsgLock () from <19.7 GRID_HOME>/lib/libhasgen19.so
#3 0x00007f79260f6106 in procr_init_ext2 (ocrctx=0x7ffe6e1cc5b8, bootlevel=458752, errorbuf=0x7ffe6e1dc5bf "", errorbuf_sz=0x7ffe6e1cc5a0, arg=0x7ffe6e1cc570) at procr.c:716
#4 0x00007f79260f5f75 in procr_init_ext (ocrctx=0x7ffe6e1cc5b8, bootlevel=458752, errorbuf=0x7ffe6e1dc5bf "", errorbuf_sz=0x7ffe6e1cc5a0, flags=0) at procr.c:586
#5 0x00007f7924fb7c28 in clsm_is_unicast_mode () from <19.7 GRID_HOME>/lib/libhasgen19.so
#6 0x00007f79252ad6b9 in clsgpnpm_connect () from <19.7 GRID_HOME>/lib/libhasgen19.so
#7 0x00007f792529b11c in clsgpnpDaemonFind () from <19.7 GRID_HOME>/lib/libhasgen19.so
#8 0x00007f792529ae6b in clsgpnp_getDaemon () from <19.7 GRID_HOME>/lib/libhasgen19.so
#9 0x00007f7925294ccf in clsgpnp_getProfileEx () from <19.7 GRID_HOME>/lib/libhasgen19.so
#10 0x00007f7924f756d7 in clsuGpnpgGetGlobProfile () from <19.7 GRID_HOME>/lib/libhasgen19.so
#11 0x00007f7924f7d2cb in clsu_get_cluster_id () from <19.7 GRID_HOME>/lib/libhasgen19.so
#12 0x00007f7925439225 in clscal_write_init () from <19.7 GRID_HOME>/lib/libhasgen19.so
#13 0x00007f7925437eb5 in clscal_writeaX () from <19.7 GRID_HOME>/lib/libhasgen19.so
#14 0x00007f7925002ee3 in clsdadrpr_writeCalogActivity () from <19.7 GRID_HOME>/lib/libhasgen19.so
#15 0x00007f7925002bd6 in clsdadrprAlert () from <19.7 GRID_HOME>/lib/libhasgen19.so
#16 0x00007f7924fee7d3 in clsd_alertprintft () from <19.7 GRID_HOME>/lib/libhasgen19.so
#17 0x00007f79260d3812 in proa_init (ocrctx=0x7ffe6e1e3d18, meta=0x5648fbf0aaa0, slts_ctx=0x5648fbd68370, bootlevel=1, errorbuf=0x7ffe6e1e3d28 "\240>\036n\376\177", errorbuf_sz=0x7ffe6e1e3d10, arg=0x0) at proa.c:1735
#18 0x00007f79260f639f in procr_init_ext2 (ocrctx=0x7ffe6e1e3d18, bootlevel=65536, errorbuf=0x7ffe6e1e3d28 "\240>\036n\376\177", errorbuf_sz=0x7ffe6e1e3d10, arg=0x0) at procr.c:770
#19 0x00007f7926c853e9 in caaocrinitctx(unsigned int, std::string*, void*, bool) () from <19.7 GRID_HOME>/lib/libcrs19.so
#20 0x00007f7926c914ea in CAA::initmain(int, unsigned char**, void (*)()) () from <19.7 GRID_HOME>/lib/libcrs19.so
#21 0x00007f7925467c83 in clsbCMain () from <19.7 GRID_HOME>/lib/libhasgen19.so
#22 0x00005648faa798bc in main ()

It was failing as gpnp profile xml file and wallets directory related files were not present.

Cause

To view full details, sign in with your My Oracle Support account.

Don't have a My Oracle Support account? Click to get started!


In this Document
Symptoms
Cause
Solution

My Oracle Support provides customers with access to over a million knowledge articles and a vibrant support community of peers and Oracle experts.