How to: troubleshooing Oracle Clusterware is not up

Symptoms:

After server boots up, Oracle clusterware does not startup successfully.

Error message: (Case 1)

/var/log/messages

Oct  9 10:08:24 VMXDB03 logger: Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.10862.

/tmp/crsctl.10862

OCR initialization failed accessing OCR device: PROC-26: Error while accessing the physical storage Operating System error [No such file or directory] [2]

Possbile Causes:

OCR device does not exist or it's not accessible


Error message: (Case 2)

/var/log/messages

Oct  9 10:08:24 VMXDB03 logger: Cluster Ready Services waiting on dependencies. Diagnostics in /tmp/crsctl.11713.

/tmp/crsctl.11713

OCR initialization failed with invalid format: PROC-22: The OCR backend has an invalid format

Possbile Causes:

OCR device corrupted, or it's not the correct device due to issues of PowerPath/Linux Divice-Mapper.