There are many hung “asmcmd daemon” processes with high CPU usage.
$top PID USER PR NI VIRT RES SHR %CPU %MEM TIME+ COMMAND 71337 grid 20 0 5717400 5.2g 1044 43.0 0.7 1:07.71 asmcmd daemon 137157grid 20 0 4751716 4.4g 14880 41.0 0.6 5:43.21 asmcmd daemon 76530 grid 20 0 5671444 5.2g 1044 40.4 0.7 2:46.47 asmcmd daemon 96115 grid 20 0 4750220 4.3g 1044 40.4 0.6 5:00.40 asmcmd daemon 81230 grid 20 0 5704468 5.2g 1036 39.7 0.7 3:58.48 asmcmd daemon ... .. .
$ ps -eaf | grep -i asmcmd grid 71337 1 40 Aug06 ? 13:01:13 asmcmd daemon grid 76530 1 40 Aug06 ? 13:02:52 asmcmd daemon grid 81230 1 40 Aug06 ? 13:04:04 asmcmd daemon grid 96115 1 40 Aug06 ? 09:35:06 asmcmd daemon grid 115047 81230 0 09:33 ? 00:00:00 sh -c /u01/app/12.2.0.1/grid/bin /clsecho -t -o /u01/app/12.2.0.1/grid/log/diag/asmcmd/user_grid/ racnode1/alert/alert.log "ASMCMD Background (PID = 81230) 2> /tmp/clsecho_stderr_file.txt grid 115058 76530 0 09:33 ? 00:00:00 [asmcmd daemon] grid 115060 126727 0 09:33 ? 00:00:00 [asmcmd daemon] ... .. .
WORKAROUND
1)Kill the “asmcmd daemon” processes.
2) Upgrade Trace File Analyzer (TFA) to the latest version.