Materialized View : OEM Monitoring and Alerting through Metric Extension( ME ), Incident Rule ( IR ) and Self Healing through Corrective Action( CA )

In previous posts, we have created following related posts to monitor FRA and auto backup archive logs:

  1. Create a Metric Extension (ME) to Monitor FRA Usage on OEM
  2. Create an Incident Rule for Metric Extension ( ME ) to Monitor FRA Used in OEM
  3. Use Corrective Action ( CA ) to Automate Archivelog Backup When FRA Usage is Over Threshold of Metric Extension ( ME ) in OEM

In this post, we will do the same thing for Materialized Views to monitor, alert and self heal the materialized views.

Subscribe to get access

Read more of this content when you subscribe today.

OEM Agent Home Page Shows ” Communication between the Oracle Management Service to the Agent is unavailable. Any features or displayed information requiring this communication will be unavailable”

After OMS upgraded to 13.4, the agent home pages are showing the following error:

Communication between the Oracle Management Service to the Agent is unavailable. Any features or displayed information requiring this communication will be unavailable

WORKAROUND

This is known issue because of SSLCipherSuites compatibility issue between OMS and Agents after OMS upgrading.

Run the following commands on EM agent server to resolve this issue:

$ emctl status agent

$ emctl pingOMS

$ emctl getproperty agent -name SSLCipherSuites
Oracle Enterprise Manager Cloud Control 13c Release 2
Copyright (c) 1996, 2016 Oracle Corporation.  All rights reserved.
SSLCipherSuites is unset; default value is SSL_RSA_WITH_RC4_128_MD5:SSL_RSA_WITH_RC4_128_SHA:SSL_RSA_WITH_3DES_EDE_CBC_SHA

$ emctl setproperty agent -name SSLCipherSuites -value TLS_RSA_WITH_AES_128_CBC_SHA:TLS_RSA_WITH_AES_256_CBC_SHA:RSA_WITH_AES_256_CBC_SHA256
Oracle Enterprise Manager Cloud Control 13c Release 2
Copyright (c) 1996, 2016 Oracle Corporation.  All rights reserved.
EMD setproperty succeeded

$ emctl getproperty agent -name SSLCipherSuites
Oracle Enterprise Manager Cloud Control 13c Release 2
Copyright (c) 1996, 2016 Oracle Corporation.  All rights reserved.
SSLCipherSuites=TLS_RSA_WITH_AES_128_CBC_SHA:TLS_RSA_WITH_AES_256_CBC_SHA:RSA_WITH_AES_256_CBC_SHA256

$ emctl stop agent

$ emctl start agent 

How to Resolve OEM Agent ‘Availability Evaluation Error’

The following commands helped a client to resolve OEM agent “Availability Evaluation Error”. Just run them in sequence until the issue is resolved.

$ ping omshost
$ nslookup omshost
$ emctl pingOMS
$ emctl config agent addinternaltargets
$ emctl secure agent
$ emctl config agent listtargets
$ emctl clearstate agent

$ emctl upload agent
$ emctl reload agent

The agent should show UP now, otherwise continues the following steps:

$ emctl stop agent
$ emctl secure agent
$ emctl clearstate agent
$ emctl secure agent
$ emctl start agent
$ emctl upload agent 
$ emctl reload agent

$ emctl pingOMS 
$ emctl status agent

How to Reinstall and Configure OEM Cloud Control 13c Central Agent 

For some reason, a client has to reinstall OEM central agents in a multi-OMS Oracle Enterprise Manager Cloud Control environment. Certainly the agent has been installed on the same server as the OMS.

First keep a record of the plugins deployed onto the agent already.

$emctl listplugins agent

Then uninstall the agent cleanly as per How to Deinstall OEM Agents in Oracle Enterprise Manager 13C

The next is to install the agent with required plugins deployed.

Now we need discover all WebLogic Domain targes based on the following instructions, and then all those targets will be monitored by the central agent.

Subscribe to get access

Read more of this content when you subscribe today.

ERROR: com.oracle.cie.gdr.utils.GdrException: Unable to find distribution xml file in distributions directory /tmp/sfx_TbqwSX/Disk1/stage

While upgrading OMS by running the following command, and the errors occur:

$ ./em13400_linux64.bin
Launcher log file is /tmp/OraInstall2021-09-14_10-33-04AM/launcher2021-09-14_10-33-04AM.log.
Extracting the installer . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . . Done
Checking monitor: must be configured to display at least 256 colors.   Actual 16777216    Passed
Checking swap space: must be greater than 512 MB.   Actual 4095 MB    Passed
Checking if this platform requires a 64-bit JVM.   Actual 64    Passed (64-bit not required)
Preparing to launch the Oracle Universal Installer from /tmp/OraInstall2021-09-14_10-33-04AM
====Prereq Config Location main===
...
..
.
ERROR: com.oracle.cie.gdr.utils.GdrException: Unable to find distribution xml file in distributions directory /tmp/sfx_TbqwSX/Disk1/stage



The log(s) can be found here: /tmp/OraInstall2021-09-14_10-33-04AM.
ERROR: Installer execution failed (102).

WORKAROUND

Quit the current installer, and rerun it again:

$ ./em13400_linux64.bin
Launcher log file is /tmp/OraInstall2021-09-14_11-24-24AM/launcher2021-09-14_11-24-24AM.log.
Extracting the installer . . . . . . . . . . . . . . . . . . . . . . . Done
Checking monitor: must be configured to display at least 256 colors.   Actual 16777216    Passed
Checking swap space: must be greater than 512 MB.   Actual 4095 MB    Passed
Checking if this platform requires a 64-bit JVM.   Actual 64    Passed (64-bit not required)
Preparing to launch the Oracle Universal Installer from /tmp/OraInstall2021-09-14_11-24-24AM
====Prereq Config Location main===
...
..
.
***
update handshake state: finished[20]
upcoming handshake states: server change_cipher_spec[-1]
upcoming handshake states: server finished[20]
Tunneling Response Thread, WRITE: TLSv1.2 Handshake, length = 96
Tunneling Response Thread, READ: TLSv1.2 Change Cipher Spec, length = 1
update handshake state: change_cipher_spec
upcoming handshake states: server finished[20]
Tunneling Response Thread, READ: TLSv1.2 Handshake, length = 96
check handshake state: finished[20]
update handshake state: finished[20]
*** Finished
verify_data:  { 76, 49, 93, 34, 108, 97, 161, 214, 175, 4, 221, 224 }
***
%% Cached client session: [Session-5, TLS_ECDHE_RSA_WITH_AES_256_CBC_SHA384]
Thread-84, WRITE: TLSv1.2 Application Data, length = 384
Tunneling Response Thread, READ: TLSv1.2 Application Data, length = 1904
Thread-84, WRITE: TLSv1.2 Application Data, length = 384
Tunneling Response Thread, READ: TLSv1.2 Application Data, length = 736
Thread-84, WRITE: TLSv1.2 Application Data, length = 352
Tunneling Response Thread, READ: TLSv1.2 Application Data, length = 96
Thread-84, WRITE: TLSv1.2 Application Data, length = 560
Tunneling Response Thread, READ: TLSv1.2 Application Data, length = 848
Thread-84, WRITE: TLSv1.2 Application Data, length = 832
Tunneling Response Thread, READ: TLSv1.2 Application Data, length = 800
Thread-84, WRITE: TLSv1.2 Application Data, length = 384
Tunneling Response Thread, READ: TLSv1.2 Application Data, length = 176
detachHome was successful.
Logs successfully copied to /u01/app/oraInventory/logs.