Skip to content

Installing OIA (Operations Intelligence & Analytics)

This document provides instructions about fresh Installation & Upgrades for OIA application (Operations Intelligence & Analytics, a.k.a AIOps). It is an application that is installed on top of RDA Fabric platform.

1. Setup & Install

Pre-requisites:

Below are the pre-requisites which need to be in place before installing the OIA (AIOps) application services.

RDAF Deployment CLI Version: 1.4.0

RDAF Infrastructure Services Tag Version: 1.0.3 / 1.0.3.3 (haproxy)

RDAF Core Platform & Worker Services Tag Version: 8.0.0

RDAF Client (RDAC) Tag Version: 8.0.0

Warning

Please complete all of the above pre-requisites before installing the OIA (AIOps) application services.

Login as rdauser user into on-premise docker registry or RDA Fabric Platform VM on which RDAF deployment CLI was installed (ex: putty)

Run the below rdaf or rdafk8scommand, to make sure all of the RDAF infrastructure services are up and running.

rdafk8s infra status
rdaf infra status

Run the below rdac pods command, to make sure all of the RDAF core platform and worker services are up and running.

rdac pods
+-------+----------------------------------------+----------------+----------+-------------+----------+--------+--------------+---------------+--------------+
| Cat   | Pod-Type                               | Host           | ID       | Site        | Age      |   CPUs |   Memory(GB) | Active Jobs   | Total Jobs   |
|-------+----------------------------------------+----------------+----------+-------------+----------+--------+--------------+---------------+--------------|
| App   | asset-dependency                       | rda-asset-depe | 090669bf |             | 20:18:21 |      8 |        47.03 |               |              |
| App   | authenticator                          | rda-identity-5 | 57905b20 |             | 20:19:11 |      8 |        47.03 |               |              |
| App   | cfxdimensions-app-access-manager       | rda-access-man | 6338ad29 |             | 20:18:44 |      8 |        47.03 |               |              |
| App   | cfxdimensions-app-notification-service | rda-notificati | bb9e3e7b |             | 20:09:52 |      8 |        31.33 |               |              |
| App   | cfxdimensions-app-resource-manager     | rda-resource-m | e5a28e16 |             | 20:18:34 |      8 |        47.03 |               |              |
| App   | user-preferences                       | rda-user-prefe | fd09d3ba |             | 20:18:08 |      8 |        47.03 |               |              |
| Infra | api-server                             | rda-api-server | b1b910d9 |             | 20:19:22 |      8 |        47.03 |               |              |
| Infra | collector                              | rda-collector- | 99553e51 |             | 20:18:17 |      8 |        47.03 |               |              |
| Infra | registry                               | rda-registry-7 | a46cd712 |             | 20:19:15 |      8 |        47.03 |               |              |
| Infra | scheduler                              | rda-scheduler- | d5537051 | *leader*    | 20:18:26 |      8 |        47.03 |               |              |
| Infra | worker                                 | rda-worker-54d | 1f769792 | rda-site-01 | 20:06:48 |      4 |        15.6  | 0             | 0            |
+-------+----------------------------------------+----------------+----------+-------------+----------+--------+--------------+---------------+--------------+

Run the below rdac healthcheck command to check the health status of all of the RDAF core platform and worker services.

All of the dependency checks should show as ok under Status column.

rdac healthcheck
+-----------+----------------------------------------+--------------+----------+-------------+-----------------------------------------------------+----------+-------------------------------------------------------+
| Cat       | Pod-Type                               | Host         | ID       | Site        | Health Parameter                                    | Status   | Message                                               |
|-----------+----------------------------------------+--------------+----------+-------------+-----------------------------------------------------+----------+-------------------------------------------------------|
| rda_infra | api-server                             | rda-api-serv | b1b910d9 |             | service-status                                      | ok       |                                                       |
| rda_infra | api-server                             | rda-api-serv | b1b910d9 |             | minio-connectivity                                  | ok       |                                                       |
| rda_app   | asset-dependency                       | rda-asset-de | 090669bf |             | service-status                                      | ok       |                                                       |
| rda_app   | asset-dependency                       | rda-asset-de | 090669bf |             | minio-connectivity                                  | ok       |                                                       |
| rda_app   | authenticator                          | rda-identity | 57905b20 |             | service-status                                      | ok       |                                                       |
| rda_app   | authenticator                          | rda-identity | 57905b20 |             | minio-connectivity                                  | ok       |                                                       |
| rda_app   | authenticator                          | rda-identity | 57905b20 |             | DB-connectivity                                     | ok       |                                                       |
| rda_app   | cfxdimensions-app-access-manager       | rda-access-m | 6338ad29 |             | service-status                                      | ok       |                                                       |
| rda_app   | cfxdimensions-app-access-manager       | rda-access-m | 6338ad29 |             | minio-connectivity                                  | ok       |                                                       |
| rda_app   | cfxdimensions-app-access-manager       | rda-access-m | 6338ad29 |             | service-dependency:registry                         | ok       | 1 pod(s) found for registry                           |
| rda_app   | cfxdimensions-app-access-manager       | rda-access-m | 6338ad29 |             | service-initialization-status                       | ok       |                                                       |
| rda_app   | cfxdimensions-app-access-manager       | rda-access-m | 6338ad29 |             | DB-connectivity                                     | ok       |                                                       |
| rda_app   | cfxdimensions-app-notification-service | rda-notifica | bb9e3e7b |             | service-status                                      | ok       |                                                       |
| rda_app   | cfxdimensions-app-notification-service | rda-notifica | bb9e3e7b |             | minio-connectivity                                  | ok       |                                                       |
| rda_app   | cfxdimensions-app-notification-service | rda-notifica | bb9e3e7b |             | service-initialization-status                       | ok       |                                                       |
| rda_app   | cfxdimensions-app-notification-service | rda-notifica | bb9e3e7b |             | DB-connectivity                                     | ok       |                                                       |
| rda_app   | cfxdimensions-app-resource-manager     | rda-resource | e5a28e16 |             | service-status                                      | ok       |                                                       |
| rda_app   | cfxdimensions-app-resource-manager     | rda-resource | e5a28e16 |             | minio-connectivity                                  | ok       |                                                       |
| rda_app   | cfxdimensions-app-resource-manager     | rda-resource | e5a28e16 |             | service-dependency:registry                         | ok       | 1 pod(s) found for registry                           |
| rda_app   | cfxdimensions-app-resource-manager     | rda-resource | e5a28e16 |             | service-dependency:cfxdimensions-app-access-manager | ok       | 1 pod(s) found for cfxdimensions-app-access-manager   |
| rda_app   | cfxdimensions-app-resource-manager     | rda-resource | e5a28e16 |             | service-initialization-status                       | ok       |                                                       |
| rda_app   | cfxdimensions-app-resource-manager     | rda-resource | e5a28e16 |             | DB-connectivity                                     | ok       |                                                       |
| rda_infra | collector                              | rda-collecto | 99553e51 |             | service-status                                      | ok       |                                                       |
| rda_infra | collector                              | rda-collecto | 99553e51 |             | minio-connectivity                                  | ok       |                                                       |
| rda_infra | collector                              | rda-collecto | 99553e51 |             | opensearch-connectivity:default                     | ok       |                                                       |
| rda_infra | registry                               | rda-registry | a46cd712 |             | service-status                                      | ok       |                                                       |
| rda_infra | registry                               | rda-registry | a46cd712 |             | minio-connectivity                                  | ok       |                                                       |
| rda_infra | scheduler                              | rda-schedule | d5537051 |             | service-status                                      | ok       |                                                       |
| rda_infra | scheduler                              | rda-schedule | d5537051 |             | minio-connectivity                                  | ok       |                                                       |
| rda_infra | scheduler                              | rda-schedule | d5537051 |             | DB-connectivity                                     | ok       |                                                       |
| rda_app   | user-preferences                       | rda-user-pre | fd09d3ba |             | service-status                                      | ok       |                                                       |
| rda_app   | user-preferences                       | rda-user-pre | fd09d3ba |             | minio-connectivity                                  | ok       |                                                       |
| rda_app   | user-preferences                       | rda-user-pre | fd09d3ba |             | service-dependency:registry                         | ok       | 1 pod(s) found for registry                           |
| rda_app   | user-preferences                       | rda-user-pre | fd09d3ba |             | service-initialization-status                       | ok       |                                                       |
| rda_app   | user-preferences                       | rda-user-pre | fd09d3ba |             | DB-connectivity                                     | ok       |                                                       |
| rda_infra | worker                                 | rda-worker-5 | 1f769792 | rda-site-01 | service-status                                      | ok       |                                                       |
| rda_infra | worker                                 | rda-worker-5 | 1f769792 | rda-site-01 | minio-connectivity                                  | ok       |                                                       |
+-----------+----------------------------------------+--------------+----------+-------------+-----------------------------------------------------+----------+-------------------------------------------------------+

Installing OIA (AIOps) Application Services:

Tip

If the user is not installing any App (OIA/AIA), please run the below command, Incase the user needs to install App (OIA/AIA) please use aiops for OIA and asset for AIA inplace of rda

Set RDA Fabric platform's application configuration as rda using the below command.

rdac rda-app-configure --type rda

Note

Other supported options for above command are below:

  • rda: Choose this option when only RDA Fabric platform need to be installed along with RDA Worker and RDA Event Gateway services without AIOps (OIA) or Asset Intelligence (AIA) applications.

  • aiops: Choose this option when Operations Intelligence (OIA, a.k.a AIOps) application need to be installed.

  • asset: Choose this option when Asset Intelligence (AIA) application need to be installed. (Note: AIA application type is deprecated and all of it's capabilities are available through base RDA Fabric platform itself. For more information, please contact cfx-support@cloudfabric.com)

  • all: Choose this option, when all of the supported applications need to be installed.

Configure OIA Services For Specific Deployment Requirements

Please review the values specified in the /opt/rdaf/deployment-scripts/values.yaml file on the CLI VM under the relevant service section. Adjust the configuration based on the allocated memory limits (mem_limit) and the system's desired throughput requirements.

  • alert_ingester / cfx-rda-alert-ingester
Environment Variable
Description Default Value
INBOUND_PARTITION_WORKERS_MAX Specifies the maximum number of worker processes used for mapping inbound events received by OIA 1
OUTBOUND_TOPIC_WORKERS_MAX Specifies the maximum number of worker processes for mapping outbound requests to external systems 3

Note

Memory Considerations for Inbound Worker Processes

  • Each inbound worker consumes approximately 700–800 MB of memory.

    - this estimation is based on inbound mapping rules that typically use one or a few datasets, each around 10–20 MB in size.

  • An inbound worker is created for each partition assigned to a service instance.

  • Event sources can be assigned to partitions either:

    - manually check the reference guide, or

    - automatically by the system.

  • Based on the number of active sources and the partitions assigned to an instance, one or more worker processes are launched in the service container.

  • Therefore, the number of workers to configure should be calculated based on:

    - the available memory allocated to the service container, and

    - the number of partitions assigned to the instance.

Run the below command to deploy RDAF OIA (AIOps) application services. (Note: Below shown tag name is a sample one for a reference only, for actual tag, please contact CloudFabrix support team at support@cloudfabrix.com)

rdafk8s app install OIA --tag 8.0.0
rdaf app install OIA --tag 8.0.0

After installing the OIA (AIOps) application services, run the below command to see the running status of the deployed application services.

rdafk8s app status
+--------------------+----------------+-------------------+--------------+---------+
| Name               | Host           | Status            | Container Id | Tag     |
+--------------------+----------------+-------------------+--------------+---------+
| rda-alert-ingester | 192.168.131.47 | Up 54 Minutes ago | 4c38f1f1ab76 | 8.0.0   |
| rda-alert-ingester | 192.168.131.49 | Up 49 Minutes ago | 2c55eda2dd7a | 8.0.0   |
| rda-alert-         | 192.168.131.49 | Up 44 Minutes ago | 8319c5927e29 | 8.0.0   |
| processor          |                |                   |                        |
| rda-alert-         | 192.168.131.50 | Up 54 Minutes ago | e99d07f8bcd6 | 8.0.0   |
| processor          |                |                   |                        |
| rda-alert-         | 192.168.131.47 | Up 54 Minutes ago | d16d8fae566c | 8.0.0   |
| processor-         |                |                   |                        |
| companion          |                |                   |                        |
| rda-alert-         | 192.168.131.49 | Up 48 Minutes ago | 16f12b91060d | 8.0.0   |
| processor-         |                |                   |                        |
| companion          |                |                   |                        |
| rda-app-controller | 192.168.131.47 | Up 54 Minutes ago | 658a64049e35 | 8.0.0   |
| rda-app-controller | 192.168.131.46 | Up 54 Minutes ago | 1c27230025a1 | 8.0.0   |
| rda-collaboration  | 192.168.131.49 | Up 43 Minutes ago | 32ea58ca8e39 | 8.0.0   |
| rda-collaboration  | 192.168.131.50 | Up 53 Minutes ago | 67a5e5ef8c1d | 8.0.0   |
| rda-configuration- | 192.168.131.46 | Up 54 Minutes ago | af292efd663c | 8.0.0   |
| service            |                |                   |                        |
| rda-configuration- | 192.168.131.49 | Up 51 Minutes ago | 7b23b8f033a6 | 8.0.0   |
| service            |                |                   |                        |
+--------------------+----------------+-------------------+--------------+---------+
rdaf app status
+--------------------+------------  --+------------+---------------+--------+
| Name               | Host           | Status     | Container Id  | Tag    |
+--------------------+------------  --+------------+---------------+--------+
| cfx-rda-app-       | 192.168.133.96 | Up 10 hours | e0a3b011092b | 8.0.0  |
| controller         |                |             |              |        |
| cfx-rda-app-       | 192.168.133.92 | Up 10 hours | dd729df4567f | 8.0.0  |
| controller         |                |             |              |        |
| cfx-rda-reports-   | 192.168.133.96 | Up 10 hours | d62ddb342bc2 | 8.0.0  |
| registry           |                |             |              |        |
| cfx-rda-reports-   | 192.168.133.92 | Up 10 hours | 4b30336152fe | 8.0.0  |
| registry           |                |             |              |        |
| cfx-rda-           | 192.168.133.96 | Up 10 hours | 6f2a8c2ff9fa | 8.0.0  |
| notification-      |                |             |              |        |
| service            |                |             |              |        |
| cfx-rda-           | 192.168.133.92 | Up 10 hours | 4fbfe27f8006 | 8.0.0  |
| notification-      |                |             |              |        |
| service            |                |             |              |        |
| cfx-rda-file-      | 192.168.133.96 | Up 10 hours | bd41100a456c | 8.0.0  |
| browser            |                |             |              |        |
| cfx-rda-file-      | 192.168.133.92 | Up 10 hours | e420ec5ee26c | 8.0.0  |
| browser            |                |             |              |        |
| cfx-rda-           | 192.168.133.96 | Up 10 hours | 8b4615d2c2e9 | 8.0.0  |
| configuration-     |                |             |              |        |
| service            |                |             |              |        |
| cfx-rda-           | 192.168.133.92 | Up 10 hours | 4d2d749ec170 | 8.0.0  |
| configuration-     |                |             |              |        |
| service            |                |             |              |        |
| cfx-rda-alert-     | 192.168.133.96 | Up 10 hours | 595524b429c3 | 8.0.0  |
| ingester           |                |             |              |        |
| cfx-rda-alert-     | 192.168.133.92 | Up 10 hours | 2a3a686a9355 | 8.0.0  |
| ingester           |                |             |              |        |
+--------------------+----------------+-------------+--------------+--------+

2. Upgrades

Please refer to the following documents for guidance on upgrading the OIA (AIOps) application services to the newer version.

2.1 Latest Version

2.2 Previous Versions

2.3 Archived Versions