Skip to content

RDA Studio Installation Guide

This document captures pre-requsites, platforms certified to deploy RDA Studio in Robotic Data Automation Fabric (RDAF).

RDA Studio Software installation prerequisites

CloudFabrix supports Windows, Linux, and Mac OS environments to install, configure and run RDA studio software. Below are the prerequisites which need to be in place before RDA studio can be installed and configured.

1. Prerequisites

Before you proceed, make sure you meet the following requirements

Windows 10 / Linux / Mac OS X with the below software are installed

Internet Connectivity to download the 'RDA' studio docker image.

  • CloudFabrix docker registry URL: cfxregistry.cloudfabrix.io
  • If there is HTTP Proxy in place, please refer to Docker documentation on how to configure HTTP Proxy settings for the Docker service.

Verify Prerequisites

Make sure the below commands are in the PATH variable in the user's login profile.

Run the below commands to verify currently installed RDA prerequisites.

docker --version
docker-compose --version
python3 --version
pip3 --version

2. Linux OS Environment

RDA software installation on Linux OS


Step 1:

Login to Linux box using standard ssh tool (eg. putty or using ssh client)

uname -a
On Ubuntu VM, sample output is as follows: Linux rda-studio-vm 5.4.0-144-generic #161-Ubuntu SMP Fri Feb 3 14:49:04 UTC 2023 x86_64 x86_64 x86_64 GNU/Linux

Step 2:


Create the following directory structure after logging into Linux machine for setting up directory structure for the RDA Studio

sudo mkdir -p /opt/rdaf/cfxdx/home/
sudo mkdir -p /opt/rdaf/cfxdx/config/network_config
sudo mkdir -p /opt/rdaf/cfxdx/output
sudo mkdir -p /opt/rdaf/deployment_scripts/
sudo chown -R `id -u`:`id -g` /opt/rdaf

Step 3:

Create rda-studio.yaml file for RDA studio

cd /opt/rdaf/deployment_scripts/

cat > rda-studio.yaml << EOF
version: '3.1'
services:
  cfxdx:
    image: cfxregistry.cloudfabrix.io/ubuntu-cfxdx-nb-nginx-all:daily
    restart: unless-stopped
    volumes:
      - /opt/rdaf/cfxdx/home/:/root
      - /opt/rdaf/cfxdx/config/network_config/:/tmp/config/
      - /opt/rdaf/cfxdx/output:/tmp/output/
      - /opt/rdaf/cfxdx/config/network_config/:/network_config
    ports:
      - "9998:9998"
    environment:
      #JUPYTER_TOKEN: cfxdxdemo
      NLTK_DATA : "/root/nltk_data"
      CFXDX_CONFIG_FILE: /tmp/config/conf.yml
      RDA_NETWORK_CONFIG: /network_config/config.json
      RDA_USER: rdademo
      RDA_PASSWORD: rdademo1234

EOF

Note

If you see any Credential Authentication failures please update with the infra VM IP in rda-studio.yml file as high lighted below

services:
  cfxdx:
    image: infra-vm-IP/ubuntu-cfxdx-nb-nginx-all:3.2.2
    restart: unless-stopped
    volumes:
      - /opt/rdaf/cfxdx/home/:/root
      - /opt/rdaf/cfxdx/config/:/tmp/config/
      - /opt/rdaf/cfxdx/output:/tmp/output/
      - /opt/rdaf/config/network_config/:/network_config
    ports:
      - "9998:9998"
    environment:
      #JUPYTER_TOKEN: cfxdxdemo
      CFXDX_CONFIG_FILE: /tmp/config/conf.yml
      RDA_NETWORK_CONFIG: /network_config/config.json
      RDA_USER: rdademo
      RDA_PASSWORD: rdademo1234

Step-4:

The RDA Stdio node registers and communicates with the RDAF platform using a configuration file that contains your tenant ID, data fabric access tokens, and object storage credentials.

Download RDA Fabric Configuration from the portal by going to Configuration --> Fabric Configuration --> RDA network configuration and copy it to the local filesystem where the worker node is going to be installed.

  • Save the file as config.json

RDAFNetworkConfig

Step-5:

  • Copy the downloaded RDA Fabric configuration file as shown below.
cp config.json /opt/rdaf/config/network_config/config.json

Step-6::

Docker Login

Run the below command to create and save the docker login session into CloudFabrix's secure docker repository.

docker login -u='readonly' -p='readonly' cfxregistry.cloudfabrix.io

Tip

Note-1: RDA Studio communicates with RDA Fabric that is running in cloud or on-premise datacenter over ports 4222/TCP & 9443/TCP. Please make sure RDA Studio has outbound network access over these network ports. In addition, make sure RDA Fabric is configured to allow inbound network traffic for the same ports to accept the traffic from RDA Studio.

Note-2: Please verify config.json is configured with publicly accessible IP/FQDN of RDA Fabric for NATs and Minio endpoints.

Step-7:

Tip

If Ubuntu version is v22.04.2 LTS or above & Docker Compose version is v2.16.0 or above, Use the following Commands mentioned below

cd /opt/rdaf/deployment_scripts

docker-compose -f rda-studio.yaml pull
docker-compose -f rda-studio.yaml up -d

This section provides additional steps to deploy RDA on Ubuntu OS (Certified on 18.04). Using the currently logged-in user, run the following commands to make sure the user has sufficient permissions.

sudo groupadd docker
sudo gpasswd -a $USER docker
docker ps 
  • If the above command throws an error 'permission denied error', run the following command to provide sufficient privileges to the currently logged-in user to run docker (Skip this step if the command does not throw permission denied error or the user has sufficient privileges/permissions).

sudo chmod 666 /var/run/docker.sock
- Run the following commands to install docker-compose for the currently logged-in user.

sudo curl -L "https://github.com/docker/compose/releases/download/1.29.2/docker-compose-$(uname -s)-$(uname -m)" -o /usr/local/bin/docker-compose
sudo chmod +x /usr/local/bin/docker-compose
sudo ln -s /usr/local/bin/docker-compose /usr/bin/docker-compose

Open firewall to allow 9998 port

sudo ufw allow 9998/tcp

Step-8:
To access 'RDA' Studio UI, open up a browser and enter the URL as https://ipaddress:9998

Note: Access RDA using https://rda-ip-address:9998/

The default user name is rdademo and the password is rdademo1234

RDA related files

Default landing page of RDA Studio on Mac OS
Note: Default username/password can be changed from docker-compose.yml file under RDA studio install directory.

1
2
3
4
environment:
  CFXDX_CONFIG_FILE: /tmp/config/conf.yml
  RDA_USER: rdademo
  RDA_PASSWORD: rdademo1234
Note: Default username/password can be changed from docker-compose.yml file under RDA install directory.

3. Mac OS Environment

Note: Please check the Prerequisites - Installation Prerequisites before you proceed.

Note: Make sure the below commands are in the PATH variable in the user's login profile.

Run the below commands to verify currently installed RDA prerequisites.

Verify Prerequisites

Make sure the below commands are in the PATH variable in the user's login profile.

Run the below commands to verify currently installed RDA prerequisites.

docker --version
docker-compose --version
python3 --version
pip3 --version

Step-1:

Create a virtual environment using python3

1
2
3
python3 -m venv <name of the environment>
eg.
$ python3 -m venv rda-venv

Step-2:

Source virtual env that was created in Step 2 as shown below.

1
2
3
$ cd rda-venv 
$ source bin/activate
(rda-venv)$  

Step-3:

Install docker-compose tool needed to install RDA as shown below

1
2
3
4
(rda-venv)$  pip3 install docker-compose
(rda-venv)$  docker-compose --version
docker-compose version 1.29.0, build 07737305
(rda-venv)$  

Note: Make sure docker-compose is installed properly

Step-4:

Create the following directory structure after logging into Linux machine for setting up directory structure for the first RDA Studio

mkdir -p /Users/$(whoami)/rdaf/cfxdx/home
mkdir -p /Users/$(whoami)/rdaf/cfxdx/config/network_config
mkdir -p /Users/$(whoami)/rdaf/cfxdx/output
mkdir -p /Users/$(whoami)/rdaf/deployment_scripts

Note: Above /home/$(whoami) is example User's home directory. Users can update as per mac user account.

Step-5:

Create rda-studio.yaml file for RDA studio

cd /Users/$(whoami)/rdaf/deployment_scripts/

cat > rda-studio.yaml << EOF

services:
  cfxdx:
    image: cfxregistry.cloudfabrix.io/ubuntu-cfxdx-nb-nginx-all:daily
    restart: unless-stopped
    volumes:
      - /Users/$(whoami)/rdaf/cfxdx/home:/root
      - /Users/$(whoami)/rdaf/cfxdx/config:/tmp/config
      - /Users/$(whoami)/rdaf/cfxdx/output:/tmp/output
      - /Users/$(whoami)/rdaf/cfxdx/config/network_config:/network_config
    ports:
      - "9998:9998"
    environment:
      #JUPYTER_TOKEN: cfxdxdemo
      NLTK_DATA : "/root/nltk_data"
      CFXDX_CONFIG_FILE: /tmp/config/conf.yml
      RDA_NETWORK_CONFIG: /network_config/config.json
      RDA_USER: rdademo
      RDA_PASSWORD: rdademo1234

EOF

Step-6:

The RDA Stdio node registers and communicates with the RDAF platform using a configuration file that contains your tenant ID, data fabric access tokens, and object storage credentials.

Download RDA Fabric Configuration from the portal by going to Configuration --> Fabric Configuration --> RDA network configuration and copy it to the local filesystem where the worker node is going to be installed.

  • Save the file as config.json

RDAFNetworkConfig

Step-7:

  • Copy the downloaded RDA Fabric configuration file as shown below.
cp config.json /Users/$(whoami)/rdaf/cfxdx/config/network_config/config.json

Step-8:

Docker Login

Run the below command to create and save the docker login session into CloudFabrix's secure docker repository.

docker login -u='readonly' -p='readonly' cfxregistry.cloudfabrix.io

Tip

Note-1: Make sure docker is up and running before Step-9

Step-9:

cd /Users/$(whoami)/rdaf/deployment_scripts

docker-compose -f rda-studio.yaml pull
docker-compose -f rda-studio.yaml up -d

Step-10:

To access 'RDA' interface, open up a browser and enter the URL as https://ipaddress:9998

Note: Access RDA using https://rda-ip-address:9998/

The default user name is rdademo and the password is rdademo1234

RDA related files

Default landing page of RDA Studio on Mac OS
Note: Default username/password can be changed from docker-compose.yml file under RDA studio install directory.

1
2
3
4
environment:
  CFXDX_CONFIG_FILE: /tmp/config/conf.yml
  RDA_USER: rdademo
  RDA_PASSWORD: rdademo1234
Note: Default username/password can be changed from docker-compose.yml file under RDA install directory.

4. Windows OS Environment

Note: Please check the Prerequisites - Installation Prerequisites before you proceed.

Note: Make sure the below commands are in the PATH variable in the user's login profile.

Verify Prerequisites

Make sure the below commands are in the PATH variable in the user's login profile.

Run the below commands to verify currently installed RDA prerequisites.

docker.exe --version
OR
docker --version
docker-compose.exe --version
OR
docker-compose --version
python3.exe --version
OR 
python3 --version
pip3.exe --version
OR
pip3 --version

Step-1:
Create the following directory structure after logging into Windows machine for setting up directory structure for the RDA Studio.

Tip

Assumption is that, user will execute the below commands from "C:\" directory.

C:\
C:\mkdir rdaf
C:\mkdir rdaf\cfxdx\home
C:\mkdir rdaf\cfxdx\config\network_config
C:\mkdir rdaf\cfxdx\output
C:\mkdir rdaf\deployment_scripts

Step-2:
Create rda-studio.yaml file for RDA studio using your favorite studio (notepad or wordpad). You can copy the following rda-studio.yaml cntent to a file 'rda-studio.yaml and copy to the following location --> C:\rdaf\deployment_scripts\

Tip

Copy and paste the following lines to C:\rda-studio.yaml using your favorite editor and save the file.

services:
  cfxdx:
    image: cfxregistry.cloudfabrix.io/ubuntu-cfxdx-nb-nginx-all:daily
    restart: unless-stopped
    volumes:
      - C:\\rdaf\\cfxdx\\home\\:/root
      - C:\\rdaf\cfxdx\\config\:/tmp/config/
      - C:\\rdaf\\cfxdx\\output:/tmp/output/
      - C:\\rdaf\\cfxdx\config\\network_config/:/network_config
    ports:
      - "9998:9998"
    environment:
      #JUPYTER_TOKEN: cfxdxdemo
      NLTK_DATA : "/root/nltk_data"
      CFXDX_CONFIG_FILE: /tmp/config/conf.yml
      RDA_NETWORK_CONFIG: /network_config/config.json
      RDA_USER: rdademo
      RDA_PASSWORD: rdademo1234

Step-3:
Once the above yaml content is saved to rda-studio.yaml file, copy the file to following location.

C:\copy rda-studio.yaml C:\rdaf\deployment_scripts

Step-4:

The RDA Stdio node registers and communicates with the RDAF platform using a configuration file that contains your tenant ID, data fabric access tokens, and object storage credentials.

Download RDA Fabric Configuration from the portal by going to Configuration --> Fabric Configuration --> RDA network configuration and copy it to the local filesystem where the worker node is going to be installed.

  • Save the file as config.json

RDAFNetworkConfig

Step-5:

  • Copy the downloaded RDA Fabric configuration file as shown below.
copy config.json C:\rdaf\config\network_config\config.json

Step-6:

Docker Login

Run the below command to create and save the docker login session into CloudFabrix's secure docker repository.

docker login -u='readonly' -p='readonly' cfxregistry.cloudfabrix.io

Tip

Note-1: Make sure docker is up and running before Step-7

Step-7:

cd C:\rdaf\deployment_scripts\

docker-compose -f rda-studio.yaml pull
docker-compose -f rda-studio.yaml up -d

Step-8:

To access 'RDA' interface, open up a browser and enter the URL as https://ipaddress:9998