NVIDIA Isaac Wrapper

LIPSedge™ AE400 and AE Series is compatible with Isaac, NVIDIA’s development platform for robotic applications. With the sample application designed by LIPS Corp., users can access LIPSedgeTM AE400 images through the NVIDIA Isaac Sight, NVIDIA’s robotic navigation application.

For optimal performances, make sure your PC / laptop meets the system requirement for NVIDIA Isaac SDK:

System Requirements
Hardware	GPU	NVIDIA GPU with compute capability of 3.5 or above
Video Card	NVIDIA video card with CUDA compatibility
Software	Isaac	NVIDIA Isaac SDK 2020.2
OS	Ubuntu 18.04 LTS system
SDK	https://github.com/lips-hci/stereo_ae400

Prerequisites

NVIDIA Isaac SDK requires CUDA 11 toolkit for live streaming. Follow the instructions to install CUDA 11 toolkit before building NVIDIA Isaac SDK.

1. On the Terminal, type the following command.

wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64/cuda-ubuntu1804.pin

2. Type the next command.

sudo mv cuda-ubuntu1804.pin /etc/apt/preferences.d/cuda-repository-pin-600

3. Type the next command.

wget https://developer.download.nvidia.com/compute/cuda/11.2.0/local_installers/cuda-repo-ubuntu1804-11-2-local_11.2.0-460.27.04-1_amd64.deb

4. Type the next command.

sudo dpkg -i cuda-repo-ubuntu1804-11-2-local_11.2.0-460.27.04-1_amd64.deb

5. Type the next command.

sudo apt-key add /var/cuda-repo-ubuntu1804-11-2-local/7fa2af80.pub

6. Update the Linux repository.

sudo apt-get update

7. Install the CUDA Toolkit.

sudo apt-get -y install cuda

Building the NVIDIA Isaac SDK

LIPSedge™ AE400 and AE Series supports NVIDIA Isaac SDK 2020.2. Before building the sample application, download NVIDIA Isaac SDK from their official website and clone the LIPSedgeTM AE400 sample applications to your PC / laptop.

NVIDIA Isaac SDK requires third-party system dependencies to operate. A shell scripts provided by NVIDIA to install Ubuntu repositories, Python packages, and Bazel, the Isaac SDK compiling tool. Install the third-party system dependencies before building the NVIDIA Isaac SDK.

1. Register and download the NVIDIA Isaac SDK 2020.2.

2. Extract the downloaded file.

3. Go to the Isaac SDK folder > engine. At the root folder of the Isaac SDK folder, install the third-party dependencies.

./engine/build/scripts/install_dependencies.sh

4. Clone the stereo_ae400 SDK to your PC / laptop.

git clone https://github.com/lips-hci/stereo_ae400.git

5. Rename the NVIDIA Isaac SDK folder as isaac.

Note: The name of the NVIDIA Isaac SDK folder must NOT contain capital letters and numbers, or the build process fails.

6. Go to the stereo_ae400 SDK folder and open WORKSPACE.

7. In WORKSPACE, specify the location of the NVIDIA Isaac SDK folder under local_repository and save changes.

Location: /home/<user name>/isaac

8. Go to the stereo_ae400 SDK folder.

9. Build the Isaac sample application.

bazel build //app/ae400_camera

Note: When building the sample application, make sure the Internet connection of your PC / laptop is stable. Otherwise, build error occurs.