LIPS® Developer Documentation
  • WELCOME
    • LIPS® Developer Documentation
    • About 3D Depth Cameras
    • Depth Image
    • Understanding Depth
    • An Ideal Depth Camera
    • LIPSedge™ AE Series Camera Selection Guide
  • LIPSedge™ SDK 1.x
    • LIPSedge™ SDK 1.x
    • Benefits from LIPSedge™ SDK implementation
    • LIPSedge™ SDK 1.x Installation Architecture
    • How to identify each camera SDK
    • New Features for v1.02
      • Installing and identifying packages on Windows
      • Saving Captures and Videos with the DepthViewer
      • Saving Point Cloud with PointCloudViewer
      • Live On-Screen displaying Depth, FPS
      • Live On-Screen displaying XYZ parameters in RawfileViewer
      • Distance measurement on-screen from point-to-point
      • Mouse Pointer Change
      • LIPSedge™ AE and S series Colormap new feature addition
      • Simple naming for LIPSedge™ SDK Tools
      • Importing parameters from .json files for LIPSedge™ AE and S series
    • LIPSedge™ SDK v1.02 Tools
      • DepthViewer
      • PointCloudViewer
      • CameraParameterViewer
      • CameraCenterViewer
      • CameraEventListener
      • CameraPowerTest
      • LensModeSelector
      • LIPSImuReader
      • CameraSimpleViewer
      • RawFileViewer
    • Features Articles
      • LIPSedge™ SDK Persistent Connection for PoE and USB
    • Tutorials
    • Development and Deployment on arm64
  • DOCUMENTS, INSTALLATION & SETUP
    • LIPSedge™ AE400 / AE450
      • User Guide
        • Previous Releases (Archive)
      • SDK Release
        • Previous Releases (Archive)
      • Installation
        • Linux
        • Windows
        • ROS Wrapper
        • NVIDIA ISAAC Wrapper
        • Persistent Connection
      • STEP files for CAD Use
      • Certifications Documents
      • Firmware
    • LIPSedge™ AE430 / AE470
      • User Guide
        • Previous Releases (Archive)
      • SDK Release
        • Previous Releases (Archive)
      • Firmware
      • STEP files for CAD Use
    • LIPSedge™ AE430-DK / AE470-DK
      • User Guide
    • LIPSedge™ DL & M3 Series
      • User Guide
        • Previous Releases (Archive)
      • SDK Release
        • Previous Releases (Archive)
        • Changelog
      • STEP files for CAD Use
      • Installation
        • Ubuntu
        • Windows
    • LIPSedge™ L215u / L210u
      • User Guide
        • Previous Releases (Archive)
      • SDK Release
        • Previous Releases (Archive)
        • Changelog
      • Installation
        • Windows
        • Linux
      • STEP files for CAD Use
    • LIPSFace™ HW110/115 On-Device 3D Facial Recognition
      • User Guide & SDK Download
      • STEP files for CAD Use
    • LIPSFace™ HW120/125 On-Device 3D Facial Recognition
      • User Guide
      • SDK
      • STEP files for CAD Use
    • LIPScan 3D ™ Middleware
      • LIPScan 3D™ SDK
        • SDK Download
          • Previous Releases
        • User Guide
        • Release Notes
    • LIPSMetric™ HA110 Handheld Dimensioner
      • User Guide
    • LIPSMetric™ ST115 Static Dimensioner
      • User Guide
    • LIPSMetric™ ST130 Pallet Dimensioner
      • User Guide
  • LIPSedge™ SDK Languages & Libraries
    • C++
      • environment-setup
      • hello-lipsedge-sdk
      • opencv-viewer
      • roi
      • depth-data
      • align-depth-color
      • range-filter
      • remove-background
      • record
      • pointcloud
      • config-resolution
      • camera-parameter
    • Python
      • environment-setup
      • hello-lipsedge-sdk
      • opencv-viewer
      • roi
      • depth-data
      • align-depth-color
      • range-filter
      • remove-background
      • record
    • Java
      • ni-hello
    • C#
      • ni-hello
      • simple-read
    • OpenCV
  • LIPSedge™ SDK Frameworks
    • GenICam (for Halcon / Aurora Vision)
      • User Manual
      • Driver(.cti) and Nodemap (.xml)
      • Supported LIPSedge™ Camera SDK
      • Installation Example
    • ROS
    • ROS2
    • NVIDIA Isaac Wrapper
    • Flutter
  • LIPSedge™ SDK Sample Codes
    • Sample Applications & Viewer & Utilities
      • ni-viewer
      • ni-pointcloud-gl
      • ni-camera-matrix
  • LIPSFace™ SDK
    • LIPSFace™ SDK Overview
    • Updates
Powered by GitBook
On this page
  1. LIPSedge™ SDK Frameworks

NVIDIA Isaac Wrapper

PreviousROS2NextFlutter

Last updated 1 year ago

LIPSedge™ AE400 and AE Series is compatible with Isaac, NVIDIA’s development platform for robotic applications. With the sample application designed by LIPS Corp., users can access LIPSedgeTM AE400 images through the NVIDIA Isaac Sight, NVIDIA’s robotic navigation application.

For optimal performances, make sure your PC / laptop meets the system requirement for NVIDIA Isaac SDK:

System Requirements

Hardware

GPU

NVIDIA GPU with compute capability of 3.5 or above

Video Card

NVIDIA video card with CUDA compatibility

Software

Isaac

NVIDIA Isaac SDK 2020.2

OS

Ubuntu 18.04 LTS system

SDK

Prerequisites

NVIDIA Isaac SDK requires CUDA 11 toolkit for live streaming. Follow the instructions to install CUDA 11 toolkit before building NVIDIA Isaac SDK.

1. On the Terminal, type the following command.

wget https://developer.download.nvidia.com/compute/cuda/repos/ubuntu1804/x86_64/cuda-ubuntu1804.pin

2. Type the next command.

sudo mv cuda-ubuntu1804.pin /etc/apt/preferences.d/cuda-repository-pin-600

3. Type the next command.

wget https://developer.download.nvidia.com/compute/cuda/11.2.0/local_installers/cuda-repo-ubuntu1804-11-2-local_11.2.0-460.27.04-1_amd64.deb

4. Type the next command.

sudo dpkg -i cuda-repo-ubuntu1804-11-2-local_11.2.0-460.27.04-1_amd64.deb

5. Type the next command.

sudo apt-key add /var/cuda-repo-ubuntu1804-11-2-local/7fa2af80.pub

6. Update the Linux repository.

sudo apt-get update

7. Install the CUDA Toolkit.

sudo apt-get -y install cuda

Building the NVIDIA Isaac SDK

NVIDIA Isaac SDK requires third-party system dependencies to operate. A shell scripts provided by NVIDIA to install Ubuntu repositories, Python packages, and Bazel, the Isaac SDK compiling tool. Install the third-party system dependencies before building the NVIDIA Isaac SDK.

1. Register and download the NVIDIA Isaac SDK 2020.2.

2. Extract the downloaded file.

3. Go to the Isaac SDK folder > engine. At the root folder of the Isaac SDK folder, install the third-party dependencies.

4. Clone the stereo_ae400 SDK to your PC / laptop.

git clone https://github.com/lips-hci/stereo_ae400.git

5. Rename the NVIDIA Isaac SDK folder as isaac.

Note: The name of the NVIDIA Isaac SDK folder must NOT contain capital letters and numbers, or the build process fails.

6. Go to the stereo_ae400 SDK folder and open WORKSPACE.

7. In WORKSPACE, specify the location of the NVIDIA Isaac SDK folder under local_repository and save changes.

Location: /home/<user name>/isaac

8. Go to the stereo_ae400 SDK folder.

9. Build the Isaac sample application.

bazel build //app/ae400_camera

Note: When building the sample application, make sure the Internet connection of your PC / laptop is stable. Otherwise, build error occurs.

LIPSedge™ AE400 and AE Series supports NVIDIA Isaac SDK 2020.2. Before building the sample application, download NVIDIA Isaac SDK from and clone the LIPSedgeTM AE400 sample applications to your PC / laptop.

./engine/build/scripts/install_dependencies.sh
their official website
https://github.com/lips-hci/stereo_ae400