[isaacsim.sensors.camera.ui] Isaac Sim Camera Simulation UI Components

Version: 0.7.4

Overview

This extension provides UI integration for creating camera and depth sensors in Isaac Sim. It adds menu items to the Create menu and context menus that enable users to create various camera and depth sensor prims from multiple vendors including Orbbec, Leopard Imaging, Luxonis, RealSense, Sensing, SICK, and Stereolabs.

Functionality

The extension automatically registers sensor creation actions and organizes them into a hierarchical menu structure by vendor. Users can access sensor creation through two main pathways: the main Create menu under “Sensors > Camera and Depth Sensors” and context menus accessible via right-click in the viewport under “Isaac > Sensors”.

The full list of supported sensors and their metadata (vendor grouping, display name, depth-sensor flag, default stage prim prefix) is sourced from isaacsim.sensors.experimental.rtx.SUPPORTED_CAMERA_CONFIGS, so adding a new vendor sensor is a one-place change in that registry.

Supported camera sensors include:

• Leopard Imaging: Hawk, Owl

• Sensing: SG2-AR0233C-5200-G2A-H100F1A, SG2-OX03CC-5200-GMSL2-H60YA, SG3-ISX031C-GMSL2F-H190XA, SG5-IMX490C-5300-GMSL2-H110SA, SG8S-AR0820C-5300-G2A-H120YA, SG8S-AR0820C-5300-G2A-H30YA, SG8S-AR0820C-5300-G2A-H60SA

• SICK: Inspector83x, InspectorP61x

Supported depth sensors include:

• Orbbec: Gemini 2, FemtoMega, Gemini 335, Gemini 335L

• Luxonis: OAK4-D, OAK4-D Wide, OAK-D Pro PoE, OAK-D Pro W PoE, OAK-D ToF

• RealSense: D455, D457, D555

• SICK: safeVisionary2, Visionary-T Mini

• Stereolabs: ZED_X

Key Components

Sensor Creation Actions

The extension creates specialized actions for each supported sensor type using the action registry. All sensors are loaded via isaacsim.sensors.experimental.rtx.RtxCamera.create(). For entries whose registry metadata sets is_depth_sensor=True, every Camera in the loaded asset that has a depth-sensor template render product is additionally wrapped with isaacsim.sensors.experimental.rtx.SingleViewDepthCameraSensor, which copies the template’s depth-sensor attributes onto the new render product.

Menu Integration

Menu items are dynamically created and organized by vendor, providing a structured approach to sensor selection. The hierarchical organization helps users locate specific sensor models efficiently within the Isaac Sim interface.

Integration

The extension uses omni.kit.actions.core to register sensor creation actions and omni.kit.context_menu to provide right-click access to sensor creation tools. It integrates with isaacsim.sensors.experimental.rtx for the underlying sensor implementation (RtxCamera and SingleViewDepthCameraSensor) and isaacsim.gui.components for UI component support.

Enable Extension

The extension can be enabled (if not already) in one of the following ways:

Command-line interface

Define the next entry as an application argument from a terminal.

APP_SCRIPT.(sh|bat) --enable isaacsim.sensors.camera.ui

Experience/extension configuration

Define the next entry under [dependencies] in an experience (.kit) file or an extension configuration (extension.toml) file.

[dependencies]
"isaacsim.sensors.camera.ui" = {}

Extension Manager UI

Open the Window > Extensions menu in a running application instance and search for isaacsim.sensors.camera.ui. Then, toggle the enable control button if it is not already active.

Actions in isaacsim.sensors.camera.ui

ID	Display Name	Description
create_camera_hawk		Create Hawk camera sensor
create_camera_luxonis_oak4_d		Create Luxonis OAK4-D camera sensor
create_camera_luxonis_oak4_d_wide		Create Luxonis OAK4-D Wide camera sensor
create_camera_luxonis_oak_d_pro_poe		Create Luxonis OAK-D Pro PoE camera sensor
create_camera_luxonis_oak_d_pro_w_poe		Create Luxonis OAK-D Pro W PoE camera sensor
create_camera_luxonis_oak_d_tof		Create Luxonis OAK-D ToF camera sensor
create_camera_orbbec_femtomega		Create Orbbec FemtoMega camera sensor
create_camera_orbbec_gemini_2		Create Orbbec Gemini 2 camera sensor
create_camera_orbbec_gemini_335		Create Orbbec Gemini 335 camera sensor
create_camera_orbbec_gemini_335l		Create Orbbec Gemini 335L camera sensor
create_camera_owl		Create Owl camera sensor
create_camera_realsense_d455		Create Realsense D455 camera sensor
create_camera_realsense_d457		Create Realsense D457 camera sensor
create_camera_realsense_d555		Create Realsense D555 camera sensor
create_camera_sensing_sg2_ar0233c_5200_g2a_h100f1a		Create Sensing SG2-AR0233C-5200-G2A-H100F1A camera sensor
create_camera_sensing_sg2_ox03cc_5200_gmsl2_h60ya		Create Sensing SG2-OX03CC-5200-GMSL2-H60YA camera sensor
create_camera_sensing_sg3_isx031c_gmsl2f_h190xa		Create Sensing SG3-ISX031C-GMSL2F-H190XA camera sensor
create_camera_sensing_sg5_imx490c_5300_gmsl2_h110sa		Create Sensing SG5-IMX490C-5300-GMSL2-H110SA camera sensor
create_camera_sensing_sg8s_ar0820c_5300_g2a_h120ya		Create Sensing SG8S-AR0820C-5300-G2A-H120YA camera sensor
create_camera_sensing_sg8s_ar0820c_5300_g2a_h30ya		Create Sensing SG8S-AR0820C-5300-G2A-H30YA camera sensor
create_camera_sensing_sg8s_ar0820c_5300_g2a_h60sa		Create Sensing SG8S-AR0820C-5300-G2A-H60SA camera sensor
create_camera_sick_inspector83x		Create SICK Inspector83x camera sensor
create_camera_sick_inspectorp61x		Create SICK InspectorP61x camera sensor
create_camera_sick_safevisionary2		Create SICK safeVisionary2 camera sensor
create_camera_sick_visionary_t_mini		Create SICK Visionary-T Mini camera sensor
create_camera_stereolabs_zed_x		Create Stereolabs ZED_X camera sensor