Assemble a Simple Robot

NVIDIA Isaac Sim’s GUI interface features are the same ones used in NVIDIA Omniverse™ USD Composer, an application dedicated to world-building. In this tutorial series, we will focus on the GUI functions that are most relevant to robotic uses. For more sophisticated general world creation, please check out Omniverse Composer.

In this tutorial, we will rig a simple “robot” with three links and two revolute joints to introduce the basic concepts of joints and articulations. We will take the objects that were added to the stage in Add Simple Objects, and turn them into a mock mobile robot with rectangular body and two cylindrical wheels. While this step is not needed for robots that are imported from Importing your Onshape Document or URDF Importer Extension, these are important concepts to understand for tuning your robots and assembling objects with articulations.

Learning Objectives

This tutorial details how to rig a two-wheel mobile robot and covers how to:

• Organize stage tree hierarchy

• Add joints between two rigid bodies

• Add joint drives and joint properties

• Add articulations

• Move the robot via a Articulation Velocity Controller

Getting Started

Prerequisites

• Complete Add Simple Objects.

Add Joints

1. If you are continuing from the GUI Tutorials and have your own mock_robot.usd saved, open it using File > Open. Otherwise, load the asset provided in the asset browser at Samples > Rigging > MockRobot > mock_robot_no_joints. Do not load it as a reference because you must make permanent modifications to the file.

2. For organization, create a Scope to store the joints by right clicking Create > Scope

3. To add a joint between two bodies, you must first select them both. Begin by clicking on the body and wheel parent transforms in the context tree window. For our mock robot, select the child prim body, then while holding Ctrl, select the child prim wheel_left.

4. With both bodies highlighted, right-click and select Create > Physics > Joints > Revolute Joint. RevoluteJoint appears under wheel_left on the stage tree. Rename it to wheel_joint_left.

5. Verify in the Property tab that body0 is /mock_robot/body/body (the cube) and body1 is /mock_robot/wheel_left/wheel_left (the cylinder).

6. Set the Local Rotation 0 to 0.0 and Local Rotation 1 to -90.0 to account for the transformation between the body and the cylinder.

7. Change the Axis of the joint to Y.

8. Repeat the previous five steps with the right wheel joint.

Before the joints were added, the three rigid bodies fell to the ground separately after pressing Play. Now that there are joints attached, the bodies fall as if they are connected. To see that they move together like they are connected via revolute joints, you can drag the robot around by holding down the Shift key and clicking and dragging on any part of the robot in the viewport.

Add a Joint Drive

Adding the joint adds the mechanical connection. To be able to control and drive the joints, you must add a joint drive API. Select both joints and click the + Add button in the Property tab, and select Physics > Angular Drive to add drive to both joints simultaneously.

• Position Control: For position controlled joints, set a high stiffness and relatively low or zero damping.

• Velocity Control: For velocity controller joints, set a high damping and zero stiffness.

For joints on a wheel, it makes more sense to be velocity controlled, so set both wheels’ Damping to 1e4*and *Target Velocity to 200. If you are working with joints with limited range, those can be set in the Property tab, under the Raw USD Properties > Lower (Upper) Limit. Press Play to see the mock mobile robot drive off.

Add Articulation

Even though directly driving the joints can move the robot, it is not the most computationally efficient way. Making things into articulations can achieve higher simulation fidelity, fewer joint errors, and can handle larger mass ratios between the jointed bodies. For more information on the physics simulation behind it, see Physics Core: Articulation. To turn a series of connected rigid bodies and joints into articulation, set an articulation root to anchor the articulation tree. According to instructions on defining articulation trees in Physics Core: Articulation:

For a fixed-base articulation, add the Articulation Root Component either to: 1) the fixed joint that connects the articulation base to the world, or 2) an ancestor of the fixed joint in the USD hierarchy. The second option allows creating multiple articulations from a single root component added to the scene. Each descendant fixed joint defines an articulation base link. For a floating-base articulation, add the Articulation Root Component either to: 1) the root rigid-body link or 2) an ancestor of the root link in the USD hierarchy.

For this tutorial, add the articulation root to the robot:

1. Select mock_robot on the tree.

2. Open + Add in the Property tab.

3. Add Physics > Articulation Root.

Validate that the resulting robot matches the asset that is provided in the asset browser at Samples > Rigging > MockRobot > mock_robot_rigged.

Add Controller

After the joints are part of an articulation, you can use tools to test the robot’s movement.

1. Go to Tools -> Robotics -> Omnigraph Controllers -> Joint Velocity to add a velocity controller graph to the stage. This graph will allow you to control the robot’s movement by setting the target velocity for each joint.

2. Click the Add button for “Robot Prim” and select the prim with the Articulation Root API, in this case, it’s /mock_robot.

3. Click OK to create the graph.

4. To move the robot, press Play to start the simulation. If you have any default position or velocity targets set, the robot starts moving towards those targets immediately. To change the joint commands, select the JointCommandArray on the stage tree under /Graphs/velocity_controller, and change the parameters input0 and input1 in the properties window.

Note

The articulation controllers use radians, the default USD properties you find under Drive API when you select the individual joints on the stage tree are in degrees.

For this particular robot, it can also be controlled using a Differential Controller. For more information about Omnigraph Controller shortcuts, go to Commonly Used Omnigraph Shortcuts.

Summary

In this tutorial, you learned to connect rigid bodies using joints, add a joint drive to control the joints, turn a chain of joints into an articulation, and control the robot using an Articulation Velocity Controller.

Next Steps

• Continue on to Add Camera and Sensors to learn how to add a camera to the car.

Further Reading

Physics Core for more details regarding joints and articulations.