-
support simulation mode
-
add CycloneDDS interface name parameter
-
upgrade teleimager version
-
The image server has been changed to teleimager. Please refer to the repository README for details.
-
televuer has been upgraded. Please see the repository README for details.
The new versions of teleimager + televuer support transmitting head camera images via WebRTC.
-
Enriched the task information parameters in recording mode, fixing and improving EpisodeWriter.
-
Improved the system’s state machine information and IPC mode.
-
Added pass-through mode, allowing direct viewing of the external environment through a VR device camera (without using the robot’s head camera).
-
Added CPU affinity mode. If you are not familiar with this mode, you can ignore it.
-
Added motion-switcher functionality, allowing automatic debug mode entry and exit without using a remote controller.
-
Support IPC mode, defaulting to use SSHKeyboard for input control.
-
Merged motion mode support for H1_2 robot.
-
Merged motion mode support for the G1_23 robot arm.
- Optimized data recording functionality.
- Improved gripper usage in simulation environment.
- Fixed startup oscillation by initializing IK before controller activation.
- Fixed SSHKeyboard stop-listening bug.
- Fixed logic of the start button.
- Fixed various bugs in simulation mode.
- Upgrade the Dex1_1 gripper control code to be compatible with the dex1_1 service driver.
- Added support for a new end-effector type:
brainco, which refers to the Brain Hand developed by BrainCo. - Changed the DDS domain ID to
1in simulation mode to prevent conflicts during physical deployment. - Fixed an issue where the default frequency was set too high.
-
Upgraded the Vuer library to version v0.0.60, expanding XR device support to two modes: hand tracking and controller tracking. The project has been renamed from
avp_teleoperatetoxr_teleoperateto better reflect its broader capabilities.Devices tested include: Apple Vision Pro, Meta Quest 3 (with controllers), and PICO 4 Ultra Enterprise (with controllers).
-
Modularized parts of the codebase and integrated Git submodules (
git submodule) to improve code clarity and maintainability. -
Introduced headless, motion control, and simulation modes. Startup parameter configuration has been streamlined for ease of use (see Section 2.2). The simulation mode enables environment validation and hardware failure diagnostics.
-
Changed the default hand retargeting algorithm from Vector to DexPilot, enhancing the precision and intuitiveness of fingertip pinching interactions.
-
Various other improvements and optimizations.
- The repository was named
avp_teleoperatein this version. - Supported robot included:
G1_29,G1_23,H1_2, andH1. - Supported end-effectors included:
dex3,dex1(gripper), andinspire1. - Only supported hand tracking mode for XR devices (using Vuer version v0.0.32RC7). Controller tracking mode was not supported.
- Data recording mode was available.