(TurtleBot3)Recognize Human Pointing

Tutorial using ROS for ver.3

TurtleBot3 recognizes human pointing direction †

In this example, TurtleBot3 recognizes the pointing direction of the human avatar and rotates the Manipulator in that direction.

Startup Procedure †

Start the Ubuntu side and then the Windows side.

Ubuntu side startup procedure †

Open a new terminal and run the following command:

$ roslaunch sigverse_turtlebot3_open_manipulator recognize_pointed_direction.launch

Windows side startup procedure †

Start the [Assets/SIGVerse/ExampleScenes/Turtlebot3/Pointing(.unity)] scene with reference to here.

Run †

When you press the left and right arrow keys after focusing on the Unity window, the right hand of the human character moves.
Then press the Space key and TurtleBot3 will rotate the Manipulator in the direction that the human character points.

If you want to finish, stop the Unity side and then the ROS side.

Ubuntu side (The details may differ from the latest version)

Windows side (The details may differ from the latest version)

Reference Video