[Documentation] [TitleIndex] [WordIndex


This package contains a set of nodes that can be used to run visual servoing demonstrations on a real Pioneer P-3DX mobile robot equipped with a camera. These nodes illustrate the usage of vision_visp stack; especially visp_auto_tracker for the tracking of the target, and visp usage in order to implement a position based visual servoing.

Two demonstrations are provided:

If you don't have a real Pioneer under the hand, it is also possible to use this stack on a simulated Pioneer robot. To this end you may use the vrep_ros_plugin stack and follow the tutorial.

Requested material

This package was used with the following materials:

Optional material:


Install ROS and create a catkin workspace

Bring the source

Get rosaria stack that allows to control a real Pioneer robot

Get demo_pioneer stack that does the visual servoing

Install dependencies

Build the source


Test first pioneer tele operation from gamepad

Check if you have the read/write rights in /dev/ttyUSB0. If not

or even better edit '/etc/udev/rules.d/51-local.rules' and add the following line:

First check if the Pioneer can be tele operated

On the gamepad, select the XInput interface mode. This can be done by sliding the a switch on the side of the gamepad to the position marked "X".

Once done, push "left or right button trigger" to wake the gamepad driver and then use the "right mini stick" to move the robot.

Start the visual servoing demo on the Pioneer

Then start the demo with a real Pioneer robot using:

This will open a windows name "visp_auto_tracker debug display" that shows the images provided by the camera. Present the target available here in front of the camera. It should be detected automatically. Once detected, on the gamepad push "left or right button trigger" to apply the visual servo command to the robot. As long as one of these two buttons are pressed, the command applied to the robot is the one that comes from the visual servoing node. If you release the button, the robot stops moving. You can then move it with the "right mini stick".

Known issues

Missing pattern.wrl file

With some old releases of visp_auto_tracker installed with rosdep you may encounter the following issue:

The fix consists in copying visp_auto_tracker/models folder in the folder where visp_auto_tracker node was installed by using:

2024-07-13 13:15