[Documentation] [TitleIndex] [WordIndex

Only released in EOL distros:  

hrl-sensor-utils: hrl_clickable_display | hrl_ft | pixel_2_3d

Package Summary

Simple utility used to convert pixels on an image to 3d points using point cloud data.

pixel_2_3d_clickable.jpg pixel_2_3d.jpg


The current algorithm takes advantage of the RGB-D ordering of the point cloud to find the relevant point quickly and reliably. This ordering is found natively on the point clouds produced by the openni_kinect stack. The hrl_clickable_display package provides an easy interface for using this code.

These launch files, properly modified, will publish a pose to the /pixel3d topic with every mouse click on the image.

roslaunch pixel_2_3d pixel_2_3d_run.launch # modify the remaps in this file
roslaunch hrl_clickable_display kinect_clickable_UI.launch



Converts pixel on image to a pose in 3D by projecting the point cloud onto the image and finding the closest projected point in the image space to the given pixel. The orientation is found by computing the surface normal and making the z-axis point along the normal in the direction of the camera.

Subscribed Topics

/l_mouse_click (geomertry_msgs/PointStamped) /image (sensor_msgs/Image) /point_cloud (sensor_msgs/PointCloud2)

Published Topics

/pixel3d (geometry_msgs/PoseStamped)


/pixel_2_3d (pixel_2_3d/Pixel23d)


~normal_radius (double, default: 0.03)

2020-01-18 12:57