Robots Atlas>ROBOTS ATLAS
Robotics

GelSight

2009ActiveUpdated: 19 August 2026Published
Key innovation
The canonical high-resolution vision-based tactile sensor: a piece of clear gel with a reflective membrane and a camera, reconstructing surface geometry at micrometer accuracy.
Category
Robotics
Abstraction level
Building block
Operation level
Robot controlData
Use cases
Dexterous manipulation and precise grasping in roboticsIn-hand object and texture recognitionSlip detection and force controlLearning touch-based manipulation policiesSurface metrology and quality control

How it works

The reflective membrane on the gel surface deforms to the shape of the touched object. A camera under the gel captures the membrane lit from several directions by multi-color LEDs; from the per-channel brightness the system computes local surface slopes (photometric stereo) and, by integration, a height map (the 3D geometry of the imprint). Motion of the printed markers is used to estimate shear forces and slip. The results feed grasp-control algorithms or manipulation-learning networks.

Problem solved

Robots need dense, accurate tactile information for dexterous manipulation that taxel arrays cannot provide. GelSight delivers a micrometer-scale map of contact geometry and forces from a single, low-cost camera module.

Key mechanisms

An elastic gel with a reflective membrane
A camera + multi-color/multi-angle LED lighting
Photometric stereo → height map (3D geometry)
Markers for shear forces and slip
Measurement independent of the object's optical properties

Strengths & limitations

Strengths
✓Micrometer-scale tactile geometry resolution
✓Independence from the touched object's color/texture
✓Rich information (shape, forces, slip) from one module
✓A mature, commercialized technology (GelSight Mini)
Limitations
✗Module thickness and size (camera + gel)
✗Wear of the membrane/gel
✗Image-processing latency
✗Limited contact area of a single sensor

Components

Gel with reflective membraneContact surface

A transparent elastomer coated with an opaque, reflective layer.

Official

Camera and LED lightingAcquisition

Capture the deformed membrane from different directions/colors.

Official

Markers and photometric algorithmProcessing

Recover 3D geometry and shear forces and slip.

Official

Implementation

Reference implementations
GelSight Inc. — GelSight Mini
— · GelSight Inc.
Official
Implementation pitfalls
Membrane wearMedium

The reflective membrane wears out and needs replacement.

Fix:Replaceable gel pads, maintenance.
Photometric calibrationMedium

Accuracy depends on correct lighting and optics calibration.

Fix:Calibration procedures, per-sensor learned models.

Evolution

2009
GelSight at MIT
Inflection point

Adelson's lab demonstrates a high-resolution gel-based vision tactile sensor.

2018
Robotics applications

GelSight increasingly used for manipulation and in-hand recognition.

2022
GelSight Mini

A compact commercial module popularizes the sensor in research and robotics.

Hyperparameters (configurable axes)

Form factorMedium
GelSight MiniA compact module for robotics and research.
czujniki dłoni/palcaIntegration into robot grippers and fingertips.
MarkersMedium
z markeramiMeasuring shear forces and slip.
bez markerówGeometry-only sensing.