MSAT

Integrates heterogeneous robotic modalities (vision, language, proprioception, tactile sensing, motor signals) as separate modality-specific token streams inside a single transformer, fused via cross-modal joint self-attention — allowing a VLA policy to jointly learn broad scene understanding together with narrow functional capabilities (motion awareness, long-term memory, physical sensing) without pipeline engineering compromises.