Memory-Augmented VLA Models for Long-Horizon Manipulation
I am exploring recurrent latent memory for embodied policies: using informative mid-layer hidden representations as compact memory that can be carried across policy inference steps while keeping training scalable.
- Extract mid-layer hidden states, transform them through an adapter, and feed the resulting memory tokens into the next policy step.
- Investigate an epoch-versioned memory bank that supports random-sample training without full backpropagation through time across long episodes.
- Use G0.5 as the backbone and study memory-dependent manipulation with RMBench, MIKASA, and RoboMME; the project is still at an early experimental stage.