Paper Detail

From Language to Drives: A Multimodal Framework for Aligning Autonomous Robots with Human Purposes

Diana Cerdas-Vargas, Alejandro Romero, Richard J. Duro

arxiv Score 14.3

Published 2026-10-26 · First seen 2026-10-27

General AI

Abstract

This work explores a multimodal approach to the alignment of the behavior of open-ended learning autonomous robots with human purposes through the use of large language models as cultural enablers. While autonomous robots can generate their own skills and goals through interaction with the environment, they often lack mechanisms to ensure that these remain relevant and aligned to those of human users. The proposed approach makes use of the general and cultural knowledge contained in LLMs and VLMs to establish a multimodal interactive alignment process in which human purposes, expressed in natural language, are transformed into motivational components of a robot architecture in the form of robot missions and drives that guide the behavior of the robot. The system is structured into three layers for semantic alignment, mission generation, and drive modeling. This design enables a bidirectional interaction loop: human inputs define high-level purposes, robots expand them into executable missions making use of multimodal information relayed by LLMs and VLMs, and feedback maintains alignment with human intent. Experiments in simulation and with a physical robot demonstrate that the process produces valid missions and behaviors, supporting effective human-agent alignment in interactive scenarios with autonomous robots.

Workflow Status

Review status
pending
Role
unreviewed
Read priority
now
Vote
Not set.
Saved
no
Collections
Not filed yet.
Next action
Not filled yet.

Reading Brief

No structured notes yet. Add `summary_sections`, `why_relevant`, `claim_impact`, or `next_action` in `papers.jsonl` to enrich this view.

Why It Surfaced

No ranking explanation is available yet.

Tags

No tags.

BibTeX

@article{cerdasvargas2026language,
  title = {From Language to Drives: A Multimodal Framework for Aligning Autonomous Robots with Human Purposes},
  author = {Diana Cerdas-Vargas and Alejandro Romero and Richard J. Duro},
  year = {2026},
  abstract = {This work explores a multimodal approach to the alignment of the behavior of open-ended learning autonomous robots with human purposes through the use of large language models as cultural enablers. While autonomous robots can generate their own skills and goals through interaction with the environment, they often lack mechanisms to ensure that these remain relevant and aligned to those of human users. The proposed approach makes use of the general and cultural knowledge contained in LLMs and VLM},
  url = {https://arxiv.org/abs/2610.35629},
  keywords = {cs.RO, cs.AI, cs.HC},
  eprint = {2610.35629},
  archiveprefix = {arXiv},
}

Metadata

{}