Paper Detail

Sensorium: An Open-Source Multimodal Data Collection and Curation Library for Embodied Surgical AI

Lorenzo Mazza, Ariel Rodriguez, Stefanie Speidel

arxiv Score 8.3

Published 2026-10-30 · First seen 2026-11-02

General AI

Abstract

Embodied surgical AI requires reliable multimodal data, yet surgical data collection remains costly, difficult to repeat, and strongly dependent on the hardware setup. We present Sensorium, an open-source Python library for recording, processing, annotating, and curating multimodal surgical data from configurable robot and sensor streams using the Robot Operating System (ROS) and ROS2 middleware. The library combines operator-facing data acquisition, configurable processing, semantic annotation, and episodic dataset generation. We evaluate Sensorium across 1516 recordings of phantom, ex vivo, and in vivo porcine experiments involving multiple surgical tasks and sensing configurations, and report preliminary usability feedback.

Workflow Status

Review status
pending
Role
unreviewed
Read priority
soon
Vote
Not set.
Saved
no
Collections
Not filed yet.
Next action
Not filled yet.

Reading Brief

No structured notes yet. Add `summary_sections`, `why_relevant`, `claim_impact`, or `next_action` in `papers.jsonl` to enrich this view.

Why It Surfaced

No ranking explanation is available yet.

Tags

No tags.

BibTeX

@article{mazza2026sensorium,
  title = {Sensorium: An Open-Source Multimodal Data Collection and Curation Library for Embodied Surgical AI},
  author = {Lorenzo Mazza and Ariel Rodriguez and Stefanie Speidel},
  year = {2026},
  abstract = {Embodied surgical AI requires reliable multimodal data, yet surgical data collection remains costly, difficult to repeat, and strongly dependent on the hardware setup. We present Sensorium, an open-source Python library for recording, processing, annotating, and curating multimodal surgical data from configurable robot and sensor streams using the Robot Operating System (ROS) and ROS2 middleware. The library combines operator-facing data acquisition, configurable processing, semantic annotation,},
  url = {https://arxiv.org/abs/2610.41946},
  keywords = {cs.AI, cs.RO},
  eprint = {2610.41946},
  archiveprefix = {arXiv},
}

Metadata

{}