Soomin Shin

Soomin Shin

Ph.D. Candidate · Human-Robot Interaction · Human-AI Interaction · End-User Authoring System · Real-World Deployment

University of Waterloo · Electrical and Computer Engineering
Supervisor: Prof. Kerstin Dautenhahn · SIRRL

About

Research

I study why socially assistive robots fail to survive beyond research labs — and how to fix it. Through a 28-month co-design process and a 6-month in-the-wild deployment at a pediatric speech therapy center, I found that the core reason: creating and updating robot interaction requires researcher involvement, making real world adoption unsustainable.

My current work addresses this directly: I am building an LLM-powered authoring social robot system that enables non-technical users — therapists — to design, customize, and iterate on robot interactions without engineering support. The goal is a system where domain experts are authors of robot and AI behavior, not passive operators of researcher-defined scripts.

Prior to my Ph.D., I conducted research on contextual affect modeling at Korea University (ACM ICMI 2022), and worked as a research intern at KIST (2023) on multi-robot systems for hospital environments and human-robot trust.


Research Projects

Projects

Ongoing LLM-powered Social Robot System for Non-Technical End-User

An LLM-powered authoring system that gives non-technical clinicians direct control over AI-driven robot interactions — enabling them to create, customize, and iterate on therapy content without engineering support.

Role: Project Leader

LLM-powered system End-User Authoring Co-Design ROS
View more →
Deployed · 6 months 6-Month In-the-Wild Deployment: Socially Assistive Robots in a Pediatric Speech Therapy Centre [1, 2]

A 6-month real-world deployment with 9 children in an active speech therapy clinic — therapists operated the robot independently across repeated clinical sessions, surfacing what pre-scripted AI systems cannot sustain.

Role: Project Leader

In-the-Wild HRI Co-Design Python ROS
View more →
Published · IROS 2023 Robotic Assistance System for Hospital Isolation Wards [3]

Developed and evaluated a multi-robot system for hospital isolation wards, incorporating telemedicine, emergency alerts, and delivery services.

Role: User Study Design & Analysis

Multi-Robot Systems Usability Study Python ROS
View more →
Published · RO-MAN 2023 Human-Robot Trust and Control [5]

Investigated whether users prefer robots that act proactively or those that follow specific verbal commands — with implications for designing AI systems where end users maintain meaningful control.

Role: Project Leader

HRI Study Design User Studies Trust
View more →
Published · IROS 2023 Multi-Agent Robot Trust Studies [4]

Explored how perceived hierarchies between robots in a team affect human trust and service evaluation.

Role: Project Leader

HRI Study Design User Studies Trust
View more →
Published · ICMI 2022 Contextual Emotion Recognition [6]

Comparison study on human perception versus CNN-based contextual emotion recognition models, evaluating AI system perception against human baselines.

Role: Project Leader

Affective Computing Deep Learning Human Perception
View more →

Publications

Selected Publications

HRI 2026 · Pioneer Track · Acceptance rate: 23%
From co-design to deployment: Toward sustainable and scalable socially assistive robots for speech-language therapy
Shin, S.
RO-MAN 2025
How Co-design and Personas can Inform Game Implementation for Robot-assisted Speech Therapy in Clinical Settings
Shin, S., Chandra, S., Rajan, A., et al.
ICSR 2024
Development of Robot-Assisted Speech-Language Therapy: Co-design with Speech-Language Pathologists
Azizi, N., Chandra, S., Shin, S., Rajan, A., et al.
IROS 2023
Heterogeneous robot-assisted services in isolation wards: a system development and usability study
Kwon, Y., Shin, S., Yang, K., et al.
IROS 2023
Do Hierarchies in a Robot Team Impact the Service Evaluation by Users?
Shin, S., Kwak, S. S.
RO-MAN 2023
Is a Robot Trustworthy Enough to Delegate Your Control?
Shin, S., Kang, D., Kwak, S. S.
ICMI 2022
Contextual modulation of affect: Comparing humans and deep neural networks
Shin, S., Kim, D., Wallraven, C.

Contact

Get in Touch