PhD Candidate | Department of Computer Science, Dartmouth College
Hello, I am Luyang Zhao, a PhD candidate in Computer Science at Dartmouth College, mentored by Professor Devin Balkcom. I earned double majors in Computer Science and Mathematics during my undergraduate years at the University of Minnesota, where I worked on research projects with Professor Maria Gini.
My research focuses on the areas include:
Robotics: Soft Robotics, Modular Robotics, Swarm Robotics, and Bio-Inspired Systems.
Artificial Intelligence: Machine Learning and Large Language Models (LLMs) for robotic design and decision-making.
Robotic Systems and Simulation: Multi-Robot Systems, Motion Planning, SLAM, Robot Simulation, and Robotic Perception for real-world applications.
I was honored with the Neukom Outstanding Graduate Research Prize for my contributions to research. My work has garnered attention in the media, with coverage from
Tech Xplore,
Dartmouth College’s official website,
ScienceSprings and Communications of the ACM.
I have also mentored graduate and undergraduate students on various research projects.
Beyond academia, I gained industry experience through research internships at Amazon Robotics, where I worked on perception, localization, and path planning for Kiva robots in dynamic warehouse environments. At TuSimple, I optimized motion planning and decision-making algorithms for autonomous vehicles navigating local roads, addressing real-time navigation and safety challenges in urban and semi-structured environments.
Additionally, I co-organized the Tensegrity Robotics Workshop at IROS 2023 and reviewed papers for journals and conferences, including RA-L, ICRA, IROS, RoboSoft, and BioRob.
Feel free to connect with me via email at luyang.zhao.gr@dartmouth.edu.
Modular robots are currently designed to perform a variety of tasks, primarily focusing on locomotion or manipulation through the reconfiguration of rigid modules. However, the potential to integrate multiple functions, such as making each robot deployable and capable of building lattice structures for self-construction and infrastructure creation, remains largely unexplored. To advance the field, we hypothesize that combining tensegrity principles with modular robotics can create lightweight, deformable units capable of integrating three critical functions within a single design: navigating varied terrains, manipulating arbitrary shape objects, and assembling weight-sustainable, active large infrastructures. Here, we designed untethered modular robots that are deformable, lightweight, deployable, outdoor-scale, capable of bearing loads, and capable of 3D attachment and detachment. With these characteristics, the system can form various 3D structures using different assembly methods, such as walking into position or being transported by rotorcraft. The deformability and lightweight nature of each block enable the assembled structures to dynamically change shape, providing new capabilities such as added compliance during locomotion and manipulation and the ability to interact with the environment in tasks like tent and bridge assemblies. In summary, we suggest that integrating lightweight and deformable properties into modular robot design offers potential improvements in their adaptability and multi-functionality.
SoftRafts: Floating and Adaptive Soft Modular RobotsLuyang Zhao,
Yitao Jiang,
Chun-Yi She,
Alberto Quattrini Li,
Muhao Chen,
and Devin Balkcom
npj Robotics (Under Revision)
2024
[Abs]
[PDF]
[Video]
Modular robots possess great potential due to their adaptability and reconfigurability, yet their use in aquatic environments and dynamic multi-tasking scenarios—particularly for complex manipulation—remains largely underexplored. To address the need for versatile and multifunctional systems in such settings, we hypothesize that integrating soft-bending capabilities into modular robots can create a platform capable of navigating complex environments, performing diverse manipulation tasks, and assembling deformable lattices. In this work, we present a variable-stiffness soft modular robot that combines rigid 3D printed components with soft foam, utilizing a cable-actuated mechanism and a propeller. This modular robot can locomote, bend, steer, connect with other modules, and assemble into various larger active structures for different applications. For instance, when configured as a gripper, the robot can collect trash from the water’s surface. When assembled into a raft, it functions as a movable platform for drone landings. In a chain configuration, the robot moves like a snake on land and transitions seamlessly to aquatic locomotion using a propeller. Additionally, these robots can operate collectively like swarm robots, such as transporting boxes collaboratively across surfaces. Our findings highlight that incorporating deformable features into modular robot designs significantly enhances their adaptability and multifunctionality in aquatic environments.
SoftSnap: Rapid Prototyping of Untethered Soft Robots Using Snap-Together ModulesLuyang Zhao,
Yitao Jiang,
Chun-Yi She,
Muhao Chen,
and Devin Balkcom
Soft Robotics (Accepted)
2025
[Abs]
[arXiv]
[PDF]
[Video]
Soft robots offer adaptability and safe interaction with complex environments.
Rapid prototyping kits that allow soft robots to be assembled easily will allow
different geometries to be explored quickly to suit different environments or to
mimic the motion of biological organisms. We introduce SoftSnap modules: snaptogether components that enable the rapid assembly of a class of untethered soft
robots. Each SoftSnap module includes embedded computation, motor-driven
string actuation, and a flexible thermoplastic polyurethane (TPU) printed structure capable of deforming into various shapes based on the string configuration.
These modules can be easily connected with other SoftSnap modules or customizable connectors. We demonstrate the versatility of the SoftSnap system through
four configurations: a starfish-like robot, a brittle star robot, a snake robot, a
3D gripper, and a ring-shaped robot. These configurations highlight the ease of
assembly, adaptability, and functional diversity of the SoftSnap modules. The
SoftSnap modular system offers a scalable, snap-together approach to simplifying soft robot prototyping, making it easier for researchers to explore untethered
soft robotic systems rapidly.
StarBlocks: Soft Actuated Self-Connecting Blocks for Building Deformable Lattice StructuresLuyang Zhao,
Yijia Wu,
Wenzhong Yan,
Weishu Zhan,
Xiaonan Huang,
Joran Booth,
Ankur Mehta,
Kostas Bekris,
Rebecca Kramer-Bottiglio,
and Devin Balkcom
IEEE Robotics and Automation Letters
2023
[Abs]
[PDF]
[Video]
In this paper, we present a soft modular block inspired by tensegrity structures that can form load-bearing structures through self-assembly. The block comprises a stellated compliant
skeleton, shape memory alloy muscles, and permanent magnet connectors. We classify five deformation primitives for individual blocks: bend, compress, stretch, stand, and shrink, which can be
combined across modules to reason about full-lattice deformation. Hierarchical function is abundant in nature and in human-designed
systems. Using multiple self-assembled lattices, we demonstrate the formation and actuation of 3-dimensional shapes, including a
load-bearing pop-up tent, a self-assembled wheel, a quadruped, a block-based robotic arm with gripper, and non-prehensile manipulation. To our knowledge, this is the first example of active deformable modules (blocks) that can reconfigure into different
load-bearing structures on-demand.
Soft Lattice Modules That Behave Independently and CollectivelyLuyang Zhao,
Yijia Wu,
Julien Blanchet,
Maxine Perroni-Scharf,
Xiaonan Huang,
Joran Booth,
Rebecca Kramer-Bottiglio,
and Devin Balkcom
IEEE Robotics and Automation Letters
2022
[Abs]
[arXiv]
[PDF]
[Video]
Natural systems integrate the work of many sub-units (cells) toward a large-scale unified goal (morphological and behav- ioral), which can counteract the effects of unexpected experiences, damage, or simply changes in tasks demands. In this letter, we exploit the opportunities presented by soft, modular, and tensegrity robots to introduce soft lattice modules that parallel the sub-units seen in biological systems. The soft lattice modules are comprised of 3D printed plastic “skeletons,” linear contracting shape mem- ory alloy spring actuators, and permanent magnets that enable adhesion between modules. The soft lattice modules are capable of independent locomotion, and can also join with other modules to achieve collective, self-assembled, larger scale tasks such as collective locomotion and moving an object across the surface of the lattice assembly. This work represents a preliminary step toward soft modular systems capable of independent and collective behaviors, and provide a platform for future studies on distributed control.
An Untethered Bioinspired Robotic Tensegrity Dolphin with
Multi-Flexibility Design for Aquatic LocomotionLuyang Zhao,
Yitao Jiang,
Chun-Yi She,
Mingi Jeong,
Haibo Dong,
Alberto Quattrini Li,
Muhao Chen,
and Devin Balkcom
RoboSoft
2025
[Abs]
[arXiv]
[PDF]
[Video]
This paper presents the first steps toward a soft
dolphin robot using a bio-inspired approach to mimic dolphin
flexibility. The current dolphin robot uses a minimalist approach, with only two actuated cable-driven degrees of freedom
actuated by a pair of motors. The actuated tail moves up and
down in a swimming motion, but this first proof of concept does
not permit controlled turns of the robot. While existing robotic
dolphins typically use revolute joints to articulate rigid bodies,
our design – which will be made opensource – incorporates a
flexible tail with tunable silicone skin and actuation flexibility
via a cable-driven system, which mimics muscle dynamics and
design flexibility with a tunable skeleton structure. The design is
also tunable since the backbone can be easily printed in various
geometries. The paper provides insights into how a few such
variations affect robot motion and efficiency, measured by speed
and cost of transport (COT). This approach demonstrates the
potential of achieving dolphin-like motion through enhanced
flexibility in bio-inspired robotics.
PLRC*: A piecewise linear regression complex for approximating optimal robot motionLuyang Zhao,
Josiah Putman,
Weifu Wang,
and Devin Balkcom
IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS)
2020
[PDF]
Design and Experiment of a Lightweight Robotic Tensegrity
Morphing WingLuyang Zhao,
Yitao Jiang,
Chun-Yi She She,
Devin Balkcom,
Haibo Dong,
and Muhao Chen
On the Exploration of LM-Based Soft Modular Robot Design
Weicheng Ma*,
Luyang Zhao*,
Chun-Yi She*,
Yitao Jiang,
Alan Sun,
Bo Zhu,
Devin Balkcom,
and Soroush Vosoughi
* means equal contribution
[Abs]
[arXiv]
[PDF]
Recent large language models (LLMs) have demonstrated
promising capabilities in modeling real-world knowledge and
enhancing knowledge-based generation tasks. In this paper,
we further explore the potential of using LLMs to aid in
the design of soft modular robots, taking into account both
user instructions and physical laws, to reduce the reliance
on extensive trial-and-error experiments typically needed to
achieve robot designs that meet specific structural or task
requirements. Specifically, we formulate the robot design
process as a sequence generation task and find that LLMs
are able to capture key requirements expressed in natural
language and reflect them in the construction sequences
of robots. To simplify, rather than conducting real-world
experiments to assess design quality, we utilize a simulation
tool to provide feedback to the generative model, allowing
for iterative improvements without requiring extensive human annotations. Furthermore, we introduce five evaluation
metrics to assess the quality of robot designs from multiple
angles including task completion and adherence to instructions, supporting an automatic evaluation process. Our model
performs well in evaluations for designing soft modular
robots with uni- and bi-directional locomotion and stairdescending capabilities, highlighting the potential of using
natural language and LLMs for robot design. However, we
also observe certain limitations that suggest areas for further
improvement.
Exploring Spontaneous Social Interaction Swarm Robotics Powered by Large Language Models
Yitao Jiang,
Luyang Zhao,
Alberto Quattrini Li,
Muhao Chen,
and Devin Balkcom
2025
[Abs]
[PDF]
[Video]
Traditional swarm robots rely on specific communication and planning strategies to coordinate particular tasks. Human swarms exhibit distinctive characteristics due to their capacity for language-based communication and active reasoning. This paper presents an exploratory approach to robotic swarm intelligence that leverages Large Language Models (LLMs) to emulate human-like active problem-solving behaviors. We introduce a decentralized multi-robot system where each robot initially only has its local information and does not know others’ existence. The robots utilize LLMs for reasoning and natural language for inter-robot communication, enabling them to discover peers, share information, and coordinate actions dynamically. In a series of experiments in zero-shot settings, we observed human-like social behaviors, including mutual discovery, identification, information exchange, collaboration, negotiation, and error correction. While the technical approach is straightforward, the main contribution lies in exploring the interactive societies that LLM-driven robots form—a form of “robot anthropology” that examines emergent collaborative structures.
LLDM: Locally linear distance maps for robot motion planning: Extended Abstract
Josiah Putman,
Lisa Oh,
Luyang Zhao,
Evan Honnold,
Galen Brown,
Weifu Wang,
and Devin Balkcom
International Symposium on Multi-Robot and Multi-Agent Systems (MRS)
2019
[PDF]
Piecewise linear regressions for approximating distance metrics
Josiah Putman,
Lisa Oh,
Luyang Zhao,
Evan Honnold,
Galen Brown,
Weifu Wang,
and Devin J. Balkcom
ArXiv
2020
[arXiv]
[PDF]
Multi-modal Perception Dataset of In-water Objects for Autonomous Surface Vehicles
Mingi Jeong,
Arihant Chadda,
Ziang Ren,
Luyang Zhao,
Haowen Liu,
Monika Roznere,
Aiwei Zhang,
Yitao Jiang,
Sabriel Achong,
Samuel Lensgraf,
and Alberto Quattrini Li
IEEE ICRA Workshop on Field Robotics
2024
SeePerSea: Multi-modal Perception Dataset of In-water Objects for Autonomous Surface Vehicles
Mingi Jeong,
Arihant Chadda,
Ziang Ren,
Luyang Zhao,
Haowen Liu,
Monika Roznere,
Aiwei Zhang,
Yitao Jiang,
Sabriel Achong,
Samuel Lensgraf,
and Alberto Quattrini Li
2025
[Abs]
[arXiv]
[PDF]
This paper introduces the first publicly accessible labeled multi-modal perception dataset for autonomous maritime navigation, focusing on in-water obstacles within the aquatic environment to enhance situational awareness for Autonomous Surface Vehicles (ASVs). This dataset, collected over 4 years and consisting of diverse objects encountered under varying environmental conditions, aims to bridge the research gap in autonomous surface vehicles by providing a multimodal, annotated, and ego-centric perception dataset, for object detection and classification. We also show the applicability of the proposed dataset by training deep learning-based open-source perception algorithms that have shown success. We expect that our dataset will contribute to development of the marine autonomy pipelines and marine (field) robotics. This dataset is opensource and can be found at https://seepersea.github.io/.
Assistive AI for Coping with Memory Loss
Libby Ferland,
Ziwei Li,
Shridhar Sukhani,
Joan Zheng,
Luyang Zhao,
and Maria L. Gini
AAAI Workshops
2018
[PDF]
Teaching
Teaching Assistant: Dartmouth College (Sep. 2018 - Now)
Master students: Chun-Yi She (2023-now), Yitao Jiang (2022-now, incoming PhD student at Dartmouth), Yijia Wu (2021-2022, now PhD student at WPI), Weishu Zhan (2022-2023, incoming PhD student at The University of Manchester)
Undergraduate students: Josiah Putman (now in Google), Maxine Perroni-Scharf (now PhD student at MIT)
Recent Highlights
Apr 23, 2025: Invited speaker at the RoboSoft 2025 Tensegrity Workshop (workshop link).
Apr 14, 2025: Invited research talk on Soft Modular Robots at NC State University, hosted by Professor Peng Gao.
Feb 18, 2025: Our ICRA art exhibition proposal, “SMILE: Soft Modular Intelligent Lattice for Entertainment,” has been accepted for the 2025 International Conference on Robotics and Automation (ICRA).
Feb 10, 2025: Delivered a seminar talk on Soft Modular Robots at Worcester Polytechnic Institute (WPI).
Feb 5, 2025: Our paper, “A Numerical and Experimental Tensegrity Robot Platform for Space Landing and Locomotion,” has been accepted for presentation at EMI 2025.
Feb 5, 2025: Delivered a seminar talk at The University of Tulsa.
Feb 3, 2025: Delivered a seminar talk at Clemson University on “Soft Modular Robots: From Modular Tensegrity Structures to Bioinspired Sea Robots.”
Jan 28, 2025: Invited as a guest lecturer in Professor Xiaonan Huang’s Soft Robotics course at the University of Michigan, where I presented my work on Soft Modular Robots.
Jan 5, 2025: Our Tensegrity dolphin paper got accepted in RoboSoft 2025.
Aug 26, 2024: Our Tensegrity Morphing Airfoil got accepted in 2025 AIAA SciTech.
May 31, 2024: Selected for a talk about “Self-Assembling Soft Modular Robots for Manipulation” for NEMS 2024.
April 14, 2024: Presented own work at RoboSoft 2024.
December, 2023: Became Admissions Ambassador for Dartmouth College.
PLRC*: A piecewise linear regression complex for approximating optimal robot motion IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) 2020 [PDF]
Design and Experiment of a Lightweight Robotic Tensegrity Morphing Wing
LLDM: Locally linear distance maps for robot motion planning: Extended Abstract International Symposium on Multi-Robot and Multi-Agent Systems (MRS) 2019 [PDF]
Multi-modal Perception Dataset of In-water Objects for Autonomous Surface Vehicles IEEE ICRA Workshop on Field Robotics 2024
