Award Abstract # 1763689
RI: Medium: Light Responsive Polymer Magnetic Microrobots with Dual Mode Sensing for Biomedical and Advanced Manufacturing Applications

NSF Org: IIS
Div Of Information & Intelligent Systems
Recipient: PURDUE UNIVERSITY
Initial Amendment Date: July 29, 2018
Latest Amendment Date: May 5, 2020
Award Number: 1763689
Award Instrument: Standard Grant
Program Manager: Jie Yang
jyang@nsf.gov
 (703)292-4768
IIS
 Div Of Information & Intelligent Systems
CSE
 Direct For Computer & Info Scie & Enginr
Start Date: September 1, 2018
End Date: August 31, 2023 (Estimated)
Total Intended Award Amount: $1,000,000.00
Total Awarded Amount to Date: $1,008,000.00
Funds Obligated to Date: FY 2018 = $1,000,000.00
FY 2020 = $8,000.00
History of Investigator:
  • David Cappelleri (Principal Investigator)
    dcappell@purdue.edu
  • Song Zhang (Co-Principal Investigator)
Recipient Sponsored Research Office: Purdue University
2550 NORTHWESTERN AVE # 1100
WEST LAFAYETTE
IN  US  47906-1332
(765)494-1055
Sponsor Congressional District: 04
Primary Place of Performance: Purdue University
IN  US  47907-2088
Primary Place of Performance
Congressional District:
04
Unique Entity Identifier (UEI): YRXVL4JYCEF5
Parent UEI: YRXVL4JYCEF5
NSF Program(s): Robust Intelligence,
NRI-National Robotics Initiati
Primary Program Source: 01001819DB NSF RESEARCH & RELATED ACTIVIT
01002021DB NSF RESEARCH & RELATED ACTIVIT
Program Reference Code(s): 7495, 7924, 8086, 9251
Program Element Code(s): 749500, 801300
Award Agency Code: 4900
Fund Agency Code: 4900
Assistance Listing Number(s): 47.070

ABSTRACT

Microrobots have many potential applications in applications as diverse as biomedical and advanced manufacturing. While current microrobots can navigate using externally applied magnetic fields, their lack of sensing and manipulation limit their capabilities. In particular, micro-force information is essential for safe biomanipulation, sensing biological processes, and performing microassembly tasks in advanced manufacturing applications. In addition, mobile microrobots that can sense electrical potentials and connections of cells will enable the characterization and study of therapeutic strategies, assisting in the treatment of various cancers. As part of the planned outreach activities, researchers will develop STEM outreach programs with Deaf Kids CODE to help empower deaf/hard of hearing K-12 students.

To this end, the project will create a new class of light responsive polymer magnetic microrobots (LRPMMs) with active end-effectors and dual-mode sensing capabilities. An embedded magnetic body will enable the use of external magnetic fields to control microrobots to navigate in the workspace. The active end-effectors will be made from responsive polymers and actuated by structured light patterns. The polymer structures will be calibrated so vision-based force-sensing techniques can be applied. Additionally, electrochromic properties will be embedded into the polymers to enable detection of electrical potential levels in the environment through their change in color. The proposed research tasks include the design and fabrication of the LRPMMs; optical system development for structured light actuation, sensing, and tracking; and control and experimental validation.

This award reflects NSF's statutory mission and has been deemed worthy of support through evaluation using the Foundation's intellectual merit and broader impacts review criteria.

PUBLICATIONS PRODUCED AS A RESULT OF THIS RESEARCH

Note:  When clicking on a Digital Object Identifier (DOI) number, you will be taken to an external site maintained by the publisher. Some full text articles may not yet be available without a charge during the embargo (administrative interval).

Some links on this page may take you to non-federal websites. Their policies may differ from this site.

(Showing: 1 - 10 of 20)
Georges Adam, Gwenn Ulliac "Design and Characterization of a Fully 3D Printed Vision-Based Micro-Force Sensor for Microrobotic Applications" IEEE International Conference on Manipulation, Automation, and Robotics at Small-Scales (MARSS) , 2022 Citation Details
Chen, Liming and Hu, Xiaowei and Zhang, Song "Calibration method for an extended depth-of-field microscopic structured light system" Optics Express , v.30 , 2022 https://doi.org/10.1364/OE.448019 Citation Details
Chen, Liming and Xiang, Wang and Zhang, Song "Calibration method for a multi-focus microscopic 3D imaging system" Optics Letters , v.48 , 2023 https://doi.org/10.1364/OL.498283 Citation Details
Liao, Yi-Hong and Zhang, Song "Semi-Global Matching Assisted Absolute Phase Unwrapping" Sensors , v.23 , 2023 https://doi.org/10.3390/s23010411 Citation Details
Zhang, S. "Autofocus methods for 3D shape measurement with digital fringe projection techniques" SPIE Optics and Photonics , 2020 Citation Details
Tan, Liyuan and Cappelleri, David J. "Modeling of Bilayer Hydrogel Springs for Microrobots with Adaptive Locomotion" 2021 IEEE/RSJ International Conference on Intelligent Robots and Systems (IROS) , 2021 https://doi.org/10.1109/IROS51168.2021.9636693 Citation Details
Tan, Liyuan and Cappelleri, David J. "Design, Fabrication, and Characterization of a Helical Adaptive Multi-Material MicroRobot (HAMMR)" IEEE Robotics and Automation Letters , v.8 , 2023 https://doi.org/10.1109/LRA.2023.3242164 Citation Details
Marrugo, Andres G. and Gao, Feng and Zhang, Song "State-of-the-art active optical techniques for three-dimensional surface metrology: a review [Invited]" Journal of the Optical Society of America A , v.37 , 2020 https://doi.org/10.1364/JOSAA.398644 Citation Details
Hyun, Jae-Sang and Zhang, Song "Influence of projector pixel shape on ultrahigh-resolution 3D shape measurement" Optics Express , v.28 , 2020 https://doi.org/10.1364/OE.389331 Citation Details
Tan, Liyuan and Lee, Hyunjin and Fang, Li and Cappelleri, David J. "A Power Compensation Strategy for Achieving Homogeneous Microstructures for 4D Printing Shape-Adaptive PNIPAM Hydrogels: Out-of-Plane Variations" Gels , v.8 , 2022 https://doi.org/10.3390/gels8120828 Citation Details
Adam, Georges and Ulliac, Gwenn and Clevy, Cedric and Cappelleri, David J. "Design and Characterization of a Fully 3D Printed Vision-Based Micro-Force Sensor for Microrobotic Applications" 2022 International Conference on Manipulation, Automation and Robotics at Small Scales (MARSS) , 2022 https://doi.org/10.1109/MARSS55884.2022.9870488 Citation Details
(Showing: 1 - 10 of 20)

PROJECT OUTCOMES REPORT

Disclaimer

This Project Outcomes Report for the General Public is displayed verbatim as submitted by the Principal Investigator (PI) for this award. Any opinions, findings, and conclusions or recommendations expressed in this Report are those of the PI and do not necessarily reflect the views of the National Science Foundation; NSF has not approved or endorsed its content.

The goal of this research was to advance the state-of-the-art in mobile microrobotics and high-speed 3D optical sensing.  The main objectives were the following:

  • Objective 1. Design and fabricate a new class of responsive polymer magnetic microrobots (RPMMs): Microrobot geometries and responsive polymer magnetic material synthesis, characterization, and performance testing and evaluation will be conducted to realize this new class of mobile microrobots.
  • Objective 2. Targeted micro-scale structured-based 3D sensing of mobile microrobots: New closed-loop high speed structured light pattern techniques for the tracking and deformation sensing of multiple responsive polymer regions on the microrobots will be developed to satisfy the performance requirements of the new RPMM's.
  • Objective 3. Control & Experimental validation: develop control schemes utilizing our in-house magnetic manipulation testbeds along with the new structured light pattern generation system; characterize and evaluate the performance of the new class of RPMMs for various types of locomotion and micromanipulation tasks.

 

Intellectual Merit Outcomes

This research has successfully developed a new family of responsive polymer magnetic microrobots (RPMMs) along with other magnetic-based multi-functional microrobots for biomedical applications.  The two classes of RPMMs developed were the Helical Adaptive Multi-Material MicroRobots (HAMMRs) and the Modular Responsive Microrobots.  The HAMMRs consist of a hard-magnetic head and helical hydrogel tail that can adapt its geometry to its environment. It locomotes using a rotating magnetic field.  The Modular Responsive Microrobots consist of a magnetic base unit and sets of modular end-effectors.  A responsive mating component consisting of hydrogel material is used to connect the different end-effector types to the magnetic base for different applications.  It is controlled through the use of magnetic field gradients.  The Dual Locomotion Mode Multi-Functional Robot (uDMMF) is a novel microrobot that utilizes two distinct magnetic locomotion methods, a combination of rotating and gradient field control, for precise micro-object manipulation using multiple end-effectors.  A novel 3D optical sensing system was developed for the high-speed, high-resolution tracking of the microrobot's pose and real-time deformation.  Based on structured light patterns, a calibration method to achieve high measurement accuracy was developed along with a focus stacking method to enlarge the depth-of-field (DOF).  A novel absolute phase unwrapping algorithm which requires less fringe patterns for higher speed 3D optical sensing and a method to optimize microscopic 3D imaging speed were also created. 

 

Broader Impacts Outcomes

The great many applications for micro-scale robots and systems yield many potential broader impacts of this work. Advances in mechanobiology, automated biomanipulation, cancer cell screening, life science automation, microsurgery, drug delivery, and diagnostic testing with microrobots can impact the healthcare of many. The use of the RPMMs for micromanipulation and assembly of micro-scale components can have impacts in advanced manufacturing areas. It will enable the optimal construction of all sorts of small-scale devices and systems, such as cm-to-mm-scale robots. Additionally, the activities involving students at K-12, undergraduate and graduate levels along with the PI team's dissemination efforts have served to stimulate STEM interest and develop the future STEM workforce.

This project has impacted the educational experiences of 11 graduate students, 12, undergraduate students, 1 high school student, 3 post-doctoral researchers, and 1 visiting scholar who have been involved with it through the life of the award. All have been exposed to and trained on state-of-the-art technology.  This project has resulted in 26 peer reviewed journal or juried conference papers.  A US patent application was filed and issued based on this research in efforts to translate the developed technology for commercial applications.

 


Last Modified: 12/08/2023
Modified by: David Cappelleri

Please report errors in award information by writing to: awardsearch@nsf.gov.

Print this page

Back to Top of page