Flying Calligrapher: Contact-Aware Motion and Force Planning and Control for Aerial Manipulation

Xiaofeng Guo*1   Guanqi He*1   Jiahe Xu1   Mohammadreza Mousaei1   Junyi Geng2   Sebastian Scherer1   Guanya Shi1  
*Equal Contribution, 1Carnegie Mellon University, 2Pennsylvania State University

Teaser Video

Abstract

Aerial manipulation has gained interest for completing high-altitude tasks that are challenging for human workers, such as contact inspection and defect detection. Previous research has focused on maintaining static contact points or forces. This letter addresses a more general and dynamic task: simultaneously tracking time-varying contact force and motion trajectories on tangential surfaces. We propose a pipeline that includes contact-aware trajectory planning to generate dynamic, feasible trajectories and a hybrid motion-force controller to compensate for contact and friction forces. We demonstrate the approach on an aerial calligraphy task using a novel sponge pen design as the end-effector. Additionally, we developed a touchscreen interface for flexible user input. Experiments show our method can effectively draw diverse letters, achieving an IoU of 0.59 and an end-effector position tracking RMSE of 2.93 cm.Aerial manipulation has gained interest for completing high-altitude tasks that are challenging for human workers, such as contact inspection and defect detection. Previous research has focused on maintaining static contact points or forces. This letter addresses a more general and dynamic task: simultaneously tracking time-varying contact force and motion trajectories on tangential surfaces. We propose a pipeline that includes contact-aware trajectory planning to generate dynamic, feasible trajectories and a hybrid motion-force controller to compensate for contact and friction forces. We demonstrate the approach on an aerial calligraphy task using a novel sponge pen design as the end-effector. Additionally, we developed a touchscreen interface for flexible user input. Experiments show our method can effectively draw diverse letters, achieving an IoU of 0.59 and an end-effector position tracking RMSE of 2.93 cm.

Method

teaser

pipeline

Experiment Results

Single Letter Drawing

write letter 'A'

trial 1

trial 2

trial 3

write letter 'I'

trial 1

trial 2

trial 3

write letter 'R'

trial 1

trial 2

trial 3

Complex Letter Drawing

writing '2024'

writing a Chinese idiom "知行合一" (meaning: Unity of Knowledge and Action)

Ablation Study

Control Comparison

without contact-related ff

our method

Trajectory Planning Comparison

with equal distance sample trajecotry generation

our method

Speed Comparison

vmax = 24.3 cm/s

vmax = 33.1 cm/s

vmax = 40.2 cm/s

Media


BibTeX

@article{guo2024flying,
      title={Flying Calligrapher: Contact-Aware Motion and Force Planning and Control for Aerial Manipulation},
      author={Guo, Xiaofeng and He, Guanqi and Xu, Jiahe and Mousaei, Mohammadreza and Geng, Junyi and Scherer, Sebastian and Shi, Guanya},
      journal={arXiv preprint arXiv:2407.05587},
      year={2024}
      }