Kun Song

Kun Song

Home

CV


Contact:
The University of Hong Kong
Pokfulam Road, Hong Kong
kunsonghku@connect.hku.hk

About Me

I am a Ph.D. sutdent in CS department in The University of Hong Kong (HKU) adviced by Jia Pan. Before that, I obtained my master's degree in RCMVL (Robot Control and Machine Vision Lab) of Shanghai Jiao Tong University (SJTU) advised by Prof. Zhenhua Xiong in 2025. I got my bachelor degree in Mechanical Engeering with honor from SJTU in 2022.

In 2024, I was a research assistant in MSC-Lab at UC Berkely advised by Prof. Masayoshi Tomizuka and Prof. Mingyu Ding.

I am generally interested in enabling robotics systems, like autonomous cars, mobile manipulators, multi-robot system, and humanoids, to interact with the environment intelligently and safely. To be more specific, my research topics lie in the crossing field of perception, planning, control, optimization, foundation models, reinforcement learning, and imitation learning.

  • Robot Learning: Reinforcement Learning, Imitation Learning, VLA, LLM, VLM, Diffusion Model;
  • Multi-robot System: Cooperative Manipulation, Multi-robot SLAM, Formation Control, Relative Pose Accuracy in a Swarm;
  • Robot Perception: Scene Understanding, SLAM System, Light-weight Mapping;
Currently, I am working on using VLM/VLA for collaborative manipulation and humanoid robots. I am open for the opportunty of collaboration. Feel free to contact me if there's anything I can help you.

News and Updates

  • Octo. 2025: Our paper (CollaBot) was accepted by IROS 2025 CIM Workshop
  • Jun. 2025: Our paper (P2 Explore) was accepted by IROS 2025
  • Mar. 2025: Our paper (planning for mobile manipulators) was accepted by RA-L
  • Jan. 2025: Our paper (containmen control) was accepted by TRO, congratulations for Ren
  • Aug. 2024: Our paper (multi-robot rendezvous) was accepted by RA-L
  • May 2024: Our paper (RHAML) was accepted by RA-L
  • Apr. 2024: Our paper (FHT-Map) was accepted by RA-L
  • Jan. 2024: Create this website

Publications

(* indicates equal contribution)
hpp

CollaBot: Vision-Language Guided Simultaneous Collaborative Manipulation of Large Objects
Kun Song, Shentao Ma, Gaoming Chen, Ninglong Jin, Guangbao Zhao, Mingyu Ding, Zhenhua Xiong, and Jia Pan
IROS, 2025, CIM Workshop

We propose CollaBot, the first generalist framework for simultaneous collaborative manipulation. First, we use SEEM for scene segmentation and point cloud extraction of the target object. Then, we propose a collaborative grasping framework, which decomposes the task into local grasp pose generation and global collaboration. Finally, we design a 2-stage planning module that can generate collision-free trajectories to achieve this task.
hpp

P2 Explore: Efficient Exploration in Unknown Cluttered Environment with Floor Plan Prediction
Kun Song, Gaoming Chen, Masayoshi Tomizuka, Wei Zhan, Zhenhua Xiong, and Mingyu Ding
IROS, 2025

We propose P2 Explore, a framework that predicts the unseen floor plan based in cluttered environments. Based on the predicted map, we extract room segmentations and generate their topology. Exploration is accelerated under the guidance of this topology.
hpp

A Novel Planning Framework for Complex Flipping Manipulation of Multiple Mobile Manipulators
Wenhang Liu, Meng Ren, Kun Song, Yu Wang, and Zhenhua Xiong
Robotics and Automation Letters, 2025

We propose a novel planning framework for complex flipping manipulation by incorporating platform motions and regrasping. We formulate the planning problem as a set cover problem and determine minimal number of regrasping.
hpp

Containment Control of Multi-Robot Systems with Non-uniform Time-varying Delays
Meng Ren, Wenhang Liu, Kun Song, Ling Shi, and Zhenhua Xiong
IEEE Transactions on Robotics, 2025

We propose a containment control law for double-integrator MRSs subject to non-uniform time-varying delays. The stability is proved by the Lyapunov-Krasovskii function and linear matrix inequalities
hpp
Multi-Robot Rendezvous in Unknown Environment with Limited Communication
Kun Song, Gaoming Chen, Wenhang Liu, and Zhenhua Xiong
Robotics and Automation Letters, 2024
We focus on rendezvous in unknown environments where communication is available. We divide this task into two steps: rendezvous based environment exploration with relative pose estimation and rendezvous point selection. A new strategy called partitioned and incomplete exploration for rendezvous (PIER) is proposed to efficiently explore the unknown environment and a rendezvous point can be selected for efficient rendezvous.
hpp

RHAML: Rendezvous-based Hierarchical Architecture for Mutual Localization
Gaoming Chen, Kun Song, Xiang Xu, Wenhang Liu, and Zhenhua Xiong
Robotics and Automation Letters, 2024

We propose a novel rendezvous-based hierarchical architecture for mutual localization (RHAML). Anisotropic convolutions are introduced into the network, yielding initial localization results and the iterative refinement module with rendering is employed. Finally, the pose graph optimization is conducted to obtain more accurate results.
hpp

FHT-Map: Feature-based Hybrid Topological Map for Relocalization and Path Planning
Kun Song, Wenhang Liu, Gaoming Chen, Xiang Xu, and Zhenhua Xiong
Robotics and Automation Letters, 2024

We propose a feature-based hybrid topological map (FHT-Map) which consists of two types of nodes: main node and support node. Main nodes store compressed visual information and laser scan to enhance subsequent relocalization capability. Support nodes retain a minimal amount of data to ensure storage efficiency while facilitating path planning.

Coming Soon
hpp

A Novel Dynamic Localization Graph for Efficient Mutual Localization
Gaoming Chen, Kun Song, Wenhang Liu, Wenyao Ma, and Zhenhua Xiong
Submitted; RAL, 2024

Paper / Code
We propose DLG, a sensor-independent framework, to assess the uncertainty during the multi-robot mutual localization. We validate the proposed method by implementing it on a place recognition based scenario.
hpp

Distributed Motion Control of Multiple Mobile Manipulator System with Disturbance and Communication Delay
Wenhang Liu, Meng Ren, Kun Song, Michael Yu Wang, and Zhenhua Xiong
Under Review; TASE, 2024

We present a novel distributed motion control approach aimed at reducing the interaction forces between multiple mobile manipulators. The stability of the control law is rigorously proven by the Lyapunov theorem and the results are validated in simulations and experiments.

Academic Services

  • Conference Reviewer: AAAI, ICRA, IROS, AIM
  • Journal Reviewer: T-RO, RA-L, RAS

  • Teaching

  • TA: COMP7308 Introduction to Unmanned Systems 2025 Fall
  • TA: ME4409 Multi-robot system and control 2023 Fall
  • TA: ME3403 Robotics 2024 Spring