Siyou Pei [Alum]


ECE Department

Office: 1762 Boelter Hall

Lab: 1762 Boelter Hall



Mixed reality creates exciting new opportunities for people to interact with computing resources and information. It has a rapidly growing user base that makes many predict that it will be the next ubiquitous device after smartphones. However, the existing interaction bandwidth between users and the Mixed Reality (MR) does not pair with the content bandwidth provided, which greatly limit the usability of MR, thus affecting the popularity of MR as ubiquitous device.

Therefore, my ultimate goal is to increase the interaction bandwidth between users and MR. There are two dimensions to broaden the bandwidth: techniques/design of interaction with virtual objects and environments, and supporting sensing technologies for MR input/output. Interaction design for a new generation of platforms is challenging while it gives us the opportunity to define a new era of interaction experience. In response, my primary research interests are developing interaction techniques and supporting sensing technologies for MR, in the field of human-computer interaction (HCI). Like how GUI and mouse made computers popular, breakthrough of the human-MR interaction will result in a much larger user group with higher frequency of use, empowered by expressive interaction and related sensing technologies. Humans will get used to being “virtually” present in MR, fluently manipulate virtual objects and explore the environments from all perspectives.

I enjoy my time at NESL. Now I am a PhD student at HiLab. More about me here.


  • Bachelor of Science in Electronic & lnformation Engineering, Zhejiang University, 2019.
  • Master of Science in Electrical & Computer Engineering, UCLA, 2021.
    Thesis: Designing Augmented Reality and Virtual Reality Interfaces around Hand Expressivity

Research Interests: Expressive interactions and sensing for Mixed Reality

Recent Publications:

  • Auritus: An Open-Source Optimization Toolkit for Training and Deployment of Human Movement Models and Filters using Earables
    Swapnil Sayan Saha, Sandeep Singh Sandha, Siyou Pei, Ziqi Wang, Ankur Sarker, and Mani B. Srivastava.
    Proceedings of the ACM on Interactive Mobile Wearable and Ubiquitous Technologies (IMWUT), May 2022. [ Details ]

Other Publications: Pei, S., Chen, A., Lee, J., & Zhang, Y. (2022, April). Hand Interfaces: Using Hands to Imitate Objects in AR/VR for Expressive Interactions. In CHI Conference on Human Factors in Computing Systems (pp. 1-16).