Publications

SonicID: User Identification on Smart Glasses with Acoustic Sensing

Published in The Proceedings of the Association for Computing Machinery on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT)/UbiComp, 2024

December 2024. Keyword: User Identification, Smart Glasses, Acoustic Sensing, Machine Learning

Recommended citation: Ke Li, Devansh Agarwal, Ruidong Zhang, Vipin Gunda, Tianjun Mo, Saif Mahmud, Boao Chen, François Guimbretière, and Cheng Zhang. 2024. SonicID: User Identification on Smart Glasses with Acoustic Sensing. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 8, 4, Article 169 (December 2024), 27 pages. (Accepted for Publication) https://arxiv.org/abs/2406.08273

ActSonic: Recognizing Everyday Activities from Inaudible Acoustic Waves Around the Body

Published in The Proceedings of the Association for Computing Machinery on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT)/UbiComp, 2024

December 2024. Keyword: Acoustic Sensing, Activity Recognition, Self-supervised Leaning

Recommended citation: Saif Mahmud, Vineet Parikh, Qikang Liang, Ke Li, Ruidong Zhang, Ashwin Ajit, Vipin Gunda, Devansh Agarwal, François Guimbretière, and Cheng Zhang. 2024. ActSonic: Recognizing Everyday Activities from Inaudible Acoustic Waves Around the Body. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 8, 4, Article 183 (December 2024), 32 pages. (Accepted for Publication) https://arxiv.org/abs/2404.13924

Ring-a-Pose: A Ring for Continuous Hand Pose Tracking

Published in The Proceedings of the Association for Computing Machinery on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT)/UbiComp, 2024

December 2024. Keyword: 3D Hand Pose Tracking, Micro-finger Gesture Recognition, Smart Ring, Acoustic Sensing

Recommended citation: Tianhong Catherine Yu, Guilin Hu, Ruidong Zhang, Hyunchul Lim, Saif Mahmud, Chi-Jung Lee, Ke Li, Devansh Agarwal, Shuyang Nie, Jinseok Oh, François Guimbretière, and Cheng Zhang. 2024. Ring-a-Pose: A Ring for Continuous Hand Pose Tracking. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 8, 4, Article 189 (December 2024), 30 pages. (Accepted for Publication) https://arxiv.org/abs/2404.12980

EchoGuide: Active Acoustic Guidance for LLM-Based Eating Event Analysis from Egocentric Videos

Published in The Proceedings of the International Symposium on Wearable Computers (ISWC), 2024

October 5-9, 2024, Melbourne, Australia. Keyword: Eating Detection, Acoustic Sensing, Activity Recognition, Foundation Models

Recommended citation: Vineet Parikh, Saif Mahmud, Devansh Agarwal, Ke Li, François Guimbretière, and Cheng Zhang. 2024. EchoGuide: Active Acoustic Guidance for LLM-Based Eating Event Analysis from Egocentric Videos. In Proceedings of the 2024 ACM International Symposium on Wearable Computers (ISWC). Association for Computing Machinery, New York, NY, USA, 40–47. https://dl.acm.org/doi/10.1145/3675095.3676611

AI-Powered Eyewear for Routine Facial Expression Analysis in Parkinson’s Disease: Study Design and Goals

Published in The International Congress of Parkinson’s Disease and Movement Disorders, 2024

September 27-October 1, 2024, Philadelphia, PA, USA. Keyword: Parkinson’s Disease, Facial Expression Analysis, Acoustic Sensing, Smart Glasses

Recommended citation: H Y. Ooi, C. Zhang, K. Li, J. Narins, H. Sarva. AI-Powered Eyewear for Routine Facial Expression Analysis in Parkinson’s Disease: Study design and goals. Mov Disord. 2024; 39 (suppl 1). https://www.mdsabstracts.org/abstract/ai-powered-eyewear-for-routine-facial-expression-analysis-in-parkinsons-disease-study-design-and-goals/

GazeTrak: Exploring Acoustic-based Eye Tracking on a Glass Frame

Published in The Annual International Conference on Mobile Computing and Networking (MobiCom), 2024

November 18-22, 2024, Washington, D.C., USA. Keyword: Eye Tracking, Acoustic Sensing, Smart Glasses, Low-power

Recommended citation: Ke Li, Ruidong Zhang, Boao Chen, Siyuan Chen, Sicheng Yin, Saif Mahmud, Qikang Liang, Francois Guimbretiere, and Cheng Zhang. 2024. GazeTrak: Exploring Acoustic-based Eye Tracking on a Glass Frame. In Proceedings of the 30th Annual International Conference on Mobile Computing and Networking (ACM MobiCom). Association for Computing Machinery, New York, NY, USA, 497–512. https://dl.acm.org/doi/10.1145/3636534.3649376

EyeEcho: Continuous and Low-power Facial Expression Tracking on Glasses

Published in The Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI), 2024

May 11-16, 2024, Honolulu, Hawaiʻi, USA. Keyword: Eye-mounted Wearable, Facial Expression Tracking, Acoustic Sensing, Low-power

Recommended citation: Ke Li, Ruidong Zhang, Siyuan Chen, Boao Chen, Mose Sakashita, Francois Guimbretiere, and Cheng Zhang. 2024. EyeEcho: Continuous and Low-power Facial Expression Tracking on Glasses. In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems (CHI). Association for Computing Machinery, New York, NY, USA, Article 319, 1–24. https://dl.acm.org/doi/10.1145/3613904.3642613

EchoWrist: Continuous Hand Pose Tracking and Hand-Object Interaction Recognition Using Low-Power Active Acoustic Sensing On a Wristband

Published in The Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI), 2024

May 11-16, 2024, Honolulu, Hawaiʻi, USA. Keyword: Acoustic Sensing, Smartwatch

Recommended citation: Chi-Jung Lee (Co-Primary), Ruidong Zhang (Co-Primary), Devansh Agarwal, Tianhong Catherine Yu, Vipin Gunda, Oliver Lopez, James Kim, Sicheng Yin, Boao Dong, Ke Li, Mose Sakashita, Francois Guimbretiere, and Cheng Zhang. 2024. EchoWrist: Continuous Hand Pose Tracking and Hand-Object Interaction Recognition Using Low-Power Active Acoustic Sensing On a Wristband. In Proceedings of the 2024 CHI Conference on Human Factors in Computing Systems (CHI). Association for Computing Machinery, New York, NY, USA, Article 403, 1–21. https://dl.acm.org/doi/10.1145/3613904.3642910

HPSpeech: Silent Speech Interface for Commodity Headphones

Published in The Proceedings of the International Symposium on Wearable Computers (ISWC), 2023

October 8-12, 2023, Cancún, Mexico. Keyword: Silent Speech, Acoustic Sensing, Headphones, Commodity-off-the-shelf (COTS)

Recommended citation: Ruidong Zhang, Hao Chen, Devansh Agarwal, Richard Jin, Ke Li, François Guimbretière, and Cheng Zhang. 2023. HPSpeech: Silent Speech Interface for Commodity Headphones. In Proceedings of the 2023 ACM International Symposium on Wearable Computers (ISWC). Association for Computing Machinery, New York, NY, USA, 60–65. https://dl.acm.org/doi/10.1145/3594738.3611365

EchoNose: Sensing Mouth, Breathing and Tongue Gestures inside Oral Cavity using a Non-contact Nose Interface

Published in The Proceedings of the International Symposium on Wearable Computers (ISWC), 2023

October 8-12, 2023, Cancún, Mexico. Keyword: Nose Interface, Tongue Gestures, Breathing Patterns, Silent Speech, Acoustic Sensing

Recommended citation: Rujia Sun, Xiaohe Zhou, Benjamin Steeper, Ruidong Zhang, Sicheng Yin, Ke Li, Shengzhang Wu, Sam Tilsen, Francois Guimbretiere, and Cheng Zhang. 2023. EchoNose: Sensing Mouth, Breathing and Tongue Gestures inside Oral Cavity using a Non-contact Nose Interface. In Proceedings of the 2023 ACM International Symposium on Wearable Computers (ISWC). Association for Computing Machinery, New York, NY, USA, 22–26. https://dl.acm.org/doi/10.1145/3594738.3611358

PoseSonic: 3D Upper Body Pose Estimation Through Egocentric Acoustic Sensing on Smartglasses

Published in The Proceedings of the Association for Computing Machinery on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT)/UbiComp, 2023

October 8-12, 2023, Cancún, Mexico. Keyword: Human Pose Estimation, Acoustic Sensing, Smart/AR Glasses, Deep Learning, Cross-Modal Supervision

Recommended citation: Saif Mahmud, Ke Li, Guilin Hu, Hao Chen, Richard Jin, Ruidong Zhang, François Guimbretière, and Cheng Zhang. 2023. PoseSonic: 3D Upper Body Pose Estimation Through Egocentric Acoustic Sensing on Smartglasses. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 7, 3, Article 111 (September 2023), 28 pages. https://dl.acm.org/doi/10.1145/3610895

EchoSpeech: Continuous Silent Speech Recognition on Minimally-obtrusive Eyewear Powered by Acoustic Sensing

Published in The Proceedings of the CHI Conference on Human Factors in Computing Systems (CHI), 2023

April 23–28, 2023, Hamburg, Germany. Keyword: Silent Speech Recognition, Acoustic Sensing, Smart Glasses

Recommended citation: Ruidong Zhang, Ke Li, Yihong Hao, Yufan Wang, Zhengnan Lai, François Guimbretière, and Cheng Zhang. 2023. EchoSpeech: Continuous Silent Speech Recognition on Minimally-obtrusive Eyewear Powered by Acoustic Sensing. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (CHI). Association for Computing Machinery, New York, NY, USA, Article 852, 1–18. https://doi.org/10.1145/3544548.3580801

EarIO: A Low-power Acoustic Sensing Earable for Continuously Tracking Detailed Facial Movements

Published in The Proceedings of the Association for Computing Machinery on Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT)/UbiComp, 2022

September 11–15, 2022, Atlanta, USA and Cambridge, UK. Keyword: Facial expression reconstruction, Acoustic sensing, Low-power, Deep learning

Recommended citation: Ke Li, Ruidong Zhang, Bo Liang, François Guimbretière, and Cheng Zhang. 2022. EarIO: A Low-power Acoustic Sensing Earable for Continuously Tracking Detailed Facial Movements. Proc. ACM Interact. Mob. Wearable Ubiquitous Technol. 6, 2, Article 62 (July 2022), 24 pages. https://doi.org/10.1145/3534621

Locating Everyday Objects using NFC Textiles

Published in The ACM/IEEE Conference on Information Processing in Sensor Networks (IPSN), 2021

May 18–21, 2021, Nashville, Tennessee, USA. Keyword: Near Field Communication, Localization, Textile Coils, Beamforming

Recommended citation: Jingxian Wang (Co-Primary), Junbo Zhang (Co-Primary), Ke Li, Chengfeng Pan, Carmel Majidi, and Swarun Kumar. 2021. Locating Everyday Objects using NFC Textiles. In Proceedings of the 20th International Conference on Information Processing in Sensor Networks (co-located with CPS-IoT Week 2021) (IPSN). Association for Computing Machinery, New York, NY, USA, 15–30. https://dl.acm.org/doi/10.1145/3412382.3458254

A Constant Factor Approximation for d-Hop Connected Dominating Set in 3-Dimensional Wireless Network

Published in IEEE Transactions on Wireless Communications (TWC), 2019

Keyword: Wireless Sensor Network, d-CDS, Spanning Tree, Cluster, Distributed Algorithm

Recommended citation: K. Li, X. Gao, F. Wu and G. Chen, "A Constant Factor Approximation for d -Hop Connected Dominating Set in Three-Dimensional Wireless Networks," in IEEE Transactions on Wireless Communications, vol. 18, no. 9, pp. 4357-4367, Sept. 2019. https://ieeexplore.ieee.org/document/8765348

QLEC: A Machine-Learning-Based Energy-Efficient Clustering Algorithm to Prolong Network Lifespan for IoT in High-Dimensional Space

Published in The International Conference on Parallel Processing (ICPP), 2019

August 5–8, 2019, Kyoto, Japan. Keyword: IoT, Energy-Efficient Clustering, Q-learning, Lifespan-Extended Network, High-Dimensional Space

Recommended citation: Ke Li, Haowei Huang, Xiaofeng Gao, Fan Wu, and Guihai Chen. 2019. QLEC: A Machine-Learning-Based Energy-Efficient Clustering Algorithm to Prolong Network Lifespan for IoT in High-Dimensional Space. In Proceedings of the 48th International Conference on Parallel Processing (ICPP). Association for Computing Machinery, New York, NY, USA, Article 105, 1–10. https://dl.acm.org/doi/10.1145/3337821.3337926