Saif Mahmud

Saif Mahmud

Ph.D. Candidate · Cornell University · SciFi Lab

Advised by Prof. Cheng Zhang

Committee: Prof. Tanzeem Choudhury, Prof. Deborah Estrin

Now Research Intern at BehaviorAI (Founding Team) · NYC

I build wearable systems that combine acoustic sensing, inertial sensors (IMU), and egocentric vision with machine learning to understand fine-grained human behavior, from full-body pose tracking to everyday activity recognition, on devices like smartglasses, smartwatches, rings, and clothing.

Seeking research internships · Fall 2026 / Spring 2027 · get in touch
SEE OLDER UPDATES
  • Aug 2022milestone Started my Ph.D. at Cornell University.
  • Feb 2021paper "Hierarchical Self Attention Based Autoencoder" accepted at PAKDD 2021.
  • Jan 2020paper "Human Activity Recognition Using Self-Attention" accepted at ECAI 2020.

Publications

Acoustic Sensing on Smart Glasses

7 papers

Active sonar on glasses for fine-grained, camera-free sensing of the body, face, and everyday behaviors. From recognizing daily activities and dietary actions to tracking 3D pose and gaze.

ActSonic

ActSonic: Recognizing Everyday Activities from Inaudible Acoustic Waves Around the Body

Saif Mahmud, V. Parikh, Q. Liang, K. Li, R. Zhang, A. Ajit, V. Gunda, D. Agarwal, F. Guimbretière, C. Zhang

IMWUT / UbiComp 2025

Under Review SonicGlasses

SonicGlasses: Smart Glasses Platform for Multi-Task Human Activity Tracking with Acoustic Sensing

K. Li, C. J. Lee, T. Gemicioglu, R. Zhang, J. Liu, Saif Mahmud, D. Agarwal, F. Guimbretière, C. Zhang

Preprint · Under Review

SonicID

SonicID: User Identification on Smart Glasses with Acoustic Sensing

K. Li, D. Agarwal, R. Zhang, V. Gunda, T. Mo, Saif Mahmud, B. Chen, F. Guimbretière, C. Zhang

IMWUT / UbiComp 2025

GazeTrak

GazeTrak: Exploring Acoustic-based Eye Tracking on a Glass

K. Li, R. Zhang, B. Chen, S. Chen, S. Yin, Saif Mahmud, F. Guimbretière, C. Zhang

MobiCom 2024

MunchSonic

MunchSonic: Tracking Fine-grained Dietary Actions through Active Acoustic Sensing on Eyeglasses

Saif Mahmud, D. Agarwal, A. Ajit, Q. Liang, T. Viranda, F. Guimbretière, C. Zhang

UbiComp / ISWC 2024

EchoGuide
🏆 Best Paper Honorable Mention

EchoGuide: Active Acoustic Guidance for LLM-Based Eating Event Analysis from Egocentric Videos

V. Parikh, Saif Mahmud, D. Agarwal, K. Li, F. Guimbretière, C. Zhang

UbiComp / ISWC 2024

PoseSonic

PoseSonic: 3D Upper Body Pose Estimation Through Egocentric Acoustic Sensing on Smartglasses

Saif Mahmud, K. Li, G. Hu, H. Chen, R. Jin, R. Zhang, F. Guimbretière, C. Zhang

IMWUT / UbiComp 2023

Wearable Sensing on Smartwatches, Rings & Clothing

4 papers

Extending acoustic, inertial, and capacitive sensing beyond glasses, into commercial smartwatches, rings, and clothing, to enable full-body pose tracking and continuous hand pose recognition on devices people already wear.

Under Review · Smartwatch EchoMotion

EchoMotion: Towards Full-Body Pose Tracking with a Single Smartwatch Using Active Acoustic Sensing

Saif Mahmud, J. Kim, K. Mahmoodi, T. C. Yu, Q. Liang, V. Parikh, F. Guimbretière, C. Zhang

Preprint · Under Review

Under Review · Smartwatch SonicFit

SonicFit: Cross-User Full-Body Pose Tracking for Fitness Exercises Using Active Acoustic and Inertial Sensing with a Single Commercial Smartwatch

J. Liu*, Saif Mahmud*, S. Liang, C. J. Lee, R. Zhang, C. Zhang

Preprint · Under Review

Ring-a-Pose

Ring-a-Pose: A Ring for Continuous Hand Pose Tracking

T. C. Yu, G. Hu, R. Zhang, H. Lim, Saif Mahmud, C. J. Lee, K. Li, D. Agarwal, S. Nie, J. Oh, F. Guimbretière, C. Zhang

IMWUT / UbiComp 2025

SeamPose

SeamPose: Repurposing Seams as Capacitive Sensors in a Shirt for Upper-Body Pose Tracking

T. C. Yu, M. Zhang, P. He, C. J. Lee, C. Cheesman, Saif Mahmud, R. Zhang, F. Guimbretière, C. Zhang

UIST 2024

Machine Learning for Sensor Data & Activity Recognition

4 papers

Self-attention, autoencoder, and graph-based sequence models for human activity recognition and spatio-temporal prediction tasks on wearable and IoT sensor data.

STLGRU

STLGRU: Spatio-Temporal Lightweight Graph GRU for Traffic Flow Prediction

K. K. Bhaumik, F. F. Niloy, Saif Mahmud, S. S. Woo

PAKDD 2024

Hierarchical Self-Attention

Hierarchical Self Attention Based Autoencoder for Open-Set Human Activity Recognition

M. T. H. Tonmoy*, Saif Mahmud*, A. K. M. M. Rahman, M. A. Amin, A. A. Ali

PAKDD 2021

Self-Attention HAR

Human Activity Recognition from Wearable Sensor Data Using Self-Attention

Saif Mahmud*, M. T. H. Tonmoy*, K. K. Bhaumik, A. K. M. M. Rahman, M. A. Amin, M. Shoyaib, M. A. H. Khan, A. A. Ali

ECAI 2020

GRU HAR

GRU-based Attention Mechanism for Human Activity Recognition

M. N. Haque, M. T. H. Tonmoy, Saif Mahmud, A. A. Ali, M. A. H. Khan, M. Shoyaib

ICASERT 2019

Wearable Devices with Wireless Transmitter-Receiver Pairs for Acoustic Sensing of User Characteristics →

US Patent Application 18/925,803 · US20250060782A1

Saif Mahmud, V. A. Parikh, R. Zhang, F. Guimbretière, C. Zhang

In the press

Show 12 more

Email: sm2446@cornell.edu
Office: 239 Gates Hall [map], Cornell University, 107 Hoy Rd, Ithaca, NY 14853, USA