About Me

I'm a machine learning engineer and researcher in the field of Human-Computer interaction (HCI). With my expertise at the intersection of HCI and applied machine learning, I invent, build, and evaluate new interaction techniques that notably improve the user experience.

Most recently, I work at Apple (AI/ML org) in Seattle, WA. Previously, I was a researcher at the University of Stuttgart where I received my Ph.D. in computer science (HCI). Don't hesitate to contact me in case of any questions.

Huy Viet Le
  • Experience
  • Apple
    2019 - Present

    Research / Machine Learning Engineer
    Seattle, WA, USA

  • University of Stuttgart
    2015 - 2019

    Research Associate
    Stuttgart, DE

  • Max Planck Institute
    2017

    Visiting Researcher
    Tübingen, DE

  • Lancaster University
    2015

    Visiting Researcher
    Lancaster, UK

  • Daimler TSS
    2014 - 2015

    Software Engineering Intern
    Stuttgart, DE

  • University of Stuttgart
    2011 - 2014

    Student Tutor
    Stuttgart, DE

  • Education
  • Ph.D.
    2015 - 2019

    Computer Science (HCI)
    University of Stuttgart

  • Master of Science
    2013 - 2015

    Software Engineering
    University of Stuttgart

  • Bachelor of Science
    2009 - 2012

    Software Engineering
    University of Stuttgart

Scientific Activities

I regularly contribute to premier HCI conferences.
  • Reviewed over 60 papers for ACM CHI '17, '18, '19, '20, '21, UIST '18, '19, '20, MobileHCI '16, '17, '18, '19, '20, IMWUT '19, ISS '17, '18, '19, '20, NordiCHI '16, '18, TEI '18, AH '18, MUM '17, Multimedia '17, and OzCHI '20
  • Served as program committee member for ACM CHI '19 (LBW), and ISS '19 (Papers)
  • Co-organized tutorials to teach HCI researchers how to apply machine learning to their projects at ACM MobileHCI '17, '18, MUM '17, PerDis '18, and the german Mensch & Computer '18 conference
  • Student volunteer at ACM MobileHCI '16, NordiCHI '16, '18, and MUM '17

Teaching

I lectured bachelor/master students to apply machine learning to HCI problems.
  • Machine Learning and Computer Vision for HCI (WS 2018/19)
  • Machine Learning for HCI (SS 2018)
  • Machine Learning for Intelligent Mobile User Interfaces with TensorFlow (WS 2017/18)
  • Media Informatics (WS 2017/18)
  • Multimodal Interaction for Ubiquitous Computers (WS 2017/18)
  • Physical Computing (SS 2017)
  • Mobile Multi-Device Interaction (SS 2016)

Press

My work was featured internationally.

Other Platforms

Publications

My research focus lies at the intersection of interactive systems and applied machine learning. A list of the latest peer-reviewed publications is also available on my  Google scholar profile. My ORCID is 0000-0001-5579-2875.

2020

PDF
Shortcut Gestures for Mobile Text Editing on Fully Touch Sensitive Smartphones.
Huy Viet Le, Sven Mayer, Maximilian Weiß, Jonas Vogelsang, Henrike Weingärtner, and Niels Henze. 2020. In ACM Trans. Comput.-Hum. Interact. 27, 5, Article 33 (August 2020).
@article{le2020shortcut,
    author = {Le, Huy Viet and Mayer, Sven and Wei\ss{}, Maximilian and Vogelsang, Jonas and Weing\"{a}rtner, Henrike and Henze, Niels},
    title = {Shortcut Gestures for Mobile Text Editing on Fully Touch Sensitive Smartphones},
    year = {2020},
    issue_date = {August 2020},
    publisher = {Association for Computing Machinery},
    address = {New York, NY, USA},
    volume = {27},
    number = {5},
    issn = {1073-0516},
    url = {https://doi.org/10.1145/3396233},
    doi = {10.1145/3396233},
    journal = {ACM Trans. Comput.-Hum. Interact.},
    month = {aug},
    articleno = {33},
    numpages = {38},
    keywords = {gestures, text editing, keyboard, Shortcuts, smartphone}
}
PDF
Imprint-Based Input Techniques for Touch-Based Mobile Devices.
Huy Viet Le, Sven Mayer, and Niels Henze. 2020. In Proceedings of the 19th International Conference on Mobile and Ubiquitous Multimedia (MUM '20). ACM, Essen, Germany.
@inproceedings{le2020imprint,
    author = {Le, Huy Viet and Mayer, Sven and Henze, Niels},
    title = {Imprint-Based Input Techniques for Touch-Based Mobile Devices},
    year = {2020},
    isbn = {9781450388702},
    publisher = {Association for Computing Machinery},
    address = {New York, NY, USA},
    url = {https://doi.org/10.1145/3428361.3428393},
    doi = {10.1145/3428361.3428393},
    booktitle = {19th International Conference on Mobile and Ubiquitous Multimedia},
    pages = {32–41},
    numpages = {10},
    keywords = {input, flexion, finger, touchscreen},
    location = {Essen, Germany},
    series = {MUM 2020}
}

2019

PDF
Investigating the Feasibility of Finger Identification on Capacitive Touchscreens Using Deep Learning.
Huy Viet Le, Sven Mayer, and Niels Henze. 2019. In Proceedings of the 24th International Conference on Intelligent User Interfaces (IUI '19). ACM, Marina del Ray, California.
@inproceedings{le2019investigating,
     author = {Le, Huy Viet and Mayer, Sven and Henze, Niels},
     title = {Investigating the Feasibility of Finger Identification on Capacitive Touchscreens Using Deep Learning},
     booktitle = {Proceedings of the 24th International Conference on Intelligent User Interfaces},
     series = {IUI '19},
     year = {2019},
     isbn = {978-1-4503-6272-6},
     location = {Marina del Ray, California},
     pages = {637--649},
     numpages = {13},
     url = {http://doi.acm.org/10.1145/3301275.3302295},
     doi = {10.1145/3301275.3302295},
     acmid = {3302295},
     publisher = {ACM},
     address = {New York, NY, USA},
     keywords = {capacitive image, deep learning, finger identification, finger-aware interaction, smartphone, touchscreen},
}
PDF
Investigating Unintended Inputs for One-Handed Touch Interaction Beyond the Touchscreen.
Huy Viet Le, Sven Mayer, Benedict Steuerlein, and Niels Henze. 2019. In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '19). ACM, Taipei, Taiwan.
@inproceedings{le2019unintended,
    author = {Le, Huy Viet and Mayer, Sven and Steuerlein, Benedict and Henze, Niels},
    title = {Investigating Unintended Inputs for One-Handed Touch Interaction Beyond the Touchscreen},
    booktitle = {Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services},
    series = {MobileHCI '19},
    year = {2019},
    isbn = {978-1-4503-6825-4},
    location = {Taipei, Taiwan},
    pages = {34:1--34:14},
    articleno = {34},
    numpages = {14},
    url = {http://doi.acm.org/10.1145/3338286.3340145},
    doi = {10.1145/3338286.3340145},
    acmid = {3340145},
    publisher = {ACM},
    address = {New York, NY, USA},
    keywords = {Finger movement, one-handed, smartphone, touch},
} 
PDF
Finding the Sweet Spot: Analyzing Unrestricted Touchscreen Interaction In-the-Wild.
Sven Mayer, Huy Viet Le, Markus Funk, and Niels Henze. 2019. In Proceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces (ISS'19). ACM, Daejeon, Republic of Korea.
@inproceedings{mayer2019finding,
    author = {Mayer, Sven and Le, Huy Viet and Funk, Markus and Henze, Niels},
    title = {Finding the Sweet Spot: Analyzing Unrestricted Touchscreen Interaction In-the-Wild},
    booktitle = {Proceedings of the 2019 ACM International Conference on Interactive Surfaces and Spaces},
    series = {ISS'19},
    year = {2019},
    isbn = {978-1-4503-6891-9},
    location = {Daejeon, Republic of Korea},
    numpages = {9},
    publisher = {ACM},
    address = {New York, NY, USA},
    keywords = {sweet spot, in-the-wild study, mobile device},
    url = {http://dx.doi.org/10.1145/3343055.3359705}, 
    doi = {10.1145/3343055.3359705},
    acmid= {3359705}, 
    pubstate = {forthcoming}
}
PDF
WindowWall: Towards Adaptive Buildings with Interactive Windows As Ubiquitous Displays.
Patrick Bader, Alexandra Voit, Huy Viet Le, Pawel W. Wozniak, Niels Henze, and Albrecht Schmidt. 2019. In ACM Transactions on Computer-Human Interaction 26, 2, Article 11 (March 2019).
@article{bader2019windowwall,
    author = {Bader, Patrick and Voit, Alexandra and Le, Huy Viet and Wozniak, Pawel W. and Henze, Niels and Schmidt, Albrecht},
    title = {WindowWall: Towards Adaptive Buildings with Interactive Windows As Ubiquitous Displays},
    journal = {ACM Transactions on Computer-Human Interaction},
    series = {TOCHI},
    issue_date = {March 2019},
    volume = {26},
    number = {2},
    month = {mar},
    year = {2019},
    issn = {1073-0516},
    pages = {11:1--11:42},
    articleno = {11},
    numpages = {42},
    url = {http://doi.acm.org/10.1145/3310275},
    doi = {10.1145/3310275},
    acmid = {3310275},
    publisher = {ACM},
    address = {New York, NY, USA},
    keywords = {Smart windows, adaptive buildings, ambient information systems, elicitation, see-through displays},
} 
PDF
Effect of Orientation on Unistroke Touch Gestures.
Sven Mayer, Valentin Schwind, Huy Viet Le, Dominik Weber, Jonas Vogelsang, Johannes Wolf, and Niels Henze. 2019. In Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems (CHI '19). ACM, Glasgow, Scotland UK.
@inproceedings{mayer2019effect,
    author = {Mayer, Sven and Schwind, Valentin and Le, Huy Viet and Weber, Dominik and Vogelsang, Jonas and Wolf, Johannes and Henze, Niels},
    title = {Effect of Orientation on Unistroke Touch Gestures},
    booktitle = {Proceedings of the 2019 CHI Conference on Human Factors in Computing Systems},
    series = {CHI '19},
    year = {2019},
    isbn = {978-1-4503-5970-2},
    location = {Glasgow, Scotland UK},
    numpages = {9},
    publisher = {ACM},
    address = {New York, NY, USA},
    keywords = {touch unistroke gestures, touch input, orientation, gesture set, user study, design guidelines, mobile device},
    url = {http://doi.acm.org/10.1145/3290605.3300928}, 
    doi = {10.1145/3290605.3300928},
    acmid = {3300928},
}
PDF
Improving the Input Accuracy of Touchscreens Using Deep Learning.
Abinaya Kumar, Aishwarya Radjesh, Sven Mayer, and Huy Viet Le. 2019. In Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems (CHI EA '19). ACM, Glasgow, Scotland Uk.
@inproceedings{kumar2019improving,
    author = {Kumar, Abinaya and Radjesh, Aishwarya and Mayer, Sven and Le, Huy Viet},
    title = {Improving the Input Accuracy of Touchscreens Using Deep Learning},
    booktitle = {Extended Abstracts of the 2019 CHI Conference on Human Factors in Computing Systems},
    series = {CHI EA '19},
    year = {2019},
    isbn = {978-1-4503-5971-9},
    location = {Glasgow, Scotland Uk},
    pages = {LBW1514:1--LBW1514:6},
    articleno = {LBW1514},
    numpages = {6},
    url = {http://doi.acm.org/10.1145/3290607.3312928},
    doi = {10.1145/3290607.3312928},
    acmid = {3312928},
    publisher = {ACM},
    address = {New York, NY, USA},
    keywords = {capacitive image, deep learning, input accuracy, smartphone, targeting, touch input, touchscreen},
}
PDF
KnuckleTouch: Enabling Knuckle Gestures on Capacitive Touchscreens Using Deep Learning.
Robin Schweigert, Jan Leusmann, Simon Hagenmayer, Maximilian Weiß, Huy Viet Le, Sven Mayer, and Andreas Bulling. 2019. In Proceedings of Mensch Und Computer 2019 (MuC'19). ACM, Hamburg, Germany.
@inproceedings{schweigert2019knuckletouch,
    author = {Schweigert, Robin and Leusmann, Jan and Hagenmayer, Simon and Wei\ss, Maximilian and Le, Huy Viet and Mayer, Sven and Bulling, Andreas},
    title = {KnuckleTouch: Enabling Knuckle Gestures on Capacitive Touchscreens Using Deep Learning},
    booktitle = {Proceedings of Mensch Und Computer 2019},
    series = {MuC'19},
    year = {2019},
    isbn = {978-1-4503-7198-8},
    location = {Hamburg, Germany},
    pages = {387--397},
    numpages = {11},
    url = {http://doi.acm.org/10.1145/3340764.3340767},
    doi = {10.1145/3340764.3340767},
    acmid = {3340767},
    publisher = {ACM},
    address = {New York, NY, USA},
    keywords = {CNN, DNN, KnuckleTouch, LSTM, input, knuckle},
} 
PDF
Force Touch Detection on Capacitive Sensors Using Deep Neural Networks.
Tobias Boceck, Sascha Sprott, Huy Viet Le, and Sven Mayer. 2019. In Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '19). ACM, Taipei, Taiwan.
@inproceedings{boceck2019force,
    author = {Boceck, Tobias and Sprott, Sascha and Le, Huy Viet and Mayer, Sven},
    title = {Force Touch Detection on Capacitive Sensors Using Deep Neural Networks},
    booktitle = {Proceedings of the 21st International Conference on Human-Computer Interaction with Mobile Devices and Services},
    series = {MobileHCI '19},
    year = {2019},
    isbn = {978-1-4503-6825-4},
    location = {Taipei, Taiwan},
    pages = {42:1--42:6},
    articleno = {42},
    numpages = {6},
    url = {http://doi.acm.org/10.1145/3338286.3344389},
    doi = {10.1145/3338286.3344389},
    acmid = {3344389},
    publisher = {ACM},
    address = {New York, NY, USA},
    keywords = {Force touch, capacitive sensor, deep neural networks, input dimension mutual, interaction, pressure},
} 

2018

PDF
InfiniTouch: Finger-Aware Interaction on Fully Touch Sensitive Smartphones.
Huy Viet Le, Sven Mayer, and Niels Henze. 2018. In Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology (UIST '18). ACM, Berlin, Germany.
@inproceedings{le2018infinitouch,
    author = {Le, Huy Viet and Mayer, Sven and Henze, Niels},
    title = {InfiniTouch: Finger-Aware Interaction on Fully Touch Sensitive Smartphones},
    booktitle = {Proceedings of the 31st Annual ACM Symposium on User Interface Software and Technology},
    series = {UIST '18},
    year = {2018},
    isbn = {978-1-4503-5948-1},
    location = {Berlin, Germany},
    pages = {779--792},
    numpages = {14},
    url = {http://doi.acm.org/10.1145/3242587.3242605},
    doi = {10.1145/3242587.3242605},
    acmid = {3242605},
    publisher = {ACM},
    address = {New York, NY, USA},
    keywords = {finger-aware interaction, machine learning, touchscreen},
} 
PDF
PalmTouch: Using the Palm As an Additional Input Modality on Commodity Smartphones.
Huy Viet Le, Thomas Kosch, Patrick Bader, Sven Mayer, and Niels Henze. 2018. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, Montreal QC, Canada.
@inproceedings{le2018palmtouch,
    author = {Le, Huy Viet and Kosch, Thomas and Bader, Patrick and Mayer, Sven and Henze, Niels},
    title = {PalmTouch: Using the Palm As an Additional Input Modality on Commodity Smartphones},
    booktitle = {Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems},
    series = {CHI '18},
    year = {2018},
    isbn = {978-1-4503-5620-6},
    location = {Montreal QC, Canada},
    pages = {360:1--360:13},
    articleno = {360},
    numpages = {13},
    url = {http://doi.acm.org/10.1145/3173574.3173934},
    doi = {10.1145/3173574.3173934},
    acmid = {3173934},
    publisher = {ACM},
    address = {New York, NY, USA},
    keywords = {capacitive image, machine learning, palm, smartphone},
} 
PDF
Fingers' Range and Comfortable Area for One-Handed Smartphone Interaction Beyond the Touchscreen.
Huy Viet Le, Sven Mayer, Patrick Bader, and Niels Henze. 2018. In Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems (CHI '18). ACM, Montreal QC, Canada.
@inproceedings{le2018fingers,
    author = {Le, Huy Viet and Mayer, Sven and Bader, Patrick and Henze, Niels},
    title = {Fingers' Range and Comfortable Area for One-Handed Smartphone Interaction Beyond the Touchscreen},
    booktitle = {Proceedings of the 2018 CHI Conference on Human Factors in Computing Systems},
    series = {CHI '18},
    year = {2018},
    isbn = {978-1-4503-5620-6},
    location = {Montreal QC, Canada},
    pages = {31:1--31:12},
    articleno = {31},
    numpages = {12},
    url = {http://doi.acm.org/10.1145/3173574.3173605},
    doi = {10.1145/3173574.3173605},
    acmid = {3173605},
    publisher = {ACM},
    address = {New York, NY, USA},
    keywords = {comfortable area, finger range, one-handed, smartphone},
} 
PDF
Designing Finger Orientation Input for Mobile Touchscreens.
Sven Mayer, Huy Viet Le, and Niels Henze. 2018. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '18). ACM, Barcelona, Spain.
@inproceedings{mayer2018designing,
    author = {Mayer, Sven and Le, Huy Viet and Henze, Niels},
    title = {Designing Finger Orientation Input for Mobile Touchscreens},
    booktitle = {Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services},
    series = {MobileHCI '18},
    year = {2018},
    isbn = {978-1-4503-5898-9},
    location = {Barcelona, Spain},
    pages = {29:1--29:9},
    articleno = {29},
    numpages = {9},
    url = {http://doi.acm.org/10.1145/3229434.3229444},
    doi = {10.1145/3229434.3229444},
    acmid = {3229444},
    publisher = {ACM},
    address = {New York, NY, USA},
    keywords = {ergonomic zone, ergonomics, finger orientation, mobile, non-comfort zone, pitch, surface, touch, yaw},
} 
PDF
Fully Hand-and-Finger-Aware Smartphone Interaction.
Huy Viet Le. 2018. In Proceedings of the Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems (CHI EA '18). ACM, Montreal QC, Canada.
@inproceedings{le2018fully,
    author = {Le, Huy Viet},
    title = {Fully Hand-and-Finger-Aware Smartphone Interaction},
    booktitle = {Proceedings of the Extended Abstracts of the 2018 CHI Conference on Human Factors in Computing Systems},
    series = {CHI EA '18},
    year = {2018},
    isbn = {978-1-4503-5621-3},
    location = {Montreal QC, Canada},
    pages = {DC13:1--DC13:4},
    articleno = {DC13},
    numpages = {4},
    url = {http://doi.acm.org/10.1145/3170427.3173023},
    doi = {10.1145/3170427.3173023},
    acmid = {3173023},
    publisher = {ACM},
    address = {New York, NY, USA},
    keywords = {mobile device, on-device touch input, touch interaction},
} 
PDF
The Effect of Road Bumps on Touch Interaction in Cars.
Sven Mayer, Huy Viet Le, Alessandro Nesti, Niels Henze, Heinrich H. Bülthoff, and Lewis L. Chuang. 2018. In Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications (AutomotiveUI '18). ACM, Toronto, ON, Canada.
@inproceedings{mayer2018effect,
    author = {Mayer, Sven and Le, Huy Viet and Nesti, Alessandro and Henze, Niels and B\"{u}lthoff, Heinrich H. and Chuang, Lewis L.},
    title = {The Effect of Road Bumps on Touch Interaction in Cars},
    booktitle = {Proceedings of the 10th International Conference on Automotive User Interfaces and Interactive Vehicular Applications},
    series = {AutomotiveUI '18},
    year = {2018},
    isbn = {978-1-4503-5946-7},
    location = {Toronto, ON, Canada},
    pages = {85--93},
    numpages = {9},
    url = {http://doi.acm.org/10.1145/3239060.3239071},
    doi = {10.1145/3239060.3239071},
    acmid = {3239071},
    publisher = {ACM},
    address = {New York, NY, USA},
    keywords = {Touch accuracy, car, center console, in-vehicle touchscreens, offset correction model, on board entertainment system},
} 
PDF
How to Communicate New Input Techniques.
Sven Mayer, Lars Lischke, Adrian Lanksweirt, Huy Viet Le, and Niels Henze. 2018. In Proceedings of the 10th Nordic Conference on Human-Computer Interaction (NordiCHI '18). ACM, Oslo, Norway.
@inproceedings{mayer2018how,
    author = {Mayer, Sven and Lischke, Lars and Lanksweirt, Adrian and Le, Huy Viet and Henze, Niels},
    title = {How to Communicate New Input Techniques},
    booktitle = {Proceedings of the 10th Nordic Conference on Human-Computer Interaction},
    series = {NordiCHI '18},
    year = {2018},
    isbn = {978-1-4503-6437-9},
    location = {Oslo, Norway},
    pages = {460--472},
    numpages = {13},
    url = {http://doi.acm.org/10.1145/3240167.3240176},
    doi = {10.1145/3240167.3240176},
    acmid = {3240176},
    publisher = {ACM},
    address = {New York, NY, USA},
    keywords = {finger orientation, finger roll interaction, finger-aware interaction, interaction methods, nail/knuckle interaction, user interface},
} 
PDF
Demonstrating PalmTouch: The Palm as An Additional Input Modality on Commodity Smartphones.
Huy Viet Le, Sven Mayer, Thomas Kosch, and Niels Henze. 2018. In Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI '18). ACM, Barcelona, Spain.
@inproceedings{le2018demonstrating,
    author = {Le, Huy Viet and Mayer, Sven and Kosch, Thomas and Henze, Niels},
    title = {Demonstrating PalmTouch: The Palm as An Additional Input Modality on Commodity Smartphones},
    booktitle = {Proceedings of the 20th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct},
    series = {MobileHCI '18},
    year = {2018},
    isbn = {978-1-4503-5941-2},
    location = {Barcelona, Spain},
    numpages = {4},
    url = {https://doi.org/10.1145/3236112.3236163},
    doi = {10.1145/3236112.3236163},
    publisher = {ACM},
    address = {New York, NY, USA},
    keywords = {palm, capacitive image, machine learning, smartphone},
} 

2017

PDF
PredicTouch: A System to Reduce Touchscreen Latency Using Neural Networks and Inertial Measurement Units.
Huy Viet Le, Valentin Schwind, Philipp Göttlich, and Niels Henze. 2017. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (ISS '17). ACM, Brighton, United Kingdom.
@inproceedings{le2017predictouch,
    author = {Le, Huy Viet and Schwind, Valentin and G\"{o}ttlich, Philipp and Henze, Niels},
    title = {PredicTouch: A System to Reduce Touchscreen Latency Using Neural Networks and Inertial Measurement Units},
    booktitle = {Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces},
    series = {ISS '17},
    year = {2017},
    isbn = {978-1-4503-4691-7},
    location = {Brighton, United Kingdom},
    pages = {230--239},
    numpages = {10},
    url = {http://doi.acm.org/10.1145/3132272.3134138},
    doi = {10.1145/3132272.3134138},
    acmid = {3134138},
    publisher = {ACM},
    address = {New York, NY, USA},
    keywords = {IMU, Latency, lag, neural network, prediction, touch input},
} 
PDF
A Smartphone Prototype for Touch Interaction on the Whole Device Surface.
Huy Viet Le, Sven Mayer, Patrick Bader, and Niels Henze. 2017. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '17). ACM, Vienna, Austria.
@inproceedings{le2017smartphone,
    author = {Le, Huy Viet and Mayer, Sven and Bader, Patrick and Henze, Niels},
    title = {A Smartphone Prototype for Touch Interaction on the Whole Device Surface},
    booktitle = {Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services},
    series = {MobileHCI '17},
    year = {2017},
    isbn = {978-1-4503-5075-4},
    location = {Vienna, Austria},
    pages = {1001--1008},
    articleno = {100},
    numpages = {8},
    url = {http://doi.acm.org/10.1145/3098279.3122143},
    doi = {10.1145/3098279.3122143},
    acmid = {3122143},
    publisher = {ACM},
    address = {New York, NY, USA},
    keywords = {capacitive, full-touch phone, mobile, prototype},
} 
PDF
Interaction Methods and Use Cases for a Full-Touch Sensing Smartphone.
Huy Viet Le, Sven Mayer, Patrick Bader, Frank Bastian, and Niels Henze. 2017. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '17). ACM, Denver, Colorado, USA.
@inproceedings{le2017interaction,
    author = {Le, Huy Viet and Mayer, Sven and Bader, Patrick and Bastian, Frank and Henze, Niels},
    title = {Interaction Methods and Use Cases for a Full-Touch Sensing Smartphone},
    booktitle = {Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems},
    series = {CHI EA '17},
    year = {2017},
    isbn = {978-1-4503-4656-6},
    location = {Denver, Colorado, USA},
    pages = {2730--2737},
    numpages = {8},
    url = {http://doi.acm.org/10.1145/3027063.3053196},
    doi = {10.1145/3027063.3053196},
    acmid = {3053196},
    publisher = {ACM},
    address = {New York, NY, USA},
    keywords = {back touch, edge touch, fat-finger, reachability, smartphone},
} 
PDF
Estimating the Finger Orientation on Capacitive Touchscreens Using Convolutional Neural Networks.
Sven Mayer, Huy Viet Le, and Niels Henze. 2017. In Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces (ISS '17). ACM, Brighton, United Kingdom.
@inproceedings{mayer2017estimating,
    author = {Mayer, Sven and Le, Huy Viet and Henze, Niels},
    title = {Estimating the Finger Orientation on Capacitive Touchscreens Using Convolutional Neural Networks},
    booktitle = {Proceedings of the 2017 ACM International Conference on Interactive Surfaces and Spaces},
    series = {ISS '17},
    year = {2017},
    isbn = {978-1-4503-4691-7},
    location = {Brighton, United Kingdom},
    pages = {220--229},
    numpages = {10},
    url = {http://doi.acm.org/10.1145/3132272.3134130},
    doi = {10.1145/3132272.3134130},
    acmid = {3134130},
    publisher = {ACM},
    address = {New York, NY, USA},
    keywords = {Finger orientation, capacitive sensing, mobile device, touchscreen},
} 
PDF
Machine Learning with Tensorflow for Mobile and Ubiquitous Interaction.
Huy Viet Le, Sven Mayer, and Niels Henze. 2017. In Proceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia (MUM '17). ACM, Stuttgart, Germany.
@inproceedings{le2017machine,
    author = {Le, Huy Viet and Mayer, Sven and Henze, Niels},
    title = {Machine Learning with Tensorflow for Mobile and Ubiquitous Interaction},
    booktitle = {Proceedings of the 16th International Conference on Mobile and Ubiquitous Multimedia},
    series = {MUM '17},
    year = {2017},
    isbn = {978-1-4503-5378-6},
    location = {Stuttgart, Germany},
    pages = {567--572},
    numpages = {6},
    url = {http://doi.acm.org/10.1145/3152832.3156559},
    doi = {10.1145/3152832.3156559},
    acmid = {3156559},
    publisher = {ACM},
    address = {New York, NY, USA},
    keywords = {classification, machine learning, mobile device, supervised learning, tensorflow, ubiquitous computing},
} 
PDF
Machine Learning for Intelligent Mobile User Interfaces Using TensorFlow.
Sven Mayer, Huy Viet Le, and Niels Henze. 2017. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '17). ACM, Vienna, Austria.
@inproceedings{mayer2017machine,
    author = {Mayer, Sven and Le, Huy Viet and Henze, Niels},
    title = {Machine Learning for Intelligent Mobile User Interfaces Using TensorFlow},
    booktitle = {Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services},
    series = {MobileHCI '17},
    year = {2017},
    isbn = {978-1-4503-5075-4},
    location = {Vienna, Austria},
    pages = {621--625},
    articleno = {62},
    numpages = {5},
    url = {http://doi.acm.org/10.1145/3098279.3119915},
    doi = {10.1145/3098279.3119915},
    acmid = {3119915},
    publisher = {ACM},
    address = {New York, NY, USA},
    keywords = {classification, machine learning, mobile device, regression, supervised learning, tensorflow},
} 
PDF
Exploring Interactions with Smart Windows for Sunlight Control.
Patrick Bader, Huy Viet Le, Julian Strotzer, and Niels Henze. 2017. In Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '17). ACM, Denver, Colorado, USA.
@inproceedings{bader2017exploring,
    author = {Bader, Patrick and Le, Huy Viet and Strotzer, Julian and Henze, Niels},
    title = {Exploring Interactions with Smart Windows for Sunlight Control},
    booktitle = {Proceedings of the 2017 CHI Conference Extended Abstracts on Human Factors in Computing Systems},
    series = {CHI EA '17},
    year = {2017},
    isbn = {978-1-4503-4656-6},
    location = {Denver, Colorado, USA},
    pages = {2373--2380},
    numpages = {8},
    url = {http://doi.acm.org/10.1145/3027063.3053242},
    doi = {10.1145/3027063.3053242},
    acmid = {3053242},
    publisher = {ACM},
    address = {New York, NY, USA},
    keywords = {gesture elicitation, guessability, mid-air, smart windows, user-defined},
}
PDF
Improving Software-reduced Touchscreen Latency.
Niels Henze, Sven Mayer, Huy Viet Le, and Valentin Schwind. 2017. In Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services (MobileHCI '17). ACM, Vienna, Austria.
@inproceedings{henze2017improving,
    author = {Henze, Niels and Mayer, Sven and Le, Huy Viet and Schwind, Valentin},
    title = {Improving Software-reduced Touchscreen Latency},
    booktitle = {Proceedings of the 19th International Conference on Human-Computer Interaction with Mobile Devices and Services},
    series = {MobileHCI '17},
    year = {2017},
    isbn = {978-1-4503-5075-4},
    location = {Vienna, Austria},
    pages = {1071--1078},
    articleno = {107},
    numpages = {8},
    url = {http://doi.acm.org/10.1145/3098279.3122150},
    doi = {10.1145/3098279.3122150},
    acmid = {3122150},
    publisher = {ACM},
    address = {New York, NY, USA},
    keywords = {LSTM, lag, latency, machine learning, multilayer perceptron, prediction, touch input, touchscreen},
} 

2016

PDF
Finger Placement and Hand Grasp During Smartphone Interaction.
Huy Viet Le, Sven Mayer, Katrin Wolf, and Niels Henze. 2016. In Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems (CHI EA '16). ACM, San Jose, California, USA.
@inproceedings{le2016finger,
    author = {Le, Huy Viet and Mayer, Sven and Wolf, Katrin and Henze, Niels},
    title = {Finger Placement and Hand Grasp During Smartphone Interaction},
    booktitle = {Proceedings of the 2016 CHI Conference Extended Abstracts on Human Factors in Computing Systems},
    series = {CHI EA '16},
    year = {2016},
    isbn = {978-1-4503-4082-3},
    location = {San Jose, California, USA},
    pages = {2576--2584},
    numpages = {9},
    url = {http://doi.acm.org/10.1145/2851581.2892462},
    doi = {10.1145/2851581.2892462},
    acmid = {2892462},
    publisher = {ACM},
    address = {New York, NY, USA},
    keywords = {back-of-device, ergonomics, grasp, smartphone, touch},
} 
PDF
Investigating Screen Shifting Techniques to Improve One-Handed Smartphone Usage.
Huy Viet Le, Patrick Bader, Thomas Kosch, and Niels Henze. 2016. In Proceedings of the 9th Nordic Conference on Human-Computer Interaction (NordiCHI '16). ACM, Gothenburg, Sweden.
@inproceedings{le2016investigating,
    author = {Le, Huy Viet and Bader, Patrick and Kosch, Thomas and Henze, Niels},
    title = {Investigating Screen Shifting Techniques to Improve One-Handed Smartphone Usage},
    booktitle = {Proceedings of the 9th Nordic Conference on Human-Computer Interaction},
    series = {NordiCHI '16},
    year = {2016},
    isbn = {978-1-4503-4763-1},
    location = {Gothenburg, Sweden},
    pages = {271--2710},
    articleno = {27},
    numpages = {10},
    url = {http://doi.acm.org/10.1145/2971485.2971562},
    doi = {10.1145/2971485.2971562},
    acmid = {2971562},
    publisher = {ACM},
    address = {New York, NY, USA},
    keywords = {Smartphone, back-of-device, one-handed use, reachability, screen shifting},
} 
PDF
Impact of Video Summary Viewing on Episodic Memory Recall: Design Guidelines for Video Summarizations.
Huy Viet Le, Sarah Clinch, Corina Sas, Tilman Dingler, Niels Henze, and Nigel Davies. 2016. In Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems (CHI '16). ACM, San Jose, California, USA.
@inproceedings{le2016impact,
    author = {Le, Huy Viet and Clinch, Sarah and Sas, Corina and Dingler, Tilman and Henze, Niels and Davies, Nigel},
    title = {Impact of Video Summary Viewing on Episodic Memory Recall: Design Guidelines for Video Summarizations},
    booktitle = {Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems},
    series = {CHI '16},
    year = {2016},
    isbn = {978-1-4503-3362-7},
    location = {San Jose, California, USA},
    pages = {4793--4805},
    numpages = {13},
    url = {http://doi.acm.org/10.1145/2858036.2858413},
    doi = {10.1145/2858036.2858413},
    acmid = {2858413},
    publisher = {ACM},
    address = {New York, NY, USA},
    keywords = {episodic memory, lifelogging, multimedia, recall, video summarization},
} 
PDF
Modeling Human Behavior During Touchscreen Interaction in Mobile Situations.
Huy Viet Le. 2016. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI '16). ACM, Florence, Italy.
@inproceedings{le2016modeling,
    author = {Le, Huy Viet},
    title = {Modeling Human Behavior During Touchscreen Interaction in Mobile Situations},
    booktitle = {Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct},
    series = {MobileHCI '16},
    year = {2016},
    isbn = {978-1-4503-4413-5},
    location = {Florence, Italy},
    pages = {901--902},
    numpages = {2},
    url = {http://doi.acm.org/10.1145/2957265.2963113},
    doi = {10.1145/2957265.2963113},
    acmid = {2963113},
    publisher = {ACM},
    address = {New York, NY, USA},
    keywords = {human behavior, mobile device, research in the large, touchscreen},
}
PDF
Multimedia Memory Cues for Augmenting Human Memory.
Tilman Dingler, Passant El Agroudy, Huy Viet Le, Albrecht Schmidt, Evangelos Niforatos, Agon Bexheti, and Marc Langheinrich. 2016. In IEEE MultiMedia (IEEE Multimedia). IEEE Multimedia, .
@article{dingler2016multimedia, 
    author={Dingler, Tilman and El Agroudy, Passant and Le, Huy Viet and Schmidt, Albrecht and Niforatos, Evangelos and Bexheti, Agon and Langheinrich, Marc}, 
    title={Multimedia Memory Cues for Augmenting Human Memory}, 
    journal={IEEE MultiMedia}, 
    series={IEEE Multimedia},
    url={https://doi.org/10.1109/MMUL.2016.31},
    year={2016}, 
    volume={23}, 
    number={2}, 
    pages={4-11}, 
    doi={10.1109/MMUL.2016.31}, 
    ISSN={1070-986X}, 
    month={Apr},
    address={}
}
PDF
Notification Dashboard: Enabling Reflection on Mobile Notifications.
Dominik Weber, Alexandra Voit, Huy Viet Le, and Niels Henze. 2016. In Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct (MobileHCI '16). ACM, Florence, Italy.
@inproceedings{weber2016notification,
    author = {Weber, Dominik and Voit, Alexandra and Le, Huy Viet and Henze, Niels},
    title = {Notification Dashboard: Enabling Reflection on Mobile Notifications},
    booktitle = {Proceedings of the 18th International Conference on Human-Computer Interaction with Mobile Devices and Services Adjunct},
    series = {MobileHCI '16},
    year = {2016},
    isbn = {978-1-4503-4413-5},
    location = {Florence, Italy},
    pages = {936--941},
    numpages = {6},
    url = {http://doi.acm.org/10.1145/2957265.2962660},
    doi = {10.1145/2957265.2962660},
    acmid = {2962660},
    publisher = {ACM},
    address = {New York, NY, USA},
    keywords = {dashboard, mobile notifications, visualization},
} 

2013

PDF
Automatic Classification of Mobile Phone's Contacts.
Alireza Sahami Shirazi, Huy Viet Le, Niels Henze, and Albrecht Schmidt. 2013. In Mensch & Computer 2013: Interaktive Vielfalt (MuC '13). Oldenbourg Verlag, München, Germany.
@inproceedings{sahami2013automatic,
    author = {Sahami Shirazi, Alireza and Le, Huy Viet and Henze, Niels and Schmidt, Albrecht},
    title = {Automatic Classification of Mobile Phone's Contacts},
    booktitle = {Mensch & Computer 2013: Interaktive Vielfalt},
    series = {MuC '13},
    year = {2013},
    editor = {Boll, Susanne and Maa\ss{}, Susanne and Malaka, Rainer},
    location = {M\"{u}nchen, Germany},
    pages = {27--36},
    numpages = {9},
    url = {https://dl.gi.de/handle/20.500.12116/7492},
    publisher = {Oldenbourg Verlag},
    address = {M\"{u}nchen, Germany}
}

Theses

PDF
Hand-and-Finger-Awareness for Mobile Touch Interaction using Deep Learning.
Huy Viet Le. 2019. Doctoral Thesis.
Passed with highest distinction (summa cum laude).
Note: This is a compressed version. The original is available on the publication server of the Uni Stuttgart.
PDF
Development and Evaluation of Automatic Video Recaps from Lifelog Data.
Huy Viet Le. 2015. Master's Thesis.
Received the Rul Gunzenhäuser Award. The results of this thesis were published as a paper at CHI 2016.
PDF
Automatische Klassifizierung von Kontakten auf Smartphones.
Huy Viet Le. 2012. Bachelor's Thesis.
The results of this thesis were published as a paper at Mensch & Computer 2013.

Blog: Projects & Articles

My research focus lies at the intersection of interactive systems and applied machine learning. The following showcases a selected number of my research projects and blog articles that I wrote to help the community on similar projects.

Hand Grip and Finger Recognition

Recognizing different hand grips and fingers on a fully touch sensitive smartphone using deep learning.

Learn more
Finger Identification

Finger Identification

Combining raw capacitive images and deep learning to recognize fingers on commodity smartphones.

Learn more
Touch Input Prediction with IMUs

Touch Input Prediction with IMUs

Predicting the user's touch input using the IMU signal of smart watches and stylus.

Learn more
Accessing Raw Capacitive Images

Accessing Raw Capacitive Images

A tutorial on how to access the raw data of capacitive touchscreens on Android devices.

Learn more