InfiniTouch – A Full-Touch Smartphone with Finger Recognition Capability using Deep Learning (UIST ’18)

InfiniTouch is the first smartphone that enables touch input on the whole device surface and identifies the fingers touching the device with deep learning. The prototype morphs two rooted LG Nexus 5 devices and 37 copper plates as capacitive sensors into one handheld device. Different fingers are identified with a convolutional neural network (CNN) which…

Continue Reading

Finger Identification on Capacitive Touchscreens using Deep Learning (IUI ’19)

Touchscreens enable intuitive mobile interaction. However, touch input is limited to 2D touch locations which makes it challenging to provide shortcuts and secondary actions similar to hardware keyboards and mice. This project studies the use of the raw measurements of capacitive touchscreens and the latest deep learning algorithms to identify the finger that is touching…

Continue Reading

On-Device Input Controls – Where to place them? (CHI ’18)

Recent smartphones incorporate a large number of input controls beyond the display on the front such as volume buttons, fingerprint scanners, and silent switches. With recent advances of foldable smartphones, the full surface of a mobile device could soon be used for inputs on mass-market devices. To help designers to find suitable and ergonomic placements…

Continue Reading