ClickLeak: Keystroke Leaks Through Multimodal Sensors in Cyber-Physical Social Networks

Public social environments are hot beds of security leaks, either they are virtual or physical. The nature of social settings allows numerous people to co-exist in the same space. This close un-bounded proximity opens up the possibility of privacy compromise in such environments. In this paper, we e...

Full description

Bibliographic Details
Main Authors: Fan Li, Xiuxiu Wang, Huijie Chen, Kashif Sharif, Yu Wang
Format: Article
Language:English
Published: IEEE 2017-01-01
Series:IEEE Access
Subjects:
Online Access:https://ieeexplore.ieee.org/document/8118065/
id doaj-a3fa62db17c44d08bde1ae80227a6fc4
record_format Article
spelling doaj-a3fa62db17c44d08bde1ae80227a6fc42021-03-29T20:19:39ZengIEEEIEEE Access2169-35362017-01-015273112732110.1109/ACCESS.2017.27765278118065ClickLeak: Keystroke Leaks Through Multimodal Sensors in Cyber-Physical Social NetworksFan Li0https://orcid.org/0000-0002-2348-4488Xiuxiu Wang1Huijie Chen2Kashif Sharif3https://orcid.org/0000-0001-7214-6568Yu Wang4Beijing Engineering Research Center of High Volume Language Information Processing and Cloud Computing Applications, School of Computer Science, Beijing Institute of Technology, Beijing, ChinaBeijing Engineering Research Center of High Volume Language Information Processing and Cloud Computing Applications, School of Computer Science, Beijing Institute of Technology, Beijing, ChinaBeijing Engineering Research Center of High Volume Language Information Processing and Cloud Computing Applications, School of Computer Science, Beijing Institute of Technology, Beijing, ChinaBeijing Engineering Research Center of High Volume Language Information Processing and Cloud Computing Applications, School of Computer Science, Beijing Institute of Technology, Beijing, ChinaDepartment of Computer Science, University of North Carolina at Charlotte, Charlotte, NC, USAPublic social environments are hot beds of security leaks, either they are virtual or physical. The nature of social settings allows numerous people to co-exist in the same space. This close un-bounded proximity opens up the possibility of privacy compromise in such environments. In this paper, we explore a novel and practical multi-modal side-channel keystroke recognition system, named ClickLeak, which can infer the PIN code/password entered on numeric keypad by using the commodity Wi-Fi devices. Such numeric keypads are commonly available in many public social environments. ClickLeak is built on the observation that each key input makes unique pattern of hand and finger movements, and this generates unique distortions to multi-path Wi-Fi signals. Acceleration and microphone sensors of smart phones determine the starting and ending time of keystrokes, while the time series of channel state information are analyzed to determine the keystrokes. The evaluation results have shown that with large scale data collections from public social settings, the key recognition accuracy can reach higher than 83%.https://ieeexplore.ieee.org/document/8118065/Cyberspacechannel state informationsocial computingdata privacysocial network services
collection DOAJ
language English
format Article
sources DOAJ
author Fan Li
Xiuxiu Wang
Huijie Chen
Kashif Sharif
Yu Wang
spellingShingle Fan Li
Xiuxiu Wang
Huijie Chen
Kashif Sharif
Yu Wang
ClickLeak: Keystroke Leaks Through Multimodal Sensors in Cyber-Physical Social Networks
IEEE Access
Cyberspace
channel state information
social computing
data privacy
social network services
author_facet Fan Li
Xiuxiu Wang
Huijie Chen
Kashif Sharif
Yu Wang
author_sort Fan Li
title ClickLeak: Keystroke Leaks Through Multimodal Sensors in Cyber-Physical Social Networks
title_short ClickLeak: Keystroke Leaks Through Multimodal Sensors in Cyber-Physical Social Networks
title_full ClickLeak: Keystroke Leaks Through Multimodal Sensors in Cyber-Physical Social Networks
title_fullStr ClickLeak: Keystroke Leaks Through Multimodal Sensors in Cyber-Physical Social Networks
title_full_unstemmed ClickLeak: Keystroke Leaks Through Multimodal Sensors in Cyber-Physical Social Networks
title_sort clickleak: keystroke leaks through multimodal sensors in cyber-physical social networks
publisher IEEE
series IEEE Access
issn 2169-3536
publishDate 2017-01-01
description Public social environments are hot beds of security leaks, either they are virtual or physical. The nature of social settings allows numerous people to co-exist in the same space. This close un-bounded proximity opens up the possibility of privacy compromise in such environments. In this paper, we explore a novel and practical multi-modal side-channel keystroke recognition system, named ClickLeak, which can infer the PIN code/password entered on numeric keypad by using the commodity Wi-Fi devices. Such numeric keypads are commonly available in many public social environments. ClickLeak is built on the observation that each key input makes unique pattern of hand and finger movements, and this generates unique distortions to multi-path Wi-Fi signals. Acceleration and microphone sensors of smart phones determine the starting and ending time of keystrokes, while the time series of channel state information are analyzed to determine the keystrokes. The evaluation results have shown that with large scale data collections from public social settings, the key recognition accuracy can reach higher than 83%.
topic Cyberspace
channel state information
social computing
data privacy
social network services
url https://ieeexplore.ieee.org/document/8118065/
work_keys_str_mv AT fanli clickleakkeystrokeleaksthroughmultimodalsensorsincyberphysicalsocialnetworks
AT xiuxiuwang clickleakkeystrokeleaksthroughmultimodalsensorsincyberphysicalsocialnetworks
AT huijiechen clickleakkeystrokeleaksthroughmultimodalsensorsincyberphysicalsocialnetworks
AT kashifsharif clickleakkeystrokeleaksthroughmultimodalsensorsincyberphysicalsocialnetworks
AT yuwang clickleakkeystrokeleaksthroughmultimodalsensorsincyberphysicalsocialnetworks
_version_ 1724194911859769344