Software Switches: Novel Hands-Free Interaction Techniques for Quadriplegics Based on Respiration-Machine Interaction

Abstract

The majority of interaction techniques for individuals with disabilities to control a computer require an additional dedicated hardware like switches beyond standard computer peripherals. Furthermore, each traditional hardware switch emulates different keyboard characters or mouse clicks depending on switch manufacturer. There is not any commonly agreed standard on this; while some switch accessible programs expect to receive enter character, other programs expect to receive mouse left click. Therefore, switch manufacturers also distribute software drivers with switches to overcome this standardization problem by allowing users to assign expected characters. But software drivers are developed for a specific switch, so they are not compatible with the other manufacturers' switches. On the other hand, for the ones with a very limited motor activity but a complete respiration activity, sip-and-puff switches are efficient solutions. However, they are expensive and invasive systems with tubes, that have to be changed regularly due to the hygiene concern, inside users' mouth. Although invasive respiration based systems (sip-and-puff devices) caught enough attention by researchers over the years, using non-invasive respiration based interaction techniques is an underestimated approach in general. In this study, we proposed two novel non-invasive interaction techniques as software switches (PuffCam and PuffMic) compatible with any switch accessible software. Both techniques are respiration operated where a hard puff, detected by a microphone or an adapted camera, is considered as 'switch on' like a puff switch. A single switch accessible software namely TestBed was also developed through this study in order to automatically evaluate interaction techniques. A user study (conducted with 46 participants with/out disabilities via TestBed) revealed that the accuracy, precision, recall and false positive rate of our interaction techniques were quite impressive, and PuffCam showed better performance than PuffMic in all metrics. According to five-point Likert scale questionnaire findings, comfort assessment of interaction techniques by participants was rated quite satisfactory. All participants agreed that the idea of controlling a computer via breathing without purchasing any dedicated hardware sounded very promising. Because most interaction techniques for computer control require extra dedicated devices and there is not any adaptable software switch (compatible with most switch accessible software) to the best of our knowledge, proposed interaction techniques can help community in an open access manner without purchasing any device.

@Article{Esiyok2019,
author="Esiyok, Cagdas
and Askin, Ayhan
and Tosun, Aliye
and Albayrak, Sahin",
title="Software switches: novel hands-free interaction techniques for quadriplegics based on respiration--machine interaction",
journal="Universal Access in the Information Society",
year="2019",
month="Feb",
day="14",
abstract="The majority of interaction techniques for individuals with disabilities to control a computer require an additional dedicated hardware like switches beyond standard computer peripherals. Furthermore, each traditional hardware switch emulates different keyboard characters or mouse clicks depending on its manufacturer. There is no commonly agreed standard on this; while some switch accessible programs expect to receive enter character, other programs expect to receive mouse left click. Switch manufacturers, therefore, distribute software drivers, which allow users to assign expected characters, with switches to overcome this standardization problem by making them adaptable. As software drivers are developed for a specific switch, they are not compatible with the other manufacturers' switches. On the other hand, for the ones with a very limited motor activity but a complete respiration activity, sip-and-puff switches are efficient solutions. However, they are expensive and invasive systems with tubes, that have to be changed regularly due to the hygiene concern, inside users' mouth. Although invasive respiration-based systems (sip-and-puff devices) caught enough attention by researchers over the years, using non-invasive respiration-based interaction techniques is an underestimated approach in general. In this study, we proposed two novel non-invasive interaction techniques as software switches (PuffCam and PuffMic) compatible with any switch accessible software. Both techniques are respiration operated, where a hard puff, detected by a microphone or an adapted camera, is considered as `switch-on' like a puff switch. We have also collected the objective data by an evaluation software namely TestBed. A user study (conducted with 46 participants with/out disabilities) revealed that the accuracy, precision, recall, and false positive rate of our interaction techniques were quite impressive, and PuffCam performed better than PuffMic for all metrics. According to questionnaire findings, comfort assessment of interaction techniques by participants was rated quite satisfactory. All participants agreed that the idea of controlling a computer via breathing without purchasing any dedicated hardware sounded very promising. Because most interaction techniques for computer control require extra dedicated devices and there is not any adaptable (i.e., compatible with most switch accessible software) software switch to the best of our knowledge, proposed interaction techniques can help community in an open access manner without purchasing any device.",
issn="1615-5297",
doi="10.1007/s10209-019-00645-2",
url="https://doi.org/10.1007/s10209-019-00645-2"
}
Authors:
Cagdas Esiyok, Ayhan Askin, Aliye Tosun, Sahin Albayrak
Category:
Journal
Year:
2019
Location:
Universal Access in the Information Society