A smart bedroom lamp that can identify eye blinks and translate them to digital operations for controlling smart devices.
What is it?
PALS is a smart device, a bedroom lamp that can identify eye blinks and translate them to digital operations that can control home or other smart devices.
PALS helps ALS patients attain a higher sense of independence in the bedroom while they are cut off their communications systems. The system allows the patient to perform different tasks when in his bedroom such as to text his caregiver that he is awaken, to control other home devices such as his audio system, light his bedroom lamp and more. Much like Morse code varying in length and quantity, the system translates a series of blinks to pre-configured tasks. In order to preserve the intimacy of the bedroom and ensure minimum disruption to the user and his surroundings, the system is integrated within a night lamp structure and uses discrete LEDs as feedback.
Project Info
Students: Liron Shalev Yafim vodkov Jonathan Limon Asaf Naory Abigail Zernik Chen Malool (Seminar Hakibutzim)
Mentors: Dr. Oren Zuckerman, Dr. Noa Morag
TA: Neta Tamir, Daniel Shir, Daniel Shein.
This Project was created with the collboartion of Seminar Hakibutzim mentored by Dori Oryan
How does it work?
The PALS system consists of a management service directly connected to both Intel the depth camera (RGBD) and the feedback device built of an Arduino micro-controller and LEDs. The management service includes an image processing module that utilizes a facial recognition algorithm to alert blinks. These alerts trigger a synchronization module which, in turn, classifies the blinks as short or long blinks and sends the translated “words” to the interface module. Lastly, the interface module deploys the corresponding tasks via external systems such as Arduino, IFTTT and messaging services.