|
This project extends the Percussion Tray example in order to be able to track continuous movements as well. The table is made touch sensitive by combining acoustic and vision tracking technologies. A camera placed above the table is tracking the continuous movement of the user’s hands, independently if they are touching the table or not, while the acoustic system is localizing the point of contact when tapping on the table. The combination of the acoustic and vision systems enables to override the limitation of each system used individually. The camera alone cannot determine whether the hands are touching the table or not, nor distinguish which of them is touching the table. On the other hand, the acoustic system alone, based on the Time Difference of Arrival (TDOA) between four sensors attached under the corners of the table, cannot track a continuous movement. However, by comparing the two positions given by the vision system and the single position given by the acoustic system, it is possible to distinguish which hand is touching the table. Once the proper hand is identified, its continuous movement over the table is tracked by the vision system, and a coloured dot corresponding to the position of the hand’s top part is displayed on a monitor for visual feedback. An output for the position value is given as long as the acoustic energy created by the friction of the finger on the table is above a certain threshold. |