Hand Motion Recognition and Visualisation for Direct Sign Writing

Abstract

Although SignWriting provides an intuitive notation system based on pictorial symbols to enable any sign based language in the world to be transcribed into a written form, it is a time consuming process for keyboard based input. To address the challenge of direct sign writing, the paper presents a human-computer-interaction system developed for recognition and visualisation of hand movements. The system is shown to be able to display the corresponding SignWriting symbols for various hand movements performed by two hands based on motion characteristics such as movement planes, movement directions, straight/curve movement paths, clockwise/anti-clockwise movements, and single/repeated movements.