Skip to main content
Home > Research > Tools
Gesture-Friendly User Interfaces

How to use Gesture Friendly Interfaces

Stephen Chen

A Gesture Friendly Interface (or GFI) helps make it easier to use an on-line learning object during classroom teaching.  Specifically, the GFI allows a key feature of the learning object to be manipulated with a trivial control action (e.g. clicking a button on a wireless mouse) so that the instructor can focus on interacting with the students and performing relevant gestures. 

Due to the dynamic and visual nature of  GFIs, it is easeist to learn about GFIs by watching the following video clips

Video 1 -- Introduction

An example of classroom teaching with a learning object without using the GFI.  Similar to a typical classroom, the instructor's PC is not in the field of view of the projection screen.  Thus, the instructor is either interacting with the screen and the audience, or manipulating the learning object -- but not both.

The learning object shown is for linear relations.

.wmv format

Video 2 -- GFI close-up

To activate the GFI, click on the "lock mouse" button.  The slider can now be controlled with both clicking and dragging (a difficult control action during classroom teaching) and left and right mouse button clicks (a trivial control action).

The learning object shown is for linear relations.

.wmv format

Video 3 -- In-Class Teaching with the Data Collection Applet

A sample lesson is shown with the Data Collection applet.  The GFI is used to control the applet -- specifically, left mouse button clicks select the highlighted item, and right mouse button clicks change which item is selected.

.wmv format

Video 4 -- In Class Teaching with the Lines and Intersection Applet

A sample lesson is shown with the Lines and Intersections applet.  The GFI is used to control the applet -- specifically, left mouse button clicks move the slider to the left (a fixed amount) and right mouse button clicks mover the slider to the right.

.wmv format

Video 5 -- In Class Teaching with the Rectangles Area Applet

A sample lesson is shown with the Rectangles Area applet.  The GFI is used to control the applet -- specifically, left mouse button clicks select the highlighted item, and right mouse button clicks change which item is selected.

.wmv format


For more information, please see the following paper.

S. Chen, G. Frempong, and W.C. Cudmore. (2006) "Gesture Friendly Interfaces for Classroom Teaching with Thinking Tools." In IFIP International Federation for Information Processing, Volume 210, Education for the 21st Century – Impact of ICT and Digital Resources, pgs 279-283. Springer. (presentation slides)