The formative research that investigated the underlying methodologies applied in Visual Assistant began in 1993.  Since then, AbleLink has completed an initial research and development project (9/99-3/00) funded by the US Department of Education's National Institute on Disability Rehabilitation Research (NIDRR) that successfully demonstrated the feasibility of using a multimedia training program on a Handheld PC to effectively enhance independence for adults with mental retardation in performing community-based vocational tasks.  This six month project involved a process of determining the functional and technical requirements for the system, developing the software prototype and then testing it in a pilot study.

The pilot study that concluded the research plan was designed to assess the effectiveness of the portable visual/audio-based training system for training specific community-based vocational skills to individuals with mental retardation.  The basic hypothesis was that the Visual Assistant system would improve vocational skill acquisition and reduce the amount of staff time required to train individuals on new community-based tasks. The hypothesis was that 1) there would be significant improvement in the ability for an individual to perform the tasks independently, and 2) that the amount of errors in completing the task would be less for subjects when using the portable Visual Assistant prototype system.

The study consisted of a comparison of 1) the portable visual/audio training approach provided with Visual Assistant and 2) the traditional training method of task demonstration. Two tasks representative of community-based vocational tasks were selected after consulting with counselors at local adult services agencies and school district transition offices.  The Pizza Hut organization was generous enough to provide supplies for the first task, pizza box assembly.  The second task that was selected was software packaging, another task common to community-based vocational settings.  The independent variable in the pilot study was the type of training and task assistance provided to study participants.  The two levels of the independent variable were 1) live demonstration and use of the Visual Assistant prototype and 2) live demonstration only.  The two tasks were analyzed to document the steps required in performing the task.  Ten individuals (eight males and two females) participated in the study, ranging in age from 18 to 70 with an average age of 41.9.  WAIS-r scores of study participants ranged from 39 to 72 with an average score of 54.8.

The order in which the subject completed the task with the Visual Assistant prototype was randomized within constraints to control for order effects. Data were collected on the both dependent variables: 1) independence measured by the number of prompts required for each step in a task; and 2) accuracy measured by the number of errors made for each vocational task.  The results of this data demonstrated strong support for the contention that using a multimedia training approach with a Palmtop PC can effectively enhance independence for adults with mental retardation in performing community-based vocational tasks.   In summary, use of the Visual Assistant prototype resulted in improved task accuracy and increased independence for ten adults that were trained on two different vocational tasks as compared to a traditional training approach.  The average errors per task when individuals used Visual Assistant was 0.75, while the average errors per task when individuals did not use the Visual Assistant prototype was 2.25.  The observed mean difference for errors per task was statistically significant (p<.006).   Additionally, the average prompts per task when individuals used Visual Assistant was 1.05, compared to the average prompts per task of 2.40 when individuals did not use the Visual Assistant prototype.  The observed mean difference for prompts required per task was statistically significant (p<.032). These results are detailed below in Table 4.

Table 4:  Results of Visual Assistant Pilot Study

Dependent Measure

Visual Assistant

No Visual Assistant

One tailed significance

 

Errors per Task

(Average number of errors on the two tasks – lower scores are better)

 

 

Ave. = 0.75 *

STD = 0.83

 

 

Ave.= 2.25 *

STD = 2.05

 

 

p < .006*

 

 

Independence

(Total help prompts needed –

lower scores are better )

 

 

Ave. = 1.05 *

STD = 1.19

 

 

Ave. = 2.40 *

STD = 2.56

 

 

p < .032*

 

  * Significant difference at p < .05

In summary, the results of this pilot study demonstrated the effectiveness of the Visual Assistant prototype for improving task accuracy and increasing independence for ten adults with mental retardation on two different vocational tasks as compared to a traditional training approach.  These results must be considered preliminary as the research scope and time available for the evaluation were limited.  However, the pilot study results were strong enough to result in NIDRR's approval of a two year continuation project to: 1) complete the Visual Assistant multimedia software program, 2) build a companion software application for the PC that helps manage the setup of the Visual Assistant training tasks, and 3) perform expanded field testing of the system to evaluate its applicability for a wide range of activities of daily living and levels of disability.  This project, which will run from September 1, 2000 through August 31, 2002, will result in a commercial software application, Visual Assistant, that will be available for a wide variety of portable PC’s running the Windows CE operating system.  By capitalizing on commercially produced portable PCs, future Visual  Assistant users will be able to choose from multiple supported living and training products that will  be developed by AbleLink and other rehabilitation technology companies.  This provides a much more cost-effective approach to providing portable independent living software because a single hardware purchase will be able to operate a variety of Windows CE software titles.