Return to Main

satisfaction survey

Mission Statement Link Research Activities Link News and Highlights Link AAC Links Contact Us Link

Communication Performance Assessment (CPA)
www.aac-rerc.com


Logfile Specifications and Software

Introduction

The AAC-RERC is establishing a topic area on its website devoted to the assessment of AAC technology and the performance of AAC users. We are tentatively calling this topic Communication Performance Assessment. This website will feature materials on:
  • Theoretical underpinnings of device design and user performance.
  • Techniques and software to facilitate performance assessment of technology and device use.
  • Information on automated data logging.
  • Links to research and practice in related areas.
  • A bibliography of CPA related articles.
  • A discussion of hot topics including:
    • Measurement issues
    • Privacy and the rights of persons being observed
    • Use of assessment results

CPA Information and Issues

The following is an outline of some of the basic information and issues dealing with Communication Performance Assessment.

Communication Performance Assessment: What is it?

CPA can be distinguished from non-observational methods such as surveys, questionnaires, formal tests and anecdotal reports. The promise of CPA is that the results of assessment reflect the individual's actual communication performance. Communication Performance Assessment of Communicative Disorders The techniques used to study communication performance are derived from a wide variety of disciplines including psychology, child development, behavior analysis, linguistics, human factors, and the cognitive and linguistic sciences. In the communicative disorders area they include:
  • Structural analysis of language samples.
  • Pragmatic, discourse and conversational analysis.
  • Applied behavior analysis.
  • Observational analysis of social interactions.
  • Ethnographic observation and interview.

Communication Performance Assessment of Augmentative Communication CPA techniques were first used in AAC over twenty years ago. Research included Debra Harris's dissertation on classroom interaction and David Beukelman and Katherine Yorkston's work on the pragmatic and vocabulary profiles of AAC users. Since then, CPA techniques have been used to study many aspects of augmentative communication, including:
  • Communication mode & gesture displays
  • Pragmatic, discourse and interaction structure
  • Propositional complexity of AAC produced utterances
  • Communicative responsiveness of AAC speakers and partners
  • Communication and selection error rate
  • AAC utterance co-construction and the role of the interlocutor.

Slow communication rate and the multi-modal nature of augmentative communication make direct observation of communication performance laborious and expensive. However, recent advances in technology have made CPA methods more viable for both the researcher and clinician. These developments include:
  • The use of digital audio and video recording technologies for transcription and documentation.
  • Software to assist in transcription and coding of communication.
  • Automated monitoring and logging of AAC user and device activity.

Check this page for updated information on CPA.

Check out CADL RERC Page for working papers on AAC usability assessment, transcription protocols and other materials relating to CPA.

Logfile Protocol

We have completed a preliminary version of a universal logfile format. This is a flexible logfile format that is powerful enough to support the most data collection requirements while providing an extendable framework for customized logging needs. Documentation for the proposed logfile standard can be found at: www.enkidu.net/logfile.html. Currently, six AAC device manufacturers and several university research groups are collaborating with the RERC to develop a standard logfile format and research tools.

The goal of this group is to:

  • Develop a voluntary standard for the logfile format.
  • Develop a comprehensive set of tools for research and clinical data analysis.
  • Work to resolve various measurement and ethical issues.
If you are interested in being part of this group, please email Jeff Higginbotham.

ACQUA

We have developed a software package, ACQUA, (stands for Augmentative Communication Quantitative Analysis) for analyzing multiple-field logfiles produced by AAC systems that conform to a proposed logging standard. This Windows-based package provides an intuitive graphical interface, facilitating rapid statistical analysis of logfiles. It is capable of computing a large number of predefined statistics, with a modular structure conducive to the incorporation of new statistics.
ACQUA Features:

  • Over 30 available statistics are available (frequencies, durations, rate & efficiency measures, readability index, etc). User-specified variables can be included.
  • Data can be summarized across entry, character, word, sentence, and output levels. A series of consecutive data windows can be analyzed, providing sliding estimates. Time series analysis is available.
  • Multiple files can be analyzed at once and output to a file for further analysis using Excel, Minitab, SPSS, etc.
  • ACQUA is compatible with simpler formats such as PRC's LAM.

The current version of ACQUA (Windows only) can be downloaded at : www.enkidu.net/downloads/ACQUA_Setup.exe. General ACQUA information can be found at: www.enkidu.net/acqua.html.

AAC Device Emulator for Logfile Generation

A preliminary version of a software-based AAC device emulator is available. This device can be used to simulate the look-&-feel and performance of different augmentative devices, device configurations and vocabulary sets. This emulator includes a comprehensive logfile generator, which can be used as an AAC device by a human operator. The ability of the emulator to automatically process text using a variety of user interfaces (e.g., word prediction, scanning) has been recently implemented.

Future versions will automatically process text (e.g., for efficiency studies). Academic and clinical researchers are encouraged to contact Jeff Higginbotham regarding customization and research support.

Augmentative Communication Text Analysis Repository

For a number of years the Communication and Assistive Device Laboratory has used a number of texts in its research on the performance characteristics of augmentative communication devices. We believe that in order to facilitate progress in this research area, it is important to make the tools, techniques and materials available for public use. We are making available text materials from five projects which are listed below. Each text is accompanied by a comprehensive set of statistical measures made using Wordsmith Tools and Readibility Calculations software programs. A detailed description of these materials, statistical tables and the text repository can be found at: http://cadlprod.net/web/textdep/definitions.htm.

Additional Information