Understanding the AAC App Rating Scale

Identifying the most effective communication systems for patients with complex needs requires a structured AAC app rating scale to ensure clinical accuracy. Clinicians often face a critical choice between using a rapid overall impression or performing a detailed itemized evaluation. Recent research has explored how these two scoring methods differ, particularly focusing on how rater experience influences the reliability of the feature matching process.

Reliability and the AAC App Rating Scale

The study utilized usability testing to evaluate various types of communication apps across different categories. Specifically, the researchers compared average item scores with overall impression ratings using a team-created AAC app rating scale. The results demonstrated that overall impression scores were significantly more reliable among experienced pilot raters than among novice raters. Consequently, while first impressions can be valuable, they may lack the necessary consistency when used by clinicians who are still developing their expertise in assistive technology.

First Impressions vs. Itemized Scores

Interestingly, the study found that overall impression scores were consistently higher than the average individual item scores. This suggests that a general 'gut feeling' might lead to an overestimation of an app's capabilities. However, a lower score on an AAC app rating scale does not necessarily indicate that an app is objectively poor. Instead, these differences often stem from the specific characteristics of the app and how closely they align with the unique requirements of the individual user. Therefore, practitioners must prioritize functional alignment over generic ratings.

Clinical Implications for Feature Matching

Feature matching remains the gold standard in selecting augmentative and alternative communication tools. Because individual item scores provide a more granular view, they are essential for identifying specific barriers to usability. Furthermore, the findings suggest that novice clinicians should rely more heavily on itemized rubrics to mitigate the subjectivity of first impressions. By focusing on how an app's specific features meet a patient's motor, cognitive, and linguistic needs, medical professionals can ensure more successful long-term communication outcomes.

Frequently Asked Questions

What is the benefit of using an AAC app rating scale?

Using a standardized rating scale allows clinicians to systematically evaluate features like usability, display, and output, ensuring the app is matched to the patient's specific capabilities rather than selected based on popularity.

Why do novice raters find itemized scores more useful?

Novice raters may lack the clinical experience to form reliable overall impressions. Itemized scores provide a structured framework that reduces bias and focuses on objective app characteristics.

Does a low score mean an app is poor quality?

Not necessarily. A low score often indicates that the app's features do not align well with the user's specific needs or the assessment criteria, rather than reflecting a total lack of capability in the software itself.

Disclaimer: This content is for informational and educational purposes only. It does not constitute medical advice or establish a doctor-patient relationship. Always seek the advice of a qualified healthcare provider for specific medical conditions. Refer to the latest local and national guidelines for clinical practice.

References

Da Fonte MA et al. Do first impressions matter? Comparing overall impression vs. individual item scores to make informed decisions on AAC apps. Disabil Rehabil Assist Technol. 2026 Feb 22. doi: 10.1080/17483107.2026.2623462. PMID: 41723854.

Shane HC, Costello JM. Augmentative and alternative communication: the feature matching process. In: Proceedings of the Annual Conference on Assistive Technology. 1994.

Gosnell J, Costello J, Shane H. Using a clinical approach to answer “what communication apps should we use?”: feature matching. Perspect AAC. 2011;20(3):87-96.