Breaking the silence - AI for Deaf mob

Start date
End date
Research partner(s)
Centre for Inclusive Design
Saje Mind

Introduction

In Australia, Deaf and hard-of-hearing Aboriginal people face significant communication barriers, especially in legal and healthcare settings. These challenges are compounded by the lack of interpreters for Auslan and traditional Aboriginal sign languages, leading to cycles of trauma, anxiety, and poor mental health.

Jody Barney, a Birri-Gubba/Urangan Deaf cultural interpreter, highlights the profound impact of these communication barriers. With lived experience in 18 different sign systems and mainstream interpreter systems, she emphasizes the urgent need for a culturally appropriate solution.

The Cultural Context

The Australian Black Lives Matter movement has once again underscored the severe plight of Aboriginal and Torres Strait Islander peoples in justice systems. Over 90% of these individuals in the justice system suffer from hearing problems ranging from mild to severe. Many use traditional Aboriginal and Kriol sign languages, which are often not recognized or understood by mainstream services.

In rural, remote, and regional Australia, 55 identifiable signing systems and 18 sign language systems are still in use. Unfortunately, the court and healthcare systems frequently provide inadequate support, often defaulting to Auslan interpreters or pen and paper, which are not effective for many.

The Problem

Deaf and hard-of-hearing Aboriginal people face significant communication barriers that hinder their access to essential services. The lack of readily available interpreters and culturally appropriate support exacerbates frustration and limits their participation in crucial interactions, perpetuating cycles of disenfranchisement and inequality.

The Solution

This project proposes an AI-powered mobile application that offers a comprehensive communication support system, designed in collaboration with Aboriginal communities:

Real-time Translation:

  • Multiple Input Options: Text, pictogram, and Auslan input translated into speech and/or text for seamless communication with anyone.
  • Personalization: AI tailors translations to the user's communication style and vocabulary level, ensuring accuracy and clarity.

Asynchronous Translation:

  • Pre-recorded Messages: Users can store commonly used phrases or questions for quick and easy access during interactions.
  • Offline Functionality: The app allows users to pre-translate documents or prepare for upcoming appointments, even without an internet connection.

Additional Communication Support Tools:

  • Legal Term Explanations: AI provides clear and concise explanations of complex legal terms used in documents and conversations.
  • Stress Management Features: Breathing exercises, calming visuals, and other tools help users manage anxiety in unfamiliar and high-stakes environments.

Cultural Sensitivity and Community Involvement

Initial research was conducted on Wiradjuri country, with strong links to the community. This project emphasizes coding for culturally appropriate AI, ensuring the system respects context, ownership, and trust. The AI solution is designed to communicate with the person, not the other way around, reflecting a deep understanding of the cultural nuances and communication preferences of Aboriginal communities.

Benefits

  • Enhanced Communication and Participation: Real-time and asynchronous translation empowers users to actively engage in legal and healthcare settings.
  • Increased Independence and Confidence: Users can communicate directly with professionals without relying solely on interpreters.
  • Improved Access to Services: Reduced communication barriers lead to a better understanding of legal rights and healthcare options.
  • Culturally Appropriate Communication: The app can be customized to accommodate Aboriginal languages, dialects, and communication preferences.
  • Reduced Stress and Anxiety: Features like pre-recorded messages and stress management tools promote a calmer and more productive communication experience.

Conclusion

By leveraging AI technology and cultural expertise, this project aims to bridge the communication gaps for Deaf and hard-of-hearing Aboriginal people. It not only provides practical solutions for immediate needs but also fosters a deeper sense of inclusion and respect for cultural heritage. We seek support and funding to bring this vision to fruition, ensuring equitable access to essential services for all.

Output(s)

Indigenous sign languages - a literature review
Type
Discussion paper
Authors
Professor Katie Ellis, Cutin University
Publication date
Not listed.
Ethical AI - Literature Review
Type
Discussion paper
Authors
McRae
Publication date
Not listed.
Co-designed Framework Methodology Final
Authors
Dr Manisha Amin
Publication date
Not listed.
Website - overview and demonstrations of AI for Deaf Mob
Authors
Simon Lillis
Publication date
Not listed.
Breaking the Silence - AIATSIS Conference presentation V1
Type
Discussion paper
Publication date
Not listed.