Could Assistive Tech Help Reduce Stress?

PROJECT: HEY, MITCH! AAC (WEB APP)

Improved interaction between caregivers and care-receivers by creating a web-based augmentative alternative communication (AAC) tool that allows individuals with speech challenges to articulate their needs and reduce caregiver fatigue.

Hey, Mitch! Landing AAC Device Landing Page

Embracing the Unexpected

Prioritizing Caregiver Support

Caregiving often begins unexpectedly, and I have firsthand experience in caring for my elderly dad. As his health declined, communicating with him and recording his daily vitals became increasingly challenging. Gathering all this information became unsustainable for my family and me to maintain.

My Goals as a Caregiver:

Improve communication with my dad, who had early-stage dementia.
Monitor his vital signs to prepare for doctor visits.
Organize all of my dad’s information in one central location.

circle chart stating convenience, accessibility, and meaningfulness

Design Principles: Convenience, Accessibility and Meaningfulness are principles that have significantly shaped my product strategy.

“Effective communication and proper record-keeping are essential goals for our family. ”
Chuck Marsh, Brother

Reducing the Load of Caregiver Responsibilities

“Hey, Mitch!” is a web-based augmentative and alternative communication (AAC) tool designed to assist individuals with speech difficulties, like my dad, in expressing their needs and thoughts. It makes conversations easier and less stressful for both care receivers and caregivers, while also providing a simple way for caregivers to record important notes.

Hey, Mitch! Landing Screen and Vital Screen

"Hey, Mitch!" AAC tool tablet view landing screen (above) and vital screen (below) with recorded notes and information.

The Benefits of Assistive Technology: Is it the Solution?

There are many factors to consider when selecting assistive technology. However, when implemented correctly, tools like Augmentative and Alternative Communication (AAC) can make conversations easier and caregiving more rewarding.

*Definition: Assistive technology refers to various tools and devices that help people live more independently and enhance their quality of life. Augmentative and Alternative Communication (AAC) is one type of assistive technology.

Roles and Responsibilities

My Role

Visual Designer, Product Owner

The Team

1 Designer, Care Team (2 Family Members, 2 Nurses, 1 Physical Therapist

Timeline

May 2025 - Present

My Key Contributions

UI Design, Illustration and Concept Ideation, Assistive Technology Research

Why Bother With a Storyboard?

Sharing My Story

I needed a storyboard to effectively tell my story because it makes it easier to identify any gaps compared to a written statement. Creating a storyboard allowed me to address these gaps before investing time and effort into my designs.

“Hey, Mitch!” Web (AAC) App Storyboard:

1. Working from home

2. Starting the work day

3. Assessing to-do items for the day

4. Reminder doctor appt for dad

5. "Hey, Mitch!" app to the rescue!

6. Noting dad's vitals for doc appt.

7. Save all info and email to doctor

8. Grab dad and go to doc appt.

9. No stress at the doctor's office

10. Ending the day at the park, stress free!

I chose to close the story with my dad and me at a park, relaxing after the doctor’s visit. It feels much more realistic for our protagonist to be “simply satisfied” with how “Hey, Mitch!” alleviated the stress of providing the doctor with all of my dad’s vital information.

Discovery: Exploring the Right Options

Choosing the Right Tool

Identifying User Needs: Skills Assessment

Before choosing the right AAC (Augmentative and Alternative Communication) solution, I first needed to identify the communication challenges my dad faced, such as sensory, motor, or cognitive difficulties, to assess his needs.

circle chart stating convenience, reliability, and meaningfulness

After assessing how my dad communicated and what he felt comfortable with, I developed a strategy along with his care team that aligned with his abilities and potential.

Technology Research

Different Types of AAC (Low-Tech/High-Tech)

After identifying the challenges my dad faced in his daily activities and interactions, I focused on finding the right assistive technology tool to meet his needs, whether it was a low-tech or high-tech device. We decided to start with a low-tech paper prototype for the initial evaluation.

Communication Board with Core Vocabulary Text and Diary Tracker

I created a low-tech communication tool using cardboard and markers to help my dad express his emotions. He can easily point to different areas and describe how he’s feeling. Additionally, I put together a diary for him to track his daily vitals.

Collaboration and Device Trials

Engaging Family Members and Care Professionals

Establishing relationships with family members and healthcare professionals, such as nurses and physical therapists, was beneficial in ensuring we all agreed on the best assistive technology for my dad.

Family and care professionals during device trials with iPad

After assessing my dad’s comfort level with our proposed tool/technology, I organized device trials and introduced a digital prototype of the communication board using an iPad.

Competitor Research

Complicated Competitor Interfaces

I wanted to explore different AAC apps for my dad to try and see if he likes any of them. Many of the AAC tools available have complicated features, and I noticed that many of the icons used are not easy to understand or don't clearly represent their meanings, which left him feeling overwhelmed.

We explored numerous AAC apps and found that many AAC icons had little to no connection to the words they were intended to represent.

“Hey, Mitch!” AAC Web Tool

The Vision

Combining Assitive Tech and Vital Information

Our main priority for phase one was to use the AAC tool to assist my dad with his speech challenges. We decided to focus on 20 core vocabulary words that he frequently uses. This approach would help us gradually introduce him to the experience and enhance his communication.

1. AAC Integration (Communication Board)

“Hey, Mitch!” focuses on essential customizable AAC core vocabulary words to ensure that all learners can utilize frequent words that allow them to discuss what they value most.

2. Accessible AAC Communication Board Iconography

Many real-world AAC icons lack legibility and clarity, making it difficult for users to understand their meanings. In contrast, the icons for "Hey, Mitch!" are designed to be clear and intuitive, ensuring that our AAC users can easily grasp their purpose.

“Creating customized icons for “Hey, Mitch!” is an ideal approach, but it would definitely require a significant amount of time and effort to create a library set.”

3. Organize Information in One Central Location

We saw an opportunity to combine the AAC tool with my dad’s important vital information. Participants appreciated being able to track vital trends but wanted the option to select relevant categories, allowing them to monitor what they need.

“Participants appreciated tracking vital trends but desired the option to choose relevant categories, allowing them to select and monitor what they need.”

4. Improving Relationships

We found ways to reduce stress for caregivers by compiling the patient's vital information into an easily accessible report. While this report was valuable to participants, they also expressed a desire to track pain levels and trends throughout the day.

Outcome and Impact

Reflections and What I Learned

During the creation of “Hey, Mitch!” I faced the heartbreaking loss of my dad, and unfortunately, we were unable to share the final concept with him. This experience motivated me to enroll in CSUN’s ATACP Assistive Technology Certification course, which has been incredibly valuable in helping me understand the tools and techniques behind assistive technology.

What's Next: Phase 2

We are committed to continuing our efforts, including testing with other caregivers. We believe this work can make a significant difference for individuals with communication challenges and help alleviate the burden on caregivers.

Project Outcome:

As of August 2025, I have successfully completed the ATACP Certificate from CSUN. This 3-month course greatly enhanced my understanding of the technologies used in the disability community.
While using our web-based prototype in a rural area, we faced connectivity issues caused by low bandwidth. To address this, we will explore offline functionality to ensure that users can still interact with the app without worrying about overage charges or connection problems.
Ongoing research is in progress on how to manage the importing and exporting of open-source AAC core vocabulary sets from the AAC community, and incorporating open-source icons if necessary.

Next Case Study

Cupcakes For Everyone