The introduction of ubiquitous technology has brought a drastic change in how health practitioners provide assessment and treatment, as well as how individuals with disabilities participate in speech therapy using digital media and technology. Using user-centered design with individuals with disabilities and participatory design with caregivers, speech language pathologists, and pediatricians, my research studies aim to offer insights for designing and evaluating mobile and voice interfaces in the context of speech therapy.
Receptive Language Screening Game: “Time For Children”
Approximately 5-12% U.S. children between 2-5 years old are likely to suffer from speech and language delays. Using an automated mobile game for receptive language screening, this study aims to explore different levels of complexity in visual scene display on the iPad, and how patterns of play may impact the game experience in young children between 2-4 years old.
Keywords: mobile game, childhood language disorders, infant and toddlers
Role: project management, user research, interaction design (visual & audio)
Expressive Language Screening Tool: Storytime
Shared storybook reading is an evidence-based intervention technique for assessing and treating children with delayed language and literacy skills. Using a Wizard of Oz experiment, this project investigates how 4-6 years old children with and without communication impairments interact with conversational interfaces on the iPad.
Keywords: mobile app, speech and language disorders, preschoolers
Role: project management, user research, experimental design, video editing and analysis
Du, Y., Abbas, H., Taraman, S., Segar, S., Bischoff, N. (2018). In-Home Speech and Language Screening for Young Children: A Proof-of-Concept Study Using Interactive Mobile Storytime. Full paper accepted at the American Medical Informatics Association (AMIA) 2019 Informatics Summit, San Francisco, United States.
Du, Y., Abbas, H., Taraman, S., Segar, S., Bischoff, N. (2018). In-home speech and language screening for young children: A pilot study using interactive mobile storytime. Abstract accepted at the AIMed North America, Dana Point, United States.
Du, Y. (2018). Tracking children’s speech and language development: A pilot study using interactive mobile storytime. Short talk accepted for the Panel “Working with Industry & Making Impact” at the Researching Multimodal Childhood Symposium, Odense, Denmark.
Du, Y., Abbas, H., Taraman, S., & Seger, S. (2017). Storytime: in-home automatic assessment for speech and language development in young children. Abstract accepted at the 1st Shaping the Future of Pediatrics Congress, Rome, Italy.
Dementia Screening Tool: eSLUMS
Nearly 9.9 million dementia cases are diagnosed each year worldwide, resulting in approximately $818 billion in related global annual healthcare costs in 2015. Early detection of cognitive impairment and dementia has become an international public health crisis. This iOS mobile application provides a digitalized cognitive screener for elders who are at risk for cognitive impairment or dementia in multiple languages.
Keywords: mobile app, cognitive screening, dementia
Role: user research, interaction design (visual & audio), content localization
Du, Y. (2017). Opportunities and challenges in the implementation of mobile health (mHealth) technology for dementia screening. Poster presented at the Computing Research Association for Women (CRA-W) Grad Cohort Workshop, Washington, D.C.
A Mix-method Study: Apps for Children with Communication Impairments
Using online interviews and surveys, this study examines how iPad apps are designed and used for speech therapy with children who have communication impairments, and offers implication for design and future research across both speech therapy and child-computer research communities.
Keywords: mobile apps, multi-stakeholder interviews, expert evaluation
Role: lead researcher (study design, data collection and analysis)
Du, Y. (2018). How are mobile apps designed and used to help children with communication impairments? Technical research session (#4599) accepted at the 2018 American Speech-Language-Hearing Association Annual Convention, Boston, Massachusetts.
Du, Y. (2018). Unpacking play in the clinical context: Mobile app use between Children with disabilities and their speech language pathologists. Full paper accepted at the International Academic Conference on Meaningful Play, East Lansing, Michigan.
Du, Y. (2018). Insights from pediatric speech language pathologists: Considering instructional goals in app recommendations for children with disabilities. Short paper accepted for the 2nd International Workshop on Children & Recommender Systems (KidRec), Trondheim, Norway.
Du, Y. (2018). Apps for communication: Investigating the design and use of mobile applications for pediatric speech therapy. Extended abstract accepted for the Student Research Competition at the 5th IEEE/ACM International Conference on Mobile Software Engineering and Systems, Gothenburg, Sweden.
Voice-Interaction for Pediatric Speech Therapy
Participating in therapy exercises at home is crucially important for long-term success. Conversational agents (CA) such as Amazon Alexa and Google Assistant, provide a novel opportunity to engage children with disabilities to participate in home exercises. This study aims to support children aged 4-6 years old to engage in speech therapy through voice-based games and activities (e.g., stories).
Keywords: conversational agents, voice game
Role: lead researcher (interaction design, experimental design, user research)
Du, Y., & Soria, A.M. (2018). Designing conversational agents to support home exercises for children who receive speech and language therapy. Poster and oral presentation accepted as the 2nd place of the Student Design Challenge, American Medical Informatics Association (AMIA) 2018 Annual Symposium, San Francisco, United States.