Page 51 - IJAMD-2-3

International Journal of AI for
Materials and Design

ORIGINAL RESEARCH ARTICLE
Gesture recognition for engaging spatial

experiences in healthcare: Co-design of
intelligent interactive illuminative textiles

Ching Lee 1,2† , Jeanne Tan 1,2† * , Hiu Ting Tang 1,2† , Jun Jong Tan 2 ,
Wing Ki Yip 1 , and Ka Wing Tse 1,2
1 School of Fashion and Textiles, The Hong Kong Polytechnic University, Kowloon, Hong Kong
Special Administrative Region, China
2 Laboratory for Artificial Intelligence in Design, New Territories, Hong Kong Special Administrative
Region, China

Abstract
The integration of artificial intelligence (AI) into textile design enhances functionality,
automation, and user interaction. While gesture recognition has been explored in
smart textiles, contactless interactive systems for healthcare remain underdeveloped.
This study presents a human-centered co-design approach to the development of an
AI-integrated gesture recognition system embedded in illuminative textile wall panels,
aimed at enhancing spatial engagement in healthcare environments. The research
† These authors contributed equally
to this work. was conducted in three key stages. First, a co-design workshop was conducted to
explore user preferences in textile materials, graphic design, and gesture interaction.
*Corresponding author:
Jeanne Tan Second, intelligent illuminative textiles were developed by knitting polymeric
(jeanne.tan@polyu.edu.hk) optical fiber into base wool yarns to enable illumination. A camera was embedded
Citation: Lee C, Tan J, Tang HT, and integrated with a computer vision-based deep learning model for detecting
Tan JJ, Yip WK, Tse KW. Gesture landmarks on the hands, shoulders, and head. The recognized gestures and body
recognition for engaging spatial movements triggered specific pre-programmed color changes on the textile surface
experiences in healthcare:
Co-design of intelligent interactive through edge-integrated light-emitting diodes. Finally, a prototype was fabricated
illuminative textiles. Int J AI Mater and installed in a government-established District Health Centre in Hong Kong
Design. 2025;2(3):45-63. to support physical activity and rehabilitation for elderly users. Semi-structured
doi: 10.36922/IJAMD025170013 interviews with stakeholders – including co-designers, users, and occupational
Received: April 22, 2025 therapists – were conducted to evaluate usability and inform design refinements.
Revised: June 12, 2025 Stakeholders reported high levels of satisfaction, emphasizing the system’s ability to
enhance community connection, therapeutic engagement, intuitive usability, and
Accepted: June 24, 2025 compelling visual feedback. These findings suggest that AI-driven interactive textiles
Published online: July 10, 2025 present promising opportunities for rehabilitation, therapeutic environments, and
Copyright: © 2025 Author(s). the promotion of elderly well-being.
This is an Open-Access article
distributed under the terms of the
Creative Commons Attribution Keywords: Interactive textiles; Illuminative textiles; Gesture recognition; Human-artificial
License, permitting distribution, intelligence interaction; Deep learning; Healthcare
and reproduction in any medium,
provided the original work is
properly cited.
Publisher’s Note: AccScience
Publishing remains neutral with 1. Introduction
regard to jurisdictional claims in
published maps and institutional Artificial intelligence (AI) has significantly influenced modern textile design by
affiliations. promoting “smart fabrics” that adapt to external stimuli and enhance user experiences

Volume 2 Issue 3 (2025) 45 doi: 10.36922/IJAMD025170013