Page 10 - IJAMD-1-3

International Journal of AI for
Materials and Design

ORIGINAL RESEARCH ARTICLE
CockpitGemini: A personalized design

framework for smart vehicle cockpits integrating
generative model-based multi-agent systems

and human digital twins

1
Mengyang Ren 1,2 , Junming Fan * , Chunyang Yu 3 , and Pai Zheng 1,2,3,4 *
1 Department of Industrial and Systems Engineering, Faculty of Engineering, The Hong Kong
Polytechnic University, Hong Kong Special Administrative Region, China
2 Laboratory for Artificial Intelligence in Design, Hong Kong Science Park, Hong Kong Special
Administrative Region, China
3 Design-AI Lab, China Academy of Art, China
4 State Key Laboratory of Intelligent Manufacturing Equipment and Technology, Huazhong University
of Science and Technology, Wuhan, Hubei Province, China

Abstract

The evolution of smart vehicle cockpits is transitioning from serving as mere driving
tools to becoming intimate partners that significantly enhance user experiences
through advanced technologies. This research addresses the growing demand
*Corresponding authors: for personalized design in smart vehicle cockpits by proposing a framework,
Junming Fan CockpitGemini. This framework integrates generative model-based multi-agent
(jun-ming.fan@connect.polyu.hk);
Pai Zheng systems and human digital twins, enabling tailored designs and services based on
(pai.zheng@polyu.edu.hk) user preferences and real-time status. The capabilities of the proposed framework
Citation: Ren M, Fan J, Yu are illustrated through four dimensions: personalized product design, personalized
C, Zheng P. CockpitGemini: A interactive interface design, user state monitoring and personalized regulation,
personalized design framework for and personalized driving strategy recommendations. A case study on the design
smart vehicle cockpits integrating
generative model-based multi-agent of personalized vehicle seats demonstrates the feasibility and usability of the
systems and human digital twins. CockpitGemini framework, highlighting its potential to enhance user satisfaction in
Int J AI Mater Design. 2024; smart vehicle cockpits.
1(3):4-19.
doi: 10.36922/ijamd.4220
Received: July 12, 2024 Keywords: Generative models; Multi-agent systems; Human digital twin; Personalized
design; Immersive user experience; Smart vehicle cockpits
Accepted: August 14, 2024
Published Online: October 10, 2024
Copyright: © 2024 Author(s).
This is an Open-Access article 1. Introduction
distributed under the terms of the
Creative Commons Attribution With the rapid development of digitalization and intelligence technologies, the
License, permitting distribution, automotive industry is undergoing a transformative shift toward smart vehicles.
1
and reproduction in any medium,
provided the original work is Smart vehicle cockpits, as a core component of smart vehicles, serve as the interfaces
properly cited. between the driver and the vehicle’s advanced functionalities. They integrate advanced
Publisher’s Note: AccScience sensing, decision-making, and interaction technologies to provide drivers with a safe,
Publishing remains neutral with efficient, and comfortable driving experience, evolving from a mere driving tool into
regard to jurisdictional claims in 2
published maps and institutional an intimate partner that supports a wide range of activities, including entertainment,
affiliations. communication, and productivity. In this context, the role of smart devices cannot be

Volume 1 Issue 3 (2024) 4 doi: 10.36922/ijamd.4220