TY - GEN
T1 - LLM-Driven Adaptive Pictography
T2 - 24th International Conference on Web-based Learning, ICWL 2025 and 10th International Symposium on Emerging Technologies for Education, SETE 2025
AU - Guo, Yuetong
AU - He, Yantong
AU - Wattanachote, Kanoksak
N1 - Publisher Copyright:
© The Author(s), under exclusive license to Springer Nature Singapore Pte Ltd. 2026.
PY - 2026
Y1 - 2026
N2 - The acquisition of Chinese characters (Hanzi) presents a significant challenge for learners worldwide, from young native speakers to second language (L2) adults, primarily because rote memorization is ineffective. This paper introduces the LLM-Driven Adaptive Pictography (LLMDAP) framework, a novel AI-powered system that transforms Hanzi learning into an active, creative, and highly personalized process. LLMDAP leverages a three-stage pipeline. The first stage, Visual Capture, allows learners to sketch concepts using pictorial cues. The second stage, Multimodal Mapping, uses a heuristic/AI-based recognizer to map sketches to characters and trigger learning content. The last stage is the Personalized Reinforcement, where the system dynamically generates a multimodal poster showcasing the character’s etymological chain and provides text-to-speech feedback. We present the complete system architecture and a fully implemented proof-of-concept that demonstrates the technical feasibility of this approach for a core set of pictographic characters. Our work contributes a novel framework grounded in cognitive theory, a functional prototype, and a detailed technical walkthrough. The LLMDAP framework marks a significant step towards highly personalized, AI-powered language education for a global audience, and we provide a clear roadmap for its future expansion and empirical validation.
AB - The acquisition of Chinese characters (Hanzi) presents a significant challenge for learners worldwide, from young native speakers to second language (L2) adults, primarily because rote memorization is ineffective. This paper introduces the LLM-Driven Adaptive Pictography (LLMDAP) framework, a novel AI-powered system that transforms Hanzi learning into an active, creative, and highly personalized process. LLMDAP leverages a three-stage pipeline. The first stage, Visual Capture, allows learners to sketch concepts using pictorial cues. The second stage, Multimodal Mapping, uses a heuristic/AI-based recognizer to map sketches to characters and trigger learning content. The last stage is the Personalized Reinforcement, where the system dynamically generates a multimodal poster showcasing the character’s etymological chain and provides text-to-speech feedback. We present the complete system architecture and a fully implemented proof-of-concept that demonstrates the technical feasibility of this approach for a core set of pictographic characters. Our work contributes a novel framework grounded in cognitive theory, a functional prototype, and a detailed technical walkthrough. The LLMDAP framework marks a significant step towards highly personalized, AI-powered language education for a global audience, and we provide a clear roadmap for its future expansion and empirical validation.
KW - Chinese Character Acquisition
KW - Educational Technology
KW - Large Language Models
KW - Multimodal AI
KW - Personalized Learning
KW - Pictography
UR - https://www.scopus.com/pages/publications/105041667352
U2 - 10.1007/978-981-92-0042-9_29
DO - 10.1007/978-981-92-0042-9_29
M3 - Conference contribution
AN - SCOPUS:105041667352
SN - 9789819200412
T3 - Lecture Notes in Computer Science
SP - 395
EP - 410
BT - Learning Technologies and Systems - 24th International Conference on Web-based Learning, lCWL 2025 and 10th International Symposium on Emerging Technologies for Education, SETE 2025, Revised Selected Papers
A2 - Fernández-Manjón, Baltasar
A2 - Mendes, António José
A2 - Temperini, Marco
A2 - Kubincová, Zuzana
A2 - Spaniol, Marc
A2 - Xu, Guandong
A2 - Popescu, Elvira
A2 - Hao, Tianyong
A2 - Wang, Xiangmeng
A2 - He, Shuning
PB - Springer Science and Business Media Deutschland GmbH
Y2 - 30 November 2025 through 3 December 2025
ER -