作者：
Xin Ruo Zhu 祝心若, Chee Lay Tan 陈志锐, Xiang Qing Hu 胡向青

中文题目：
AI赋能南洋题画诗的多模态文学教材开发与实践路径

英文题目：
AI Empowering Nanyang Painting Poems: Development and Practical Pathways of Multimodal Literary Teaching Materials

简介：
For students of Chinese as a second language (CSL), poetry is a challenging point in teaching, especially modern poetry, where the lack of an imagistic bridge between the poem and the reader makes it difficult for students to understand and interpret the verses. Nanyang painting poems (NPPs), characterized by the unique style and artistic conception of “poetry within painting and painting within poetry” integrate poetry, calligraphy, and visual art into a single multimodal text — a rich and multidimensional teaching materials. Singapore' unveiled the 2026 financial year budget aimed at boosting AI, including training and free access to advanced AI tools for the public, however its potential in developing CLS literary materials remains underexplored, that have sparked research interest in AI-assisted intelligent multimodal teaching materials. The article focuses on NPPs as its object of study, exploring the digital heritage of NPPs and the development of AI-assisted CSL literary teaching materials. Through field research and online access, it collects data including images of the works, authors’ interpretations, exhibition reports and reviews, as well as digital media display materials. The article 1) compares the functionalities of LLMs, AI multimodal systems, and intelligent agents, in order to elect the AI tools to assistant in recognition and quantitative statistics; 2) employs the ‘language-image’ analytical tools of Multimodal Semiotics, and Multimodal Analysis method to carry out the encoding of textual symbols and visual symbols, as well as hierarchical classification analysis; 3) by analyzing two representative case studies, the research transforms theoretical planning into practical operation, including clear steps of human-AI collaboration, resource allocation, and execution mechanisms. Ultimately, it embodies the practical pathways through which AI empowers the development of multimodal teaching materials for NPPs. The research findings indicate that 1) NPPs presented in a multimodal composite manner, this enhances the richness, concreteness, and intuitiveness of CSL literary teaching materials, thereby improving the comprehensibility and reception of poetry; 2) AI multimodal technology, by the text recognition and images recognition of NPPs, and combining with speech synthesis, can further enhance the learning experience. From the perspective of literary teaching materials, the article examined the ways and means by which the authors of NPPs express, transmit, and understand meaning through symbols. The study explored the development direction of AI-enabled NPPs in CSL literary teaching materials, providing practical pathways and theoretical references for the development of intelligent literary teaching materials in AI-driven Chinese language education.

返回