AR Poetry Teaching System

Taoyuan Poetry: AR Teaching System
桃園「塘」詩:AR教學系統

Interaction Design & Cross-disciplinary Applied Design

2018

The main purpose of this system development is to enhance the interaction of literary poetry teaching and learning motivation through the assistance of personal mobile devices and the experience of the landscape field.

This system is an innovative teaching of AR interaction for cross-disciplinary collaboration between design and literature. By designing the three-dimensional imagery in the poetry, and then superimposing the virtual scene on the real scene. This system reproduce the situation and enviroment that the poet experienced, in order to help readers to understand the artistic conception and connotation in poetry more deeply.

In addition, this system allows students to create in the field, by dragging the modular 3D virtual components, re-structuring the new artistic conception, and practicing poetry writing to achieve the field experience, just like a poet. To experience the pleasure of learning poetry, reading poetry, listening poetry, and even playing with poetry.

此系統開發的主要目的希望可以透過個人行動載具的輔助,結合地景場域體驗來增加文學詩詞教學的互動性及提升學習動機。

此系統為設計與文學的跨領域合作,開發AR互動之創新教學。藉由設計將詩詞文字中的意象三度空間化,再以虛擬的景象重疊於真實場景中,希望可以重現詩人當下創作時所體驗的情境,期待此能有助於讓讀者更深入了解詩詞的內涵,並理解詩詞中意境。

此外,此系統也可以讓學生實地創作,藉由拖曳模組化的3D虛擬元件,重新組構出心中新的意境,同時也練習詩詞的撰寫,達到實地體驗,猶如自己是詩人般的現場學詩、讀詩、聽詩、甚至玩詩的樂趣。

.

The advisor of the project is Chor-Kheng Lim who is the leader of CKfablab. I was the team member of CKfablab, and I joined this project as a project designer and interaction engineer. My role in the project is doing the AR system development, animation and graphic design.

此專案的主持人為林楚卿數位構築實驗室之林楚卿老師,我身為實驗室的一員,以專案設計師及互動工程師的角色參與這項專案,主要負責擴增實境系統開發、動畫及平面視覺設計。

Check out the project in the CKfablab’s website here.

Demo Video

.

  • Advisor | Chor-Kheng Lim (林楚卿)
  • Team | CKfablab
  • What I do | AR system development
  • Skills I use | Unity AR development with Vuforia

.

Award

  • 2018 元智大學VR/AR教育應用創作競賽 YZU VR/AR educational application competition, 銅獎

.

AR interface (spatialize poetry and artistic conception) AR介面呈現 (詩詞意境空間化)

Testing the AR teaching system in the literature poetry class 實地操作及體驗教學