Ryōkan Pilgrimage

Ryōkan (良寛, 1758–1831) is one of the most beloved figures of Japanese cultural history: a Zen monk of the Sōtō school who declined temple rank to live in a mountain hermitage, played temari with village children, and left behind waka and calligraphy that are treasured to this day. Yet the living memory of such figures thins with each generation — the landscapes they walked are redeveloped, their works retreat into museum cases, and their presence survives only as text.

The project asks a design question: not merely to learn facts about Ryōkan, but to restore his presence through bodily acts. It answers with a playable system, Ryōkan Pilgrimage, and a genre proposal, TeleAbsence Gaming — extending the Tangible Media Group's TeleAbsence vision, interface media that evoke the presence of those who are absent, from communication media into interactive play.

The world remembers Ryōkan a little more … Ryōkan is once again present in the world.

In the fiction, a demon king has devoured the world's memory of Ryōkan. The player — the last pilgrim who remembers him — walks a stylized Echigo landscape of rice terraces, bamboo groves, and ridgelines rendered in a sumi-e-informed look, along a 3.4 km circular route that begins and ends at the same point, echoing the go-and-return structure of pilgrimage. Four ink monuments, each bearing one of Ryōkan's waka — the temari ball, cherry blossoms, the moon, and snow — stand along the way.

Along the route stand statues of Teishin-ni, Ryōkan's disciple and poetic correspondent. Each opens a poetry-exchange event in which the player composes a waka of their own, guided by mora counting. The poem is rendered in Ryōkan's hand at runtime by the generative system below, joins the recitable repertoire, and can be mounted with chosen ink and paper and exported outside the game — the pilgrimage yields a real artifact: a poem of one's own in the hand of the remembered.

A lecture deck on the writing system behind the game — why a love letter is hard to write even with a smartphone and AI in hand, how Ryōkan can serve as a love interface, and a case study that passes a poem by Hakushu Kitahara through the hands of poets, calligraphers, and painters until it becomes a letter of one's own.

‹ ›

01 / 44 ← → keys · click to advance Fullscreen

The system runs entirely on one consumer macOS machine with a built-in webcam and microphone. The game automatically spawns a Python perception process at startup and talks to it over local UDP: gesture, voice, and walk events flow into the game, while state queries and a live annotated camera wipe flow back to the HUD, so the player can always see what the camera sees.

One algorithm, two readings. The same skeletonization pipeline recovers a brush trajectory from calligraphy and a walkable road from terrain — "following the brush" and "following the path" become a single interaction principle.

A comparative user study — guided play of Ryōkan Pilgrimage against a curated book on the same four poems and 83 knowledge cards — is designed but not yet conducted. It will test whether embodied play yields higher engagement, stronger retention after two weeks, greater felt presence of Ryōkan, and more transfer toward his heritage, while expecting books to hold a slight edge in immediate factual recall. The reading, if confirmed: books teach; embodied play teaches durably and engages.

The research is built from small, open instruments. They are arranged in the traditional order of mastery — shu (守, learn the form), ha (破, break it), ri (離, leave it).

Names. In academic and research contexts, Ko Narukama uses the name Ko Ishiyama. The project is conducted as a Research Affiliate of the Tangible Media Group at the MIT Media Lab.

Tangible Media Group ↗(opens in a new tab)