Yakuri-ji was founded in 829 by Kūkai (Kōbō Daishi), the founder of Shingon Buddhism in Japan.

Before traveling to China, Kūkai planted eight roasted chestnuts here to divine if his journey would succeed. When he returned, all eight had sprouted and grown, so the temple's name changed from 'Eight Countries' to 'Eight Chestnuts.'