Yakuri-ji a été fondé en 829 par Kūkai (Kōbō Daishi), le fondateur du bouddhisme Shingon au Japon.

Before traveling to China, Kūkai planted eight roasted chestnuts here to divine if his journey would succeed. When he returned, all eight had sprouted and grown, so the temple's name changed from 'Eight Countries' to 'Eight Chestnuts.'