Yakuri-ji wurde 829 von Kūkai (Kōbō Daishi), dem Begründer des Shingon-Buddhismus in Japan, gegründet.

Before traveling to China, Kūkai planted eight roasted chestnuts here to divine if his journey would succeed. When he returned, all eight had sprouted and grown, so the temple's name changed from 'Eight Countries' to 'Eight Chestnuts.'