A hermit named Kokusen Sennin who lived at this temple reportedly healed Emperor Kanmu of a brain disease in the 8th century and was awarded the title of Bosatsu (bodhisattva) for his efforts.

The mountain road to the temple closes completely from late December through February, and even when open, large buses are banned from attempting the narrow, winding ascent.

Yokomine-ji is Temple No. 60 on the Shikoku Pilgrimage.

At 745 meters elevation, Yokomineji is one of the notorious 'henro korogashi' temples, which literally translates to 'place where pilgrims tumble down' due to its treacherous steep slopes.