Mount Muro's caves were believed to be carved by a dragon deity named Zennyo Ryuo. The imperial court once traveled here to pray for rain and good harvests, trusting the dragon spirit to bring storms.

The mountains around Muro-ji served as secret training grounds for Iga ninja, who used the remote, forested terrain to practice their skills away from prying eyes alongside the temple's mountain ascetics.