The Chaturbhuj Temple's construction began in 1558 by Madhukar Shah, a devout Bundela Rajput ruler. Intended to enshrine an idol of Lord Rama, the temple's construction faced an interesting turn of events. Queen Ganesh Kunwari, Madhukar Shah's wife, brought the idol from Ayodhya. As per the legend, the idol was to be installed in a new temple built specifically for it. However, upon the queen's return, the idol was temporarily placed in the queen's palace (which is now the Ram Raja Temple). When the Chaturbhuj Temple was completed, the idol refused to move, believed to be divinely ordained. Consequently, the Ram Raja Temple became the primary place of worship, while the Chaturbhuj Temple remains a magnificent architectural monument.