There is considerable disagreement about who built the temple and why. One of the stories is that it was built about 500 years ago by a servant of Raja Man Singh in honor of his mother . After its construction, the servant boasted that having built the temple, he had repaid his karmic debt to his mother. However, since one can never fully repay one's debt to their mother, she cursed the temple and it started to lean. Accordingly, it is also called the Matru-run (Mother's Debt) temple.