This temple is one of the 51 pithasthans in India as per Hindu mythology. As per mythology, Lord Vishnu had cut off the body of Mata Sati into 51 pieces by Sudarshana Chakra and all these pieces fell at different places throughout the country and these places are known as pithasthans. It is said that 'right foot' of Mata Sati fell at Matabari.
This pithasthan is also known as Kurma Pith because the shape of the temple premises resembles to that of "Kurma" namely tortoise. Inside the temple, the idol of Maa Kali is kept which is made of 'reddish black Kastic pathar.' Maa Kali is worshipped in her 'Soroshi' form in this temple. There is an idol of smaller size of Maa Kali called 'Chotto Maa 'and this image used to be carried by Maharajas of Tripura during "Mrigaya" namely hunting and also during war.
The temple consists of square type sanctum of the typical Bengali hut type structure with a conical dome. The temple was constructed in 1501 A.D. by the then Maharaja Dhanya Manikya.
In the eastern side of the temple there is a famous Kalyan Sagar where fishes and tortoises of huge size are found and devotees feed them with "muri" and biscuits. No fishing is permitted in the Kalyan Sagar.
Every year on Dewali, a famous Mela takes place near the temple which is visited by more than two lakhs pilgrims.