The Hanseswari temple has a distinctive architecture different from the usual pattern present in this area, consisting 13 minars or Ratnas, each built as a blooming lotus bud. The inner structure of the building resembles human anatomy. It was started by Raja Nrisingha Deb Roy Mahasay and later completed by his widow wife Rani Sankari in 1814.