In 1874, Iswar Chandra Vidyasagar asked permission to build a residence in Calcutta from his father, Thakurdas Bandyopadhyay, who was then residing at Kashi. After getting the blessings of father, he began building this house at 25, Brindaban Mullick Lane which later changed to 36. Vidyasagar Street in 1920. In the year 1877, Vidyasagar moved in and lived here till his death. Sri Sri Ramakrishna came to visit Vidyasagar at this house in 1882. In 1891, Vidyasagar passed away at this house.
The house was acquired by The Government of West Bengal on 6th November, 1998 as per requisition of Higher Education Department. In January, 2021, the Department of Higher Education, Government of West Bengal established Vidyasagar Academy at this house to study the life and works of Vidyasagar and their impact on the society and to disseminate knowledge to the community.