The church on Zelená Hora became one of the most visited pilgrimage places and its grounds took part in many magnificent Baroque festivities, culminating in 1735 with massive celebrations of the presumed 500th anniversary of monastery's foundation.

A fatal blow to the pilgrimage site was a fire that broke out in the monastery on July 16, 1784; due to strong winds, the fire spread to the pilgrimage church and cloister, depriving them of their roofs.

The fire was followed by a request from the then abbot Otto Steinbach of Kranichstein to close the monastery. The Emperor Joseph II dissolved the monastery in October of the same year, although he had originally intended to keep it as a shelter for priests who had committed crimes and had been sentenced by the church authorities. Immediately after the fire, a collection was organized to repair the damage done to the church and cloister but it was only used for a temporarily cover of the roof. The remaining unused funds were returned to the donors. When the monastery was dissolved and the church was scheduled to close as well, an inventory of the church furniture was made so that any valuables could be removed. In 1785, it was permitted to celebrate the mass on the feast of St John of Nepomuk. However, the removal of the equipment was still planned, which eventually partially happened. The organ was transported and installed in the church of St Wenceslas in the nearby village of Radešínská Svratka, the pulpit in the church of the Visitation of Our Lady in Obyčtov and benches in the church of St Martin in Jámy.