Although the castle defences were dismantled, the domestic range was left intact. Even so, the castle was falling from favour and so on the 24th July 1750, when a fire tore through the Sharrington Range, little effort was made to extinguish the flames & no attempt was made to rebuild the castle afterwards.
The Castle was now settled into the role of romantic ruin. The Earl's of Dudley showed interest in the ruin & work was undertaken to improve its appearance.
Throughout the 19th, 20th & into the 21st Century, the castle fulfilled the new role as a centre for festivals & fetes for the people of Dudley & beyond.