The owner of the old E J Teare's newsagents in South Street is to face legal action after failing to obey a council order to improve the building.
The empty business is a longstanding town centre eyesore which the local authority said was 'adversely affecting its land.'
After being issued with a notice to make improvements in May, the owners failed to make the required repairs.
In response to the non-compliance, Somerset Council's legal team is taking action to secure the improvements.
The council could now carry out the repair works themselves and pass the cost on to the business owner.
A spokesperson for Somerset Council said: "An inspection of the premises has taken place after the notice elapsed. The matter has now been referred to the Council's legal team."
The former newsagents is a listed building, but has fallen into a deleterious state.
Teare's ceased trading in July, 2017, and the building has remained vacant ever since, while residents and councillors have for years called for renovation works to be carried out.
The empty shop had one its windows smashed last year, forcing authorities to step in to board up part of the frontage.