The buildings in Llanishen, which are now vacant, have been called ‘impossible to let’ in their current state