Plans for four homes and a flat at a redundant St John Ambulance station site in Haverhill in west Suffolk have been refused.