No building permit shall be issued for the erection of any building or structure in an unapproved subdivision or on a lot abutting a highway or street which has not been accepted by the Town or approved by the Town Plan and Zoning Commission in accordance with its regulations. This section shall not apply to the issuance of a building permit for the construction of a building or structure on a lot which, on September 17, 1951, was on record in the office of the Town Clerk and which abutted an accepted or approved highway or street or highway or street which was actually in use for vehicular traffic or for the construction of farm or accessory buildings which are not in violation of any lawful zoning regulations of the Town.