A.
Within the districts established by this Part 1, there exist lots, structures and uses of land and structures which were lawful before this Part 1 was passed but which would be prohibited, regulated or restricted under the terms of this Part 1. It is the intent of this Part 1 to permit these nonconformities to continue but not to permit their enlargement, expansion or extension nor to permit them to be used as grounds for the addition of other prohibited structures or uses elsewhere in the same district.
B.
To avoid undue hardship, nothing in this Part 1 shall be deemed to require a change in the plans, construction or designated uses of any building on which actual construction was lawfully begun prior to the effective date of adoption or amendment of this Part 1 and upon which actual building construction has been diligently carried on. "Actual construction" is hereby defined to include the placing of construction materials in a permanent position and fastened in a permanent manner, except that, where demolition or removal of an existing building has been substantially begun preparatory to rebuilding, such demolition or removal shall be deemed to be actual construction, provided that work shall be diligently carried on until completion of the building involved.