Any variance hereafter granted by the Planning Board permitting the erection or alteration of any structure or structures or permitting a specified use of any premises shall expire by limitation unless such construction or alteration shall have been actually commenced on each and every structure permitted by said variance or unless such permitted use has actually been commenced within one year from the date of publication of the notice of the judgment or determination of the Board; except, however, that the running of the period of limitation herein provided shall be tolled from the date of filing an appeal from the decision of the Board to the governing body or to a court of competent jurisdiction until the termination, in any manner, of such appeal or proceeding.