In any case in which the Building Inspector of the village shall deny an application for a building permit solely or partly because of the provisions of §
12-2 of this chapter, he shall promptly send to the applicant, by registered mail, addressed to the address of the applicant set forth in the application, a notice of his action, which notice shall specify the ground or grounds upon which the same is based.
Insofar as it relates to the provisions of §
12-2 of this chapter, action of the Building Inspector shall be subject to administrative review only upon an appeal to the Board of Zoning Appeals of the village duly taken pursuant to and in accordance with the provisions of the Village Law and the rules of said Board.