From and after the delivery of such deed of cession, the said tract and all erections, structures, buildings, fixtures, goods, chattels, and property, at any time thereon or thereto belonging or in any wise appertaining and belonging to the United States, shall be and remain exempt from tollages, taxes, and assessments of every name and nature, for and during the time the United States shall remain the owner thereof.