In the event of failure on the part of any bank in such municipality to qualify as a depository, the board of mayor and aldermen or other like governing authority of such city, town or village, hereinafter called the governing authority, may select a treasurer who shall safely keep and disburse the funds of such town, city or village according to law, and make bond for that purpose as now provided by law for such treasurers. The governing authority at any regular or special meeting may select and designate a depository or depositories into which the tax collector or collectors and auditor or auditors of said city, town or village shall deposit all tax collections and public funds, when collected and/or received, and in which the same shall thereafter be distributed, at the time or in the manner, as required by law to the several funds or accounts as now provided by law. Any depository so selected by the governing authority shall be within the State of Mississippi, and may hold such deposit or deposits at such rate of interest as may be agreed upon by the governing authority or in the discretion of the governing authority without liability for interest; but such depositories shall secure the same by pledging with the governing authority such security, in such amounts and upon such conditions as is now required by law of depositories which qualify as such by bidding therefor.