Before a county administrator shall perform any of the duties or functions of the office, and before any letters shall be granted to him, he shall execute and file in the office of the clerk of the chancery court a bond with two (2) or more sufficient sureties, to be approved by the chancellor in termtime or vacation, in a penalty of Five Thousand Dollars ($5,000.00) payable to the state, conditioned that he will discharge all the duties of the office of county administrator, which bond may be sued on at the instance of any person interested. He shall also take an oath at or prior to the granting of letters of administration, to be filed in the clerk’s office, to administer according to law every estate which may be committed to his charge, and that he will account for and pay over all monies in his hands by virtue of his office when thereto required by order of the court.