Any applicant or licensee aggrieved by the decision of the licensing agency after a hearing, may within thirty (30) days after the mailing or serving of notice of the decision as provided in Section 43-11-11, file a notice of appeal in the chancery court of the First Judicial District of Hinds County or the chancery court of the county in which the institution is located or to be located, and the chancery clerk thereof shall serve a copy of the notice of appeal upon the licensing agency. Thereupon the licensing agency shall, within sixty (60) days or such additional time as the court may allow from the service of such notice, certify and file with the court a copy of the record and decision, including the transcript of the hearings on which the decision is based. Findings of fact by the licensing agency shall be conclusive unless substantially contrary to the weight of the evidence but upon good cause shown, the court may remand the case to the licensing agency to take further evidence, and the licensing agency may thereupon affirm, reverse or modify its decision. The court may affirm, modify or reverse the decision of the licensing agency and either the applicant or licensee or the licensing agency may appeal from this decision to the Supreme Court as in other cases in the chancery court. Pending final disposition of the matter the status quo of the applicant or licensee shall be preserved, except as the court otherwise orders in the public interest. Rules with respect to court costs as in other cases in chancery shall apply equally to cases hereunder.