When any judgment of conviction is reversed and the case remanded after the convict has been conveyed to the penitentiary, he may be removed to the county in which he was tried by the sheriff of that county, or his deputy, in the same manner in which he was conveyed to the penitentiary; and all the provisions of this code in respect to authority, duty and compensation of officers and escapes, or attempts to escape, by convicts are applicable to such removal.