The Board of Corrections must receive into the penitentiary all convicts sentenced to imprisonment therein by any court of the United States held in this state, and must safely keep and employ them according to the rules and regulations of the institution until the expiration of the term for which they are sentenced or until they are otherwise discharged by law; and it must account to the Department of Finance for all moneys received for the support of such prisoners.