But when the government privatizes services, that agency problem always exists. Instead of contracting to one service like any other entity, government would always need to contract with several. You're just making a stronger argument for not privitizing government services.
Moreover, laying all the blame at the feet of government for these companies being scumbags is precisely why I said private industry has the wrong culture for this sort of thing.
If you read the article you will see that they do it most likely cheaper than the prison can do:
JPay’s rapid rise stems in part from the generous deal it offers many prison systems. They pay nothing to have JPay take over handling financial transfers. And for every payment it accepts in these states — prisoners typically receive about one per month — the company sends between 50 cents and $2.50 back to the prison operator.
The government does have the power, and they most likely are outsourcing this part of their non core infrastructure like most other companies do, to save money.
Moreover, laying all the blame at the feet of government for these companies being scumbags is precisely why I said private industry has the wrong culture for this sort of thing.