I doubt RL is involved. That would be soooo risky.

Bidding algorithms can model the price of winning the auction, you can maximize profit without fancy RL