That's like saying if I go and paint my house in leopard stripe paint that since my mortgage isn't going up the only cost to my net worth was the cost of the paint + labor.
If it doesn’t stop you from doing it and no one involved (including you) ever does any analysis resulting in a change in behavior - you’re basically correct, economically.