Brownie points come from the Girl Scouts (aka Brownies) and are associated with the stamps received for good deeds.

As far as I know brownie points and actual cake brownies have nothing in common.