I mean, in several models, including the current most-likely one (last I heard) it effectively is finite. Eventually no new planets or stars can get created, and then some time after that, no atoms can exist.

Will the "universe" exist after that? Kind of a philosophical question, but nothing interesting will exist _in_ the universe.