I also have this all the time. I think it stores the metadata in iCloud (if you configure it) so it does not rescan your media, but it does need to redownload the iCloud data. No other app suffers from this, so I think it’s a bug.