Indeed, since it looks at data from before you press the trigger as well. The camera is always active while you have the camera app; storing a few seconds of pictures is a trivial amount of memory.
Live Photo means storing the video in the image file. Turning it off doesn’t mean the video is no longer used, just that it isn’t stored.