Unless something has changed since I first set up google now on my phone, anything that requires trawling through your inbox is entirely opt-in (that is, another layer of opt-in beyond installing the app and enabling google now)