I copy pasted the exact prompt into gpt4 (not the api, the webapp) and regenerated the answer 5 times.

Every time it came back with a conclusive yes. Are you sure you used gpt4 and not gpt3.5? I guess cherry picking is done both ways.