In my last round of interviews, by far my favorite session was "here is a real project with a real bug, debug it, then if you have time, describe how to fix it, then if you have time, write the fix". (At Stripe FWIW.)
It was super representative of what my work is actually like, and what I'm good at, and ChatGPT would not have figured it out.
Yeah! I didn't end up taking a job at Stripe, but I came away very impressed with their process. Only one interview was leetcode-ish and it was a phone screen and purposefully not a high bar. Then the real interviews were: that debugging one which I loved, an "integration" one which involved live coding while plugging a few different unfamiliar libraries and APIs together (also something I really do in my job), a standard system design interview (still don't really love these...), and an in depth conversation with a hiring manager. Still a tough day, but pretty decent process I think!
Do you mean this debugging interview in particular, because it could potentially be useful work fixing a real bug for them? To be clear, it isn't an extant bug. I think the way they do it is they take an interesting (but fairly straightforward) real bug that they fixed at some point, and they back out the fix.
It was super representative of what my work is actually like, and what I'm good at, and ChatGPT would not have figured it out.
yet