I've sold a vehicle doing the exact same thing. We met at my credit union, he paid me, money is in my hand all of 5 seconds before I hand it to the credit union employee. Loan paid off, I get the difference, he gets the title, done. Easy.
If the guy is serious, he will offer to do the exact same thing or will accept you wanting to do it this way. If he says no, fuck em.