I usually don't recommend PSU right away, but yes, the PSU can be responsible for the strangest shit you can imagine.
I'll never forget the day I was seeing what was wrong with my moms computer and then smoke started pouring out of the back of it.. Fan stopped working, overheated to the point of solder melting, short circuited, smoke.