I downloaded a new kernel, the imoseyon lean kernel (v3.01GBtest1, downloaded v2.5.3GBtest7 as well, in case I don't see improvement with this one). It's taken just about half an hour to get from 80%-100% and I'm just about to wipe the battery stats. I do know that when I flashed the ROM the first time, and wiped the battery stats I wasn't at full charge...I MIGHT have even had the cord plugged in, but I can't remember.
I've read that these can cause a huge hit to battery life, and that this (the kernel I'm running, and charging 100% and wiping battery stats) seems to fix it. Also, your tip of turning off USB debugging seemed to help too. I've also got Netflix working, so I'll see tomorrow how it all goes. Crossing my fingers for good battery life and no boot loops lol.