The absolute last thing you want to do is put it back on in the WRONG spot, which'll make it worse. Either get it balanced, or deal with it 'as-is'. If you don't experience any ill handling at the speeds you normally travel, then you'll be okay, but that's a judgement call for you to make. It may also cause your tire to wear prematurely in certain spots... But I'm guessing for the size of your bike, it won't be as noticable.