Won't hurt Apple in the long run as they've already removed Java from future OSX installations: Java is the achilles heel of OSX, remove it.
Also the architecture of OSX and Windows are vastly different. There are so many ways to exploit a PC it's not even funny. Yes Macs can be compromised, however it takes some effort. With windows (even ones with top notch anti virus's) it's cake.
Read up on RAT'S (zeuS, cerberuS), file-binding, crypted/polymorphic code and drive-by-download's, then make the decision for yourself.