Privileges can be revoked just like anything else. Nothing states that you HAVE to have a drivers license. Think of it in simple terms. Riding the COTA bus, if you were a shit head, your pass would be revoked Im sure.
Driving on the road like a shit head.. aka.. wreckless, FRA, DUS (my biggest pet peeve imaginable), speeds, tag violations.. your privilege can be revoked. Just because "you paid your dues" doesnt mean you have the right to still be on the road with a record as such. The BMV revoked his privilege numerous times with the FRA and DUS, he obviously chose to drive during those times.