As mentioned, I'm sure there's a tax from the name, but inspect, admire, and take a chance to drive a car like that, and you'll understand why.
All things considered, I'd be more afraid to drive a Rolls, than an exotic of similar value. The supercars and exotics of that price range are a far cry in fit and finish, but the price tag likely comes from performance, race heritage, and of course brand name.
Ferrari F40 comes to mind. They float around the 300-400k price range... ever look at one of those up close?
The fit and finish of a Rolls is far better than anything you've likely ever witnessed.