I don't like the IS-F that much either. It's too luxury oriented.
I'm not so much sure if it's that it's luxury-oriented, but there's a lot of little "what were they thinking?" glitches. I didn't have a chance to really flog it, but the engine and transmission didn't work as well together as I expected, the driving position didn't suit me, and the back seat had some really funny contours that force you to lean toward the middle of the car at about a fifteen-degree angle. Just weird crap like that.