I've got to admit, I've found some of the stuff people have been saying online about Matt Smith (not necessarily here) pretty offensive. The guy's got a big chin and floppy hair - that doesn't make him a hideously ugly abomination.
I suspect he's going to wind up being very, very popular.
I doubt he'll be as popular as Tennant, but Tennant was a once-in-a-generation intersection of great talent and enormously lucky timing. The fact that Smith is following in the footsteps of ten actors rather than one kind of softens the risk of him being unpopular.