Semantic variant primary progressive aphasia (svPPA) typically presents with left-hemisphere predominant rostral temporal lobe (rTL) atrophy and the most significant complaints within the language domain. Less frequently, patients present with right-hemisphere predominant temporal atrophy coupled with marked impairments in processing of famous faces and emotions. Few studies have objectively compared these patient groups in both domains and therefore it is unclear to what extent the syndromes overlap. Clinically diagnosed svPPA patients were characterized as left- (n = 21) or right-predominant (n = 12) using imaging and compared along with 14 healthy controls. Regarding language, our primary focus was upon two hallmark features of svPPA; confrontation naming and surface dyslexia. Both groups exhibited naming deficits and surface dyslexia although the impairments were more severe in the left-predominant group. Familiarity judgments on famous faces and affect processing were more profoundly impaired in the right-predominant group. Our findings suggest that the two syndromes overlap significantly but that early cases at the tail ends of the continuum constitute a challenge for current clinical criteria. Correlational neuroimaging analyses implicated a mid portion of the left lateral temporal lobe in exception word reading impairments in line with proposals that this region is an interface between phonology and semantic knowledge.