The impact of human-mediated environmental change on the evolutionary trajectories of wild organisms is poorly understood. In particular, capacity of species to adapt rapidly (in hundreds of generations or less), reproducibly and predictably to extreme environmental change is unclear. Silene uniflora is predominantly a coastal species, but it has also colonized isolated, disused mines with phytotoxic, zinc-contaminated soils. To test whether rapid, parallel adaptation to anthropogenic pollution has taken place, we used reduced representation sequencing (ddRAD) to reconstruct the evolutionary history of geographically proximate mine and coastal population pairs and found largely independent colonization of mines from different coastal sites. Furthermore, our results show that parallel evolution of zinc tolerance has occurred without gene flow spreading adaptive alleles between mine populations. In genomic regions where signatures of selection were detected across multiple mine-coast pairs, we identified genes with functions linked to physiological differences between the putative ecotypes, although genetic differentiation at specific loci is only partially shared between mine populations. Our results are consistent with a complex, polygenic genetic architecture underpinning rapid adaptation. This shows that even under a scenario of strong selection and rapid adaptation, evolutionary responses to human activities (and other environmental challenges) may be idiosyncratic at the genetic level and, therefore, difficult to predict from genomic data.