The microbial ecology of acidic mine and sulfide cave ecosystems is well characterised with respect to aquatic communities, typically revealing low taxonomic complexity and dominance by a relatively limited number of cosmopolitan acidophilic bacterial and archaeal taxa. Whilst pH, temperature, and geochemistry are recognised drivers of diversity in these ecosystems, the specific question of a possible influence of substratum mineralogy on microbial community composition remains unanswered. Here we address this void, using 81 subterranean mineral samples from a low temperature abandoned, acidic, sulfide ore mine system at Mynydd Parys (Parys Mountain in English), Wales, UK. Four primary and 15 secondary minerals were identified via x-ray diffraction, each sample containing a maximum of five and an average of two minerals. The mineralogy of primary (e.g. pyrite and quartz) and secondary (e.g. melanterite and pisanite) minerals was significantly correlated with prokaryotic community structure at multiple taxonomic levels, implying that the mineralosphere effect reported in less extreme terrestrial environments is also implicated in driving prokaryotic community composition in extremely acidic, base metal-bearing sulfide mineralisation at Mynydd Parys. Twenty phyla were identified, nine of which were abundant (mean relative abundance >1%). While taxa characteristic of acidic mines were detected, for example Leptospirillum (phylum Nitrospirae), Acidithiobacillus (phylum Proteobacteria), Sulfobacillus (phylum Firmicutes) and Ferroplasma (phylum Euryarchaeota), their abundance in individual samples was highly variable. Indeed, in the majority of the 81 samples investigated the abundance of these and other typical acidic mine taxa was low, with 25% of samples devoid of sequences from recognised acidic mine taxa. Most notable amongst the bacterial taxa not previously reported in such environments were the recently cultivated Muribaculaceae family (phylum Bacteroidetes), which often dominated Mynydd Parys samples regardless of their mineralogical content. Our results pose further questions regarding the mechanisms by which taxa not previously reported in such extreme environments appear to survive in Mynydd Parys, opening up research pathways for exploring the biodiversity drivers underlying microbial community composition and function in extremely acidic mine environments.