In early childhood, the human brain goes through a period of tuning to native speech sounds but retains remarkable flexibility, allowing the learning of new languages throughout life. However, little is known about the stability over time of early neural specialization for speech and its influence on the formation of novel language representations. Here, we provide evidence that early international adoptees, who lose contact with their native language environment after adoption, retain enhanced sensitivity to a native lexical tone contrast more than 15 years after being adopted to Sweden from China, in the absence of any pretest familiarization with the stimuli. Changes in oscillatory brain activity showed how adoptees resort to inhibiting the processing of defunct phonological representations, rather than forgetting or replacing them with new ones. Furthermore, neurophysiological responses to native and nonnative contrasts were not negatively correlated, suggesting that native language retention does not interfere with the acquisition of adoptive phonology acquisition. These results suggest that early language experience provides strikingly resilient specialization for speech which is compensated for through inhibitory control mechanisms as learning conditions change later in life.