The dorsolateral pFC (DLPFC) is a key region for working memory. It has been proposed that the DLPFC is dynamically recruited depending on task demands. By this view, high DLPFC recruitment for low-demanding tasks along with weak DLPFC upregulation at higher task demands reflects low efficiency. Here, the fMRI BOLD signal during working memory maintenance and manipulation was examined in relation to aging and catechol-O-methyltransferase (COMT) Val158Met status in a large representative sample (n = 287). The efficiency hypothesis predicts a weaker DLPFC response during manipulation, along with a stronger response during maintenance for older adults and COMT Val carriers compared with younger adults and COMT Met carriers. Consistent with the hypothesis, younger adults and met carriers showed maximal DLPFC BOLD response during manipulation, whereas older adults and val carriers displayed elevated DLPFC responses during the less demanding maintenance condition. The observed inverted relations support a link between dopamine and DLPFC efficiency.