Oscillatory brain activity is known to play an essential role in information processing in working memory. Recent studies have indicated that alpha activity (8–13 Hz) in the parieto-occipital area is strongly modulated in working memory tasks. However, the function of alpha activity in working memory is open to several interpretations, such that alpha activity may be a direct neural correlate of information processing in working memory or may reflect disengagement from information processing in other brain areas. To examine the functional contribution of alpha activity to visuospatial working memory, we introduced visuospatial distractors during a delay period and examined neural activity from the whole brain using magnetoencephalography. The strength of event-related alpha activity was estimated using the temporal spectral evolution (TSE) method. The results were as follows: (1) an increase of alpha activity during the delay period as indicated by elevated TSE curves was observed in parieto-occipital sensors in both the working memory task and a control task that did not require working memory; and (2) an increase of alpha activity during the delay period was not observed when distractors were presented, although TSE curves were constructed only from correct trials. These results indicate that the increase of alpha activity is not directly related to information processing in working memory but rather reflects the disengagement of attention from the visuospatial input.