Chromatic information is processed by the visual system both at an unconscious level and at a level that results in conscious perception of color. It remains unclear whether both conscious and unconscious processing of chromatic information depend on activity in the early visual cortex or whether unconscious chromatic processing can also rely on other neural mechanisms. In this study, the contribution of early visual cortex activity to conscious and unconscious chromatic processing was studied using single-pulse TMS in three time windows 40–100 msec after stimulus onset in three conditions: conscious color recognition, forced-choice discrimination of consciously invisible color, and unconscious color priming. We found that conscious perception and both measures of unconscious processing of chromatic information depended on activity in early visual cortex 70–100 msec after stimulus presentation. Unconscious forced-choice discrimination was above chance only when participants reported perceiving some stimulus features (but not color).