The N170 ERP peak has been found to be consistently larger in response to the presentation of faces than to other objects, yet it is not clear whether this face-sensitive N170 is also elicited during fixations made subsequent to the initial presentation. To investigate this question, the current study utilised Event and Fixation-Related Potentials in two experiments, time-locking brain potentials to the presentation of faces and objects (watches) images in participants’ peripheral vision, and to their first fixations on the images. Experiment 1 found that a face-sensitive N170 was elicited by the onset of images but not by a subsequent fixation on the images, and that face inversion did not modulate N170 beyond presentation. Experiment 2 found that disrupting the structure of the peripheral preview (phase-scrambling) led to a face-sensitive N170 at fixation onsets on the intact-images. Interestingly, N170 amplitudes for both faces and objects were significantly enhanced after the peripheral preview was phase-scrambled, suggesting that the N170 in part reflects a category-detection process that is elicited once when an image structure is viewed. These results indicate that neural processing during fixations will be significantly modulated when they are immediately preceded by peripheral previews, and is not specific to faces.