In many sensory systems, receptive fields (RFs) measured by spike responses undergo progressive refinement during development. It has been proposed that elimination of excitatory synaptic inputs underlies such functional refinement. However, despite many extracellular recording and anatomical studies, direct in vivo intracellular evidence has remained limited. In this study, by cell-attached recordings in the developing optic tectum of zebrafish, we found that during a short period after the initial formation of retinotectal synapses, spike visual RFs of tectal neurons underwent a two-stage developmental modulation: from an initial expansion to a later refinement. Whole-cell voltage-clamp recordings revealed that the underlying excitatory synaptic RF exhibited a similar developmental progression, with its spatial extent first increased and then reduced, and its spatial tuning profile gradually sharpened. The inhibitory RF was initially larger than the excitatory RF but became matched with the excitatory RF at later stages. Simulation with the integrate-and-fire neuron model suggested that the developmental changes of excitatory RFs primarily accounted for the initial enlargement and later refinement of spike RFs, whereas inhibitory inputs generally reduced the size of the spike RF without affecting its developmental progression. In addition, spike RF of individual retinal ganglion cells did not significantly change in size during the same period, and the spatial extent and tuning profile of the tectal excitatory RF barely changed after intratectal excitatory connections were silenced. Together, our results demonstrate that the functional refinement of tectal visual RFs results primarily from a selective elimination of feedforward retinotectal inputs.