Zinc telluride, due to its direct band gap and broadband light absorption, has the good application prospects in terahertz devices, solar cells, waveguide devices, and green light emitting diodes. In the photovoltaic field, it is possible to further improve the photoelectron conversion efficiency of multi-junction tandem solar cells by combining zinc telluride with III-V semiconductors. Ultrafast photo-excited carrier dynamics is fundamental to understand photoelectron conversion process of nanofilm solar cells. In this study, the ultrafast energy carrier dynamics of N-doped polycrystalline zinc telluride is investigated by using the femtosecond laser two-color pump-probe method at room temperature. The polycrystalline zinc telluride nanofilm is grown on a 500 μm GaAs (001) substrate via molecular beam epitaxy and doped by using a nitrogen ratio frequency plasma cell. The laser pulses with a central wavelength of 800 nm are divided into pump beam and probe beam by a beam splitter, after which the pump beam passes through a bismuth triborate crystal and its frequency is doubled to 400 nm. The 400 nm pump beam and 800 nm probe beam are focused on the sample collinearly through the same objective lens. Photo-excited carriers will be generated since the excitation photon energy of 400 nm pump beam (3.1 eV) is higher than the band gap of zinc telluride (～ 2.39 eV). The experimental data are analyzed by using the theoretical fitting model which includes energy relaxation processes of electrons and lattice, and the theoretical curves are consistent well with the experimental data. The fitted results show that the three dominated relaxation processes which affect the initial reflectivity recovery are in sub-picosecond time regime. The positive amplitude electron relaxation process is attributed to inter-band carrier cooling and carrier diffusion through electron-photon interactions, and the deduced decay time of this positive amplitude electron relaxation process is about 0.75 ps. The negative amplitude electron relaxation process is characterized as a photo-generated carrier trapping process induced by defects, and the decay time of this process is about 0.61 ps. The lattice heating process is realized through electron-phonon coupling process, and the calculated time constant of the lattice heating is about 0.86 ps.