The intrinsic magnetic topological insulator MnBi₂Te₄ exhibits rich topological effects such as quantum anomalous Hall effect and axion electrodynamics. Here, by combining the use of synchrotron and laser light sources, we carry out comprehensive and high-resolution angle-resolved photoemission spectroscopy studies on MnBi₂Te₄ and clearly identify its topological electronic structure. In contrast to theoretical predictions and previous studies, we observe topological surface states with diminished gap forming a characteristic Dirac cone. We argue that the topological surface states are mediated by multidomains of different magnetization orientations. In addition, the temperature evolution of the energy bands clearly reveals their interplay with the magnetic phase transition by showing interesting differences between the bulk and surface states, respectively. The investigation of the detailed electronic structure of MnBi₂Te₄ and its temperature evolution provides important insight into not only the exotic properties of MnBi₂Te₄, but also the generic understanding of the interplay between magnetism and topological electronic structure in magnetic topological quantum materials.