We systematically investigate the excitonic dephasing of three representative transition-metal dichalcogenides, namely, MoS2, MoSe2, and WSe2 atomic monolayer thick and bulk crystals, in order to gain a proper understanding of the factors that determine the optical coherence in these materials. Coherent nonlinear optical spectroscopy and temperature dependent absorption, combined with theoretical calculations of the phonon spectra, indicate electron-phonon interactions, to be the limiting factor. Surprisingly, the excitonic dephasing, differs only slightly between atomic monolayers and high quality bulk crystals, which indicates that material imperfections are not the limiting factor in atomically thin monolayer samples. The temperature dependence of the electronic band gap and the excitonic linewidth combined with "ab initio" calculations of the phonon energies and the phonon density of states reveal a strong interaction with the E' and E" phonon modes. © 2016 American Physical Society.