Researchers are warning that these shifts in time may be doing more harm than good.