Dust, Distortions and Shadows in the Universe's Oldest Light