Atiyah's Connectivity, Morse Theory and Solution Sets