In three very interesting and suggestive papers, H. Carayol introduced new aspects of complex geometry and Hodge theory into the study of non-classical automorphic representations -- in particular, those involving the totally degenerate limits of discrete series. This talk is based on two joint projects which aim to put Carayol's work into a more general context, while hewing to his over-riding theme of producing arithmetic structures on the cohomology of non-algebraic generalizations of Shimura varieties.