Spectral Graph Theory: The mathematics of self-supervised learning [Special Issue on the Mathematics of Deep Learning]
Possessing a manipulable representation of the world is a requirement for intelligent machines to plan, reason, and act in the world. Endowing computational systems, e.g., deep networks (DNs), with artificial intelligence (AI) capabilities is the goal of self-supervised learning (SSL). Immense optimism, fueled by early successes, funneled vast resources into SSL, which led to fast-paced but fragmented early developments.
