Condensed Complexity - The Essence of Information Processing and Cognition?

Session

Session 5

205

9 Nov 2023, 11:00

Lecture Hall (FIAS)

Description

Chair: Roberto Covino

10. Decoding the Information in Self-Supervised Learning: Pathway to Optimal Representations

Prof. Ravid Shwartz-Ziv (New York University)

09/11/2023, 11:00

Deep Neural Networks (DNNs) have excelled in many fields, largely due to their proficiency in supervised learning tasks. However, the dependence on vast labeled data becomes a constraint when such data is scarce. Self-Supervised Learning (SSL), a promising approach, harnesses unlabeled data to derive meaningful representations. Yet, how SSL filters irrelevant information without explicit...

9. Generalized Equivariance through Fluid Representations in Brains and Machines

Andy Keller (University of Amsterdam), Prof. Max Welling (University of Amsterdam)

09/11/2023, 11:45

In the machine learning community, structured representations have demonstrated themselves to be hugely beneficial for efficient learning from limited data and generalization far beyond the training set. Examples of such structured representations include the spatially organized feature maps of convolutional neural networks, and the group structured activations of other equivariant models. To...