Main content

Top content

Begleitseminar zum Studienprojekt: Exploring Physical Understanding in LLMs (Part I)

8.3203

Dozenten

Beschreibung

This is an interdisciplinary seminar accompanying a study project. The seminar will help maintaining the study project's structure, which I report also below.

Note: Prerequisites are good programming skills and at least an introductor level understanding of Deep Learning (applied to either for Computer Vision or NLP).

We have received a high volume of interest in this project and to that end, we are compelled to conduct a selection process to provide a meaningful organization and supervision for all participants. As part of the selection process, we will be requesting applicants to submit a brief essay that introduces themselves and their motivation for participating in the project. This will help us to better understand each candidate and determine the best fit for the program. More information on that will be announced around two weeks before the course starts.

Structure:
The project will be structured into three main phases, with weekly meetings focusing on different aspects of learning and research:

Part 1 - Background Learning:
Introduction to LLMs and their capabilities in next-word prediction and multimodal learning. Students will receive learning packages covering the foundational theories and the evolution of LLMs.
Deliverables: Each student will prepare a brief presentation summarizing the key concepts and their implications for understanding physical reality.

Part 2 - Literature Review:
Focus on discussing seminal and recent papers that are pivotal to understanding the current landscape of LLMs’ cognitive abilities, especially in physical understanding. This phase includes identifying gaps in the current research.
Deliverables: In small groups, students will present summaries and critiques of selected papers, highlighting methodologies, findings, and areas needing further exploration.

Part 3 - Research Operationalization and Benchmark Development:
Small groups will operationalize research questions based on identified gaps from the literature review. This phase will involve hands-on work with the GRAP evaluation benchmark as detailed in the paper available at https://arxiv.org/abs/2311.09048
Deliverables: Each group will develop enhancements or new features for the GRAP benchmark, aiming to address specific challenges in evaluating the physical understanding of LLMs. The project concludes with groups presenting their proposed solutions and implementations.

Weitere Angaben

Ort: 93/E12
Zeiten: Di. 14:00 - 16:00 (wöchentlich)
Erster Termin: Dienstag, 29.10.2024 14:00 - 16:00, Ort: 93/E12
Veranstaltungsart: Seminar (Offizielle Lehrveranstaltungen)

Studienbereiche

Cognitive Science > Master-Programm
Human Sciences (e.g. Cognitive Science, Psychology)

Research Areas:

Algebraic geometry 14-XX
K-theory 19-XX
Algebraic topology 55-XX

Publications in MathSciNet

Publications in Zentralblatt

Publications:

Cellularity of hermitian K-theory and Witt-theory (with Markus Spitzweck and Paul Arne Østvær)
On the η-inverted sphere. K-Theory-Proceedings of the International Colloquium
Gigantic random simplicial complexes Link (with Jens Grygierek, Martina Juhnke-Kubitzke, Matthias Reitzner and Tim Römer)
On very effective hermitian K-theory Link (with Alexey Ananyevskiy and Paul Arne Østvær)
The first stable homotopy groups of motivic spheres DOI (with Markus Spitzweck and Paul Arne Østvær)
Vanishing in stable motivic homotopy sheaves (with Kyle Ormsby and Paul Arne Østvær) Link
The multiplicative structure on the graded slices of hermitian K-theory and Witt-theory (with Paul Arne Østvær) Link
Slices of hermitian K–theory and Milnor's conjecture on quadratic forms (with Paul Arne Østvær) Link
Calculus of functors and model categories, II (with Georg Biedermann) Link
The Arone-Goodwillie spectral sequence for Σ∞Ωn and topological realization at odd primes (with Sebastian Buescher, Fabian Hebestreit und Manfred Stelzer) Link
Motivic slices and coloured operads (with Javier Gutierrez, Markus Spitzweck and Paul Arne Østvær) Link
Motivic strict ring models for K-theory (with Markus Spitzweck and Paul Arne Østvær) PDF
Theta characteristics and stable homotopy types of curves DOI
A universality theorem for Voevodsky's algebraic cobordism spectrum (with Ivan Panin and Konstantin Pimenov) Link
On the relation of Voevodsky's algebraic cobordism to Quillen's K-theory DOI (with Ivan Panin and Konstantin Pimenov)
On Voevodsky's algebraic K-theory spectrum BGL (with Ivan Panin and Konstantin Pimenov)
Rigidity in motivic homotopy theory DOI (with Paul Arne Østvær)
Calculus of functors and model categories DOI (with Georg Biedermann and Boris Chorny)
Motivic Homotopy Theory Link (with B.I.Dundas, M.Levine, P.A.Østvær and V.Voevodsky)
Motives and modules over motivic cohomology Link (with Paul Arne Østvær)
Modules over motivic cohomology DOI (with Paul Arne Østvær)
Enriched functors and stable homotopy theory Link (with Bjørn Ian Dundas and Paul Arne Østvær)
Motivic functors Link (with Bjørn Ian Dundas and Paul Arne Østvær)

Preprints and Talks:

Motives, homotopy theory of varieties, and dessins d'enfants PDF
GQT Graduate School PDF

Projekte

DFG-Sachbeihilfe "Algebraic bordism spectra: Computations, filtrations, applications" (DFG-RSF-Antrag mit Alexey Ananyevskiy)
DFG-Sachbeihilfe "Applying motivic filtrations" (mit Marc Levine und Markus Spitzweck) im DFG Schwerpunktprogramm 1786
DFG-Sachbeihilfe "Operads in algebraic geometry and their realizations" (mit Jens Hornbostel,
Markus Spitzweck und Manfred Stelzer) im DFG Schwerpunktprogramm 1786
DFG Sachbeihilfe ``Operad structures in motivic homotopy theory'' im DFG Schwerpunktprogramm 1786 ``Homotopy theory and algebraic geometry'' (mit Markus Spitzweck)
DFG Sachbeihilfe ``Motivic filtrations over Dedekind domains'' im DFG Schwerpunktprogramm 1786 ``Homotopy theory and algebraic geometry'' (mit Marc Levine und Markus Spitzweck)
DFG Graduiertenkolleg 1916 ``Combinatorial structures in geometry''
DFG Sachbeihilfe ``Goodwillie towers, realizations, and E_n-structures''
Graduiertenkolleg ``Combinatorial structures in algebra and topology'' (mit H. Brenner, W. Bruns, T. Römer und R. Vogt)
DFG Sachbeihilfe ``Combinatorial structures in algebra and topology'' (mit H. Brenner, W. Bruns, T. Römer und R. Vogt)

Supervision

PhD

Philip Herrmann: Stable equivariant motivic homotopy theory and motivic Borel cohomology, 2012
Florian Strunk: On motivic spherical bundles, 2013

Master/Diplom

Markus Severitt: Motivic Homotopy Types of Projective Curves, 2006 PDF
Philip Herrmann: Ein Modell für die motivische Homotopiekategorie, 2009
Florian Strunk: Ein Modell für motivische Kohomologie, 2009
Sebastian Büscher: Anwendung der F₂-kohomologischen Goodwillie-Spektralsequenz für iterierte Schleifenraeume, 2010
Fabian Hebestreit: On topological realization at odd primes, 2010
Katharina Lorenz: Darstellung unterschiedlicher mathematischer Rekonstruktionen von Größen, 2012
Jana Brickwedde: Fehlvorstellungen zum Grenzwertbegriff, 2015
Lena-Christin Müller: Penrose-Parkettierungen und ihre Eigenschaften, 2015
Larissa Bauland: Der Satz von Seifert-van Kampen und einige seiner Anwendungen, 2018
Nikolaus Krause: Eine algebraische Einfuehrung in die Milnor-Witt K-Theorie, 2019

Bachelor

Ein Spezialfall des letzten Satzes von Fermat, 2010
Transzendente Zahlen, 2010
Zur Gruppe des Rubik-Wuerfels, 2011
Einige Betrachtungen zum letzten Satz von Fermat, 2012
Die Involution auf algebraischer K-Theorie, 2012
Platonische und Archimedische Körper, 2012
Klassifikation regulärer Polyeder, 2013
Grundbegriffe der Trigonometrie und ihrer Umsetzung in der gymnasialen Sekundarstufe I, 2014
Die Riemann’sche Zetafunktion und der Primzahlsatz, 2014
Konstruktion der klassischen Zahlbereiche, 2014
Eigenschaften und spezielle Werte der Riemann'schen Zetafunktion, 2015
Das quadratische Reziprozitätsgesetz und dessen Bedeutung in der Kryptographie, 2015
Graphen färben, 2015
Klassifikation und Visualisierung von Koniken, 2016
Konstruktion von Polygonen mit einem einzigen Schnitt, 2016
Parkettierungen der Ebene durch kongruente konvexe Fuenfecke, 2019
Die klassischen Hopf-Faserbuendel und einige ihrer Eigenschaften, 2019
Einige Anmerkungen mathematischer und historischer Natur zu Fermats Letztem Satz, 2019