Nathan Godey

NLP Postdoc @Cornell

HOME
NLP COURSE
PUBLICATIONS
LOGBOOK
RESUME / CV

Home NLP course

NLP course

NLP course

featured 1 category , 7 posts

publications 10 posts

Recently Updated

On the Scaling Laws of Geographical Representation in Language Models
MANTa: Efficient Gradient-Based Tokenization for End-to-End Robust Language Modeling
Headless Language Models: Learning without Predicting with Contrastive Weight Tying
Lost in Backpropagation: The LM Head is a Gradient Bottleneck
Gaperon: A Peppered English-French Generative Language Model Suite

Trending Tags

thesis anisotropy softmax data-curation language-models pretraining attention award biomedical compression

© 2026 Nathan Godey. Some rights reserved.

Powered by Jekyll with Chirpy theme.

Trending Tags

thesis anisotropy softmax data-curation language-models pretraining attention award biomedical compression

A new version of content is available.