Nathan Godey

NLP Postdoc @Cornell

HOME
NLP COURSE
PUBLICATIONS
LOGBOOK
RESUME / CV

Home Tags representation

Tag

representation 1

How word frequency affects language models Mar 13, 2023

Recently Updated

On the Scaling Laws of Geographical Representation in Language Models
MANTa: Efficient Gradient-Based Tokenization for End-to-End Robust Language Modeling
Headless Language Models: Learning without Predicting with Contrastive Weight Tying
Lost in Backpropagation: The LM Head is a Gradient Bottleneck
Gaperon: A Peppered English-French Generative Language Model Suite

Trending Tags

thesis anisotropy softmax data-curation language-models pretraining attention award biomedical compression

© 2026 Nathan Godey. Some rights reserved.

Powered by Jekyll with Chirpy theme.

Trending Tags

thesis anisotropy softmax data-curation language-models pretraining attention award biomedical compression

A new version of content is available.