Nathan Godey

PhD student in NLP @ALMAnaCH

HOME
NLP COURSE
PUBLICATIONS
LOGBOOK
RESUME / CV

Home Tags representation

Tag

representation 1

How word frequency affects language models Mar 13, 2023

Recently Updated

MANTa: Efficient Gradient-Based Tokenization for End-to-End Robust Language Modeling
Chinchilla Scaling Laws Calculator
Why do small language models underperform? Studying Language Model Saturation via the Softmax Bottleneck
On the Scaling Laws of Geographical Representation in Language Models
Anisotropy Is Inherent to Self-Attention in Transformers

Trending Tags

thesis anisotropy frequency geographical language-modeling representation softmax software tokenization

© 2024 Nathan Godey. Some rights reserved.

Powered by Jekyll with Chirpy theme.

Trending Tags

thesis anisotropy frequency geographical language-modeling representation softmax software tokenization

A new version of content is available.