blog-2024-01-22

asteroid is not a steroid!

random link dump

GPT-3.5 crashes when it thinks about useRalativeImagePath too much

Ralative is a very uncommon misspelling, appearing only in the xml configuration file of a single application. It was added as a token, but after tokenization, xml files were excluded from the training data set. Now there's a token without training data and GPT 3.5 crashes when prompted to use that token. They're called glitch tokens and there are lists of them.

link: https://iter.ca/post/gpt-crash/ HN


nothing's linking here.

last edited by: stefs at Monday, January 22, 2024, 3:33:00 PM Coordinated Universal Time


edit history source