blog-2024-01-22

_asteroid is not a steroid!_

## random link dump

* Steroid to Heaven  
  https://thebaffler.com/outbursts/steroid-to-heaven-nathan-west
* Nightshade: a tool that turns any image into a data sample that is unsuitable for model training  
  https://nightshade.cs.uchicago.edu/whatis.html
* Self-driving as a case study for AGI  
  https://karpathy.github.io/2024/01/21/selfdriving-agi/ ^[HN](https://news.ycombinator.com/item?id=39084785)^


### GPT-3.5 crashes when it thinks about useRalativeImagePath too much

`Ralative` is a very uncommon misspelling, appearing only in the xml configuration file of a single application. It was added as a token, but after tokenization, xml files were excluded from the training data set. Now there's a token without training data and [GPT] 3.5 crashes when prompted to use that token. They're called glitch tokens and there are lists of them.

link: https://iter.ca/post/gpt-crash/ ^[HN](https://news.ycombinator.com/item?id=39086106)^