gpt2-self-attention-scoring-2

Podcast: GPT and the nature of intelligence

Advances in natural language processing and deep learning make us question what is the meaning of intelligence. I was recently reading this very interesting article by the gradient: https://thegradient.pub/gpt2-and-the-nature-of-intelligence/ . The article refers to GPT2, but with GPT3 already, the questions it poses are more relevant than ever. On this Read more…