This is where it really blows away previous models. It’s not just stringing together individual words that sound plausible, but it’s creating text where pronouns agree with each other and the people and ideas mentioned in the text are consistent throughout. The other amazing ability of GPT-2 is that it can maintain coherency across several paragraphs of text. Instead, it has gotten so good at predicting the next word in any given situation that it has accidentally encoded a weird, squishy version of all human knowledge within the model.Ībraham Lincoln did start his career as a Lawyer in Springfield, Illinois, and Springfield is a city, so Springfield makes sense as a probable word that might show up in a sentence about Abraham Lincoln. It doesn’t have a database of facts and figures to draw from like a ‘Question and Answer’ system. It’s just a statistical model of how English is used on the web. And he was born in Hodgenville, Kentucky, not Springfield, Illinois! But let’s be honest, you didn’t know that, did you? It sounded right! Second, the sentence is perfectly formatted and indistinguishable from something written by a human.Ībraham Lincoln was born on February 12th, not April 4th.First, it shows that the model has encoded that Abraham Lincoln was a person in America who was born in 1809.This sentence is fascinating for several reasons:
0 kommentar(er)
