So How Does ChatGPT really work? Behind the screen!
Claim your SPECIAL OFFER for MagellanTV here: Start your free trial TODAY so you can watch “Tech Talk“ about new technologies transforming out planet:
FOLLOW UP VIDEO:
For Input on Videos and Early Access, Join Me here:
REFERENCES
The subject of video:
Detailed overview of how ChatGPT works:
ChatGPT facts:
CHAPTERS:
0:00 What is ChatGPT?
1:33 Magellan offer
2:31 How ChatGPT differs from Google
4:26 Overview of how ChatGPT works
7:07 Simple example of what happens behind the scenes
9:45 Beyond sentence completion
10:21 Three stages of pre-training process
13:24 The huge dataset used
SUMMARY
ChatGPT is an intelligent chatbot that uses natural language processing. The GPT stands for Generative Pre-trained Transformer, which means it generates responses, it is pre-trained by humans, and it transforms input data into an output. This model was created by an artificial intelligence research company called OpenAI.
ChatGPT’s power is the ability to interpret the context and meaning of a query and produce a relevant answer in grammatically correct and natural language, based on the information that it has been trained on.
It uses neural networking, with supervised learning and reinforcement learning, two key components of modern machine learning. What it does fundamentally is predict what words, phrases and sentences are likely to be associated with the input made. It then chooses the words and sentences that it deems most likely to be associated with the input. So it attempts to understand your prompt and then output words and sentences that it predicts will best answer your question, based on the data it was trained on.
It also randomizes some outputs so that the answers you get for the same input, will often be different. How ChatGPT fundamentally works, is that it tries to determine what words would most likely be expected after having learned how your input compares to words written on billions of webpages, books, and other data that it has been trained on.
But it’s not like the predictive text on your phone that’s just guessing what the word will be based on the letters it sees. ChatGPT attempts to create fully coherent sentences as a response to any input. And it doesn’t just stop at the sentence level. It’s generating sentences and even paragraphs that could follow your input.
If you ask it complete this sentence, “Quantum mechanics is…” -- The processing that happens behind the scenes goes something like this: It calculates from all the instances of this text, what word comes next, and at what fraction of the time. It doesn’t look literally at text, but it looks for matches in context and meaning.
The end result is that it produces a ranked list of words that might follow, together with their “probabilities.” So it’s calculations might produce something like this for the next word that would follow after the word “is”:
a 4.5%
based 3.8%
fundamentally 3.5%
described 3.2%
many 0.7%
It chooses the next word based on this tanking.
But the sentence completion model is not enough, because you might ask it to do something where that strategy might not be appropriate.
In the first stage of the training process, Human contractors play the role of both a user and the ideal chatbot. Each training consists of a conversation with the goal of training the model to have human-like conversations.
Through this supervised human-taught process, it learns to come up with an output that is more than just sentence completion. It learns patterns about the context and meaning of various inputs so that it can respond appropriately.
But human training has scale limitations. Human trainers could not possibly anticipate all the questions that could ever be asked. For this it uses a third step which is called reinforcement learning. This is a type of unsupervised learning. This process trains the model where no specific output is associated with any given input.
Instead the model is trained to learn the underlying context and patterns in the input data based on its earlier human-taught pretraining.
#chatgpt
This way the model can process a huge amount of data from various sources, and learn the patterns from texts and sentences of a near limitless number of subjects. The dataset used to train ChatGPT which is based on GPT-3.5 is about 45 terabytes of data.
1 view
353
96
2 months ago 00:14:12 1
Comparison Spider-Man 2099 SH Figuarts VS CT Toys
2 months ago 00:14:14 1
Приветы из дома! Восемь счастливых историй!
2 months ago 00:02:16 1
Esaret || Orhun + Hira ►► Crazy in love [+english subtitles]
2 months ago 00:04:09 1
The Animals - House of the Rising Sun (1964) ♫ 60 YEARS 🎶⭐ ❤
2 months ago 00:25:38 1
🔥Trump MUST BE KEPT ALIVE at all costs! | Exclusive RFK JR Interview!!
2 months ago 00:14:36 1
Sting And Shaggy: NPR Music Tiny Desk Concert
2 months ago 00:03:12 1
Britney Spears - My Only Wish (This Year) - Connor Street Cover
2 months ago 00:03:23 1
K/DA - POP/STARS (ft. Madison Beer, (G)I-DLE, Jaira Burns) | Music Video - League of Legends
2 months ago 00:04:54 1
Phil Collins - In The Air Tonight (Official Music Video)
2 months ago 00:03:53 1
Glenn Medeiros - Nothing’s Gonna Change My Love For You (Official Music Video) [HD]
2 months ago 01:03:17 1
Selected Sessions MK b2b Sonny Fodera U-Bahn DJ Set
2 months ago 00:03:52 1
Михаил Сегал, Юрий Шевчук – Вышли мне строчку
2 months ago 00:59:25 1
Men & Women of the Bible (Daniel - Part III) - Pastor Lance Edminster
2 months ago 00:07:09 1
What Just Happened On Our Earth!!! September 2024 #Naturaldisasters part.5
2 months ago 00:04:34 1
Dr. Alban - It’s My Life (Club Remix) [Official Audio]
2 months ago 00:26:20 1
What RUINED Sega? - The Fall of an Empire
2 months ago 00:06:59 1
AYURVEDIC SELF-ABHYANGA: How to do an Ayurvedic Self-Abhyanga or Self-Massage at home
2 months ago 00:02:42 1
Counting 1-10 Song | Number Songs for Children | The Singing Walrus
2 months ago 00:04:49 1
Дима Билан и Данил Плужников - Мама (вечер Олега Газманова на Новой Волне-2016)
2 months ago 00:08:47 1
Champion - Bethel Music & Dante Bowe
2 months ago 00:19:50 1
Quickest AUDI RS vs Quickest DUCATI: DRAG RACE
2 months ago 00:09:36 1
Spain’s Dramatic Turn To China Leaves Europe In Absolute Shock, No One Was Ready For This
2 months ago 00:10:56 1
Tedy to Make Crunchy Slime With Bags | Creative Slime | Slime Story | 92