Kua riro te kupu whakarāpopoto GPT, i roto i ētahi tau torutoru noa iho, hei tohu mō tētahi whakararuraru hangarau nui. Kei muri i ēnei reta e toru kei reira tētahi panonitanga tauira: kua neke tātou mai i ngā taputapu rorohiko e whakahaeretia ana e ngā whakahau ki ngā hoa mahi matihiko e kōrero tahi ana tātou. Kia tino mārama ai ki te nui o tēnei hurihanga, me titiro te tangata ki raro i te taupoki me te tirotiro i ngā mahi uaua o tēnei mātauranga.
I. Whakamāramatanga Hangarau: Ngā Pou e Toru o te Whakarāpopototanga
Ko te GPT he whakarāpopototanga mō te Generative Pre-trained Transformer. E whakaahua ana ia kupu i tētahi wāhanga nui o te hanganga o te tauira.
1. Whakaputa
I te ao o te matauranga horihori, e rua ngā momo tauira e wehea ana: te tauira whakahāwea me te tauira whakaputa.
- He tauira wehewehe ka tirotiro i ngā raraunga, ka hoatu he tapanga ki taua raraunga (hei tauira, "He whakaahua tēnei nō tētahi ngeru").
- He tauira whakaputa uri, pērā i a GPT, ka haere tonu atu. I runga i tōna mōhiotanga, ka taea e ia te whakaputa raraunga hou kāore i te kitea i mua. Mena kua tātarihia e ia ngā miriona rotarota, e kore e whakahuahia kotahi i roto i te ngākau; ka tito i tētahi mea hou, me te whakaute i ngā ture o te rīme me te mita kua "mōhiotia" e ia.
2. Kua whakangungua i mua
Koinei te wāhi e takoto ai te mana mata. I mua i te taenga atu ki tō mata, i haere te tauira ki tētahi wāhanga ako nui. Whakaarohia he whare pukapuka kei roto te wāhanga nui o te ipurangi o te ao: te katoa o Wikipedia, ngā whare pukapuka matihiko, ngā huihuinga kōrero (pēnei i a Reddit), ngā putunga waehere rorohiko (GitHub), me ngā pūranga purongo.
Mō ngā marama, i runga i ngā mano tini o ngā tukatuka kaha, ka "pānui" te tauira i tēnei tuhinga kia kore ai e ako noa i ngā meka motuhake, engari kia ako hoki i te hanganga hohonu o te reo. Mā tēnei "whakangungu-mua" ka taea e te tauira te tae mai me te papamuri ahurea me te reo whānui i mua i te whiwhinga o tana pātai tuatahi.
3. Whakawhitiwhiti
Koinei te putanga nui o te pūtaiao o te tau 2017, i ahu mai i tētahi pepa rangahau a Google ko "Ko te aro noa e hiahia ana koe"I mua i te Transformer, ka pānuihia e ngā tauira AI ngā rerenga kupu i te kupu, i runga i te raupapa (ngā tauira auau). Heoi, ka tirohia e te Transformer te rerenga katoa, ā, i te wā kotahi anō hoki."
Nā te tikanga e kīia nei ko te Attention, ka taea te paunatia te hiranga o ia kupu e pā ana ki ētahi atu. I roto i te rerenga kōrero "Kāore te kararehe i whiti i te huarahi nā te mea kua ngenge rawa," e mārama ana te Transformer "it"e pā ana ki te kararehe. Mena ka mutu te rerenga kōrero ki te "nā te mea i whānui rawa,” ka mārama tonu ko te kupu “ia” e pā ana ki te tiriti. Nā tēnei kaha ki te mārama ki ngā horopaki uaua te mea e tino tangata ai ngā urupare a GPT.
II. He hītori poto mō te whanaketanga: Mai i te GPT-1 ki te GPT-5
Ko te kōrero mō GPT he kōrero mō te tipu tere, e peia ana e te kamupene OpenAI.
Te oho ake (GPT-1 me GPT-2)
I te tau 2018, i whakatakoto a GPT-1 i te turanga. Ka taea e ia te mahi i ngā mahi māmā, engari he poto noa iho tōna mahara. I te tau 2019, i tino piki ake a GPT-2 me te 1.5 piriona tawhā (ngā hononga ā-roto o te tauira). Nā tōna pūkenga ki te whakaputa tuhinga mārama, i te tīmatanga ka whakaroa a OpenAI ki te tuku, i te wehi kei whakamahia hei hanga kōrero teka ā-umanga.
Te Pahūtanga (GPT-3 me te 3.5)
I te tau 2020, i whiti a GPT-3 i tētahi arai hinengaro me ngā tawhā 175 piriona. He taniwha rorohiko. Kāore i te mea he kaiwhakamāori, he kaituhi rānei; kua kaha ki te whakaaroaro arorau me te tuhi waehere i roto i ngā reo hōtaka maha. Ko te putanga GPT-3.5 te miihini mō te whakarewatanga tūmatanui o ChatGPT i te Whiringa-ā-rangi 2022, ā, i puta he rongonui puta noa i te ao.
Te Pakeketanga (GPT-4 me tua atu)
I tukuna i te tau 2023, he maha ngā momo o te GPT-4. Ka taea e ia te tātari i ngā whakaahua, te whakaoti rapanga pāngarau uaua, me te whakaatu i ngā taumata auaha teitei ake. I whakatikatikaina tōna tika hei whakaiti i ngā "whakaaro pōhewa" (ngā wā e tito maia ai te AI i ngā meka).
E hāngai ana: ChatGPT-5 mutunga kore, kore utu hoki i runga i te AI Ipurangi Koreutu
III. Ngā Mahi ā-Roto: He Mīhini Tūponotanga
He rerekē ki te whakapono rongonui, kāore he "whakaaro" he whakaaro rānei o te GPT. He mahi tatauranga noa iho tana, engari he whānui rawa te tauine e whakatauira ana i te mātauranga.
Ina patohia e te kaiwhakamahi tētahi patai, ka hurihia e te tauira ia kupu hei raupapa tau e kiia nei ko te whakauru (te whakapūtātanga rānei). Mā ēnei tau ka taea te whakanoho i ngā kupu ki roto i tētahi wāhi pāngarau me ngā mano tini o ngā ine. I tēnei wāhi, he tata te pāngarau o te kupu "Kīngi" ki te "Kuīni" me te "Karauna".
He raupapa o ngā matapae te tukanga urupare:
- Ka tātarihia e te tauira te tere.
- Ka tatauhia ko tēhea kupu (te kupu rānei "tohu") te tūponotanga teitei rawa atu mō te tīmatanga o te urupare.
- Kia whiriwhiria taua kupu, ka tāpirihia anō ki roto i tana tātaritanga hei matapae i te kupu e whai ake nei.
- Ka whakahokia tēnei tukanga kia tae rā anō ki tētahi pūwāhi whakamutu.
Ko te mea e whakamīharo ai te hua, kāore a GPT e whiriwhiri i te kupu tino tūpono (ka puta ai he kupu tāruarua, he kupu hoha hoki), engari ka whakamahia he tautuhinga "pāmahana" (te matapōkeretanga whakahaeretia) hei whakarerekē i tōna momo me tōna auahatanga.
IV. Te taahiraa nui: Te whakahāngaitanga tangata (RLHF)
Ki te hoatu noa e koe te ipurangi katoa ki te mīhini kia pānuihia, ka tūpono ka riri, ka tuku tohutohu morearea rānei, nā te mea kei roto i te ipurangi te pai me te kino o te tangata.
Hei hanga i te GPT kia "āhua ake", ka whakamahia e OpenAI te Reinforcement Learning from Human Feedback (RLHF). E mano tini ngā kaiwhakamātautau tangata i taunekeneke ki ngā putanga tōmua o te tauira, me te whakatau i ngā whakautu: "He whakautu pai tēnei," "He whanoke tēnei," "He teka tēnei."
Mā tēnei tukanga, i ako te AI ki te tango i te tūnga o te kaiawhina āwhina, kore whakaaro, me te herea ki ngā tikanga matatika. Mā tēnei paparanga whakamutunga ka huri te hangarau mata hei hua hokohoko whānui.
V. Ngā wero me ngā herenga
Ahakoa tōna mana, he taputapu tonu a GPT me ōna wāhi matapo:
- HukapaaNā te mea e whai ana kia pono ā-tatauranga, ka tito pea i tētahi kōrero mō tōna oranga, i tētahi puna ture rānei kāore i te tīariari, nā te mea he tika te tangi o ngā kupu "whakaaro".
- Te kore o te maharaKāore a GPT e rongo i tetahi mea. Kāore e mārama ki te ao tūturu. Ki te whakamāramahia e ia te tunu omelet, kāore e mōhiotia he aha te wera, te kakara rānei o te hua manu; ko te whanaungatanga reo anake i waenganui i aua ariā e mōhiotia ana e ia.
- Utu taiaoHe nui te hiko me te wai e hiahiatia ana (hei whakamatao i ngā tūmau) hei whakangungu me te whakahaere i ēnei tauira.
Opaniraa
Ehara i te mea he pūmanawa tukatuka kupu noa iho te GPT. He hanganga hinengaro. Pērā i te hiko i āhei ai te whakamahi mīhini i te mahi tinana, kei te tīmata te GPT ki te whakahaere aunoa i ētahi momo mahi hinengaro.
Mā te mārama ko te GPT he whakarāpopototanga mō te Generative (te waihanga), Pre-trained (te mātauranga nui), me te Transformer (te māramatanga horopaki), ka taea e tātou te mārama ake he aha tēnei hangarau e tohu ana i tētahi huringa nui. Kei te tīmatanga noa iho tātou o te tūhura i ngā mea ka kawea mai e ēnei tauira māmā ake, e matatau ake ana ki te pūtaiao, ki te mātauranga, me te auahatanga toi.
