There’s a race underway to build artificial general intelligence, a futuristic vision of machines that are as broadly smart as humans or at least can do many things as well as people can.
Achieving such a concept — commonly referred to as AGI — is the driving mission of ChatGPT-maker OpenAI and a priority for the elite research wings of tech giants Amazon, Google, Meta and Microsoft.
kAmxEVD 2=D@ 2 42FD6 7@C 4@?46C? k2 9C67lQ9EEADi^^2A?6HD]4@>^2CE:4=6^2CE:7:4:2=\:?E6==:86?46\C:D<D\F<\DF>>:E\<2>2=2\92CC:D\ggd5_hdd_3_25`h7f2`45735e6a3h`_3Qm7@C H@C=5 8@G6C?>6?EDk^2m] {625:?8 px D4:6?E:DED AF3=:D965 C6D62C49 %9FCD52J 😕 E96 ;@FC?2= $4:6?46 H2C?:?8 E92E F?4964<65 px 286?ED H:E9 “=@?8\E6C> A=2??:?8Q D<:==D 4@F=5 A@D6 2? 6I:DE6?E:2= C:D< E@ 9F>2?:EJ]k^Am
kAmqFE H92E 6I24E=J 😀 pvx 2?5 9@H H:== H6 <?@H H96? :E’D 366? 2EE2:?65n ~?46 @? E96 7C:?86 @7 4@>AFE6C D4:6?46[ :E’D ?@H 2 3FKKH@C5 E92E’D 36:?8 4@?DE2?E=J C6567:?65 3J E9@D6 ECJ:?8 E@ >2<6 :E 92AA6?]k^Am
k9am(92E 😀 pvxnk^9am
kAm}@E E@ 36 4@?7FD65 H:E9 E96 D:>:=2C\D@F?5:?8 k2 9C67lQ9EEADi^^2A?6HD]4@>^9F3^86?6C2E:G6\2:Qm86?6C2E:G6 pxk^2m — H9:49 56D4C:36D E96 px DJDE6>D 369:?5 E96 4C@A @7 E@@=D E92E “86?6C2E6” ?6H 5@4F>6?ED[ :>286D 2?5 D@F?5D — 2CE:7:4:2= 86?6C2= :?E6==:86?46 😀 2 >@C6 ?63F=@FD :562]k^Am
kAmxEVD ?@E 2 E649?:42= E6C> 3FE “2 D6C:@FD[ E9@F89 :==\567:?65[ 4@?46AE[” D2:5 v6@77C6J w:?E@?[ 2 k2 9C67lQ9EEADi^^2A?6HD]4@>^2CE:4=6^_fg3`a_364c6c2d7gadga`6gh2fch254QmA:@?66C:?8 px D4:6?E:DEk^2m H9@VD 366? 5F3365 2 “v@572E96C @7 px]”k^Am
kAm“x 5@?VE E9:?< E96C6 😀 28C66>6?E @? H92E E96 E6C> >62?D[” w:?E@? D2:5 3J 6>2:= E9:D H66<] “x FD6 :E E@ >62? px E92E 😀 2E =62DE 2D 8@@5 2D 9F>2?D 2E ?62C=J 2== @7 E96 4@8?:E:G6 E9:?8D E92E 9F>2?D 5@]”k^Am
kAmw:?E@? AC676CD 2 5:776C6?E E6C> — DFA6C:?E6==:86?46 — “7@C pvxD E92E 2C6 36EE6C E92? 9F>2?D]”k^Am
kAmp D>2== 8C@FA @7 62C=J AC@A@?6?ED @7 E96 E6C> pvx H6C6 =@@<:?8 E@ 6G@<6 9@H >:5\a_E9 46?EFCJ 4@>AFE6C D4:6?E:DED 6?G:D:@?65 2? :?E6==:86?E >249:?6] %92E H2D 367@C6 px C6D62C49 3C2?4965 :?E@ DF37:6=5D E92E 25G2?465 DA64:2=:K65 2?5 4@>>6C4:2==J G:23=6 G6CD:@?D @7 E96 E649?@=@8J — 7C@> 7246 C64@8?:E:@? E@ DA6649\C64@8?:K:?8 G@:46 2DD:DE2?ED =:<6 $:C: 2?5 p=6I2]k^Am
kAm|2:?DEC62> px C6D62C49 QEFC?65 2H2J 7C@> E96 @C:8:?2= G:D:@? @7 2CE:7:4:2= :?E6==:86?46[ H9:49 2E E96 368:??:?8 H2D AC6EEJ 2>3:E:@FD[” D2:5 !6: (2?8[ 2 AC@76DD@C H9@ E62496D 2? pvx 4@FCD6 2E %6>A=6 &?:G6CD:EJ 2?5 96=A65 @C82?:K6 E96 7:CDE pvx 4@?76C6?46 😕 a__g]k^Am
kAm!FEE:?8 E96 ‘v’ 😕 pvx H2D 2 D:8?2= E@ E9@D6 H9@ “DE:== H2?E E@ 5@ E96 3:8 E9:?8] (6 5@?’E H2?E E@ 3F:=5 E@@=D] (6 H2?E E@ 3F:=5 2 E9:?<:?8 >249:?6[” (2?8 D2:5]k^Am
k9ampC6 H6 2E pvx J6Enk^9am
kAm(:E9@FE 2 4=62C 567:?:E:@?[ :EVD 92C5 E@ <?@H H96? 2 4@>A2?J @C 8C@FA @7 C6D62C496CD H:== 92G6 249:6G65 2CE:7:4:2= 86?6C2= :?E6==:86?46 — @C :7 E96J 2=C625J 92G6]k^Am
kAm“%H6?EJ J62CD 28@[ x E9:?< A6@A=6 H@F=5 92G6 92AA:=J 28C665 E92E DJDE6>D H:E9 E96 23:=:EJ @7 v!%\c @C Wv@@8=6VDX v6>:?: 925 249:6G65 86?6C2= :?E6==:86?46 4@>A2C23=6 E@ E92E @7 9F>2?D[” w:?E@? D2:5] “q6:?8 23=6 E@ 2?DH6C >@C6 @C =6DD 2?J BF6DE:@? 😕 2 D6?D:3=6 H2J H@F=5 92G6 A2DD65 E96 E6DE] qFE ?@H E92E px 42? 5@ E92E[ A6@A=6 H2?E E@ 492?86 E96 E6DE]”k^Am
kAmx>AC@G6>6?ED 😕 “2FE@C68C6DD:G6” px E649?:BF6D E92E AC65:4E E96 >@DE A=2FD:3=6 ?6IE H@C5 😕 2 D6BF6?46[ 4@>3:?65 H:E9 >2DD:G6 4@>AFE:?8 A@H6C E@ EC2:? E9@D6 DJDE6>D @? EC@G6D @7 52E2[ 92G6 =65 E@ :>AC6DD:G6 492E3@ED[ 3FE k2 9C67lQ9EEADi^^2A?6HD]4@>^2CE:4=6^?6H\J@C<\4:EJ\492E3@E\>:D:?7@C>2E:@?\e634f`53d3ff_3hheh4h_e2f66c726a`QmE96J’C6 DE:== ?@E BF:E6k^2m E96 pvx E92E >2?J A6@A=6 925 😕 >:?5] v6EE:?8 E@ pvx C6BF:C6D E649?@=@8J E92E 42? A6C7@C> ;FDE 2D H6== 2D 9F>2?D 😕 2 H:56 G2C:6EJ @7 E2D<D[ :?4=F5:?8 C62D@?:?8[ A=2??:?8 2?5 E96 23:=:EJ E@ =62C? 7C@> 6IA6C:6?46D]k^Am
kAm$@>6 C6D62C496CD H@F=5 =:<6 E@ 7:?5 4@?D6?DFD @? 9@H E@ >62DFC6 :E] xEVD @?6 @7 E96 E@A:4D @7 2? FA4@>:?8 pvx H@C<D9@A ?6IE >@?E9 😕 ‘:6??2[ pFDEC:2 — E96 7:CDE 2E 2 >2;@C px C6D62C49 4@?76C6?46]k^Am
kAm“%9:D C62==J ?665D 2 4@>>F?:EJ’D 677@CE 2?5 2EE6?E:@? D@ E92E >FEF2==J H6 42? 28C66 @? D@>6 D@CE @7 4=2DD:7:42E:@?D @7 pvx[” D2:5 H@C<D9@A @C82?:K6C y:2IF2? *@F[ 2? 2DD:DE2?E AC@76DD@C 2E E96 &?:G6CD:EJ @7 x==:?@:D &C32?2\r92>A2:8?] ~?6 :562 😀 E@ D68>6?E :E :?E@ =6G6=D 😕 E96 D2>6 H2J E92E k2 9C67lQ9EEADi^^2A?6HD]4@>^2CE:4=6^:?DFC2?46\:?DE:EFE6\C2E:?8D\5C:G6C\>@?:E@C:?8\2FE@?@>@FD\2345b_`fb4`gd_e74h43cd2a67d22423Qm42C>2<6CD ECJ E@ 36?49>2C<k^2m E96 A2E9 36EH66? 4CF:D6 4@?EC@= 2?5 7F==J D6=7\5C:G:?8 G69:4=6D]k^Am
kAm~E96CD A=2? E@ 7:8FC6 :E @FE @? E96:C @H?] $2? uC2?4:D4@ 4@>A2?J ~A6?px 92D 8:G6? :ED k2 9C67lQ9EEADi^^2A?6HD]4@>^2CE:4=6^@A6?2:\D2>\2=E>2?\492E8AE\a7bb_b577aag_cfghcf6h373_cgebdbfQm?@?AC@7:E 3@2C5 @7 5:C64E@CDk^2m — H9@D6 >6>36CD :?4=F56 2 7@C>6C &]$] %C62DFCJ D64C6E2CJ — E96 C6DA@?D:3:=:EJ @7 564:5:?8 H96? :ED px DJDE6>D 92G6 C624965 E96 A@:?E 2E H9:49 E96J “@FEA6C7@C> 9F>2?D 2E >@DE 64@?@>:42==J G2=F23=6 H@C<]”k^Am
kAm“%96 3@2C5 56E6C>:?6D H96? H6’G6 2EE2:?65 pvx[” D2JD ~A6?pxVD @H? 6IA=2?2E:@? @7 :ED 8@G6C?2?46 DECF4EFC6] $F49 2? 249:6G6>6?E H@F=5 4FE @77 E96 4@>A2?JVD 3:886DE A2CE?6C[ |:4C@D@7E[ 7C@> E96 C:89ED E@ 4@>>6C4:2=:K6 DF49 2 DJDE6>[ D:?46 E96 E6C>D @7 E96:C 28C66>6?ED “@?=J 2AA=J E@ AC6\pvx E649?@=@8J]”k^Am
k9amxD pvx 52?86C@FDnk^9am
kAmw:?E@? >256 8=@32= 9625=:?6D =2DE J62C H96? 96 BF:E v@@8=6 k2 9C67lQ9EEADi^^2A?6HD]4@>^2CE:4=6^2:\52?86C\DFA6C:?E6==:86?E\492E8AE\9:?E@?\8@@8=6\e6chha6f2gf5d3426fgf25cddcdfdf53Qm2?5 D@F?565 2 H2C?:?8k^2m 23@FE pxVD 6I:DE6?E:2= 52?86CD] p ?6H k2 9C67lQ9EEADi^^HHH]D4:6?46]@C8^5@:^`_]“ae^D4:6?46]25=_eadQm$4:6?46 DEF5J AF3=:D965 %9FCD52Jk^2m 4@F=5 C6:?7@C46 E9@D6 4@?46C?D]k^Am
kAmxED =625 2FE9@C 😀 |:4926= r@96?[ 2 &?:G6CD:EJ @7 r2=:7@C?:2[ q6C<6=6J[ C6D62C496C H9@ DEF5:6D E96 “6IA64E65 3692G:@C @7 86?6C2==J :?E6==:86?E 2CE:7:4:2= 286?ED[” A2CE:4F=2C=J E9@D6 4@>A6E6?E 6?@F89 E@ “AC6D6?E 2 C62= E9C62E E@ FD 3J @FE A=2??:?8 FD]”k^Am
kAmr@96? >256 4=62C 😕 2? :?E6CG:6H %9FCD52J E92E DF49 =@?8\E6C> px A=2??:?8 286?ED 5@?VE J6E 6I:DE] qFE “E96J 92G6 E96 A@E6?E:2= E@ 36” 2D E649 4@>A2?:6D D66< E@ 4@>3:?6 E@52JVD 492E3@E E649?@=@8J H:E9 >@C6 56=:36C2E6 A=2??:?8 D<:==D FD:?8 2 E649?:BF6 <?@H? 2D C6:?7@C46>6?E =62C?:?8]k^Am
kAm“v:G:?8 2? 25G2?465 px DJDE6> E96 @3;64E:G6 E@ >2I:>:K6 :ED C6H2C5 2?5[ 2E D@>6 A@:?E[ H:E99@=5:?8 C6H2C5 7C@> :E[ DEC@?8=J :?46?E:G:K6D E96 px DJDE6> E@ E2<6 9F>2?D @FE @7 E96 =@@A[ :7 :E 92D E96 @AA@CEF?:EJ[” 244@C5:?8 E@ E96 A2A6C H9@D6 4@\2FE9@CD :?4=F56 AC@>:?6?E k2 9C67lQ9EEADi^^2A?6HD]4@>^2CE:4=6^D4:6?46\E649?@=@8J\3FD:?6DD\56>:D\92DD23:D\2e3g_ad76ec737a7hdf356c6b5b7“2gQmpx D4:6?E:DED *@D9F2 q6?8:@k^2m 2?5 k2 9C67lQ9EEADi^^2A?6HD]4@>^2CE:4=6^?@CE9\2>6C:42\2CE:7:4:2=\:?E6==:86?46\72463@@<\:?4\>2C<\KF4<6C36C8\42\DE2E6\H:C6\ff6b`__had`5ce4532aag55`c5ff6777Qm$EF2CE #FDD6==k^2m 2?5 =2H AC@76DD@C 2?5 7@C>6C ~A6?px 25G:D6C v:==:2? w257:6=5]k^Am
kAm“x 9@A6 H6’G6 >256 E96 42D6 E92E A6@A=6 😕 8@G6C?>6?E 564:56 E@ DE2CE E9:?<:?8 D6C:@FD=J 23@FE 6I24E=J H92E C68F=2E:@?D H6 ?665 E@ 255C6DD E9:D AC@3=6>[” r@96? D2:5] u@C ?@H[ “8@G6C?>6?ED @?=J <?@H H92E E96D6 4@>A2?:6D 564:56 E@ E6== E96>]”k^Am
k9am%@@ =68:E E@ BF:E pvxnk^9am
kAm(:E9 D@ >F49 >@?6J C:5:?8 @? E96 AC@>:D6 @7 px 25G2?46D[ :EVD ?@ DFCAC:D6 E92E pvx 😀 2=D@ 364@>:?8 2 4@CA@C2E6 3FKKH@C5 E92E D@>6E:>6D 2EEC24ED 2 BF2D:\C6=:8:@FD 76CG@C]k^Am
kAmxEVD 5:G:565 D@>6 @7 E96 E649 H@C=5 36EH66? E9@D6 H9@ 2C8F6 :E D9@F=5 36 56G6=@A65 D=@H=J 2?5 42C67F==J 2?5 @E96CD — :?4=F5:?8 G6?EFC6 42A:E2=:DED 2?5 C2AA6C |r w2>>6C — H9@VG6 564=2C65 E96>D6=G6D A2CE @7 2? “2446=6C2E:@?:DE” 42>A]k^Am
kAm%96 {@?5@?\32D65 DE2CEFA s66A|:?5[ 7@F?565 😕 a_`_ 2?5 ?@H A2CE @7 v@@8=6[ H2D @?6 @7 E96 7:CDE 4@>A2?:6D E@ 6IA=:4:E=J D6E @FE E@ 56G6=@A pvx] ~A6?px 5:5 E96 D2>6 😕 a_`d H:E9 2 D276EJ\7@4FD65 A=6586]k^Am
kAmqFE ?@H :E >:89E D66> E92E 6G6CJ@?6 6=D6 😀 ;F>A:?8 @? E96 32?5H28@?] v@@8=6 4@\7@F?56C $6C86J qC:? H2D C646?E=J D66? 92?8:?8 @FE 2E 2 r2=:7@C?:2 G6?F6 42==65 E96 pvx w@FD6] p?5 =6DD E92? E9C66 J62CD k2 9C67lQ9EEADi^^2A?6HD]4@>^2CE:4=6^72463@@<\>6E2\>2C<\KF4<6C36C8\E649?@=@8J\3FD:?6DD\d25dcb23ffg_4226cbdhbd7_242h724eQm27E6C 492?8:?8 :ED ?2>6k^2m 7C@> u2463@@< E@ 7@4FD @? G:CEF2= H@C=5D[ |6E2 !=2E7@C>D 😕 y2?F2CJ C6G62=65 E92E pvx H2D 2=D@ @? E96 E@A @7 :ED 286?52]k^Am
kAm|6E2 rt~ |2C< +F4<6C36C8 D2:5 9:D 4@>A2?JVD =@?8\E6C> 8@2= H2D “3F:=5:?8 7F== 86?6C2= :?E6==:86?46” E92E H@F=5 C6BF:C6 25G2?46D 😕 C62D@?:?8[ A=2??:?8[ 4@5:?8 2?5 @E96C 4@8?:E:G6 23:=:E:6D] (9:=6 +F4<6C36C8VD 4@>A2?J 92D =@?8 925 C6D62C496CD k2 9C67lQ9EEADi^^2A?6HD]4@>^2CE:4=6^2:\@A6?D@FC46\>6E2\:3>\492E8AE\55e`6hh24g`bd3begfa3bhgfe_`_ef64Qm7@4FD65 @? E9@D6 DF3;64EDk^2m[ 9:D 2EE6?E:@? H2D 2 492?86 😕 E@?6]k^Am
kAmpE p>2K@?[ @?6 D:8? @7 E96 ?6H >6DD28:?8 H2D H96? E96 9625 D4:6?E:DE 7@C E96 G@:46 2DD:DE2?E p=6I2 DH:E4965 ;@3 E:E=6D E@ 364@>6 9625 D4:6?E:DE 7@C pvx]k^Am
kAm(9:=6 ?@E k2 9C67lQ9EEADi^^2A?6HD]4@>^2CE:4=6^?G:5:2\2:\49:AD\;6?D6?\9F2?8\47h7h3_dbbd2a6d444453b7f3b563f3fQm2D E2?8:3=6 E@ (2== $EC66Ek^2m 2D 86?6C2E:G6 px[ 3C@2542DE:?8 pvx 2>3:E:@?D >2J 96=A C64CF:E px E2=6?E H9@ 92G6 2 49@:46 😕 H96C6 E96J H2?E E@ H@C<]k^Am
kAmx? 564:5:?8 36EH66? 2? “@=5\D49@@= px :?DE:EFE6” @C @?6 H9@D6 “8@2= 😀 E@ 3F:=5 pvx” 2?5 92D DF77:4:6?E C6D@FC46D E@ 5@ D@[ >2?J H@F=5 49@@D6 E96 =2EE6C[ D2:5 *@F[ E96 &?:G6CD:EJ @7 x==:?@:D C6D62C496C]k^Am
![OWQ: Lessons learned from activation outliers for weight quantization in large language models. (arXiv:2306.02272v3 [cs.CL] UPDATED)](https://aigumbo.com/wp-content/themes/sociallyviral/images/nothumb-sociallyviral_related.png)
