{"id":1287,"date":"2024-08-06T16:32:36","date_gmt":"2024-08-06T07:32:36","guid":{"rendered":"https:\/\/armdown.net\/?p=1287"},"modified":"2024-08-11T14:21:33","modified_gmt":"2024-08-11T05:21:33","slug":"%ec%96%b8%ec%96%b4-%eb%aa%a8%eb%8d%b8language%ec%9d%98-%eb%af%b8%eb%9e%98%eb%8a%94-%ec%84%b8%ea%b3%84-%eb%aa%a8%eb%8d%b8world-model","status":"publish","type":"post","link":"https:\/\/armdown.net\/?p=1287","title":{"rendered":"\uc5b8\uc5b4 \ubaa8\ub378(Language)\uc758 \ubbf8\ub798\ub294 \uc138\uacc4 \ubaa8\ub378(World Model)?"},"content":{"rendered":"

\ud604\uc7ac \uac00\uc7a5 \uc720\uba85\ud55c \uc778\uacf5\uc9c0\ub2a5\uc740 \u2018\uc5b8\uc5b4 \ubaa8\ub378\u2019(Language Model)\uc774\ub2e4. \uc5ec\uae30\uc11c \u2018\ubaa8\ub378\u2019\uc774\ub780 \uc911\ud575(core) \ud504\ub85c\uadf8\ub7a8\uc774\ub77c\uace0 \uc774\ud574\ud558\uba74 \ubb34\ub09c\ud558\ub2e4. \uc989, \u2018\uc5b8\uc5b4 \ubaa8\ub378\u2019\uc774\ub77c \ud568\uc740 \uc911\ud575\uc5d0 \u2018\uc5b8\uc5b4\u2019\uac00 \uc788\ub2e4\ub294 \uc758\ubbf8\ub2e4. \ucc57GPT, \ud074\ub85c\ub4dc, \uc81c\ubbf8\ub2c8, \ud558\uc774\ud37c\ud074\ub85c\ubc14X \ub4f1\uc774 \uc774\uc5d0 \uc18d\ud55c\ub2e4. \uc5ec\uae30\uc5d0 \u2018\ud14d\uc2a4\ud2b8+X\u2019\uc758 \uc9dd\uc9d3\uae30 \ud615\ud0dc\ub85c \ud655\uc7a5\ud55c \uac83\uc774 \u2018\uba40\ud2f0\ubaa8\ub2ec\u2019(multi-moda)\uc774\ub2e4. \ubaa8\ub4dc(mode) \ud639\uc740 \ubaa8\ub2ec\ub9ac\ud2f0(modality)\uac00 \uc5ec\ub7ff\uc774\ub77c\ub294 \ub73b\uc774\ub2e4(\uac00\ub839 \ud14d\uc2a4\ud2b8+\uc774\ubbf8\uc9c0, \ud14d\uc2a4\ud2b8+\uc18c\ub9ac, \ud14d\uc2a4\ud2b8+\ucf54\ub4dc \ub4f1\uc774 \uc5ee\uc5ec \uc788\ub2e4).<\/p>\n

\uc580 \ub974\ucfe4\uc740 \u2018\uc5b8\uc5b4 \ubaa8\ub378\u2019\uc740 \ud55c\uacc4\uac00 \ubd84\uba85\ud558\ub2e4\uace0 \ub9d0\ud55c\ub2e4. \uc5b8\uc5b4\ub294 \uc138\uacc4\uc758 \uadf9\ud788 \uc77c\ubd80\ub9cc \ud3ec\ucc29\ud55c\ub2e4\ub294 \uc774\uc720\uc5d0\uc11c\ub2e4. \uadf8\ub798\uc11c \uc81c\uc548\ud558\ub294 \uac83\uc774 \u2018\uc138\uacc4 \ubaa8\ub378\u2019(World Model)\uc774\ub2e4. \ud558\uc9c0\ub9cc \u2018\uc5b8\uc5b4 \ubaa8\ub378\u2019\uc758 \ud655\uc7a5\uc744 \ud1b5\ud574 \uc5ec\uae30\uc5d0 \ub3c4\ub2ec\ud560 \uc218\ub294 \uc5c6\uace0 \uadf8\uc640\ub294 \uc644\uc804\ud788 \ub2e4\ub978 \uc811\uadfc\uacfc \uc124\uacc4, \uc989 \uc804\ubb38 \uc6a9\uc5b4\ub85c \uc644\uc804\ud788 \ub2e4\ub978 \uc544\ud0a4\ud14d\ucc98\uac00 \ud544\uc694\ud558\ub2e4. \uc774 \uc544\ud0a4\ud14d\ucc98\ub97c \uc5b4\ub5bb\uac8c \uc124\uacc4\ud558\ub290\ub0d0\ub294 \uc544\uc9c1 \ubd84\uba85\uce58 \uc54a\ub2e4. \ud558\uc9c0\ub9cc \ub974\ucfe4\uc758 \uae30\ubcf8\uc801 \ud1b5\ucc30\uc740 \ub9e4\uc6b0 \ucca0\ud559\uc801\uc774\ub2e4.<\/p>\n

\uc81c3\uc758 \uc548\uc73c\ub85c \u2018\ud1a0\ub300 \ubaa8\ub378'(Foundation Model)\uc774 \uc81c\uc548\ub418\uace0 \uc788\uae30\ub3c4 \ud558\ub2e4. \u2018\uc5b8\uc5b4 \ubaa8\ub378\u2019\uc774 \u2018\uc5b8\uc5b4\u2019\uc5d0 \uae30\ubc18\ud558\uace0 \uc788\ub2e4\ub294 \ud55c\uacc4\ub97c \ubc97\uc5b4\ub098\uae30 \uc704\ud574\uc11c\ub77c\ub294 \uc810\uc5d0\uc11c \u2018\uc138\uacc4 \ubaa8\ub378\u2019\uacfc \uc9c0\ud5a5\uc744 \uac19\uc774 \ud558\uc9c0\ub9cc, \u2018\uc5b8\uc5b4 \ubaa8\ub378\u2019\uc744 \ud655\uc7a5\ud558\ub294 \ubc29\ubc95\uc774 \ud1b5\ud560 \uac83\uc774\ub77c\uace0 \uc804\uc81c\ud55c\ub2e4\ub294 \uc810\uc5d0\uc11c \u2018\uc138\uacc4 \ubaa8\ub378\u2019\uacfc \ub2e4\ub974\ub2e4. \uc774\ub294 \ub2e4\ubd84\ud788 \uc218\uc0ac(rhetoric) \uc218\uc900\uc5d0 \uba38\ubb38\ub2e4\ub294 \uc0dd\uac01\uc774\ub2e4.<\/p>\n

\uadf8\ub7ec\uba74 \uc55e\uc73c\ub85c\ub294 \uc5b4\ub5bb\uac8c \ub420\uae4c? \uc0ac\uc2e4 \uc0c8\ub85c\uc6b4 \uc544\ud0a4\ud14d\ucc98\ub97c \ub9cc\ub4e0\ub2e4\ub294 \uac74 \uc26c\uc6b4 \uc77c\uc774 \uc544\ub2c8\ub2e4. \uadf8\ub098\ub9c8 \ub974\ucfe4\uc758 \ubc29\ud5a5\uc774 \uac00\uc7a5 \ubc14\ub78c\uc9c1\ud574 \ubcf4\uc778\ub2e4(\uadf8\ub9bc \ucc38\uc870). \ub974\ucfe4\uc740 \uc138\uacc4 \ubaa8\ub378\uc744 \ub2e4\uc74c\uacfc \uac19\uc774 \uc815\uc758\ud55c\ub2e4.<\/p>\n

\"\"<\/p>\n

(\ub0b4\uc6a9\uc744 \ud14d\uc2a4\ud2b8\ub85c \uc62e\uae30\uba74 \uc544\ub798\uc640 \uac19\ub2e4)<\/p>\n

Lots of confusion about what a world model is. Here is my definition:<\/span><\/p>\n

Given:<\/span>
\n– an observation x(t)<\/span>
\n– a previous estimate of the state of the world s(t)<\/span>
\n– an action proposal a(t)<\/span>
\n– a latent variable proposal z(t)<\/span><\/p>\n

A world model computes:<\/span>
\n– representation: h(t) = Enc(x(t))<\/span>
\n– prediction: s(t+1) = Pred( h(t), s(t), z(t), a(t) )<\/span>
\nWhere<\/span>
\n– Enc() is an encoder (a trainable deterministic function, e.g. a neural net)<\/span>
\n– Pred() is a hidden state predictor (also a trainable deterministic function).<\/span>
\n– the latent variable z(t) represents the unknown information that would allow us to predict exactly what happens. It must be sampled from a distribution or or varied over a set. It parameterizes the set (or distribution) of plausible predictions.<\/span><\/p>\n

The trick is to train the entire thing from observation triplets (x(t),a(t),x(t+1)) while preventing the Encoder from collapsing to a trivial solution on which it ignores the input.<\/span><\/p>\n

Auto-regressive generative models (such as LLMs) are a simplified special case in which<\/span>
\n1. the Encoder is the identity function: h(t) = x(t),<\/span>
\n2. the state is a window of past inputs <\/span>
\n3. there is no action variable a(t)<\/span>
\n4. x(t) is discrete<\/span>
\n5. the Predictor computes a distribution over outcomes for x(t+1) and uses the latent z(t) to select one value from that distribution.<\/span>
\nThe equations reduce to:<\/span>
\ns(t) = [x(t),x(t-1),…x(t-k)]<\/span>
\nx(t+1) = Pred( s(t), z(t), a(t) )<\/span>
\nThere is no collapse issue in that case.<\/span><\/p><\/blockquote>\n

\uadf8\ub7ec\ub098 ‘\uad00\ucc30(observation)’\uc774\ub77c\ub294 \uac83\uc774 \uc815\ud655\ud788 \uc5b4\ub5a4 \uc791\ub3d9\uc744 \ub73b\ud558\ub294\uc9c0\ub294 \ubd84\uba85\uce58 \uc54a\ub2e4. \ub3d9\ubb3c\uc5d0\uac8c \uad00\ucc30\uc740 \uc9c0\uac01(perception) \ud639\uc740 \uac10\uac01(sensation)\uacfc \uac19\uc740 \ub73b\uc778\ub370, \uadf8\uac83\uc740 \uc9c4\ud654 \uacfc\uc815\uc5d0\uc11c \ud615\uc131\ub418\uc5c8\uace0 \ubd84\uba85\ud55c \ubaa9\uc801\uacfc \uad00\ub828\ub418\uba70, \ud2b9\ud788 ‘\ub1cc’\ub85c \ud5a5\ud558\uace0 ‘\ub1cc’\uc5d0\uc11c \ub098\uc624\ub294 \uac10\uac01-\uc6b4\ub3d9 \ud68c\ub85c(sensori-motrice scheme) ‘\uc18d’\uc5d0\uc11c \uc774\ud574\ub41c\ub2e4(\uc774\uc5d0 \ub300\ud574\uc11c\ub294 \uc705\uc2a4\ud03c\uc758 \ub2e4\uc74c \ub3c4\uc2dd\uc744 \ucc38\uace0\ud560 \uc218 \uc788\ub2e4). \uadf8\ub7ec\ub098 \uc778\uacf5\uc801\uc778 \uc13c\uc11c\uac00 \uad00\ucc30\ud55c\ub2e4\ub294 \uac74 \uad00\ucc30 \uc885\ub958\uc758 \uc218 \uce21\uba74\uc5d0\uc11c\ub3c4 \ube48\uc57d\ud558\uace0 \uadf8\uac83\uc774 \ub3d9\ubb3c\uc758 \uad00\ucc30(\uac00\ub839 \ub208\uacfc \uce74\uba54\ub77c)\uacfc \uc5bc\ub9c8\ub098 \uac19\uc740 \uac83\uc778\uc9c0\ub3c4 \uc758\ubb38\uc2a4\ub7fd\ub2e4.<\/p>\n

\"\"
\uc57c\ucf65 \ud3f0 \uc705\uc2a4\ud03c\uc758 ‘\uae30\ub2a5 \uace0\ub9ac’<\/figcaption><\/figure>\n

(\uc544\ub798\ub294 ‘\uac10\uac01\uc758 \uac1c\uc218’ \uad00\ub828\ud55c 2024\ub144 8\uc6d4 1\uc77c \ud3ec\uc2a4\ud305)<\/p>\n

\n
\n

\uc778\uac04\uc758 \uac10\uac01\uc740 \uba87 \uc885\ub958\uc77c\uae4c? \ubcf4\ud1b5 5\uac10\uc744 \ub5a0\uc62c\ub9ac\uaca0\uc73c\ub098, \uc2e4\uc81c\ub85c\ub294 17\uac1c\uc5d0 \ub2ec\ud55c\ub2e4. \uc2dc\uac01, \uccad\uac01, \ud6c4\uac01, \ubbf8\uac01, \ucd09\uac01, \ud1b5\uc99d, \uade0\ud615, \uad00\uc808\uac10\uac01, \uc6b4\ub3d9\uac10\uac01, \uc5f4, \ucd94\uc704, \ud608\uc555, \ud608\uc561 \uc0b0\uc18c \ud568\ub7c9, \ub1cc\ucc99\uc218\uc561\uc758 \uc0b0\uc18c\ub3c4, \uac08\uc99d, \uad76\uc8fc\ub9bc, \ud3d0\uc758 \ud33d\ucc3d.<\/p>\n

\uae30\uacc4\ub294 \uba87 \uc885\ub958\uc758 \uac10\uac01(sensor)\uc744 \uac00\uc9c8\uae4c? \uadf8\uac83\uc744 \uc778\uac04(\ub610\ub294 \ub3d9\ubb3c)\ucc98\ub7fc \ud1b5\ud569\ud560 \uc218 \uc788\uc744\uae4c? \ud1b5\ud569\uc758 \uc815\ub3c4\ub294 \uc5b4\ub5a0\ud560\uae4c? \uad73\uc774 \ud1b5\ud569\ud560 \ud544\uc694\uac00 \uc5c6\ub294 \uac78\uae4c?<\/p>\n

\ub85c\ubd07\uc5d0 \uc13c\uc11c\uc640 \ubaa8\ud130\ub97c \ub2ec\uba74 \uc778\uac04\uc5d0 \uadfc\uc811\ud558\ub294 \uc815\ubcf4\ub97c \uc218\uc9d1\ud560 \uc218 \uc788\uc744\uae4c? \ub85c\ubd07 \ud639\uc740 \ud504\ub85c\uadf8\ub7a8(AI \ud3ec\ud568)\uc774 \uac10\uac01\ub4e4\uc744 \ud1b5\ud569\ud55c\ub2e4\ub294 \uac8c \uc5b4\ub5a4 \uc758\ubbf8\uc77c\uae4c? \ud639\uc740 \uac00\ub2a5\ud560\uae4c?<\/p>\n<\/blockquote>\n<\/div>\n

\ub098\uc544\uac00 \ub525\ub7ec\ub2dd \uc778\uacf5\uc9c0\ub2a5\uc774 \ub1cc\ub97c \ubaa8\uc0ac\ud588\ub2e4\uace0\ub4e4 \ub9ce\uc774 \ub9d0\ud558\ub294\ub370, \uadf8\uac74 \uc2e0\uacbd\ub9dd\uc758 \uc791\ub3d9 \ubc29\uc2dd \uc911 \uadf9\ud788 \uc77c\ubd80\uc5d0 \ub300\ud574\uc11c\ub9cc \uc131\ub9bd\ud560 \ubfd0\uc774\ub2e4. \ub1cc\ub294 \uae30\ubcf8\uc801\uc73c\ub85c ‘\uc608\ucd09 \uae30\uacc4’\uc774\uba70, \uc0dd\uc874\uacfc \ubc88\uc2dd\uc774\ub77c\ub294 \uae30\ubcf8 \ubaa9\uc801\uc5d0 \ucda9\uc2e4\ud558\ub2e4. \ub9c8\uc74c\uacfc \uc0dd\uac01\uc740 \uc774 \uc81c\uc57d \uc870\uac74 \uc18d\uc5d0\uc11c \uc791\ub3d9\ud55c\ub2e4. \ub370\uc774\ud130\ub97c \ud559\uc2b5\ud574\uc11c \uc791\ub3d9\ud558\ub294 \uc778\uacf5\uc9c0\ub2a5\uc740 \uacfc\uac70\uc758 \ud328\ud134\uc744 \ucc3e\ub294 \ub370 \ud2b9\ud654\ub418\uc5b4 \uc788\uc73c\uba70, \uc2a4\uc2a4\ub85c \ubbf8\ub798\ub97c \uc608\uce21\ud558\ub294 \ub2a5\ub825\uc774 \uc5c6\ub2e4. \uc694\ucee8\ub300 \ub1cc\ub294 \ubbf8\ub798\ub97c \ud56d\ud558\uace0, \uc778\uacf5\uc9c0\ub2a5\uc740 \uacfc\uac70\ub97c \ud5a5\ud55c\ub2e4. \ub1cc\uc640 \uc778\uacf5\uc9c0\ub2a5(\ub525\ub7ec\ub2dd \uae30\ubc18 \ud3ec\ud568)\uc740, \ubca0\ub974\uadf8\uc190 \ud639\uc740 \ub4e4\ub8b0\uc988\uc758 \ud45c\ud604\uc744 \ube4c\ub9ac\uba74, \ubcf8\uc131\uc0c1 \ub2e4\ub974\ub2e4(diff\u00e8rent en nature).<\/p>\n

\ub0b4 \uc0dd\uac01\uc5d0 ‘\uc131\uacf5 \uc0ac\ub840’\uc5d0 \ub300\ud55c \uc5f0\uad6c\uac00 \ub354 \uc774\ub8e8\uc5b4\uc838\uc57c \ud55c\ub2e4. \ub300\ud45c\uc801\uc778 \uc131\uacf5 \uc0ac\ub840\ub294 \ubc14\ub85c \uc778\uac04, \ud638\ubaa8 \uc0ac\ud53c\uc5d4\uc2a4\ub2e4. \uacf5\ud559\uc774 \ub098\uc544\uac00\ub294 \ubc29\uc2dd\uc774 \uaf2d \uc778\uac04\uc744 \ubaa8\ub378\ub85c \uc0bc\uc744 \uc774\uc720\ub294 \uc5c6\ub2e4. \ud558\uc9c0\ub9cc \uac08 \uae38\uc744 \ucc3e\uc9c0 \ubabb\ud560 \ub54c\ub294 \uc131\uacf5 \uc0ac\ub840\ub97c \ub354 \ud30c\uace0\ub4dc\ub294 \uac83\uc774 \uc77c\ub9ac\uac00 \uc788\ub294 \ud589\ub3d9\uc774\ub2e4.<\/p>\n","protected":false},"excerpt":{"rendered":"

\ud604\uc7ac \uac00\uc7a5 \uc720\uba85\ud55c \uc778\uacf5\uc9c0\ub2a5\uc740 \u2018\uc5b8\uc5b4 \ubaa8\ub378\u2019(Language Model)\uc774\ub2e4. \uc5ec\uae30\uc11c \u2018\ubaa8\ub378\u2019\uc774\ub780 \uc911\ud575(core) \ud504\ub85c\uadf8\ub7a8\uc774\ub77c\uace0 \uc774\ud574\ud558\uba74 \ubb34\ub09c\ud558\ub2e4. \uc989, \u2018\uc5b8\uc5b4 \ubaa8\ub378\u2019\uc774\ub77c \ud568\uc740 \uc911\ud575\uc5d0 \u2018\uc5b8\uc5b4\u2019\uac00 \uc788\ub2e4\ub294 \uc758\ubbf8\ub2e4. \ucc57GPT, \ud074\ub85c\ub4dc, \uc81c\ubbf8\ub2c8, \ud558\uc774\ud37c\ud074\ub85c\ubc14X \ub4f1\uc774 \uc774\uc5d0 \uc18d\ud55c\ub2e4. \uc5ec\uae30\uc5d0 \u2018\ud14d\uc2a4\ud2b8+X\u2019\uc758 \uc9dd\uc9d3\uae30 \ud615\ud0dc\ub85c \ud655\uc7a5\ud55c \uac83\uc774 \u2018\uba40\ud2f0\ubaa8\ub2ec\u2019(multi-moda)\uc774\ub2e4. \ubaa8\ub4dc(mode) \ud639\uc740 \ubaa8\ub2ec\ub9ac\ud2f0(modality)\uac00 \uc5ec\ub7ff\uc774\ub77c\ub294 \ub73b\uc774\ub2e4(\uac00\ub839 \ud14d\uc2a4\ud2b8+\uc774\ubbf8\uc9c0, \ud14d\uc2a4\ud2b8+\uc18c\ub9ac, \ud14d\uc2a4\ud2b8+\ucf54\ub4dc \ub4f1\uc774 \uc5ee\uc5ec \uc788\ub2e4). \uc580 \ub974\ucfe4\uc740 \u2018\uc5b8\uc5b4 \ubaa8\ub378\u2019\uc740 \ud55c\uacc4\uac00 \ubd84\uba85\ud558\ub2e4\uace0 \ub9d0\ud55c\ub2e4. \uc5b8\uc5b4\ub294 \uc138\uacc4\uc758 …
Read More<\/a><\/p>\n","protected":false},"author":1,"featured_media":0,"comment_status":"open","ping_status":"open","sticky":false,"template":"","format":"standard","meta":{"_jetpack_newsletter_access":"","_jetpack_dont_email_post_to_subs":false,"_jetpack_newsletter_tier_id":0,"_jetpack_memberships_contains_paywalled_content":false,"_jetpack_feature_clip_id":0,"_jetpack_memberships_contains_paid_content":false,"footnotes":"","jetpack_publicize_message":"","jetpack_publicize_feature_enabled":true,"jetpack_social_post_already_shared":true,"jetpack_social_options":{"image_generator_settings":{"template":"highway","default_image_id":0,"font":"","enabled":false},"version":2},"jetpack_post_was_ever_published":false},"categories":[43,34],"tags":[],"class_list":["post-1287","post","type-post","status-publish","format-standard","hentry","category-ai","category-free"],"jetpack_publicize_connections":[],"jetpack_featured_media_url":"","jetpack_sharing_enabled":true,"_links":{"self":[{"href":"https:\/\/armdown.net\/index.php?rest_route=\/wp\/v2\/posts\/1287","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/armdown.net\/index.php?rest_route=\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/armdown.net\/index.php?rest_route=\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/armdown.net\/index.php?rest_route=\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/armdown.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcomments&post=1287"}],"version-history":[{"count":9,"href":"https:\/\/armdown.net\/index.php?rest_route=\/wp\/v2\/posts\/1287\/revisions"}],"predecessor-version":[{"id":1359,"href":"https:\/\/armdown.net\/index.php?rest_route=\/wp\/v2\/posts\/1287\/revisions\/1359"}],"wp:attachment":[{"href":"https:\/\/armdown.net\/index.php?rest_route=%2Fwp%2Fv2%2Fmedia&parent=1287"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/armdown.net\/index.php?rest_route=%2Fwp%2Fv2%2Fcategories&post=1287"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/armdown.net\/index.php?rest_route=%2Fwp%2Fv2%2Ftags&post=1287"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}