{"id":449,"date":"2024-12-04T20:22:52","date_gmt":"2024-12-04T20:22:52","guid":{"rendered":"https:\/\/naujienaplius.lt\/index.php\/2024\/12\/04\/aws-dabar-leidzia-greitai-issaugoti-talpykla-ir-90-sumazinti-islaidas\/"},"modified":"2024-12-04T20:22:52","modified_gmt":"2024-12-04T20:22:52","slug":"aws-dabar-leidzia-greitai-issaugoti-talpykla-ir-90-sumazinti-islaidas","status":"publish","type":"post","link":"https:\/\/naujienaplius.lt\/index.php\/2024\/12\/04\/aws-dabar-leidzia-greitai-issaugoti-talpykla-ir-90-sumazinti-islaidas\/","title":{"rendered":"AWS dabar leid\u017eia greitai i\u0161saugoti talpykl\u0105 ir 90 % suma\u017einti i\u0161laidas"},"content":{"rendered":" \r\n<br><div>\n\t\t\t\t<div id=\"boilerplate_2682874\" class=\"post-boilerplate boilerplate-before\">\n<p><em>Prisijunkite prie m\u016bs\u0173 kasdieni\u0173 ir savaitini\u0173 naujienlai\u0161ki\u0173, kad gautum\u0117te naujausi\u0173 naujien\u0173 ir i\u0161skirtinio turinio apie pramon\u0117je pirmaujan\u010di\u0105 AI apr\u0117pt\u012f. Su\u017einokite daugiau<\/em><\/p>\n\n\n\n<hr class=\"wp-block-separator has-css-opacity is-style-wide\"\/>\n<\/div><p>DI naudojimas ir toliau ple\u010diasi, o kai daugiau \u012fmoni\u0173 integruoja AI \u012frankius \u012f savo darbo eig\u0105, daugelis nori ie\u0161koti daugiau galimybi\u0173 suma\u017einti su AI modeli\u0173 naudojimu susijusias i\u0161laidas. <\/p>\n\n\n\n<p>Siekdama patenkinti klient\u0173 poreikius, AWS paskelb\u0117 apie dvi naujas Bedrock galimybes, kad suma\u017eint\u0173 dirbtinio intelekto modeli\u0173 ir program\u0173, kurios jau yra konkurent\u0173 platformose, eksploatavimo i\u0161laidas. <\/p>\n\n\n\n<p>Per pagrindin\u0119 kalb\u0105 AWS re:Invent, Swami Sivasubramanian, AWS AI ir duomen\u0173 viceprezidentas, paskelb\u0117 apie i\u0161man\u0173j\u012f greit\u0105 mar\u0161ruto parinkim\u0105 pagrindiniame sluoksnyje ir greitosios talpyklos atk\u016brim\u0105. <\/p>\n\n\n\n<p>I\u0161manusis raginimo mar\u0161ruto parinkimas pad\u0117t\u0173 klientams nukreipti raginimus \u012f geriausi\u0105 dyd\u012f, kad didelis modelis neatsakyt\u0173 \u012f paprast\u0105 u\u017eklaus\u0105. <\/p>\n\n\n\n<p>\u201eK\u016br\u0117jams reikia tinkam\u0173 modeli\u0173 j\u0173 programoms, tod\u0117l si\u016blome plat\u0173 modeli\u0173 rinkin\u012f\u201c, \u2013 sak\u0117 Sivasubramanianas. <\/p>\n\n\n\n<p>AWS teig\u0117, kad \u201eIntelligent Prompt Routing\u201c \u201egali suma\u017einti i\u0161laidas iki 30%, nepakenkiant tikslumui\u201c. Vartotojai tur\u0117s pasirinkti modeli\u0173 \u0161eim\u0105, o \u201eBedrock\u201c i\u0161manusis raginimo mar\u0161rutas nukreips raginimus tinkamo dyd\u017eio tos \u0161eimos modeliams. <\/p>\n\n\n\n<p>Raginim\u0173 perk\u0117limas naudojant skirtingus modelius, siekiant optimizuoti naudojim\u0105 ir i\u0161laidas, pama\u017eu i\u0161populiar\u0117jo AI pramon\u0117je. \u201eStartup Not Diamond\u201c liep\u0105 paskelb\u0117 savo i\u0161maniojo mar\u0161ruto parinkimo funkcij\u0105. <\/p>\n\n\n\n<p>Balso agent\u0173 bendrov\u0117 \u201eArgo Labs\u201c, AWS klientas, teig\u0117, kad naudoja i\u0161man\u0173j\u012f greit\u0105 mar\u0161ruto parinkim\u0105, kad u\u017etikrint\u0173, jog tinkamo dyd\u017eio modeliai tvarkyt\u0173 \u012fvairias klient\u0173 u\u017eklausas. Paprasti \u201etaip\u201c arba \u201ene\u201c klausimai, pvz., \u201eAr turite rezervacij\u0105? valdomi ma\u017eesnio modelio, bet sud\u0117tingesnio modelio, pvz., \u201eKokios galimos vegani\u0161kos galimyb\u0117s? b\u016bt\u0173 nukreiptas \u012f didesn\u012f. <\/p>\n\n\n\n<div id=\"ez-toc-container\" class=\"ez-toc-v2_0_83 counter-hierarchy ez-toc-counter ez-toc-grey ez-toc-container-direction\">\n<div class=\"ez-toc-title-container\">\n<p class=\"ez-toc-title\" style=\"cursor:inherit\">Turinys:<\/p>\n<span class=\"ez-toc-title-toggle\"><a href=\"#\" class=\"ez-toc-pull-right ez-toc-btn ez-toc-btn-xs ez-toc-btn-default ez-toc-toggle\" aria-label=\"Toggle Table of Content\"><span class=\"ez-toc-js-icon-con\"><span class=\"\"><span class=\"eztoc-hide\" style=\"display:none;\">Toggle<\/span><span class=\"ez-toc-icon-toggle-span\"><svg style=\"fill: #999;color:#999\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" class=\"list-377408\" width=\"20px\" height=\"20px\" viewBox=\"0 0 24 24\" fill=\"none\"><path d=\"M6 6H4v2h2V6zm14 0H8v2h12V6zM4 11h2v2H4v-2zm16 0H8v2h12v-2zM4 16h2v2H4v-2zm16 0H8v2h12v-2z\" fill=\"currentColor\"><\/path><\/svg><svg style=\"fill: #999;color:#999\" class=\"arrow-unsorted-368013\" xmlns=\"http:\/\/www.w3.org\/2000\/svg\" width=\"10px\" height=\"10px\" viewBox=\"0 0 24 24\" version=\"1.2\" baseProfile=\"tiny\"><path d=\"M18.2 9.3l-6.2-6.3-6.2 6.3c-.2.2-.3.4-.3.7s.1.5.3.7c.2.2.4.3.7.3h11c.3 0 .5-.1.7-.3.2-.2.3-.5.3-.7s-.1-.5-.3-.7zM5.8 14.7l6.2 6.3 6.2-6.3c.2-.2.3-.5.3-.7s-.1-.5-.3-.7c-.2-.2-.4-.3-.7-.3h-11c-.3 0-.5.1-.7.3-.2.2-.3.5-.3.7s.1.5.3.7z\"\/><\/svg><\/span><\/span><\/span><\/a><\/span><\/div>\n<nav><ul class='ez-toc-list ez-toc-list-level-1 ' ><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-1\" href=\"https:\/\/naujienaplius.lt\/index.php\/2024\/12\/04\/aws-dabar-leidzia-greitai-issaugoti-talpykla-ir-90-sumazinti-islaidas\/#Talpyklos_raginimai\" >Talpyklos raginimai<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-2\" href=\"https:\/\/naujienaplius.lt\/index.php\/2024\/12\/04\/aws-dabar-leidzia-greitai-issaugoti-talpykla-ir-90-sumazinti-islaidas\/#AI_modeliu_naudojimas_gali_buti_brangus\" >AI modeli\u0173 naudojimas gali b\u016bti brangus<\/a><\/li><li class='ez-toc-page-1 ez-toc-heading-level-2'><a class=\"ez-toc-link ez-toc-heading-3\" href=\"https:\/\/naujienaplius.lt\/index.php\/2024\/12\/04\/aws-dabar-leidzia-greitai-issaugoti-talpykla-ir-90-sumazinti-islaidas\/#Daugiau_modeliu\" >Daugiau modeli\u0173<\/a><\/li><\/ul><\/nav><\/div>\n<h2 class=\"wp-block-heading\" id=\"h-caching-prompts\"><span class=\"ez-toc-section\" id=\"Talpyklos_raginimai\"><\/span>Talpyklos raginimai<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>AWS taip pat paskelb\u0117, kad \u201eBedrock\u201c nuo \u0161iol palaikys greit\u0105 talpykl\u0105, kai \u201eBedrock\u201c gali i\u0161laikyti bendrus arba kartojamus raginimus, neperjungdamas modelio ir negeneruodamas kito prieigos rakto. <\/p>\n\n\n\n<p>\u201e\u017deton\u0173 generavimo i\u0161laidos da\u017enai gali padid\u0117ti, ypa\u010d d\u0117l pakartotini\u0173 raginim\u0173\u201c, &#8211; sak\u0117 Sivasubramanianas. \u201eNor\u0117jome suteikti klientams paprast\u0105 b\u016bd\u0105 dinami\u0161kai i\u0161saugoti raginimus talpykloje neprarandant tikslumo.<\/p>\n\n\n\n<p>AWS teig\u0117, kad greitas kaupimas talpykloje suma\u017eina i\u0161laidas \u201eiki 90 %, o dels\u0105 \u2013 iki 85 % palaikomiems modeliams\u201c.<\/p>\n\n\n\n<p>Ta\u010diau AWS \u0161iek tiek pav\u0117lavo \u012f \u0161i\u0105 tendencij\u0105. Skubios talpyklos kaupimas buvo prieinamas kitose platformose, kad pad\u0117t\u0173 vartotojams suma\u017einti i\u0161laidas pakartotinai naudojant raginimus. Anthropic Claude 3.5 Sonnet ir Haiku si\u016blo greit\u0105 talpykl\u0105 savo API. \u201eOpenAI\u201c taip pat i\u0161pl\u0117t\u0117 savo API greit\u0105j\u0105 talpykl\u0105. <\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-using-ai-models-can-be-expensive\"><span class=\"ez-toc-section\" id=\"AI_modeliu_naudojimas_gali_buti_brangus\"><\/span>AI modeli\u0173 naudojimas gali b\u016bti brangus<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>AI program\u0173 paleidimas i\u0161lieka brangus ne tik d\u0117l mokymo modeli\u0173 kainos, bet ir d\u0117l faktinio j\u0173 naudojimo. \u012emon\u0117s teig\u0117, kad AI naudojimo i\u0161laidos vis dar yra viena did\u017eiausi\u0173 kli\u016b\u010di\u0173 platesniam diegimui. <\/p>\n\n\n\n<p>\u012emon\u0117ms pereinant prie agent\u0173 naudojimo atvej\u0173, naudotojai vis dar kainuoja, kai pinga modelis ir agentas, kad prad\u0117t\u0173 atlikti savo u\u017eduotis. Tokie metodai kaip greitas kaupimas talpykloje ir i\u0161manusis mar\u0161ruto parinkimas gali pad\u0117ti suma\u017einti i\u0161laidas, nes apriboja, kada raginimas siun\u010dia modelio API, kad atsakyt\u0173 \u012f u\u017eklaus\u0105. <\/p>\n\n\n\n<p>Ta\u010diau modeli\u0173 k\u016br\u0117jai teig\u0117, kad augant pritaikymui kai kuri\u0173 modeli\u0173 kainos gali kristi. \u201eOpenAI\u201c teig\u0117, kad AI i\u0161laidos netrukus gali suma\u017e\u0117ti. <\/p>\n\n\n\n<h2 class=\"wp-block-heading\" id=\"h-more-models\"><span class=\"ez-toc-section\" id=\"Daugiau_modeliu\"><\/span>Daugiau modeli\u0173<span class=\"ez-toc-section-end\"><\/span><\/h2>\n\n\n\n<p>AWS, kurioje yra daug \u201eAmazon\u201c modeli\u0173, \u012fskaitant naujus \u201eNova\u201c modelius, ir pirmaujantys atvirojo kodo tiek\u0117jai, \u201eBedrock\u201c prid\u0117s nauj\u0173 modeli\u0173. Tai apima \u201ePoolside\u201c modelius, \u201eStability AI\u201c \u201eStable Diffusion 3.5\u201c ir \u201eLuma&#8217;s Ray 2\u201c. Tikimasi, kad modeliai netrukus pasirodys \u201eBedrock\u201c. <\/p>\n\n\n\n<p>\u201eLuma\u201c generalinis direktorius ir vienas i\u0161 \u012fk\u016br\u0117j\u0173 Amit Jain sak\u0117 \u201eVentureBeat\u201c, kad AWS yra pirmasis bendrov\u0117s debes\u0173 tiekimo partneris, priglobiantis savo modelius. Jainas teig\u0117, kad bendrov\u0117 naudojo \u201eAmazon\u201c \u201eSageMaker HyperPod\u201c, kurdama ir mokydama \u201eLuma\u201c modelius. <\/p>\n\n\n\n<p>\u201eAWS komanda tur\u0117jo in\u017einieri\u0173, kurie jaut\u0117si m\u016bs\u0173 komandos dalimi, nes pad\u0117jo mums i\u0161siai\u0161kinti problemas. Mums prireik\u0117 beveik savait\u0117s ar dviej\u0173, kad atgaivintume savo modelius\u201c, \u2013 sak\u0117 Jain. <\/p>\n<div id=\"boilerplate_2660155\" class=\"post-boilerplate boilerplate-after\"><div class=\"Boilerplate__newsletter-container\">\n<div class=\"Boilerplate__newsletter-main\">\n<p><strong>VB dienra\u0161tis<\/strong><\/p>\n<p>B\u016bkite \u017einomi! Kasdien gaukite paskutines naujienas savo pa\u0161to d\u0117\u017eut\u0117je<\/p>\n<p class=\"Form__newsletter-legal\">Prenumeruodami sutinkate su \u201eVentureBeat\u201c paslaug\u0173 teikimo s\u0105lygomis.<\/p>\n<p class=\"Form__success\" id=\"boilerplateNewsletterConfirmation\">\n<p>\t\t\t\t\tA\u010di\u016b, kad u\u017esiprenumeravote. Daugiau VB naujienlai\u0161ki\u0173 rasite \u010dia.\n\t\t\t\t<\/p>\n<p class=\"Form__error\">\u012evyko klaida.<\/p>\n<\/p><\/div>\n<\/p><\/div>\n<\/div>\t\t\t<\/div>\r\n<br>\r\n<br><a href=\"https:\/\/venturebeat.com\/ai\/aws-now-allows-prompt-caching-with-90-cost-reduction\/\">Source link <\/a>","protected":false},"excerpt":{"rendered":"<p>Prisijunkite prie m\u016bs\u0173 kasdieni\u0173 ir savaitini\u0173 naujienlai\u0161ki\u0173, kad gautum\u0117te naujausi\u0173 naujien\u0173 ir i\u0161skirtinio turinio apie pramon\u0117je pirmaujan\u010di\u0105 AI apr\u0117pt\u012f. Su\u017einokite&hellip;<\/p>\n","protected":false},"author":1,"featured_media":450,"comment_status":"","ping_status":"","sticky":false,"template":"","format":"standard","meta":{"om_disable_all_campaigns":false,"_monsterinsights_skip_tracking":false,"_monsterinsights_sitenote_active":false,"_monsterinsights_sitenote_note":"","_monsterinsights_sitenote_category":0,"footnotes":""},"categories":[167],"tags":[],"class_list":["post-449","post","type-post","status-publish","format-standard","has-post-thumbnail","hentry","category-technologijos"],"aioseo_notices":[],"_links":{"self":[{"href":"https:\/\/naujienaplius.lt\/index.php\/wp-json\/wp\/v2\/posts\/449","targetHints":{"allow":["GET"]}}],"collection":[{"href":"https:\/\/naujienaplius.lt\/index.php\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/naujienaplius.lt\/index.php\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/naujienaplius.lt\/index.php\/wp-json\/wp\/v2\/users\/1"}],"replies":[{"embeddable":true,"href":"https:\/\/naujienaplius.lt\/index.php\/wp-json\/wp\/v2\/comments?post=449"}],"version-history":[{"count":0,"href":"https:\/\/naujienaplius.lt\/index.php\/wp-json\/wp\/v2\/posts\/449\/revisions"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/naujienaplius.lt\/index.php\/wp-json\/wp\/v2\/media\/450"}],"wp:attachment":[{"href":"https:\/\/naujienaplius.lt\/index.php\/wp-json\/wp\/v2\/media?parent=449"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/naujienaplius.lt\/index.php\/wp-json\/wp\/v2\/categories?post=449"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/naujienaplius.lt\/index.php\/wp-json\/wp\/v2\/tags?post=449"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}