{"id":10735,"date":"2025-08-14T16:14:42","date_gmt":"2025-08-14T14:14:42","guid":{"rendered":"https:\/\/eurocc.nscc.sk\/?p=10735"},"modified":"2025-08-14T16:14:42","modified_gmt":"2025-08-14T14:14:42","slug":"webinar-ako-vznika-velky-jazykovy-model-pre-jazyk-s-obmedzenymi-zdrojmi","status":"publish","type":"post","link":"https:\/\/eurocc.nscc.sk\/en\/webinar-ako-vznika-velky-jazykovy-model-pre-jazyk-s-obmedzenymi-zdrojmi\/","title":{"rendered":"Webinar: How a Large Language Model is Created for a Low-Resource Language"},"content":{"rendered":"
\n
\n
\n
Webinar: How a Large Language Model is Created for a Low-Resource Language<\/h5>\n\n\n\n

<\/p>\n\n\n\n

We invite you to join our next expert webinar, which will focus on advances in artificial intelligence for the Slovenian language. The event will take place online in mid-September and will offer a unique opportunity to look behind the scenes of developing a large language model tailored for a low-resource language. The speaker will be Domen Vre\u0161 from the Faculty of Computer and Information Science, University of Ljubljana, who has long been engaged in research in the fields of natural language processing and artificial intelligence.<\/p>\n\n\n\n

<\/p>\n\n\n\n

<\/p>\n<\/div>\n\n\n\n

\n
\"\"<\/a><\/figure><\/div><\/div>\n<\/div>\n\n\n\n

Speaker:<\/strong> Domen Vre\u0161
Affiliation:<\/strong> Faculty of Computer and Information Science, University of Ljubljana
Title of the lecture:<\/strong> Advances in Artificial Intelligence for the Slovenian Language: Training and Scaling the GaMS Large Language Model
Format:<\/strong> Online
Date and Time:<\/strong> 17 September 2025 at 10:00 CEST<\/p>\n\n\n\n

About webinar<\/strong>
This webinar will provide an in-depth look at the development of GaMS, a large language model (LLM) tailored for the Slovenian language. We will begin by exploring the general principles of LLM training and explain why this process requires substantial computational resources and data. Participants will learn about the entire workflow, from data preparation through training to model performance evaluation.<\/p>\n\n\n\n

We will then focus on scaling LLM training on EuroHPC infrastructure, specifically on the Leonardo supercomputer. This step made it possible to achieve higher performance and quality of the model. Domen Vre\u0161 will also share insights into the technical and organisational aspects of collaborating on such a project.<\/p>\n\n\n\n

Finally, we will delve into the specific challenges of developing an LLM for a low-resource language such as Slovenian. What makes this process more demanding? How can the limitations of available data be overcome? And what creative solutions did the team apply in the GaMS model?<\/p>\n\n\n\n

A dedicated part of the webinar will address the challenges of evaluating LLMs in low-resource environments, where established benchmarks and comprehensive evaluation datasets are often lacking. The speaker will explain how this gap can be bridged through the collection and integration of human feedback, and how such data is used to further improve and fine-tune the model.<\/p>\n\n\n\n

Target audience:<\/strong>
The webinar is suitable for artificial intelligence professionals, researchers in natural language processing, as well as students, technology enthusiasts, and anyone interested in the development and applications of large language models in minority languages.<\/p>\n\n\n\n

Whether you are an AI expert or simply seeking inspiration, this webinar offers a clear and engaging insight into the groundbreaking work behind the GaMS model and its significance for the future of Slovenian language processing.
Don\u2019t miss the opportunity to participate and gain valuable insights directly from an expert at the University of Ljubljana.<\/p>\n\n\n\n

\n
REGISTRATION<\/a><\/div>\n<\/div>\n\n\n\n

<\/p>\n\n\n\n

<\/p>\n\n\n\n

<\/p>\n\n\n\n

<\/figure>\n\n\n\n
<\/div><\/div>\n\n\n\n

<\/p>\n\n\n\n

<\/p>\n<\/div><\/div>\n\n\n\n

\n
\"\"\/<\/figure>\n\n\n\n

<\/p>\n\n\n\n

<\/figure>\n\n\n\n
\n
NEWS<\/a><\/div>\n<\/div>\n\n\n
\"\"<\/a> Ke\u010f AI klope na br\u00e1nu teol\u00f3gie<\/a> 11 Jun<\/span> -<\/span> Pre\u010do umel\u00e1 inteligencia patr\u00ed aj do teol\u00f3gie?<\/span><\/div>
\"\"<\/a> Nov\u00fd recept na skrotenie slne\u010dnej energie<\/a> 11 Jun<\/span> -<\/span> Umel\u00e1 inteligencia v spojen\u00ed s \u010distou fyzikou dok\u00e1\u017ee predpoveda\u0165 silu slne\u010dn\u00e9ho \u017eiarenia r\u00fdchlej\u0161ie a lacnej\u0161ie ne\u017e kedyko\u013evek predt\u00fdm<\/span><\/div>
\"\"<\/a> Chce\u0161 \u0161tudova\u0165 superpo\u010d\u00edta\u010de?<\/a> 7 May<\/span> -<\/span> Zva\u017euje\u0161 magistersk\u00e9 \u0161t\u00fadium a l\u00e1ka \u0165a svet vysokov\u00fdkonn\u00fdch v\u00fdpo\u010dtov, umelej inteligencie a d\u00e1tovej vedy? <\/span><\/div><\/div>\n<\/div><\/div>","protected":false},"excerpt":{"rendered":"

Poz\u00fdvame v\u00e1s na n\u00e1\u0161 \u010fal\u0161\u00ed odborn\u00fd webin\u00e1r, ktor\u00fd sa zameria na pokroky v oblasti umelej inteligencie pre slovinsk\u00fd jazyk. Podujatie sa uskuto\u010dn\u00ed\u00a0online v polovici septembra\u00a0a pon\u00fakne jedine\u010dn\u00fa pr\u00edle\u017eitos\u0165 nazrie\u0165 do z\u00e1kulisia v\u00fdvoja ve\u013ek\u00e9ho jazykov\u00e9ho modelu prisp\u00f4soben\u00e9ho pre jazyk s obmedzen\u00fdmi zdrojmi. Predn\u00e1\u0161aj\u00facim bude\u00a0Domen Vre\u0161\u00a0z Univerzity v \u013dub\u013eane, Fakulty informatiky a po\u010d\u00edta\u010dov\u00fdch vied, ktor\u00fd sa dlhodobo venuje v\u00fdskumu v oblasti spracovania prirodzen\u00e9ho jazyka a umelej inteligencie.<\/p>","protected":false},"author":2,"featured_media":10742,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"templates\/template-full-width.php","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/eurocc.nscc.sk\/en\/wp-json\/wp\/v2\/posts\/10735"}],"collection":[{"href":"https:\/\/eurocc.nscc.sk\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/eurocc.nscc.sk\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/eurocc.nscc.sk\/en\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/eurocc.nscc.sk\/en\/wp-json\/wp\/v2\/comments?post=10735"}],"version-history":[{"count":11,"href":"https:\/\/eurocc.nscc.sk\/en\/wp-json\/wp\/v2\/posts\/10735\/revisions"}],"predecessor-version":[{"id":11051,"href":"https:\/\/eurocc.nscc.sk\/en\/wp-json\/wp\/v2\/posts\/10735\/revisions\/11051"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/eurocc.nscc.sk\/en\/wp-json\/wp\/v2\/media\/10742"}],"wp:attachment":[{"href":"https:\/\/eurocc.nscc.sk\/en\/wp-json\/wp\/v2\/media?parent=10735"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/eurocc.nscc.sk\/en\/wp-json\/wp\/v2\/categories?post=10735"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/eurocc.nscc.sk\/en\/wp-json\/wp\/v2\/tags?post=10735"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}