{"id":10735,"date":"2025-08-14T16:14:42","date_gmt":"2025-08-14T14:14:42","guid":{"rendered":"https:\/\/eurocc.nscc.sk\/?p=10735"},"modified":"2025-08-14T16:14:42","modified_gmt":"2025-08-14T14:14:42","slug":"webinar-ako-vznika-velky-jazykovy-model-pre-jazyk-s-obmedzenymi-zdrojmi","status":"publish","type":"post","link":"https:\/\/eurocc.nscc.sk\/en\/webinar-ako-vznika-velky-jazykovy-model-pre-jazyk-s-obmedzenymi-zdrojmi\/","title":{"rendered":"Webinar: How a Large Language Model is Created for a Low-Resource Language"},"content":{"rendered":"
\n
\n
\n
Webinar: How a Large Language Model is Created for a Low-Resource Language<\/h5>\n\n\n\n

<\/p>\n\n\n\n

We invite you to join our next expert webinar, which will focus on advances in artificial intelligence for the Slovenian language. The event will take place online in mid-September and will offer a unique opportunity to look behind the scenes of developing a large language model tailored for a low-resource language. The speaker will be Domen Vre\u0161 from the Faculty of Computer and Information Science, University of Ljubljana, who has long been engaged in research in the fields of natural language processing and artificial intelligence.<\/p>\n\n\n\n

<\/p>\n\n\n\n

<\/p>\n<\/div>\n\n\n\n

\n
\"\"<\/a><\/figure><\/div><\/div>\n<\/div>\n\n\n\n

Speaker:<\/strong> Domen Vre\u0161
Affiliation:<\/strong> Faculty of Computer and Information Science, University of Ljubljana
Title of the lecture:<\/strong> Advances in Artificial Intelligence for the Slovenian Language: Training and Scaling the GaMS Large Language Model
Format:<\/strong> Online
Date and Time:<\/strong> 17 September 2025 at 10:00 CEST<\/p>\n\n\n\n

About webinar<\/strong>
This webinar will provide an in-depth look at the development of GaMS, a large language model (LLM) tailored for the Slovenian language. We will begin by exploring the general principles of LLM training and explain why this process requires substantial computational resources and data. Participants will learn about the entire workflow, from data preparation through training to model performance evaluation.<\/p>\n\n\n\n

We will then focus on scaling LLM training on EuroHPC infrastructure, specifically on the Leonardo supercomputer. This step made it possible to achieve higher performance and quality of the model. Domen Vre\u0161 will also share insights into the technical and organisational aspects of collaborating on such a project.<\/p>\n\n\n\n

Finally, we will delve into the specific challenges of developing an LLM for a low-resource language such as Slovenian. What makes this process more demanding? How can the limitations of available data be overcome? And what creative solutions did the team apply in the GaMS model?<\/p>\n\n\n\n

A dedicated part of the webinar will address the challenges of evaluating LLMs in low-resource environments, where established benchmarks and comprehensive evaluation datasets are often lacking. The speaker will explain how this gap can be bridged through the collection and integration of human feedback, and how such data is used to further improve and fine-tune the model.<\/p>\n\n\n\n

Target audience:<\/strong>
The webinar is suitable for artificial intelligence professionals, researchers in natural language processing, as well as students, technology enthusiasts, and anyone interested in the development and applications of large language models in minority languages.<\/p>\n\n\n\n

Whether you are an AI expert or simply seeking inspiration, this webinar offers a clear and engaging insight into the groundbreaking work behind the GaMS model and its significance for the future of Slovenian language processing.
Don\u2019t miss the opportunity to participate and gain valuable insights directly from an expert at the University of Ljubljana.<\/p>\n\n\n\n

\n
REGISTRATION<\/a><\/div>\n<\/div>\n\n\n\n

<\/p>\n\n\n\n

<\/p>\n\n\n\n

<\/p>\n\n\n\n

<\/figure>\n\n\n\n
<\/div><\/div>\n\n\n\n

<\/p>\n\n\n\n

<\/p>\n<\/div><\/div>\n\n\n\n

\n
\"\"\/<\/figure>\n\n\n\n

<\/p>\n\n\n\n

<\/figure>\n\n\n\n
\n
NEWS<\/a><\/div>\n<\/div>\n\n\n
\"\"<\/a> Artificial Intelligence and a Supercomputer as a New Weapon Against Environmental Disasters<\/strong><\/a> 26 Mar<\/span> -<\/span> Scientists from Nitra, Slovakia are teaching machines to predict industrial failures before they can cause damage. Thanks to collaboration with the European supercomputer LUMI, they have developed a digital \u201cguardian\u201d capable of detecting pipeline leaks or manufacturing faults with high accuracy\u2014helping protect both the environment and companies\u2019 budgets.<\/span><\/div>
\"\"<\/a> The Slovak Recipe for Fair Play and Happier Players<\/strong><\/a> 25 Mar<\/span> -<\/span> Do you play games on your phone and sometimes feel like the game just doesn\u2019t understand you? Experts from Nitra, Slovakia, have used one of Europe\u2019s most powerful supercomputers to change that. Thanks to the Italian giant named Leonardo, they discovered how to read between the lines of player behavior and make the gaming experience more personal and fair.<\/span><\/div>
\"\"<\/a> Apply for the EUMaster4HPC Summer School 2026 focused on High-Performance Computing.<\/a> 23 Mar<\/span> -<\/span> From 5 to 14 July 2026, the EUMaster4HPC Summer School titled \u201cHigh-Performance Computing and Emerging Trends\u201d will take place in Luxembourg. The event will be held at the Marienthal Youth Center and the University of Luxembourg in Belval.<\/span><\/div><\/div>\n<\/div><\/div>","protected":false},"excerpt":{"rendered":"

Poz\u00fdvame v\u00e1s na n\u00e1\u0161 \u010fal\u0161\u00ed odborn\u00fd webin\u00e1r, ktor\u00fd sa zameria na pokroky v oblasti umelej inteligencie pre slovinsk\u00fd jazyk. Podujatie sa uskuto\u010dn\u00ed\u00a0online v polovici septembra\u00a0a pon\u00fakne jedine\u010dn\u00fa pr\u00edle\u017eitos\u0165 nazrie\u0165 do z\u00e1kulisia v\u00fdvoja ve\u013ek\u00e9ho jazykov\u00e9ho modelu prisp\u00f4soben\u00e9ho pre jazyk s obmedzen\u00fdmi zdrojmi. Predn\u00e1\u0161aj\u00facim bude\u00a0Domen Vre\u0161\u00a0z Univerzity v \u013dub\u013eane, Fakulty informatiky a po\u010d\u00edta\u010dov\u00fdch vied, ktor\u00fd sa dlhodobo venuje v\u00fdskumu v oblasti spracovania prirodzen\u00e9ho jazyka a umelej inteligencie.<\/p>","protected":false},"author":2,"featured_media":10742,"comment_status":"closed","ping_status":"closed","sticky":false,"template":"templates\/template-full-width.php","format":"standard","meta":[],"categories":[1],"tags":[],"_links":{"self":[{"href":"https:\/\/eurocc.nscc.sk\/en\/wp-json\/wp\/v2\/posts\/10735"}],"collection":[{"href":"https:\/\/eurocc.nscc.sk\/en\/wp-json\/wp\/v2\/posts"}],"about":[{"href":"https:\/\/eurocc.nscc.sk\/en\/wp-json\/wp\/v2\/types\/post"}],"author":[{"embeddable":true,"href":"https:\/\/eurocc.nscc.sk\/en\/wp-json\/wp\/v2\/users\/2"}],"replies":[{"embeddable":true,"href":"https:\/\/eurocc.nscc.sk\/en\/wp-json\/wp\/v2\/comments?post=10735"}],"version-history":[{"count":11,"href":"https:\/\/eurocc.nscc.sk\/en\/wp-json\/wp\/v2\/posts\/10735\/revisions"}],"predecessor-version":[{"id":11051,"href":"https:\/\/eurocc.nscc.sk\/en\/wp-json\/wp\/v2\/posts\/10735\/revisions\/11051"}],"wp:featuredmedia":[{"embeddable":true,"href":"https:\/\/eurocc.nscc.sk\/en\/wp-json\/wp\/v2\/media\/10742"}],"wp:attachment":[{"href":"https:\/\/eurocc.nscc.sk\/en\/wp-json\/wp\/v2\/media?parent=10735"}],"wp:term":[{"taxonomy":"category","embeddable":true,"href":"https:\/\/eurocc.nscc.sk\/en\/wp-json\/wp\/v2\/categories?post=10735"},{"taxonomy":"post_tag","embeddable":true,"href":"https:\/\/eurocc.nscc.sk\/en\/wp-json\/wp\/v2\/tags?post=10735"}],"curies":[{"name":"wp","href":"https:\/\/api.w.org\/{rel}","templated":true}]}}