Recording of the event: Slovak Language in the Era of Large Language Models (with support from the Leonardo supercomputer)
On June 11, 2025, a joint webinar on language modeling was held, organized by the National Competence Centres for HPC in Slovakia and Italy. The discussion focused on the challenges and solutions related to using large language models (LLMs) for less-resourced languages such as Slovak.
Participants were introduced to several innovative approaches aimed at reducing linguistic inequality in the era of artificial intelligence:
- Generation of bilingual datasets: We used a database of professionally edited Slovak books and the LLaMA 3.3 70B Instruct model to translate between Slovak and English, resulting in datasets for training translation models and improving machine-translated Slovak.
- Summarization of scientific texts: Using the Gemini Flash Experimental model and the PLOS database, we generated Slovak summaries of scientific articles, contributing to the development of domain-specific language in large language models (LLMs).
- Enhancing cultural context: We are preparing a dataset based on Slovak sources aimed at improving the models’ ability to understand culturally specific topics and local context.
The webinar was hosted by Marek Dobeš, with Radovan Garabík and Peter Bednár as co-authors of the project. The research is conducted using high-performance computing infrastructure – the Slovak supercomputer Devana and the Italian supercomputer Leonardo, operated by the Cineca supercomputing center in Italy.
The case study highlights the potential for applying these methodologies to other low-resource languages. We believe that the insights gained from this project can inspire experts around the world.
Building International Cooperation in HPC: Visit to ITER Tenerife and Teide HPC 17 Jul - At the beginning of July 2025, Lucia Malíčková, representative of the National Supercomputing Centre (NSCC) and the National Competence Centre for High-Performance Computing (NCC for HPC), had the opportunity to visit the renowned technological and research institution ITER – Instituto Tecnológico y de Energías Renovables, S.A. on the island of Tenerife.
As part of the working visit, she met with the center’s director Carlos Suarez and Jesús Rodríguez Alamo to discuss opportunities for establishing cooperation in the field of high-performance computing (HPC), research, development, and innovation using advanced technological infrastructures.
Meeting with Michal Valko, expert on large language models 15 Jul - The National Supercomputing Centre and the National Competence Centre for HPC, represented by Lucia Malíčková, met with prominent Slovak scientist Michal Valko, who is among the world’s leading experts in artificial intelligence and machine learning. They discussed opportunities for future collaboration, with a particular focus on leveraging Slovakia’s HPC capacities to support advanced research in large language models and algorithms that require minimal human feedback.
Data, Theology and HPC: A Collaboration Seeking Paths to Understanding 8 Jul - Continuing our collaboration with the Faculty of Theology at Trnava University!
The National Supercomputing Centre (NSCC) and the National Competence Centre for HPC will continue their collaboration with the Faculty of Theology at Trnava University in 2025. Following a successful joint study that demonstrated the potential of artificial intelligence and high-performance computing in the analysis of religious texts, representatives of both institutions met again to identify new areas and opportunities for future joint projects.