Category: General

As part of our project, we are working to overcome this barrier for the Slovak language through several strategies that may also offer methodological insights for other low-resource languages:

• Generating Bilingual Datasets: Using a carefully curated database of professionally edited Slovak books, we employ the LLaMA 3.3 70B Instruct model to translate texts into English and then back into Slovak. This process allows us to create two datasets—one for training a compact open-source model for English-to-Slovak translation, and another for improving the quality of machine-translated Slovak.
• Summarizing Scientific Texts: Using Gemini Flash Experimental and the PLOS scientific database, we generate summaries of scientific articles in Slovak. This dataset supports the training of Slovak LLMs in the area of specialized scientific terminology.
• Enhancing Cultural Context: Although models like DeepSeek and ChatGPT perform relatively well in Slovak, they struggle with culturally specific and contextual topics related to Slovakia. We plan to synthesize texts from Slovak sources to create a dataset that fills this gap.

Date and Time: June 11, 2025, 10:00 – 11:00 CEST
Venue: online
Language:   English
Speaker: Marek Dobeš
Co-authors: Radovan Garabík and Peter Bednár
Registration

Our aim is to mitigate the data scarcity for the Slovak language and enhance the performance of LLMs in terms of linguistic accuracy, scientific discourse, and cultural relevance. We believe that the approaches explored in this case study may inspire similar efforts for other low-resource languages.

This research is conducted on high-performance infrastructure — specifically, the Slovak national supercomputer Devana and. Leonardo one of Europe’s most powerful supercomputers operated by Cineca in Italy. These platforms enable us to process multilingual datasets, train models at scale, and test advanced LLM techniques with resource efficiency.

Although our case study focuses on Slovak, the methods and tools we are developing are broadly applicable to other underrepresented languages around the world. We warmly invite collaborators from all countries — not only from Central Europe or Italy, but from any region where a lack of language data poses a barrier to AI development. Our project demonstrates how European collaboration and shared use of supercomputing resources can open up new possibilities for inclusive, multilingual language modeling — especially for countries that have so far had limited opportunities to contribute to the creation of multilingual language models.

During the intensive discussions, the partners focused primarily on current challenges and opportunities in the field of international cooperation, with particular attention given to:

• the exchange of best practices in reaching target audiences,
• the organization of joint training sessions and activities for small and medium-sized enterprises (SMEs),
• the sharing of successful case studies (“success stories”) and the preparation of their coordinated presentation,
• the planning of joint cross-border events.

The meeting also contributed to the alignment of communication and dissemination strategies of both centres, with the aim of enhancing the effectiveness of outreach regarding the benefits of high-performance computing among both expert and general audiences. The participants appreciated the opportunity for an in-person meeting, which helped strengthen inter-institutional ties and opened up new areas of potential collaboration.

EuroCC Slovakia and EuroCC Czech Republic expressed their commitment to continuing joint initiatives aimed at systematically developing competencies in the field of HPC and strengthening regional synergy between national centres within the European HPC ecosystem.

The discussion also addressed the challenges and opportunities that AI presents for small and medium-sized enterprises, as well as the possibilities for effectively implementing solutions based on high-performance computing (HPC) infrastructure. One of the main speakers was Lucia Malíčková, who represented the National Supercomputing Centre (NSCC) and the National Competence Centre for High-Performance Computing (NCC for HPC). In her presentation, she outlined specific examples of AI applications across various sectors, as well as the services and support that NSCC and NCC provide to companies in adopting innovative and digital solutions. She also emphasized the opportunities for Slovak enterprises to engage in European initiatives related to AI and supercomputing.

The event took place within the framework of the BrAIn project – Bringing Artificial Intelligence towards SMEs, which is funded by the Interreg Danube Region Programme. The project supports digitalization and innovation in small and medium-sized enterprises across the Danube region by facilitating knowledge transfer in the field of artificial intelligence.

The National Supercomputing Centre (NSCC), together with the National Competence Centre for High-Performance Computing (NCC for HPC), provides professional support, consulting services, and access to advanced technologies for businesses interested in leveraging artificial intelligence and high-performance computing. This assistance enables companies to implement innovative solutions effectively. These institutions also organize expert events, workshops, and tailored consultations focused on addressing the specific needs of small and medium-sized enterprises during their digital transformation journey.

FF+ is an ambitious European project aimed at accelerating digital transformation and promoting sustainability in manufacturing. The project’s goal is to connect manufacturing companies with digital innovation hubs and centres of excellence across Europe. At the same time, FF+ provides a framework for collaboration at the European level, which is essential for the effective sharing of knowledge, technologies, and best practices among EU member states.

The National Competence Centre for HPC in Slovakia has long focused on supporting industrial digitalisation through high-performance computing (HPC), artificial intelligence (AI), and data analytics. Its goal is to enable Slovak companies – including SMEs – to harness the potential of modern technologies for innovation, increased efficiency, and reduced time-to-market for research and development. In this field, the NCC for HPC has experience in implementing pilot projects, providing technological consulting, and organising tailor-made training programs.

The meeting with the FF+ team at the ASHPC25 conference represented an important step towards building bridges between national and European initiatives. Both sides agreed on the need for further coordination and the development of collaboration. Specific opportunities for synergy were identified, such as involving industrial partners in testing and applying HPC solutions, as well as exchanging data models and algorithms between research and manufacturing entities.

ASHPC25 is an annual event that brings together HPC experts, users, and solution providers from across Europe, offering a platform for professional exchange on the latest developments, challenges, and trends in high-performance computing. The Slovak Competence Centre for HPC was represented at the conference by Halyna Hyryavets (communication activities and international cooperation), Božidara Pellegrini (innovation support and services for the private sector), and Tomáš Kollárik (educational activities and cooperation with academia). On the very first day of the event, a meeting of the Central European Working Group took place, bringing together national HPC competence centres from Central European countries. This session provided valuable space for exchanging experiences, identifying common challenges, and fostering synergies within the EuroCC project.

During the conference, the Slovak team actively participated in several expert discussions and bilateral meetings. Božidara Pellegrini led a working session with Tina Črnigoj, dissemination coordinator of the Future Factories Plus (FF+) project, focused on identifying synergies in supporting innovation, digital transformation, and the involvement of SMEs in adopting HPC, AI, and advanced technologies. Halyna Hyryavets and Božidara Pellegrini also held discussions with Karina Pešatová, founder of the Central European Chapter of Women in HPC, exploring opportunities for future collaboration. Tomáš Kollárik established new contacts with experts and potential trainers for the upcoming educational activities of the NCC, thereby strengthening the network of professionals in the fields of HPC and data analytics.

The working groups and panel sessions addressed several current topics, including access to EuroHPC JU computing resources, improving the efficiency and availability of training services, targeted communication towards diverse user groups, and supporting companies and startups in adopting HPC and data technologies. Discussions also covered the development of the AI Factories initiative, which represents a new impulse for strengthening European capacities in the field of artificial intelligence.

Participation in the ASHPC25 conference was highly beneficial for the Slovak team. It contributed to strengthening regional and European cooperation, establishing new partnerships, and deepening expert dialogue on the importance of HPC for research, public services, and business.

The National Competence Centre for HPC in Slovakia was represented at the meeting by Halyna Hyryavets, who is responsible for communication, marketing activities, and cross-border cooperation; Tomáš Kollárik, who oversees educational activities; and Božidara Pellegrini, who focuses on facilitating HPC services for the private sector and building partnerships with companies.

As part of the working discussions, we addressed several current topics. We focused on access to EuroHPC JU computing resources, discussed ways to improve training and educational services to better meet user needs, and also explored how to enhance the clarity and accessibility of information through targeted and clear communication.

An important topic of discussion was also the support for companies and startups in accessing HPC infrastructure. We shared our experiences and discussed joint initiatives at the European level. A significant part of the meeting was dedicated to the AI Factories initiative, which represents a new impetus for the development of artificial intelligence in Europe and opens up further opportunities for Slovakia – whether in terms of access to computing capacity, support for innovation, or talent development (even though an AI Factory has not yet been established in Slovakia).

We are glad to have actively contributed to the expert discussions and shared our insights and experiences, which can help further strengthen the HPC ecosystem in the region. We see such in-person meetings as extremely valuable for coordination and effective collaboration across the entire EuroCC network.

We thank the organizers for a well-prepared event and look forward to continuing our joint activities that help bring high-performance computing closer to people, businesses, and institutions across Europe.

While traditional artificial intelligence models are trained to recognize objects from predefined categories (such as “dog,” “car,” or “tree”), modern research is shifting toward enabling machines to perceive any object as a distinct entity—even if that object has never appeared in the training data before. This advancement is particularly crucial in the field of robotics, where machines operate in unpredictable environments and must independently identify new and unfamiliar objects.

The lecture introduced several breakthrough technologies that make this advancement possible. The main topics included:

• the use of the DINO model (2021), which was trained without the need for annotated data and enables a humanoid robot to direct its attention to relevant parts of a scene,
• the use of the CUTLER model (2023) and the MaskCut method, which operates on the principle of optimizing the image's graph structure (NCut) and enables efficient object segmentation,
• new approaches to generating precise segmentation masks using neural network learning, which improve the accuracy of object localization and shape within an image.

In addition to the technological overview, the webinar also offered practical demonstrations of how these models are applied within a robotic system. Participants had the opportunity to gain insight into the research process and understand how theoretical knowledge is put into practice—from model training to deployment in real-world environments.

The event was intended for a broad expert audience—researchers, educators, PhD candidates, students, and professionals in the fields of artificial intelligence, robotics, and computer vision. The high attendance and the number of questions during the discussion confirmed that this is a highly relevant and rapidly evolving area of research.

We thank everyone who participated in the webinar and trust that the knowledge gained will contribute to the continued advancement of research and innovation in this field.

Participants gained deeper insights into the technical foundations of transformer architectures, including how these models process input data, generate responses, and why they are both powerful and computationally demanding. A particularly intriguing part of the presentation was the introduction of the Model Context Protocol (MCP), which offers a new approach to handling context and memory within LLM systems. MCP was compared with other methods such as Retrieval-Augmented Generation (RAG) and so-called Agent-to-Agent (A2A) protocols. These emerging methodologies highlight the direction in which LLM technologies are evolving and the potential they hold in the development of personalized chatbots, intelligent assistants, and autonomous AI agents.

Lucia Malíčková and Halyna Hyryavets represented the National Supercomputing Center (NSCC) at the event. During the meetup, Lucia Malíčková introduced the mission and activities of the NSCC, as well as the range of services the center provides to both the research community and academic institutions. She also presented the work of the National Competence Center for HPC, which supports Slovak businesses, researchers, and public institutions in transferring knowledge and innovation in the field of high-performance computing into practical use.

During the event, we also officially announced the beginning of a new collaboration aimed at connecting the artificial intelligence community with experts in high-performance computing. We believe this synergy will open up new opportunities for leveraging advanced AI technologies in areas that require significant computational power—such as training large models, running simulations, or processing complex datasets. We look forward to future joint activities and discussions that can help strengthen the link between technological infrastructure, applied research, and innovation.

The event took place in a friendly and open atmosphere, providing space for discussion, networking, and sharing experiences among participants from various fields — including data science, academia, technology companies, and startups. We would like to extend our sincere thanks to the organizers for their professional preparation and for giving us the opportunity to be part of a community that is eager to engage in conversations about the future of technology in an expert yet accessible way.

Our participation confirms that the topics of artificial intelligence and high-performance computing are becoming increasingly relevant—and increasingly interconnected—within Slovakia. We are pleased to have contributed to this important discussion and look forward to future opportunities to showcase the benefits and potential that HPC infrastructure offers for AI development and the digital transformation of society.

During our working meetings with representatives of the program, we explored specific areas of cooperation. We discussed opportunities for student internships as well as involvement in solving practical tasks related to high-performance computing (HPC). We see the interest in linking the academic and technological environment with real-world practice as one of the key prerequisites for preparing experts to tackle the digital challenges of the future.

At the same time, we discussed with SARIO the possibility of expanding our cooperation to include a master's program project focused on talent development in the field of supercomputing. Through this initiative, we aim to support the creation of a new generation of specialists capable of tackling complex computational tasks across various sectoral challenges—from industry to research and development.

For us, this cooperation is of strategic importance. It represents a concrete step toward ensuring that Slovakia becomes not only a user but also a creator of advanced digital solutions. We are building connections between the public sector, education, and innovation—exactly the kind of partnership that can move the country forward in terms of technological progress.

We also discussed opportunities for further cooperation during a meeting with project manager Barbora Szepeová. We value the established dialogue and believe that we can build a long-term partnership that will deliver tangible results for companies, students, and the professional community alike.

We are convinced that by systematically combining expertise in high-performance computing with initiatives such as Internships for Universities – Solutions for Companies, we can make a real contribution to transforming Slovakia into an innovative economy built on knowledge, data, and modern technologies.

In the interview, she outlines the practical applications of supercomputers in industry, healthcare, marketing, and public administration. She shares experiences from companies that have decided to harness computing power to solve specific problems – from optimizing production and analyzing customer data to developing new products. At the same time, she openly addresses the barriers that often prevent companies from taking the first step – such as concerns about technical complexity or complicated procedures – and explains how, with the support of our center, these obstacles can be easily overcome.

We also invite you to join the upcoming online workshop Supercomputer in Business – The Secret Weapon for Your Success,taking place on May 13, 2025. The workshop is intended for companies interested in exploring the practical uses of supercomputers, learning from real-life examples, and discovering how they can collaborate with us.

If you're curious about how a supercomputer could benefit your business, be sure to read the full interview..