Meeting with Michal Valko, expert on large language models
The National Supercomputing Centre and the National Competence Centre for HPC, represented by Lucia Malíčková, met with prominent Slovak scientist Michal Valko, who is among the world’s leading experts in artificial intelligence and machine learning. They discussed opportunities for future collaboration, with a particular focus on leveraging Slovakia’s HPC capacities to support advanced research in large language models and algorithms that require minimal human feedback.
Michal Valko currently serves as Chief Models Officer at a stealth startup, is a researcher at the prestigious French institute Inria, and lectures at ENS Paris-Saclay. In 2024, he also became the principal engineer for Llama at Meta, where he is building the online reinforcement learning infrastructure and conducting research for the Llama 3 models.
His research focuses on designing algorithms that can operate with as little human intervention as possible. This includes deep reinforcement learning, bandit algorithms, unsupervised learning, as well as so-called self play — learning by comparing one’s own outcomes. Recently, he has concentrated on data representations, language models, and developing deep learning algorithms with solid theoretical foundations. He is currently working on algorithmic solutions that enable more efficient fine-tuning and better alignment of large language models (LMMs).
Michal Valko comes from Slovakia, where he attended the Alejová Gymnasium in Košice. Looking back, he especially values the close collaboration between this school and the Faculty of Science at UPJŠ, which sparked his interest in science. He went on to study artificial intelligence and mathematical methods in computer science at the Faculty of Mathematics, Physics and Informatics of Comenius University. In 2011, he earned his PhD at the University of Pittsburgh under the supervision of Miloš Hauskrecht. He then completed his postdoctoral studies with Rémi Munos, with whom he later co-founded Google DeepMind Paris.
Throughout his career, he has also worked on projects with companies such as Intel, Adobe, Technicolor, and Microsoft Research. As early as 2009–2010, during an internship at Intel Labs in Silicon Valley, he contributed to the development of autonomous systems designed to help visually impaired people recognize faces.
The National Supercomputing Centre and the National Competence Centre for HPC will continue to actively seek opportunities to connect Slovakia’s HPC infrastructures with global leaders in the field of artificial intelligence. They believe that this meeting will also lay the groundwork for new ambitious initiatives.
How to Communicate Science and Technology Effectively: Our Team’s Experience 22 Aug - Our team has long been dedicated not only to the development of high-performance computing, but also to the effective communication of the results and opportunities we bring to industry, academia, and the next generation of researchers. We consider this a key part of our work – a modern scientific and technological institution today cannot operate in isolation but must be able to clearly and transparently communicate the value and impact of its activities.
HPC and MATLAB: A Strong Partnership for Accessible Supercomputing 19 Aug - Minulý týždeň sa uskutočnilo zaujímavé pracovné stretnutie, na ktorom sa Lucia Malíčková, zastrešujúca Národné superpočítačové centrum a Národné kompetenčné centrum pre HPC, stretla s Martinom Foltínom zo spoločnosti HUMUSOFT s.r.o., oficiálneho distribútora MathWorks. 
Webinar: How a Large Language Model is Created for a Low-Resource Language 14 Aug - Pozývame vás na náš ďalší odborný webinár, ktorý sa zameria na pokroky v oblasti umelej inteligencie pre slovinský jazyk. Podujatie sa uskutoční online v polovici septembra a ponúkne jedinečnú príležitosť nazrieť do zákulisia vývoja veľkého jazykového modelu prispôsobeného pre jazyk s obmedzenými zdrojmi. Prednášajúcim bude Domen Vreš z Univerzity v Ľubľane, Fakulty informatiky a počítačových vied, ktorý sa dlhodobo venuje výskumu v oblasti spracovania prirodzeného jazyka a umelej inteligencie.