Proud of being Poles - read the new issue of the Coopernicus Quarterly!
Knowledge article main photo
The Polish value of AI – discovering the genetic code of ChatGPT-4

In the ever-evolving landscape of artificial intelligence, ChatGPT is a testament to remarkable advances in natural language processing. From its inception to its latest versions, ChatGPT has undergone a fascinating evolution, transforming from a text-based conversational model to a comprehensive language generator. Can you trace Polish roots in the chatbot’s evolution?

Evolution

The GPT-1 model, introduced in 2018, demonstrated the power of transfer learning with its 12-layer transformer architecture, demonstrating the ability to learn from scratch and laying the foundation for subsequent models. In 2019, GPT-2 appeared with a tenfold increase in parameters (1.5 billion) and dataset size, increasing its ability to handle a variety of language tasks. GPT-2’s improved accuracy in identifying long dependencies and predicting sentences has prepared the ground for GPT-3. 

To further develop ChatGPT’s capabilities, OpenAI introduced reinforcement learning (one of the mainstreams of machine learning). The model has been fine-tuned based on user feedback, giving it a more insightful and informed understanding of the context and preferences conveyed by users. This is a step toward a more informed and personalized user interaction. 

In an effort to balance security and openness, OpenAI has introduced ChatGPT+. The subscription-based model supports the continued availability of free access while funding further research and development – an approach designed to strike a balance between maintaining an open platform and controlling the use of the technology.

The future of ChatGPT is to achieve Turing completeness, that is, the ability to perform any computation a Turing machine can perform. Pursuing such intelligence means sharpening the model’s ability to understand and solve problems. 

ChatGPT 4 new era of AI communication

On March 14, 2023, OpenAI introduced the latest version of its artificial intelligence model, GPT-4. It represents a breakthrough in machine communication capabilities and opens up new horizons by enabling the processing of text, images and videos – making it an extremely versatile tool for a wide variety of fields. [1] GPT-4, decidedly advanced compared to its predecessor, GPT-3.5, offers a 10-fold leap in efficiency. One of the key differences between ChatGPT-4 and ChatGPT-3 is the ability to analyze graphical objects. ChatGPT-4 can recognize objects in graphics and photos, generating precise image descriptions. It offers more advanced text complexity, enabling the creation of complex sentence structures and consideration of complex relationships between words. ChatGPT-4’s innovative capabilities include better support for multiple languages. The model can generate high-quality content in 50 different languages, automatically translating texts between them. This is a significant improvement for global communication.

Polish DNA

The success of the ChatGPT-4 is not only a testament to technological advances, but also a confirmation of the talent of Poles. Three graduates of the 3rd High School with Bilingual Branches named after the Polish Navy in Gdynia had a hand in the development of the AI tool. Jakub Pachocki is a graduate of computer science at the University of Warsaw and a PhD student at Carnegie Mellon University. He has been at the forefront of lists of the world’s best programmers for years.  In addition to Jakub Pachocki, the team working on AI includes Szymon Sidor, and Filip Wolski. [2] Scientist – Szymon Sidor, participated in the Computer Science Olympiads together with Dr. Pachocki. After graduating from high school, he decided to continue his education at a renowned university – Cambridge University in the UK, despite the availability of studies at the University of Warsaw. Immediately after graduating from Cambridge, he focused on the field of robotics at the Massachusetts Institute of Technology. Filip Wolski is a computer scientist who achieved the title of world champion in programming, triumphing at both the 18th International Olympiad in Computer Science in Mexico and the 31st World Academic Team Programming Championships in Japan.

Ryszard Szubartowski, a lecturer with the title of IT Superbelfr of the Year 2023, played the role of academic mentor – a teacher of computer science for the graduates of the aforementioned school in Gdynia. He was responsible for their education during the three-year period of study at Middle School No. 24 at the Third High School in Gdynia, and for another three years at the Third High School. A teacher plays a key role in education, not only imparting knowledge, but also inspiring and igniting students’ curiosity. By expressing passion and curiosity about a subject, he can effectively transfer this energy to his charges. 

During the 2023 meeting, in Warsaw, Sam Altman said: “I don’t know what Poland is doing that produces such technical talent.” OpenAI co-founder Wojciech Zaremba, for his part, stressed that “Polish universities produce the highest level of knowledge.” We keep our fingers crossed for the next successes in technological development of Poles!

Bibliography:

[1] All about ChatGPT, ChatGPT – history and versions, 18.04.2023 https://ochatgpt.pl/historia-i-wersje/ [accessed 13.01.2023].

[2] Aneta Marczak, Trinity graduate creator of new ChatGPT, 02.01.2024, https://www.gdynia.pl/mieszkaniec/nauka-2,7718/absolwent-trojki-tworca-nowego-chatgpt,578676  [accessed 13.01.2023].

Cover photography generated by AI, Leonardo.ai

Zuzanna Czernicka
Bio:
I am deeply immersed in the dynamic world of banking and FinTech. My focus encompasses critical areas such as foreign exchange, payments, and the cutting-edge landscape of FinTech regulation. My academic interests span a broad range of topics including electronic payments, Open Banking, blockchain impacts, the DeFi ecosystem, NFTs, ICOs, and tokenization. I am dedicated to understanding and analyzing the new regulatory frameworks shaping the FinTech world. Currently, I am writing my Bachelor's thesis on the robo-advisory services. This work reflects my commitment to understanding and contributing to the regulatory frameworks that are vital for the growth and governance of emerging financial technologies.
Written by:

Zuzanna Czernicka

Leave a comment