Building the World’s Most Powerful Foundation Models for Tabular Data
Our research is focused on a foundational challenge in machine learning: building scalable, general-purpose models for real-world tabular data.
We prioritize the following themes:

Meta
learning

Architecture
research

Generative
modeling

Large scale
systems

Code
generation

Structured
data
Developing Foundation Models for Real-World Tabular Data
Many landmark breakthroughs in supervised deep learning can be distilled into tabular prediction problems. Historically, however, each advancement has required immense, specialized resources. We propose a paradigm shift: the development of a universal predictor that leverages shared experience across billions of examples to adapt to novel tasks via in-context learning. Our objective is to build a foundation model for structured data where previous breakthroughs become mere queries to a single system. In this paper, we argue that current foundation model architectures are ill-suited for this task and outline our approach to solving it. This work serves as the research manifesto for Fundamental.
Authored by

Marta Garnelo
Chief Science Officer
Research interests include meta learning, multi-agent reinforcement learning and generative modelling.
Google Scholar Profile

Wojciech Marian Czarnecki
Founding Advisor
Research interests include learning theory, deep reinforcement learning and open ended learning systems
Google Scholar Profile
Meet Some of the Team
Powering Fundamental

Research Environment
Fundamental is built around rigorous research, careful experimentation, and long-term technical ambition. We aim to create an environment where foundational questions can be explored deeply, and where research transitions thoughtfully into real-world systems.
Crucially, we care as much about who we are as what we build; we’re a tight-knit team that prioritizes mutual respect, kindness, and a shared sense of purpose.

Join Us
We are looking for exceptional researchers and engineers who identify with our vision and values. For researchers interested in foundational problems at the intersection of machine learning, structured data, and decision systems, Fundamental is a place to work on problems that matter.
First
Principles
A series of interviews between our Chief Science Officer and key players in the research community.
Beyond Bigger Models: From StarCraft to Representation
Marta Garnelo, Chief Science Officer
Wojciech Czarnecki, Founding Advisor








