A whistle-stop history of artificial intelligence — from the 1956 Dartmouth workshop to where the technology sits today, and what 70 years of cycles tell us about deploying it sensibly now.
Read transcript
You know, when you're standing on the deck of a ship in freezing waters and like you see an iceberg,
your brain naturally focuses entirely on the part sticking out of the water.
Right. The visible part.
Exactly. It's bright. It's, you know, jagged. It's reflecting the sun right there in front of you.
You look at it and you just think about that massive block of ice you can see.
But every experienced ship captain knows that that visible ice is maybe, what, 10 percent of the reality.
Yeah, if that.
Right. The true mass, I mean, the part that actually dictates where that ice is moving, the part with the real kinetic power, is completely submerged in the dark water below.
Which is such a perfect way to look at it.
Because today, for this deep dive, we are applying that exact lens to something that feels like it just suddenly appeared out of nowhere in our daily lives over the last few years.
Artificial intelligence.
So welcome to today's deep dive.
We are looking at this really illuminating infographic created by Sandy Segal and TFIA.
It's titled Layers of AI, Everything You Know.
And they use this exact iceberg metaphor to map out the entire landscape of AI.
And it's so needed because, well, to the average person, AI started around the time they first used like a chat bot that wrote a cover letter for them or something.
Like chat GPT just fell out of the sky.
Exactly. But that visibility completely distorts the timeline. The underlying architecture goes back decades.
Decades. And so our mission for you today is to trace that architecture.
We are going to guide you from the absolute deepest, oldest, completely submerged foundations of AI way down in the dark waters of the 1950s.
And we're going to climb all the way up through the layers to the hottest peak where we currently sit in 2026.
It's a long climb.
It really is. Okay, let's unpack this, starting at the very bottom.
So to understand the AI on our screens today, we have to examine the base upon which everything else rests.
The infographic labels this deepest ocean floor layer classical AI, and it traces it all the way back to the 1956 Dartmouth workshop.
1956, which is wild because that summer research project actually coined the term artificial intelligence.
They did, yeah.
And the ambition was just wild.
I mean, they essentially thought they could map human intelligence and program a machine to simulate it in like a few months.
A very optimistic summer.
Yeah, extremely optimistic.
Yeah.
But looking at what lives in this bottom layer, you can see how they approached it.
We've got symbolic AI, expert systems, knowledge representation, and logic and reasoning.
Right, because symbolic AI completely dominated this era.
It was entirely about explicit rules, you know, manipulating symbols.
Programmers and subject matter experts had to painstakingly write out every single logical step.
Like by hand.
By hand.
It was literally, if condition A is met, execute path B.
It was all about encoding human knowledge into a rigid, searchable format.
My analogy for classical AI is it's like giving a computer a massive thousands of pages long rulebook and a strict set of logic puzzles.
That's a good way to put it.
Like early medical diagnosis programs, right?
If the patient has a fever over 101 and if the patient has a cough, then check for X.
It's essentially a giant exhaustive flow chart.
But the problem there is brittleness.
If a patient presents a symptom that is even slightly outside the encoded syntax, the system crashes or returns an error.
It just cannot adapt.
No, it can't.
Because the combinatorial explosion of the real world makes it literally impossible to write a rule for everything.
Right.
There are too many variables.
Exactly.
The human programmer was the bottleneck.
So to fix that brittleness, researchers realized the machine actually had to write its own rules.
And that conceptual leap happened just three years later.
In 1959.
Yes, 1959 with Arthur Samuel, who is an IBM researcher.
He creates a checkers playing program.
And that marks the discovery of the machine learning layer.
If we connect this to the bigger picture, Arthur Samuel realized that explicitly programming a computer to evaluate every single possible checkerboard state was mathematically unfeasible.
Right, there are just too many board combinations.
Exactly. So he programmed the computer to evaluate board positions, play against itself thousands of times,
and adjust the mathematical weight of certain moves based on whether they led to a win or a loss.
Which is just brilliant. And the infographic lists the core components of this machine learning layer.
It points out supervised and unsupervised learning, classification, reinforcement learning, and regression.
Yeah, those are the big ones.
And for you listening, this represents the vital historical shift.
We are moving from a machine that blindly follows rigid, human-coded logic to one that begins to extract patterns from data on its own.
Yeah. So, like, instead of writing rules to identify a spam email, you use supervised learning.
You feed the algorithm 10,000 emails labeled spam and 10,000 labeled not spam.
Okay.
And then the algorithm calculates the statistical frequency of words like lottery or wire transfer in the spam pile, and it creates its own mathematical filter.
Oh, wow. And what about unsupervised learning?
Unsupervised learning removes the labels entirely.
So you give it, say, a database of customer purchases, and it clusters them into distinct buying personas based on hidden similarities.
Without any human categorization at all.
Not at all.
That's amazing.
And then regression is predicting a continuous output.
Right.
Like forecasting a stock price based on historical trends.
Yeah, exactly.
And reinforcement learning is the Arthur Samuel approach.
You give the system a goal, an environment, and a reward signal, and you just let it optimize its own strategy through trial and error.
Right.
So we're still deep underwater in our iceberg metaphor.
The conceptual groundwork for today's tech is already poured in the mid-20th century.
It is, but traditional machine learning still had a severe limitation, which was feature engineering.
Feature engineering.
Yeah. For a model to classify a house price, for instance, a human first had to define the features.
So square footage, number of bedrooms, zip code.
If you wanted it to recognize a handwritten digit, a human had to write code to detect loops and straight lines.
Oh, I see.
As problems got more complex, humans couldn't effectively define the features anymore.
Because, I mean, you can't write a rule for how a cluster of pixels represents the concept of a cat in different lighting conditions.
Exactly. It's too abstract.
Which brings us moving upward into the middle submerged layers of the iceberg.
The source infographic explicitly points to this section and labels it what makes it all work and crucially, the magic.
The magic. I love that label.
And the first layer of this magic dates back to 1986 created to the PDP group and it's labeled neural networks.
Let me just read some of the terminology listed here because it's basically the fundamental physics of modern AI.
We've got perceptrons, cost functions, backpropagation, activation functions, and hidden layers.
Right.
The PDP group, which stands for Parallel Distributed Processing, they revived the idea of modeling systems after biological neural networks.
Okay, I have to act as the voice of the listener here and just push back on this timeline for a second.
We were talking about hidden layers and backpropagation existing in 1986.
Yeah, 1986.
We've been sitting on this magic for almost 40 years.
I mean, why didn't we have chat GPT in the 90s then?
Well, the math existed, but the environment was incredibly hostile to it.
So a perceptron is simply a mathematical node that takes numerical inputs, multiplies them by assigned weights, and passes them forward.
You stack these nodes into hidden layers to process complex nonlinear information, and then the activation function is the crucial gatekeeper.
What does that do?
It decides whether a node's output is significant enough to pass to the next layer.
It essentially prevents the whole network from collapsing into just one giant flat linear equation.
Oh, okay. I get that.
And the cost function measures the gap between the network's prediction and the actual correct answer.
Yeah.
Which leads us to backpropagation.
Right. Backpropagation is arguably the most important mechanism on this entire infographic.
Really?
Oh, absolutely. It is the calculus, specifically the chain rule used to calculate the gradient of the error.
It takes that error from the cost function and propagates it backwards through the network.
Hence the name.
Exactly. It fine-tunes the individual weight of every single artificial synapse so the network's next guess is slightly more accurate.
So it's an optimization engine.
Yes.
To go back to my timeline question, if they had all this back then...
To answer the timeline question, in 1986, they basically built a Ferrari engine, but they didn't have any gas, and they were driving it on a dirt road.
Ah.
They lacked the massive data sets required to train these weights, and they completely lacked the computational horsepower to process the calculus at scale.
So they're just waiting on the hardware and the data to catch up.
Exactly.
The internet eventually provided the data billions of digitized images and text, and the gaming industry, specifically the development of GPUs, provided the massive parallel compute power.
Which triggered the explosion in the next layer up, the 2012 layer, marked by AlexNet creating the deep learning layer.
Right.
AlexNet entered a famous computer vision competition and literally cut the error rate in half compared to traditional machine learning algorithms.
It was a shockwave.
AlexNet proved that if you stack neural networks deep enough, adding many hidden layers,
and train them on millions of images using GPUs, the network will figure out its own features.
So nobody had to tell AlexNet what a cat's ear looked like.
Nope. The hidden layers abstracted those visual edges and textures entirely on their own.
That is wild. Looking at the deep learning layer here, we see the absolute heavy hitters of modern architecture.
ANNs, CNNs, LSTMs, autoencoders, and transformers.
So ANNs are the broad category artificial neural networks, but the specialized architectures are where the real breakthroughs happened.
CNNs, or convolutional neural networks, they revolutionized vision.
Oh, so?
They use mathematical filters that slide over grids of pixels, pooling information to detect edges, then shapes, then full objects.
They're literally why autonomous vehicles can read stop signs today.
Wow. And autoencoders are equally fascinating to me.
They take high-dimensional data, like a high-resolution image, and force it through a tiny mathematical bottleneck called a latent space.
Right.
The network has to compress the data, stripping away the noise, and then a decoder tries to rebuild the original image from that compressed representation.
It essentially forces the AI to learn the absolute, most essential underlying properties of the data.
Exactly. And then for sequence data, like text or speech, researchers developed LSTM as long, short-term memory networks.
Because traditional networks didn't have memory, right?
Right. Traditional networks processed inputs individually with zero memory of what came before.
LSTMs introduced gates that mathematically decided what information to remember and what to forget as it processed a sequence.
That's what made early translation and speech-to-text possible.
But the limitation of LSTMs was that they had to read sequentially, like word by word.
Yeah.
Which brings us to arguably the most vital term in this entire layer, transformers.
Yes. Introduced around 2017 in a famous paper called Attention is All You Need, the transformer architecture completely discarded the sequential approach.
They introduced the self-attention mechanism.
Exactly. Instead of reading a sentence word by word, a transformer looks at the entire sequence simultaneously.
It assigns mathematical weights to track the relationships between all words, regardless of how far apart they are in a paragraph.
So it instantly understands that the word bank in one sentence refers to a river and in another refers to a financial institution based on the attention weights of the surrounding context.
Yes. And crucially, it's highly parallelizable, which means it could be trained on massive GPU clusters much, much faster than LSTMs.
It's incredible. These dense, submerged layers.
For the logic of 1956, the statistical learning of 1959, the calculus of neural networks in 1986, exploding into deep learning in 2012, they are the absolute engine of modern AI.
They are everything. Every single time you interact with an AI tool today, you are sending a signal down through the deep learning layer, relying on backpropagation from 1986 and statistical concepts from 1959.
Which brings us to a critical visual detail in the infographic.
Right above that 2012 deep learning layer, there is a water line, a beautifully drawn wave separating the underwater depths from the 2017 layer.
We're finally breaking the surface into the section of the source labels, what everyone sees.
The tip of the iceberg emerges.
Right. Here's where it gets really interesting.
We hit the generative AI layer, starting from 2017 onward.
Sitting right here above the water, we have LLMs, large language models, diffusion models, VAEs, and multimodal models.
This is the era where AI transitioned from just identifying and classifying data to synthesizing entirely new data based on the underlying distributions it learned.
So an LLM is simply a massive transformer model that has analyzed so much text, it can predict the next statistically probable word with terrifying accuracy.
Yep.
But the visual generation is where the math feels truly magical.
Let's look at diffusion models, which power things like Midjourney or Deli.
Confusion is just a brilliant reversal of entropy.
During training, you take a clean image of a dog and systematically corrupt it by adding Gaussian noise statics step by step until the image is nothing but a television screen of static.
And then you train a deep learning model to reverse that specific mathematical process to predict the noise and subtract it.
So when you prompt a diffusion model to generate a new image, it starts with a canvas of pure random static and runs that denoising process backward, guided by your text prompt, and it basically hallucinates the image out of the noise.
Exactly. And VAE's variational autoencoders operate on a similar principle of generation.
Instead of compressing data into a fixed rigid point in that latent space we mentioned earlier, VAEs map data to a probability distribution.
Which does what exactly?
It allows the model to sample from that distribution and smoothly generate novel continuous outputs.
I see. And multimodal models just take these different architectures and stitch them together, right?
Pretty much. They fuse the text processing power of transformers with the visual processing power of CNNs and diffusion.
So the model can process a spreadsheet, read a PDF, look at a photograph, and output an audio summary.
My analogy for generative AI is that it's a charismatic, highly capable surface-level performer.
It writes the code, it composes the music, it drafts the emails.
But this performer is entirely propped up by the unseen physics underneath.
The LM doesn't exist without the transformer's attention mechanism.
The diffusion model relies entirely on the convolutional neural networks
doing the calculus of the noise reduction.
What's fascinating here is how this visibility dictates public perception.
Because generative AI is what everyone sees on their screens,
society just assumes AI started with these generative tools.
Right, like it's brand new.
Exactly. But the infographic corrects that illusion.
Generative AI is just the current application layer.
It's the deep learning engine trained specifically to map and traverse latent spaces.
But despite how impressive it is, generative AI has a hard limit.
It is entirely passive.
Highly passive.
An LLM sits dormant on a server until a human types a prompt.
It generates the next sequence of tokens, outputs the response, and then goes back to sleep.
It has no agency, no continuous thought process, and no ability to affect the world outside of its text box.
And that limitation is what forces the next paradigm shift.
to move from a system that generates content to a system that executes objectives.
Which means we leave the surface-level creation tools and scale the very top of the iceberg.
The layer marked with a little crown and labeled Hottest.
The source points a little arrow right here and says, we are here.
2026.
Agentic AI.
Agentic AI.
We have climbed from 1956 to 2026.
The agentic AI layer started to emerge around 2022, but is hitting terminal velocity right now.
Unpacking this peak, we see four crucial pillars that separate it from everything below.
Memory, planning, tool use, and autonomous execution.
Memory completely alters the interaction.
A standard LLM has a limited context window.
Once the chat resets, it forgets you exist.
Right. It's starting from scratch every time.
Exactly.
But Agentic AI utilizes external memory banks, often via vector databases.
It takes your past interactions, converts them into high-dimensional mathematical embeddings, and stores them.
So when you give it a new task, it queries that vector database to retrieve your preferences,
previous project context, and past errors to inform its current response.
Yes. And then planning takes that context and operationalizes it.
A generative model just spits out the next word.
But an agentic system utilizes reasoning frameworks like chain of thought or tree of thoughts.
So if you give it a complex goal, like audit my company's AWS infrastructure and reduce costs,
it doesn't just write a generic essay about cloud computing.
No, it breaks the goal into a dependency graph of subtasks.
Step one, authenticate into the system.
Step two, pull usage logs.
Step three, analyze instances against current pricing models.
But knowing the steps is useless without tool use, right?
Exactly.
The AI is no longer trapped inside its pre-trained weights.
If an agent needs current financial data, it independently writes a Python script,
queries a live Bloomberg API, retrieves the JSON data, and parses it.
Wow.
It manipulates browser engines to navigate web pages, clicking buttons, and filling out forms exactly like a human user would.
And that culminates in the final pillar at the absolute peak of the iceberg, autonomous execution.
Frameworks like React Reason and Act create a continuous loop.
That's the real game changer.
The agent reasons about its current state, takes an action using a tool, observes the output of that action, and reasons about whether it moved closer to the goal.
If a Python script throws an error, the agent reads the error log,
debugs its own code, rewrites it, and executes it again without ever asking the human for help.
It is the shift from a digital oracle to a digital laborer.
So what does this all mean?
We look at generative AI, and we are amazed by its ability to synthesize data.
But agentic AI with vector memory, chain of thought planning, and react loops
actually takes action in the real world.
Your relationship with this technology flips.
You are no longer prompting a model for an answer.
You are deploying an eponymous system with a budget and an objective,
leaving it to execute a multi-day plan on your behalf.
You transition from an end user to a manager of digital agents.
Which is a massive shift.
Yeah.
And understanding this visual stack, this whole iceberg,
really protects you from the sheer noise of the tech industry.
Every day there's a new AI buzzword, a new startup, a new paper published.
It causes massive information overload.
It really does.
But when you hold this mental model of the iceberg, you instantly categorize new information.
When a research paper details a new way to optimize matrix multiplication in neural networks, you categorize that underwater.
That is foundational physics.
Right. And when a company launches an app that turns text into 3D video game assets, you know that it's surface level generative AI.
Exactly. And when an enterprise software company announces a system that monitors supply chains,
negotiates with vendors via email, and signs digital contracts autonomously,
you place that firmly at the agentic peak.
It gives you a cognitive map so you aren't drowning in jargon.
So let's quickly summarize this climb for everyone listening.
We started Deep Underwater in 1956,
where classical AI forced computers to follow brittle, human-coded logic puzzles.
We moved to 1959, where machine learning used statistics
to let algorithms learn their own filters from data.
Then we entered the magic layers of 1986 and 2012, where backpropagation, neural networks, and deep learning allowed machines to abstract their own features across hidden layers.
We broke the surface in 2017, where the massive scale of transformers and diffusion models allowed generative AI to reverse those processes and synthesize new text and imagery.
And now in 2026, we stand at the crowned peak of egenic AI, closing the loop with memory, planning, and autonomous execution.
The overnight success of artificial intelligence is really the result of a relentless, layered, 70-year mathematical climb.
It really is, which leaves me with a final provocative thought for you to ponder as we wrap up this deep dive.
We've traced the layers of this iceberg, each one painstakingly conceptualized and built by researchers, mathematicians, and computer scientists.
But if we are now at the peak, if agentic AI possesses autonomous execution, if it can use tools,
And if it can write and debug its own code to solve complex reasoning problems, what happens when it is tasked with building the next layer of the iceberg?
The feedback loop closes completely.
Exactly.
Will the layer that sits above 2026 be researched and coded by human hands, like every single layer below it?
Or will the new architectures, the new latent spaces, and the next evolutionary breakthroughs be autonomously generated by the agents themselves?
because the next time you look out at the water and see that shining tip of the AI iceberg,
you really have to ask yourself, going forward, who is actually building this ship?