Machine learning vs. deep learning: what’s the difference?
Machine learning and deep learning are both hot topics and buzzwords in the tech industry. You’ll hear these topics in the context of artificial intelligence (AI), self-driving cars, computers beating humans at games, and other newsworthy technology developments. If you’re new to the AI field, you might wonder what the difference is between the two.
Think of it this way: deep learning and machine learning are both subsets of artificial intelligence. And, deep learning is a subset of machine learning. Machine learning is an AI technique, and deep learning is a machine learning technique.
Last Updated July 2020
Complete hands-on machine learning tutorial with data science, Tensorflow, artificial intelligence, and neural networks | By Sundog Education by Frank Kane, Frank KaneExplore Course
Machine Learning is One of Many AI Techniques
In the early days of AI, the field relied on hard-coded rules and algorithms. Playing chess against an AI is an exercise in brute computational force; the computer program looks ahead at every possible series of moves and chooses the move with the best outcome. AI chatbots can hold a “conversation” with you by looking for certain words and phrases provided by the user. It then replies with canned responses a programmer thought of ahead of time (modern virtual assistants still rely on this technique). While these systems may seem intelligent, they depend on their programmed intelligence – they have no ability to learn with experience on their own.
Machine learning flips that on its head. Instead of relying on hard-coded rules to solve problems, a machine learning algorithm is trained by feeding it real-world data. Machine learning then builds a model that looks for patterns between the data you give it and the thing you’re trying to predict. That model can make predictions for new things it’s never seen before. As the model is exposed to more and more training data, its accuracy gets better and better.
Top courses in Machine Learning
As a simple example, imagine you want to build a system that can predict the sale price of a house based on the attributes of that house. You might train a machine learning algorithm by feeding it historical data of house sale prices, together with things like the home’s location, square footage, number of bathrooms, age, etc. The algorithm would start to find how these different properties of a house affect its sales price and build up a model that understands how each attribute affects the ultimate price of the home. For new houses going on the market, this machine learning algorithm could use the model to predict its sales price automatically. And as more and more home sales are fed into the system over time, its accuracy will get better and better.
This machine learning system isn’t relying on ruled programmed by a human; rather, it is learning them based on real data.
Deep Learning is One of Many Machine Learning Techniques
How might that house pricing system work? It’s actually rather simple; you could plot the various attributes such as square footage against the sale prices you are training the system with, fit a curve to each one, and use those curves to predict prices of new houses that are hitting the market. That’s called multiple regression.
Or, you could build a decision tree that learns a hierarchical series of decision points that lead to an accurate price prediction. It might start with a price range for a given area, refine that by the size of the house, refine that further by the house’s age, and so on until a final price is estimated. These are just two of many machine learning algorithms we might employ, but neither of them is what we call “deep learning.”
Empower your team. Lead the industry.
Get a subscription to a library of online courses and digital learning tools for your organization with Udemy for Business.
Deep Learning as Complex Artificial Neural Networks
Though deep learning is another machine learning technique, it has attracted attention because it is very flexible – and inspired by how our own human brain works.
Deep learning systems are made of layers of virtual neurons. Each neuron’s job is to simply add up the inputs coming into it and decide whether to fire off an output signal to the next layer of neurons above it.
Every neuron in a layer is connected to every neuron in the layers of the network above and below it. By learning the optimal weights for each of these connections, this neural network can solve a wide variety of problems, in much the same way your own brain does. Even though a neural network is a simple concept, the sheer number of connections between neurons means they can represent very complex problems.
An example of a neural network
Coming back to the real estate pricing example, all the attributes in your training data (location, size, etc.) are processed to be on a similar scale and fed into the neurons at the bottom-most layer of your neural network. Through multiple iterations, the neural network arrives at the best set of weights between its connections to produce an accurate price prediction at the output of its top-most layer. Once this neural network has been trained with the best weights between neurons, it can start to quickly predict prices for new houses the model hasn’t seen before.
When the number of layers in a neural network is more than one, we say it is a deep neural network. And this is what we mean by the term deep learning. A deep learning model is a machine learning system implemented by a deep neural network.It’s not a case of machine learning vs. deep learning; deep learning is a machine learning technique – and a very exciting one! We’ve only scratched the surface of it here; there’s much more to learn.