Introduction to Deep Learning Project

Welcome to Block C !! In this module of 4 weeks, you will be continuing your Machine Learning module from Block B. You will start with the building block Perceptrons, to eventually make your own image classifier using deep neural networks.

Note: Deep learning is a subset of Machine Learning

Fairness

When is it considered Deep learning?

In Machine learning feature extraction is an important data processing step, which requires complex mathematical algorithms (mostly designed by experts). In case of deep learning the program is able to find patterns in data to build solutions without the complex feature extraction steps. For example, in 4 weeks from now, you will be be able to create a program which can conclude whether a patient has Pnemonia or not !

Fairness

So, let's get started in this exciting project… Before we go to the next steps, keep in mind some terms that you may across during your research "More layers of Neural Networks" is same as saying "Deep Neural Networks" a.k.a "DEEP LEARNING".

Morning's Objectives:

  1. To get an overview of problem scenarios that Neural networks can solve.
  2. To understand the basic terminology in neurons and neural netowrks
Tip

Pro Tip !!

Take notes of what new concepts are being discussed. You can take notes in the DL-notes.docx file in your Block C Microsoft Teams assignment. This notes document is automatically part of your evidence for assessment.

2) What is a Neural Network ?

watch this video from Andrew Ng to get an intuition of Neural networks:

After watching the video, think about these points, and try to keep notes of your findings

2a can we predict the house price based on house size by using Linear regression technique? In case you are not sure, a revisit to linear regression will be a good idea.

2b Does it make sense to call neural networks a subset of machine learning ?

2c Did you take notes of all the new terms you heard in this video?

3) Supervised Learning with Neural Network

watch this video to get an overview of Application of Neural Networks, Structured and unstructured data.

After watching the video, think about these points, and try to keep notes of your findings

3a What all forms of input data exsists ? What sort of application they can be used for? (any form from the video above that you can relate to, or if you can find some more yourself, it will be awesome)

3b Try to think of any application for Neural Networks and correspondingly what sort of input data will you need for the application.

3c [optional] What is temporal factor in input data and how is it important for Speech recognition application?

3d Did you take notes of all the new terms you heard in this video?

4) Why Deep learning is rising recently ? [Optional]

watch this video to get an overview of the main drivers behing the rise of deep learning.

5) Reading time…

Now, the next steps in getting better overview of deep learning and fundamentals of neurons, lets dive into our favourite Codecademy page. Open the Build Deep Learning Models with TensorFlow Path on Codecademy and complete the module:

1) Welcome to the Build Deep Learning Models with TensorFlow Skill Path

  • 2 informational articles

2) Foundations of Deep Learning and Perceptrons:

specifically these:

  • Article: What is Deep Learning
  • Article: What is Neural Networks
  • Article: Dangers of Black Box

LUNCH !!

Next up!

After Lunch you will revisit some of the data structures and get introduced to tensor for the maths requirement of Neural networks. Don't worry, its easy as TensorFlow does most of the heavylifting for you, you just need to know how to use and apply the interfaces for your projects.


Additional resources [Optional]

-https://blog.dataiku.com/when-and-when-not-to-use-deep-learning#:~:text=One%20of%20the%20main%20advantages,large%20number%20of%20interdependent%20variables.