Activation Functions | Deep Learning Tutorial 8 (Tensorflow Tutorial, Keras & Python)




[ad_1]

Activation functions are very important in building a non linear model for a given problem. In this video we will cover different activation functions that are used while building a neural network. We will discuss these functions with their pros and cons,
1) Step
2) Sigmoid
3) tanh
4) ReLU (rectified linear unit)
5) Leaky ReLU
We will also write python code to implement these functions and see how they behave for sample inputes.

Github link for code in this tutorial: : https://github.com/codebasics/py/blob/master/DeepLearningML/2_activation_functions/2_activation_functions.ipynb

Next video: https://www.youtube.com/watch?v=cT4pQT5Da0Q&list=PLeo1K3hjS3uu7CxAacxVndI4bE_o3BDtO&index=9

Previous video: https://www.youtube.com/watch?v=iqQgED9vV7k&list=PLeo1K3hjS3uu7CxAacxVndI4bE_o3BDtO&index=7

Deep learning playlist: https://www.youtube.com/playlist?list=PLeo1K3hjS3uu7CxAacxVndI4bE_o3BDtO
Machine learning playlist : https://www.youtube.com/playlist?list=PLeo1K3hjS3uvCeTYTeyfe0-rN5r8zn9rw  

Prerequisites for this series:   
1: Python tutorials (first 16 videos): https://www.youtube.com/playlist?list=PLeo1K3hjS3uv5U-Lmlnucd7gqF-3ehIh0    
2: Pandas tutorials(first 8 videos): https://www.youtube.com/playlist?list=PLeo1K3hjS3uuASpe-1LjfG5f14Bnozjwy
3: Machine learning playlist (first 16 videos): https://www.youtube.com/playlist?list=PLeo1K3hjS3uvCeTYTeyfe0-rN5r8zn9rw  

Website: http://codebasicshub.com/
Facebook: https://www.facebook.com/codebasicshub
Twitter: https://twitter.com/codebasicshub
Patreon: https://www.patreon.com/codebasics

Source


[ad_2]

Comment List

  • codebasics
    November 23, 2020

    sir thank u so much

  • codebasics
    November 23, 2020

    i am using multiclass (let's say 10-20 )categorical values as an labels, and numerical + categorical as non-label..i am using label encoding for that…tried several machine learning models and now planning to use deep learning as well.can you suggest which activation function would work best for multiclass?

  • codebasics
    November 23, 2020

    useful video

  • codebasics
    November 23, 2020

    Just love the way you explain.

  • codebasics
    November 23, 2020

    👏🏻👏🏻

  • codebasics
    November 23, 2020

    Thanks for the great tutorial….
    Not sure if this query is right. Sir, while explaining ReLU the mark of 1 at y-axis is not correct, I guess……Please correct me if I am wrong….:-)

  • codebasics
    November 23, 2020

    Really very intuitive indeed!🙏🙏🙏🙏

  • codebasics
    November 23, 2020

    Sir please include softmax activation fuction also..can u give me brief of it…because i m using it in my project

  • codebasics
    November 23, 2020

    every video, a new learning is guarenteed

  • codebasics
    November 23, 2020

    Thank you very much! Such a great explanation. Thank you for explaining the pitfalls in the activation functions – it is for the first time I hear them.

  • codebasics
    November 23, 2020

    Hi I get an error module 'tensorflow' has no attribute 'get_default_graph'….How do you solve this ..I ried with 2.X version initially and changed 1.15 to see if the issue goes or not..but no success

  • codebasics
    November 23, 2020

    Thank you for such an amazing tutorial!

  • codebasics
    November 23, 2020

    Your explanations are always classic and very detailed even undergraduate student can start learning DL during his course.
    Keep it up sir….keep good health.

  • codebasics
    November 23, 2020

    THE BEST video series for dl, I hope its not the last video on the list. Waiting for the next one, impatiently!

  • codebasics
    November 23, 2020

    Nice tutorial. How do you make the drawings used in your presentation?

  • codebasics
    November 23, 2020

    Sir, Can you also please recommend for individuals who cannot process tensor-flow on older cpu's then can use "colabs' which is nothing but a version of jupyter notebook hosted by Google and is available at colabs.google.com and is FREE

  • codebasics
    November 23, 2020

    Well explained sir…waiting for next video

  • codebasics
    November 23, 2020

    sir u have not covered the softmax part. can u suggest something for the reference purpose

  • codebasics
    November 23, 2020

    Sir my Laptop 4GB Ram and
    OS—-window
    1TB
    Can I perform practical of Deep learning using 4GB Ram
    Sir Please reply

  • codebasics
    November 23, 2020

    well done

  • codebasics
    November 23, 2020

    Awesome explanation plz continue this series

  • codebasics
    November 23, 2020

    Simply fantastic

  • codebasics
    November 23, 2020

    🤩✌️

  • codebasics
    November 23, 2020

    sir what ah explanation , it seems so easy to learn deep learning,carry on your winning momentum , hope you become one of the great teachers in data science🔥🔥🔥🔥🔥🔥🔥🔥🔥

  • codebasics
    November 23, 2020

    Is softmax and step function somewhat same or different?

  • codebasics
    November 23, 2020

    I am watching your video since beginning. All is amazing Sirji.

  • codebasics
    November 23, 2020

    Hello sir… your videos are great. I need your small help. I am a BE IT student. Can you suggest me project idea for final year. My Domain is machine learning and deep learning and I want use some part of computer vision. This would be great help if you suggest me topic. Thanks in advance.

  • codebasics
    November 23, 2020

    Excellent series, clearly explained Thanks.

  • codebasics
    November 23, 2020

    Thanks

  • codebasics
    November 23, 2020

    i feel deep learning is an easy technique, when watching ur lecture series.

  • codebasics
    November 23, 2020

    Understood well…thanks sir!!

  • codebasics
    November 23, 2020

    Sir, what is the significance of traditional ML algorithms (eg: Linear Regression, Random Forest etc) if deep learning is becoming so popular?

  • codebasics
    November 23, 2020

    Thanks for the video .. wish you all the best

  • codebasics
    November 23, 2020

    hello sir, hope you are fine
    improve and recover soon

  • codebasics
    November 23, 2020

    Hey sir I had finally decided to do bsc in statistics then msc in data science and last pg in data science

    These will be good?

  • codebasics
    November 23, 2020

    I like your all videos

Write a comment