Python Data Science Tutorial: Analyzing the 2019 Stack Overflow Developer Survey




[ad_1]

In this video, we will be learning how to use analyze survey data in Python.

This video is sponsored by Brilliant. Go to https://brilliant.org/cms to sign up for free. Be one of the first 200 people to sign up with this link and get 20% off your premium subscription.

In this Python Programming video, we will be learning how to download and analyze real-world data from the 2019 Stack Overflow Developer Survey. This is terrific practice for anyone getting into the data science field. We will learn different ways to analyze this data and also some best practices. Let’s get started…

The code from this video can be found at:
http://bit.ly/SO-Survey-2019

CSV Tutorial – https://youtu.be/q5uM4VKywbA
Jupyter Notebooks Tutorial – https://youtu.be/HW29067qVWk

✅ Support My Channel Through Patreon:
https://www.patreon.com/coreyms

✅ Become a Channel Member:
https://www.youtube.com/channel/UCCezIgC97PvUuR4_gbFUs5g/join

✅ One-Time Contribution Through PayPal:
https://goo.gl/649HFY

✅ Cryptocurrency Donations:
Bitcoin Wallet – 3MPH8oY2EAgbLVy7RBMinwcBntggi7qeG3
Ethereum Wallet – 0x151649418616068fB46C3598083817101d3bCD33
Litecoin Wallet – MPvEBY5fxGkmPQgocfJbxP6EmTo5UUXMot

✅ Corey’s Public Amazon Wishlist
http://a.co/inIyro1

✅ Equipment I Use and Books I Recommend:
https://www.amazon.com/shop/coreyschafer

▶️ You Can Find Me On:
My Website – http://coreyms.com/
My Second Channel – https://www.youtube.com/c/coreymschafer
Facebook – https://www.facebook.com/CoreyMSchafer
Twitter – https://twitter.com/CoreyMSchafer
Instagram – https://www.instagram.com/coreymschafer/

#Python

Source


[ad_2]

Comment List

  • Corey Schafer
    December 1, 2020

    I hope everyone finds this useful. Going out and practicing with real-world data like this is one of the best (if not the best) way to practice your skills. If any of you do your own analysis that's interesting then be sure to share it with us in the comment section below!

    PS I forgot to mention that as usual, the code for this video can be found in the description section.

  • Corey Schafer
    December 1, 2020

    I liked the incremental approach of coding by examples .

  • Corey Schafer
    December 1, 2020

    Hey can you analyse it using numpy library

  • Corey Schafer
    December 1, 2020

    Awesome tutorial, thanks Corey!

  • Corey Schafer
    December 1, 2020

    Great tutorials sir , I always wondered How to learn python because everything in the python is like random but your videos give me the best explanation ever, I want to contribute to your channel How can I do that Can you please tell me ?

  • Corey Schafer
    December 1, 2020

    Sorry. I am getting error messages… 'for line in csv.reader: row = next(self.reader) etc

  • Corey Schafer
    December 1, 2020

    for line in csv_reader :
    counts[line['hobbyist'] ] += 1
    really great idea for increment on counts dict

    thanks

  • Corey Schafer
    December 1, 2020

    Why don't you create a video on how to deploy code from your development to higher environment properly. How to make sure all the dependency will be installed folders are created and code is executed

  • Corey Schafer
    December 1, 2020

    It seems like Counter() could be a topic of its own. I need to dig more into that. Awesome code-along experience!

  • Corey Schafer
    December 1, 2020

    Is the video with pandas-way out? 🙂

  • Corey Schafer
    December 1, 2020

    It didn't work somehow and I had to do a google search on my error: 'charmap' codec can't decode byte 0x81 in position 5739.
    So I had to change the with open part and specify the encoding part, after that everything worked fine.

    with open('data/survey_results_public.csv', encoding='utf-8') as f:

  • Corey Schafer
    December 1, 2020

    Hey Corey, I have seen the previous videos on DataFrames with Pandas where you used Jupyter as well. You mentioned in this video that it is nice that you can run code brackets or just certain lines of code.
    My question would be then, what is the difference between Jupyter and Spyder? Since Spyder can also execute certain code lines, without loading everything in again and has a super awesome functionality where you have a variable manager in which you can view every variable you declared.

  • Corey Schafer
    December 1, 2020

    it blew my mind.

  • Corey Schafer
    December 1, 2020

    @corey: when to expect some data science real life projects?

  • Corey Schafer
    December 1, 2020

    Just what I needed to start off my winter break. I can't wait for your pandas series! Keep up the great work Corey.

  • Corey Schafer
    December 1, 2020

    Looking forward to seeing a future video where pandas is used to analyze this same data. Really appreciated your stepping through the thought process, something I haven't seen in many other data science tutorials. Approaches to data cleaning is another interesting topic that would be nice to see covered in a future video. Recently there were these FEC reports… 🙂

  • Corey Schafer
    December 1, 2020

    Great video! This video helped me soooooooo much!

  • Corey Schafer
    December 1, 2020

    Please make this the first of a Data Science playlist. PLEASE.

  • Corey Schafer
    December 1, 2020

    Where are you're videos man. I check every day. 🙁 lol

  • Corey Schafer
    December 1, 2020

    Hi great Corey ! Thank you very much on your channel , your flask tutorial is the best i ever seen ! Please could you do a flask-api tutorial too ?

  • Corey Schafer
    December 1, 2020

    More please sir..(:-

  • Corey Schafer
    December 1, 2020

    In case anybody ran into an error like "UnicodeDecodeError: 'charmap' codec can't decode byte 0x81" while reading the csv file like I had, the fix is to add a encoding='utf-8' parameter to the with open() function. e.g. with open('survey_results_public.csv', encoding='utf-8') as f:

  • Corey Schafer
    December 1, 2020

    Finally, i understand analyzing Data in Python! I went from Coursera via EDX, UDEMY etc. But this…. this is a pure gold sir! Please, do some course or learning path for Data Science with Machine Learning in Python in depth( let it be if needed a paid learning path). You are one of the best! If you somehow manage to come in Macedonia, tell me, i want to bow before you!

  • Corey Schafer
    December 1, 2020

    Your videos are awesome. I am new to Python and preparing for Python certification. Can you please let me know which one of the following programs are good to proceed? Thanks in advance.

    1. PCAP: Programming Essentials in Python from Netacad
    2. Microsoft 98-381 Introduction to Programming Using Python

  • Corey Schafer
    December 1, 2020

    @Corey, I love watching your videos when I have my morning coffee. It's elegant and super informative. Thank you!

  • Corey Schafer
    December 1, 2020

    your tutorials are the best i've never watched, even paid ones from udemy aren't that good than yours, thanks for these great lessons Corey…
    really what 's missing from your courses is some practice exercises, i hope you'll make some videos about that, and they should be oriented real world projects.
    another thing, i think you should make a tutorial about python and sell it on udemy or lynda…etc,

  • Corey Schafer
    December 1, 2020

    Corey please create a tutorial on python coroutine.. async await its so confusing .. please

  • Corey Schafer
    December 1, 2020

    Love your videos. Just wish it didn't take long to release them. I'm always checking for new videos. I understand you're probably busy. Keep it up though! I've learned so much from you!

  • Corey Schafer
    December 1, 2020

    Great vid! Really helpful, could you possibly do a Pandas version of this?

  • Corey Schafer
    December 1, 2020

    Corey – Did you end up deciding to stay with Sublime or are you still thinking of migrating over to VSCode?

  • Corey Schafer
    December 1, 2020

    Hey Corey, we've talked in the comments before about Youtube, getting started, etc. Would love your feedback on my channel, thumbnails, topics, anything you think would help me grow and gain a larger audience. If you don't wanna respond here, my instagram is @mitchell96w. Seriously any feedback would be awesome and I would really appreciate it. Love your vids as always. Hope you had a good halloween.

  • Corey Schafer
    December 1, 2020

    yes, please pandas

  • Corey Schafer
    December 1, 2020

    Can you do something for home bill management?

  • Corey Schafer
    December 1, 2020

    If anyone else is facing the UnicodeDecodeError try adding this second argument to the open function =>
    with open('data/survey_results_public.csv', encoding="utf8")

  • Corey Schafer
    December 1, 2020

    Looking forward the panda series boss. Thank you for all your hard work

  • Corey Schafer
    December 1, 2020

    Your videos are great and is probably the most easily understandable in all of youtube.
    Also, can you make videos about implementing AI in python cause there are not any good ones that meet your standard

  • Corey Schafer
    December 1, 2020

    I'm definitely interested in a future tutorial of using pandas with this data! Otherwise a fantastic job

  • Corey Schafer
    December 1, 2020

    30 minutes:
    requires the following to pass bad data…

    try:
    # put the code here

    except AttributeError:

    pass

  • Corey Schafer
    December 1, 2020

    Hi Corey, thank you for the content you put out, it is beyond exceptional. Also, it would be great if you could make an in-depth course on SpaCy, and its application in Data Science.

  • Corey Schafer
    December 1, 2020

    nice vid! thanks

  • Corey Schafer
    December 1, 2020

    On inspection of the data. The csv.DictReader(f) throws 594 errors in the for loop >> line in csvReader:
    Not sure what causes the error, but this exists.

    Needs to be handled with
    try:
    except UnicodeDecodeError:

    who else sees this ?

  • Corey Schafer
    December 1, 2020

    for line in csvReader: failed on line 16.
    UnicodeDecodeError: 'charmap' codec can't decode byte 0x81 in position 5739: character maps to <undefined>

    problem with the data-set or other reason ?

  • Corey Schafer
    December 1, 2020

    Brilliant as always!! Looking forward to the Pandas series!!

  • Corey Schafer
    December 1, 2020

    dislike because you guided me to a terrible website that doesn't deserve my time and money.

  • Corey Schafer
    December 1, 2020

    Hey @corey please make videos for Airflow DAG's also. They are basically python codes so it would fit nicely within your python series

Write a comment