Python Data Science Project Ideas! (for all skill levels)




[ad_1]

In this video, we walk through eight project ideas to help you build up your data science skills. All of the resources mentioned in the video can be found here in the description.

Covid-19 Analysis (2:16):
– Johns Hopkins Data: https://github.com/CSSEGISandData/COVID-19/tree/master/csse_covid_19_data/csse_covid_19_time_series
– Code that I wrote: https://github.com/KeithGalli/Data-Science-Project-Ideas/blob/master/Covid/Covid%20Analysis.ipynb
– Kaggle: https://www.kaggle.com/covid19
– @sentdex kaggle video: https://youtu.be/S6GVXk6kbcs
– @3Blue1Brown simulations video: https://youtu.be/gxAaO2rsdIs

Board Game AI (3:16):
– Overview video: https://youtu.be/y7AKtWGOPAE
– Implementing minimax algorithm in python: https://youtu.be/MMLtza3CZFM
– Reinforcement learning (Snake) tutorial: https://towardsdatascience.com/how-to-teach-an-ai-to-play-games-deep-reinforcement-learning-28f9b920440a
– AlphaZero chess tutorial: https://towardsdatascience.com/create-ai-for-your-own-board-game-from-scratch-alpha-zero-part-3-f22761372245
– @DeepMind AlphaGo Documentary: https://youtu.be/WXuK6gekU1Y

Reddit, Data is Beautiful (4:50):
– Thread url: https://www.reddit.com/r/dataisbeautiful/
– Population changes chart: https://www.reddit.com/r/dataisbeautiful/comments/fr8q34/change_in_population_by_county_between_2010_and/
– S&P 500 recoveries chart: https://www.reddit.com/r/dataisbeautiful/comments/frzlbt/sp_500_recovers_during_major_crashes_oc/

Text Sentiment Analysis Tool (6:48):
– My full tutorial (machine learning w/ sklearn): https://youtu.be/M9Itm95JzL0
– Learn about Transformers: http://jalammar.github.io/illustrated-transformer/
– BERT Paper: https://arxiv.org/pdf/1810.04805.pdf
– Spacy NLP Library: https://explosion.ai/blog/spacy-transformers
– YouTube API: https://developers.google.com/youtube/v3/quickstart/python

Sports Analysis (8:34):
– My script to webscrape sports data: https://github.com/KeithGalli/Data-Science-Project-Ideas/blob/master/Sports/extract_data.py
– Basketball reference site that I scraped: https://www.basketball-reference.com/leagues/NBA_2020_per_game.html

Stock Trading Bot (10:12):
– Alpaca Site: https://alpaca.markets/
– Alpaca Tutorials: https://alpaca.markets/docs/get-started-with-alpaca/tutorial-videos/
– Quantopian (to learn more & backtest your trading strategies): https://www.quantopian.com/tutorials/getting-started

House Pricing Prediction (12:02):
– Link to competition: https://www.kaggle.com/c/house-prices-advanced-regression-techniques

Miscellaneous Kaggle Projects (13:06):
– Kaggle Data: https://www.kaggle.com/datasets
– Airbnb Data: https://www.kaggle.com/dgomonov/new-york-city-airbnb-open-data
– My real world data science tutorial: https://youtu.be/eMOA1pPVUc4

Hope you guys enjoyed this video! If you have any questions about any of these projects let me know in the comments. Like & Subscribe if you haven’t already :).

Some skills you should hopefully take away from these projects:
– Analysis with Python Pandas Library
– Visualization with Python Matplotlib Library
– AI/Machine Learning skills with scikit learn library
– Regression Techniques
– Exploratory Data Analysis

———————————————

Follow me on social media!
Instagram | https://www.instagram.com/keithgalli/
Twitter | https://twitter.com/keithgalli

———————————————
~ Intro Music ~
Track: Sunflower — Soyb [Audio Library Release]
Music provided by Audio Library Plus
Watch: https://youtu.be/dG1U3NuR9Pk
Free Download / Stream: https://alplus.io/sunflower

———————
If you are curious to learn how I make my tutorials, check out this video: https://youtu.be/LEO4igyXbLs

⭐ Kite is a free AI-powered coding assistant that will help you code faster and smarter. The Kite plugin integrates with all the top editors and IDEs to give you smart completions and documentation while you’re typing. I’ve been using Kite for 6 months and I love it! https://www.kite.com/get-kite/?utm_medium=referral&utm_source=youtube&utm_campaign=keithgalli&utm_content=description-only
(affiliate link)

Source


[ad_2]

Comment List

  • Keith Galli
    November 16, 2020

    Nice video ! I played a bit with the covid data in the nlp Kaggle challenge and I made a tool around it. It's called Corona Papers. It's a search engine that mines research papers with BERT embedding directly at search time.
    have a look at it on my channel :). https://www.youtube.com/watch?v=iVsteYEF0ko

  • Keith Galli
    November 16, 2020

    Who would know a 9-year-olds know how to program

  • Keith Galli
    November 16, 2020

    I have started making a project last week on covid-19 analysis and I am having many problems in making my menu driven program for the analysis choice. Plzz help me out to write commands in dataframe made with CSV to make atleast 8 commands can you help me out for this it's my class 12 project for this year I think you are the right person to help me out of this sir plzz help your fan.

  • Keith Galli
    November 16, 2020

    Hi Keith! Just let you know tha I've found this channel very informative and insightful. I am a Data Scientist wannabe and have around many sources of knowledge and information. You are far one of the best I've found. Cheers, mate, thank you a lot.

  • Keith Galli
    November 16, 2020

    Great advices! thanks man, keep up the good work!

  • Keith Galli
    November 16, 2020

    I am in love with TypeScript/JavaScript and I am here cheating on my true love ❤️ because Keith is so charismatic and clever…

  • Keith Galli
    November 16, 2020

    Its really helpful

  • Keith Galli
    November 16, 2020

    Data science is so dry

  • Keith Galli
    November 16, 2020

    Hey, very nice video, I actually came in with an idea already, but some of the resources listed here will be helpful.

  • Keith Galli
    November 16, 2020

    Glad to hear one cool Data Science dude (Keith Galli) compliment another cool Data Science dude ("Sentdex") on YouTube. Wish all the very best to both the guys for openly and methodically sharing their knowledge.

  • Keith Galli
    November 16, 2020

    I'm going to drop a comment that this video is completely useless just so there's maybe something for the NLP's to find as the one negative against it.

  • Keith Galli
    November 16, 2020

    ValueError: could not convert string to float: '2008-12-01'

    what is the solution of this type of error ?

  • Keith Galli
    November 16, 2020

    nice one!

  • Keith Galli
    November 16, 2020

    thanks. i vote to see more on the stock trading bot.

  • Keith Galli
    November 16, 2020

    hey Keith Galli,
    thank you for everything. can you suggest to us where we can learn statistics for data science. for total beginners?

  • Keith Galli
    November 16, 2020

    keep up the great work

  • Keith Galli
    November 16, 2020

    Thank you so much to share this video. It helped to learn Data Science in depth

  • Keith Galli
    November 16, 2020

    Stock trading bot tutorial please! A good way to check if it works would be using paper trading function (ofc the emotion effect is not there, but it's a good way for people who are interested to test out), it would help to see if the bot and/or models worked before you want to use it with real money.

  • Keith Galli
    November 16, 2020

    On insta i follow keith potato for fun memes and on YT I follow Keith Galli for such amazing and inspiring contents. Please make a data analysis walkthrough project on Covid-19 worldwide analysis.

  • Keith Galli
    November 16, 2020

    Really awesome videos man, please keep them up! Had fun working through that last Data Science Project with you! +subscribed

  • Keith Galli
    November 16, 2020

    Hey Keith!!
    Your data analysis video really helped me to start thinking deep inside python lib.
    I would love to do project on marketing ( house price prediction) if u ever make one.
    Keep posting informative and cool videos like this, it really helps!!!!

  • Keith Galli
    November 16, 2020

    Are you a data scientist? If yes please tell me what degree should I have to become a part of data science core like part of the research team and machine learning engineers.

  • Keith Galli
    November 16, 2020

    you should make a video on things required in data science and the best place we can learn from.

  • Keith Galli
    November 16, 2020

    Your videos helped me a lot for my bachelor's thesis (especially being shown how to use the documentation was helpful). One thing I still struggle with is collecting data to work with. It would be great if you could make a video on how to get data from all kinds of websites into python in a usable format (csv, etc.). Keep up the good work, your videos have taught me way better than the lectures at university.

  • Keith Galli
    November 16, 2020

    You look like captain America

  • Keith Galli
    November 16, 2020

    Great video! Loved it <3

  • Keith Galli
    November 16, 2020

    First, thank for great educational videos I am interesting building dashboard using stock API. Could you please do one video for building dashboard. Thanks again.

  • Keith Galli
    November 16, 2020

    Hey, your channel is pure gold! Maybe you could do a tutorial on plotting maps? I've been looking for a reasonable way to plot a choropleth map for quite a long while now.

  • Keith Galli
    November 16, 2020

    Another excellent video. I was particularly happy to hear your NLP-related suggestions. Thanks!

  • Keith Galli
    November 16, 2020

    More QUARANTINE CONTENT! ME MISS KEITH LOng time

  • Keith Galli
    November 16, 2020

    Wow, what a gem! Fascinating, informative, fun, and best of all, inspiring. Need I say more? Thanks Keith! – #SimplyBrilliant

  • Keith Galli
    November 16, 2020

    keep going on my friend

Write a comment