Python Data Science Project Ideas! (for all skill levels)
[ad_1]
In this video, we walk through eight project ideas to help you build up your data science skills. All of the resources mentioned in the video can be found here in the description.
Covid-19 Analysis (2:16):
– Johns Hopkins Data: https://github.com/CSSEGISandData/COVID-19/tree/master/csse_covid_19_data/csse_covid_19_time_series
– Code that I wrote: https://github.com/KeithGalli/Data-Science-Project-Ideas/blob/master/Covid/Covid%20Analysis.ipynb
– Kaggle: https://www.kaggle.com/covid19
– @sentdex kaggle video: https://youtu.be/S6GVXk6kbcs
– @3Blue1Brown simulations video: https://youtu.be/gxAaO2rsdIs
Board Game AI (3:16):
– Overview video: https://youtu.be/y7AKtWGOPAE
– Implementing minimax algorithm in python: https://youtu.be/MMLtza3CZFM
– Reinforcement learning (Snake) tutorial: https://towardsdatascience.com/how-to-teach-an-ai-to-play-games-deep-reinforcement-learning-28f9b920440a
– AlphaZero chess tutorial: https://towardsdatascience.com/create-ai-for-your-own-board-game-from-scratch-alpha-zero-part-3-f22761372245
– @DeepMind AlphaGo Documentary: https://youtu.be/WXuK6gekU1Y
Reddit, Data is Beautiful (4:50):
– Thread url: https://www.reddit.com/r/dataisbeautiful/
– Population changes chart: https://www.reddit.com/r/dataisbeautiful/comments/fr8q34/change_in_population_by_county_between_2010_and/
– S&P 500 recoveries chart: https://www.reddit.com/r/dataisbeautiful/comments/frzlbt/sp_500_recovers_during_major_crashes_oc/
Text Sentiment Analysis Tool (6:48):
– My full tutorial (machine learning w/ sklearn): https://youtu.be/M9Itm95JzL0
– Learn about Transformers: http://jalammar.github.io/illustrated-transformer/
– BERT Paper: https://arxiv.org/pdf/1810.04805.pdf
– Spacy NLP Library: https://explosion.ai/blog/spacy-transformers
– YouTube API: https://developers.google.com/youtube/v3/quickstart/python
Sports Analysis (8:34):
– My script to webscrape sports data: https://github.com/KeithGalli/Data-Science-Project-Ideas/blob/master/Sports/extract_data.py
– Basketball reference site that I scraped: https://www.basketball-reference.com/leagues/NBA_2020_per_game.html
Stock Trading Bot (10:12):
– Alpaca Site: https://alpaca.markets/
– Alpaca Tutorials: https://alpaca.markets/docs/get-started-with-alpaca/tutorial-videos/
– Quantopian (to learn more & backtest your trading strategies): https://www.quantopian.com/tutorials/getting-started
House Pricing Prediction (12:02):
– Link to competition: https://www.kaggle.com/c/house-prices-advanced-regression-techniques
Miscellaneous Kaggle Projects (13:06):
– Kaggle Data: https://www.kaggle.com/datasets
– Airbnb Data: https://www.kaggle.com/dgomonov/new-york-city-airbnb-open-data
– My real world data science tutorial: https://youtu.be/eMOA1pPVUc4
Hope you guys enjoyed this video! If you have any questions about any of these projects let me know in the comments. Like & Subscribe if you haven’t already :).
Some skills you should hopefully take away from these projects:
– Analysis with Python Pandas Library
– Visualization with Python Matplotlib Library
– AI/Machine Learning skills with scikit learn library
– Regression Techniques
– Exploratory Data Analysis
———————————————
Follow me on social media!
Instagram | https://www.instagram.com/keithgalli/
Twitter | https://twitter.com/keithgalli
———————————————
~ Intro Music ~
Track: Sunflower — Soyb [Audio Library Release]
Music provided by Audio Library Plus
Watch: https://youtu.be/dG1U3NuR9Pk
Free Download / Stream: https://alplus.io/sunflower
———————
If you are curious to learn how I make my tutorials, check out this video: https://youtu.be/LEO4igyXbLs
⭐ Kite is a free AI-powered coding assistant that will help you code faster and smarter. The Kite plugin integrates with all the top editors and IDEs to give you smart completions and documentation while you’re typing. I’ve been using Kite for 6 months and I love it! https://www.kite.com/get-kite/?utm_medium=referral&utm_source=youtube&utm_campaign=keithgalli&utm_content=description-only
(affiliate link)
Source
[ad_2]
Nice video ! I played a bit with the covid data in the nlp Kaggle challenge and I made a tool around it. It's called Corona Papers. It's a search engine that mines research papers with BERT embedding directly at search time.
have a look at it on my channel :). https://www.youtube.com/watch?v=iVsteYEF0ko
Who would know a 9-year-olds know how to program
I have started making a project last week on covid-19 analysis and I am having many problems in making my menu driven program for the analysis choice. Plzz help me out to write commands in dataframe made with CSV to make atleast 8 commands can you help me out for this it's my class 12 project for this year I think you are the right person to help me out of this sir plzz help your fan.
Hi Keith! Just let you know tha I've found this channel very informative and insightful. I am a Data Scientist wannabe and have around many sources of knowledge and information. You are far one of the best I've found. Cheers, mate, thank you a lot.
Great advices! thanks man, keep up the good work!
I am in love with TypeScript/JavaScript and I am here cheating on my true love ❤️ because Keith is so charismatic and clever…
Its really helpful
Data science is so dry
Hey, very nice video, I actually came in with an idea already, but some of the resources listed here will be helpful.
Glad to hear one cool Data Science dude (Keith Galli) compliment another cool Data Science dude ("Sentdex") on YouTube. Wish all the very best to both the guys for openly and methodically sharing their knowledge.
I'm going to drop a comment that this video is completely useless just so there's maybe something for the NLP's to find as the one negative against it.
ValueError: could not convert string to float: '2008-12-01'
what is the solution of this type of error ?
nice one!
thanks. i vote to see more on the stock trading bot.
hey Keith Galli,
thank you for everything. can you suggest to us where we can learn statistics for data science. for total beginners?
keep up the great work
Thank you so much to share this video. It helped to learn Data Science in depth
Stock trading bot tutorial please! A good way to check if it works would be using paper trading function (ofc the emotion effect is not there, but it's a good way for people who are interested to test out), it would help to see if the bot and/or models worked before you want to use it with real money.
On insta i follow keith potato for fun memes and on YT I follow Keith Galli for such amazing and inspiring contents. Please make a data analysis walkthrough project on Covid-19 worldwide analysis.
Really awesome videos man, please keep them up! Had fun working through that last Data Science Project with you! +subscribed
Hey Keith!!
Your data analysis video really helped me to start thinking deep inside python lib.
I would love to do project on marketing ( house price prediction) if u ever make one.
Keep posting informative and cool videos like this, it really helps!!!!
Are you a data scientist? If yes please tell me what degree should I have to become a part of data science core like part of the research team and machine learning engineers.
you should make a video on things required in data science and the best place we can learn from.
Your videos helped me a lot for my bachelor's thesis (especially being shown how to use the documentation was helpful). One thing I still struggle with is collecting data to work with. It would be great if you could make a video on how to get data from all kinds of websites into python in a usable format (csv, etc.). Keep up the good work, your videos have taught me way better than the lectures at university.
You look like captain America
Great video! Loved it <3
First, thank for great educational videos I am interesting building dashboard using stock API. Could you please do one video for building dashboard. Thanks again.
Hey, your channel is pure gold! Maybe you could do a tutorial on plotting maps? I've been looking for a reasonable way to plot a choropleth map for quite a long while now.
Another excellent video. I was particularly happy to hear your NLP-related suggestions. Thanks!
More QUARANTINE CONTENT! ME MISS KEITH LOng time
Wow, what a gem! Fascinating, informative, fun, and best of all, inspiring. Need I say more? Thanks Keith! – #SimplyBrilliant
keep going on my friend