Natural Language Processing – Tokenization (NLP Zero to Hero – Part 1)
[ad_1]
Welcome to Zero to Hero for Natural Language Processing using TensorFlow! If you’re not an expert on AI or ML, don’t worry — we’re taking the concepts of NLP and teaching them from first principles with our host Laurence Moroney (@lmoroney).
In this first lesson we’ll talk about how to represent words in a way that a computer can process them, with a view to later training a neural network to understand their meaning.
Hands-on Colab → https://goo.gle/2uO6Gee
NLP Zero to Hero playlist → https://goo.gle/nlp-z2h
Subscribe to the TensorFlow channel → https://goo.gle/TensorFlow
Source
[ad_2]
Suppose if you have 30 textfile in one folder how do you tokenize the word?
Thank you for the video. Sometimes exclamation mark could be informative for tasks such as sentiment classification. But the tokenizer filters out. Is there way for preventing this?
Great, thanks for the info!
Sir my name is mohith I am final year BE student can you help me out some doubt on nlp I am working on data generalization and data sanitization our task is identifying given text weather it is sanitized or not generalized or not how it work in python can you help out sir please…. it is helpfull to me
Hi. What happens if I set nums_words to 0? I tried and it still prints all the words
Amazingly well said
I need your advise on finding the text similarity
This code has apache license, so can it be reused?
Too good
Great explanation, thanks a lot!!!
Best intro video. Glued to your presentation style
Lol, you explained this so well that it made me want to implement my own library for tokenization
can 1679 15223 2 153692 be a word?
Thank you so much! This is so informative, so quickly, in well structured lessons. I'm using a TensorFlow package for R and this helps me understand my project so much better!
Will this still work with TensorFlow.js Layers API (https://www.tensorflow.org/js/guide/layers_for_keras_users)? I would love not to go out of JS loop if possible.Thank you for your efforts.
Very informative and easy to learn. Thank you very much.
I want TensorFlow track jacket that you have wear
Could you help me with python 3.8.2 compatible version of Tensorflow and Keras.
Yay😅
Amazing presentation
thank you
how can make the same example in my raspberry?