Natural Language Processing – Tokenization (NLP Zero to Hero – Part 1)




[ad_1]

Welcome to Zero to Hero for Natural Language Processing using TensorFlow! If you’re not an expert on AI or ML, don’t worry — we’re taking the concepts of NLP and teaching them from first principles with our host Laurence Moroney (@lmoroney).

In this first lesson we’ll talk about how to represent words in a way that a computer can process them, with a view to later training a neural network to understand their meaning.

Hands-on Colab → https://goo.gle/2uO6Gee

NLP Zero to Hero playlist → https://goo.gle/nlp-z2h
Subscribe to the TensorFlow channel → https://goo.gle/TensorFlow

Source


[ad_2]

Comment List

  • TensorFlow
    November 13, 2020

    Suppose if you have 30 textfile in one folder how do you tokenize the word?

  • TensorFlow
    November 13, 2020

    Thank you for the video. Sometimes exclamation mark could be informative for tasks such as sentiment classification. But the tokenizer filters out. Is there way for preventing this?

  • TensorFlow
    November 13, 2020

    Great, thanks for the info!

  • TensorFlow
    November 13, 2020

    Sir my name is mohith I am final year BE student can you help me out some doubt on nlp I am working on data generalization and data sanitization our task is identifying given text weather it is sanitized or not generalized or not how it work in python can you help out sir please…. it is helpfull to me

  • TensorFlow
    November 13, 2020

    Hi. What happens if I set nums_words to 0? I tried and it still prints all the words

  • TensorFlow
    November 13, 2020

    Amazingly well said

  • TensorFlow
    November 13, 2020

    I need your advise on finding the text similarity

  • TensorFlow
    November 13, 2020

    This code has apache license, so can it be reused?

  • TensorFlow
    November 13, 2020

    Too good

  • TensorFlow
    November 13, 2020

    Great explanation, thanks a lot!!!

  • TensorFlow
    November 13, 2020

    Best intro video. Glued to your presentation style

  • TensorFlow
    November 13, 2020

    Lol, you explained this so well that it made me want to implement my own library for tokenization

  • TensorFlow
    November 13, 2020

    can 1679 15223 2 153692 be a word?

  • TensorFlow
    November 13, 2020

    Thank you so much! This is so informative, so quickly, in well structured lessons. I'm using a TensorFlow package for R and this helps me understand my project so much better!

  • TensorFlow
    November 13, 2020

    Will this still work with TensorFlow.js Layers API (https://www.tensorflow.org/js/guide/layers_for_keras_users)? I would love not to go out of JS loop if possible.Thank you for your efforts.

  • TensorFlow
    November 13, 2020

    Very informative and easy to learn. Thank you very much.

  • TensorFlow
    November 13, 2020

    I want TensorFlow track jacket that you have wear

  • TensorFlow
    November 13, 2020

    Could you help me with python 3.8.2 compatible version of Tensorflow and Keras.

  • TensorFlow
    November 13, 2020

    Yay😅

  • TensorFlow
    November 13, 2020

    Amazing presentation

  • TensorFlow
    November 13, 2020

    thank you
    how can make the same example in my raspberry?

Write a comment