When you are using spaCy you will see that they refer to the word “model” quite often. So what are models? A “model” in machine learning is the output of a machine learning algorithm run on data. Source It is easiest to explain using an example. Create a file called spacy_model.py and add the following…
This article is part of the Learn spaCy series Stop words are very common words like “a”, “the” etc which do not provide much information (low information density words) about the text you are analyzing. spaCy allows you to check if a given word is a stop word. Let us see how we can do…
This article is part of the Learn spaCy series What is a dependency parse tree? While there is no simple explanation on the spaCy website, I found a good explanation on the Stanford Stanza website. Dependency parsing .. builds a tree structure of words from the input sentence, which represents the syntactic dependency relations between…
This article is part of the Learn spaCy series What are part of speech tags? In corpus linguistics, part-of-speech tagging (POS tagging or PoS tagging or POST), also called grammatical tagging is the process of marking up a word in a text (corpus) as corresponding to a particular part of speech,[1] based on both its…
This article is part of the Learn spaCy series What are named entities? A named entity is a “real-world object” that’s assigned a name – for example, a person, a country, a product or a book title. spaCy can recognize various types of named entities in a document, by asking the model for a prediction….
This article is part of the Learn spaCy series The default parser in spaCy converts a document (such as a paragraph of text) into a list of sentences where the sentences are themselves composed of tokens. Tokens are not words, they are a little more complex as the documentation explains. During processing, spaCy first tokenizes…
This article is part of the Learn spaCy series When you are using spaCy to process text, one of the first things you want to do is split the text (paragraph, document etc) into individual sentences. I will explain how to do that in this tutorial. First, download and install spaCy Create a new file…
This article is part of the Learn spaCy series In this tutorial I explain how to get started with spaCy. This is intended for programmers who are familiar with Python and are interested in using the PyCharm IDE. Create a new Python project (note, PyCharm automatically creates it in a virtual environment) Add a requirements.txt…
