How to split text into sentences using spaCy
When you are using spaCy to process text, one of the first things you want to do is split the text (paragraph, document etc) into individual sentences.
I will explain how to do that in this tutorial.
First, download and install spaCy
Create a new file in the same project called sentences.py
Add the following code into the sentences.py file
Note: you need to download the en_core_web_sm model first to be able to run the script below
import spacy
nlp = spacy.load("en_core_web_sm")
doc = nlp('This is the first sentence. This is the second sentence.')
for sent in doc.sents:
print(sent)Run the Python script.
Here is what you will see in the output.
As you can see, the paragraph has been split into the two sentences.
How to split text into individual words in spaCy
About this website BotFlo1 was created by Aravind Mohanoor as a website which provided training and tools for non-programmers who were2 building Dialogflow chatbots. This website has now expanded into other topics in Natural Language Processing, including the recent Large Language Models (GPT etc.) with a special focus on helping non-programmers identify and use the right tool for their specific NLP task. For example, when not to use GPT 1 BotFlo was previously called MiningBusinessData. That is why you see that name in many videos 2 And still are building Dialogflow chatbots. Dialogflow ES first evolved into Dialogflow CX, and Dialogflow CX itself evolved to add Generative AI features in mid-2023
You must be logged in to post a comment.