DELHI TECHNOLOGICAL
UNIVERSITY
SE-316
NATURAL LANGUAGE PROCESSING
Submitted by
Bharat Mishra
Roll Number: - 2K21/SE/54
Batch: - SE-A1
Submitted to: Geetanjali Garg
Department of Software Engineering
Delhi Technological University
Bawana Road, Delhi-110042
INDEX
S. No. Experiment Date
1. Import nltk and download the ‘stopwords’ and 13-01-2024
‘punkt’ packages
2. Import spacy and load the language model. 19-01-2024
3. WAP in python to tokenize a given text. 09-02-2024
4. WAP in python to get the sentences of a text 09-02-2024
document.
5. WAP in python to tokenize text with stopwords 23-02-2024
as delimiters.
6. WAP in python to add custom stop words in 05-03-2024
spaCy.
7. WAP to remove punctuations, perform 19-03-2024
stemming, lemmatize given text and extract
usernames from emails
8. WAP to do spell correction, extract all nouns, 26-03-2024
pronouns and verbs in a given text
9. WAP to find similarity between two words and 02-04-2024
classify a text as positive/negative sentiment
EXPERIMENT-1
AIM : Import nltk and download the ‘stopwords’ and ‘punkt’
packages
CODE :
import nltk
nltk.download('stopwords')
nltk.download('punkt')
OUTPUT :
EXPERIMENT-2
AIM : Import spacy and load the language model
CODE :
import spacy
nlp_eng = spacy.load('en_core_web_sm')
nlp_multi = spacy.load('xx_ent_wiki_sm')
OUTPUT :
EXPERIMENT-3
AIM : WAP in python to tokenize a given text
CODE :
from nltk import word_tokenize
text = "Last week, the University of Cambridge shared its own research that shows if
everyone wears a mask outside home,dreaded ‘second wave’ of the pandemic can be
avoided."
text = word_tokenize(text)
for t in text:
print(t)
OUTPUT :
EXPERIMENT-4
AIM : WAP in python to get the sentences of a text document.
CODE :
file = open('/content/demo.text')
Input_text = file.read()
ans = Input_text.split('.')
for an in ans:
print(an,'\n')
OUTPUT :
EXPERIMENT-5
AIM : WAP in python to tokenize text with stopwords as
delimiters.
CODE :
text = "Walter was feeling anxious. He was diagnosed today. He probably is the best
person I know."
stop_words_and_delims = ['was', 'is', 'the', '.', ',', '-', '!', '?']
for r in stop_words_and_delims:
text = text.replace(r, 'DELIM')
words = [t.strip() for t in text.split('DELIM')]
words_filtered = list(filter(lambda a: a not in [''], words))
for word in words_filtered:
print(word)
OUTPUT :
EXPERIMENT-6
AIM : WAP in python to add custom stop words in spaCy.
CODE :
import spacy
nlp = spacy.load('en_core_web_sm')
custom_stop_words = ['was', 'is','the','JUNK','NIL','of','more' ,'.',
',', '-', '!', '?','a']
for word in custom_stop_words:
nlp.vocab[word].is_stop = True
doc = nlp("Jonas was a JUNK great guy NIL Adam was evil NIL Martha JUNK was
more of a fool")
for token in doc:
if not token.is_stop:
print(token.text, end=" ")
OUTPUT :
EXPERIMENT-7
AIM : WAP to remove punctuations, perform stemming,
lemmatize given text and extract usernames from emails
CODE :
punctuations = '''!()-[]{};:'"\,<>./?@#$%^&*_~'''
string = "Jonas!!! great \\guy <> Adam --evil [Martha] ;;fool() ."
ans = ""
for char in string:
if char not in punctuations:
ans+=char
print(ans)
from nltk.stem import PorterStemmer
from nltk.tokenize import word_tokenize
text= "Dancing is an art. Students should be taught dance as a subjectin schools . I
danced in many of my school function. Some people arealways hesitating to dance."
ans = ""
stemmer = PorterStemmer()
tokens = word_tokenize(text)
for token in tokens:
ans+=stemmer.stem(token)
ans+=" "
print(ans)
from nltk.corpus import wordnet
from nltk.tokenize import word_tokenize
from nltk.stem.wordnet import WordNetLemmatizer
nltk.download('wordnet')
lemmatizer = WordNetLemmatizer()
text= "Dancing is an art. Students should be taught dance as a subject in schools . I
danced in many of my school function. Some people are always hesitating to dance."
ans = ""
tokens = word_tokenize(text)
for token in tokens:
ans+=lemmatizer.lemmatize(token, wordnet.VERB)
ans+=" "
print(ans)
from nltk.tokenize import word_tokenize
find any disruptions, kindly contact
[email protected] or
[email protected]"
text_list = word_tokenize(text)
usernames = []
for i in range(len(text_list)):
if text_list[i] == "@":
usernames.append(text_list[i-1])
print(username)
OUTPUT :
EXPERIMENT – 8
AIM : WAP to do spell correction, extract all nouns, pronouns and verbs in a
given text.
CODE :
from textblob import TextBlob
text="He is a gret person. He beleives in bod"
textb = TextBlob(text)
correct_text = textb.correct()
print(correct_text)
import nltk
from nltk import word_tokenize, pos_tag
text="James works at Microsoft. She lives in manchester and likes to play the flute"
tokens = word_tokenize(text)
parts_of_speech = nltk.pos_tag(tokens)
nouns = list(filter(lambda x: x[1] == "NN" or x[1] == "NNP", parts_of_speech))
for noun in nouns:
print(noun[0])
from nltk import pos_tag, word_tokenize
text = "I may bake a cake for my birthday. The talk will introduce reader about Use of
baking"
words = word_tokenize(text)
verb_phrases = []
for i in range(len(words)):
if i > 0 and pos_tag(words)[i][1] == 'VB':
verb_phrase = words[i-1] + ' ' + words[i]
verb_phrases.append(verb_phrase)
for i in verb_phrases:
print (i)
OUTPUT :
EXPERIMENT - 9
AIM : WAP to find similarity between two words and classify a text
as positive/negative sentiment
CODE :
import spacy
nlp = spacy.load('en_core_web_md')
words = "amazing terrible excellent"
tokens = nlp(words)
token1, token2, token3 = tokens[0], tokens[1], tokens[2]
print(f"Similarity between {token1} and {token2} : ", token1.similarity(token2))
print(f"Similarity between {token1} and {token3} : ", token1.similarity(token3))
from textblob import TextBlob
text = "It was a very pleasant day"
print(TextBlob(text).sentiment)
OUTPUT :
