Smrutiranjan Mohapatra

# IR Assignment 2

1. Find the attached file "Text_Brown_corpus". It includes 100 lines of formal text from Brown corpus.The corpus is already tokenized.
2. Using any programming language, drop all the stop words from the text.
3. Count and report total number of actual stop wordsin the text, how many you indentified and how many you succesfully
dropped.
4. Apply porter or other stemmer and stanford lemmatizer on the text.

ir-assignment-2

# IR ASSIGNMENT 1

Follow the steps as mentioned bellow to complete the task 1.
1. Find attached 2 files "News_Text" and "Tweet_oklahoma_tornado_2013". 
First file includes formal text from news article and 2nd file
contains 100 lines of tweets oklahoma Tornado incident in 2013.
2. Using any programming language and available tokenizer, tokenize
both the files.
3. Count and report total number of words, correctly and wrongly tokenized words.
.


assignments