Trouble importing text from a .docx file

[atinesh922]

I am trying tokenize words of a Word Document Doc.docx having a sentence This is a doc file. But unfortunately, each token is getting prefixed with a letter 'u'

from nltk .tokenize import word_tokenize
import docx

def getText(filename):
    doc = docx.Document(filename)
    fullText =
    for para in doc.paragraphs:
        fullText.append(para.text)
    return '\n'.join(fullText)

Text = getText('Doc.docx')
words = word_tokenize(Text)
print(words)

Output:
Output : [u'This', u'is', u'a', u'doc', u'file']

Expected Output : ['This', 'is', 'a', 'doc', 'file']

[hshivaraj]

 But unfortunately, each token is getting prefixed with a letter 'u'

That is basically representing that each token is a unicode string. Try this to get rid of it

Text = getText('Doc.docx')
words = word_tokenize(Text)
words = map(str, words)
print(words)

In Python3 every string is unicode and therefore you wont get this issue (in fact its not even an issue). Use python3 or the trick above if using python2.

[nilamo]

That shouldn't be an issue. When you actually do something with those tokens/words, the 'u' won't be there anyway.

[snippsat]

As mention you do not do anything with those Unicode strings.
All string method work the same with Unicode string and using print the u wont be there.

>>> lst = [u'This', u'is', u'a', u'doc', u'file']
>>> for item in lst:
...     print(item)
...     
This
is
a
doc
file

>>> lst[0].upper()
u'THIS'
>>> # print and u is gone
>>> print(lst[0].upper())
THIS

You should be using python 3,there as mention is all string Unicode.
Unicode was one biggest changes in Python 3.