Wikipedia Extractor

Link: http://medialab.di.unipi.it/wiki/Wikipedia_Extractor

Intro: WikiExtractor.py is a Python script that extracts and cleans text from a Wikipedia database dump. The output is stored in a number of files of similar size in a given directory. Each file contains several documents in the document format.

Text extraction from HTML pages

1) http://cogcomp.cs.illinois.edu/page/software_view/MSS
2) Link: http://researchlog-duyvuleo.blogspot.sg/2010/11/easy-way-to-extract-useful-text-from.html
3) Link: http://researchlog-duyvuleo.blogspot.sg/2012/06/justext.html
4) Link (PhD thesis): http://is.muni.cz/th/45523/fi_d/phdthesis.pdf

jusText

http://code.google.com/p/justext/

jusText is a tool for removing boilerplate content, such as navigation links, headers, and footers from HTML pages. It is designed to preserve mainly text containing full sentences and it is therefore well suited for creating linguistic resources such as Web corpora.

HTML Parsers

1) Jericho HTML Parser: http://jericho.htmlparser.net/docs/index.html

2) boilerpipe: http://researchlog-duyvuleo.blogspot.com/search?q=boilerpipe

3) HTML Parser: http://htmlparser.sourceforge.net/

4) TBA

The Easy Way to Extract Useful Text from Arbitrary HTML

http://ai-depot.com/articles/the-easy-way-to-extract-useful-text-from-arbitrary-html/