Monday, 16 July 2012

Very large-scale corpus (COCA)


COCA (Corpus of Contemporary American English)

Link: http://corpus.byu.edu/coca/
Intro: The Corpus of Contemporary American English (COCA) is the largest freely-available corpus of English, and the only large and balanced corpus of American English. The corpus was created by Mark Davies of Brigham Young University, and it is used by tens of thousands of users every month (linguists, teachers, translators, and other researchers). COCA is also related to other large corpora that we have created.
The corpus contains more than 450 million words of text and is equally divided among spoken, fiction, popular magazines, newspapers, and academic texts. It includes 20 million words each year from 1990-2012 and the corpus is also updated regularly (the most recent texts are from Summer 2012). Because of its design, it is perhaps the only corpus of English that is suitable for looking at current, ongoing changes in the language (see the 2011 article in Literary and Linguistic Computing).

***
Ngram corpus from COCA:
1) COCA Ngrams:
Link: see this post.

2) COHA Ngrams:
Link: http://www.ngrams.info/download_coha.asp
Intro: The Corpus of Historical American English (COHA) contain 400 million words of text from 1810-2009, and all of the n-grams from the corpus can be freely downloaded. They contain all n-grams that occur at least three times total in the corpus, and you can see the frequency of each of these n-grams in each decade from the 1810s-2000s. This data can be used offline to carry out powerful searches on a wide range of phenomena in the history of American English.

---------------------------------
My thoughts:
- I have been developing a language-generic n-gram-based spell checking tool. So, this ngram corpus will be very beneficial.
- Other tasks in English NLP may need this corpus.

Thursday, 12 July 2012

C&C semantic tools

CCG (Combinatory Categorial Grammar) Parser: http://svn.ask.it.usyd.edu.au/trac/candc/wiki

Boxerhttp://svn.ask.it.usyd.edu.au/trac/candc/wiki/boxer
Intro: Boxer is developed by Johan Bos and generates semantic representations. It takes as input CCG (Combinatory Categorial Grammar) derivations and produces DRSs (Discourse Representation Structures, from Hans Kamp's Discourse Representation Theory) as output. It is distributed with the C&C tools.

FRED

Intro: A tool for automatically producing RDF/OWL ontologies and linked data from natural language sentences, currently limited to English.

Wednesday, 11 July 2012

Interested Papers at EMNLP 2012

1) Tenses in SMT

D12-1026: Zhengxian Gong; Min Zhang; Chew Lim Tan; Guodong Zhou
N-gram-based Tense Models for Statistical Machine Translation

2)

D12-1041: Nan Duan; Mu Li; Ming Zhou
Forced Derivation Tree based Model Training to Statistical Machine Translation


3) ...

ESAXX - suffix array tool

Linkhttp://code.google.com/p/esaxx/
Introesaxx is a C++ template library supporting to build an enhanced suffix array which is useful for various string algorithms. For an input text of length N, esaxx builds a suffix tree in linear time using almost 20N bytes working space (alphabet size independent).

Interested Papers at ACL 2012


1) New NLP topic: automatic document dating
P12-1011: Nathanael Chambers
Labeling Documents with Timestamps: Learning from their Time Expressions

2)
P12-1050: Arianna Bisazza; Marcello Federico
Modified Distortion Matrices for Phrase-Based Statistical Machine Translation

3) ...

Sunday, 8 July 2012

Saffron - Extracting the Valuable Threads of Expertise

Linkhttp://saffron.deri.ie/acl

Intro: Saffron provides insights in a research community or organization by analysing its main topics of investigation and the experts associated with these topics.
Saffron analysis is fully automatic and is based on text mining and linked data principles.
This instance of Saffron analyzes the research community in Natural Language Processing based on the proceedings of the conferences organized by the Association for Computational Linguistics (ACL).