Wednesday, 15 August 2012

Champollion Tool Kit - Text Sentence Aligner

Linkhttp://champollion.sourceforge.net/
Intro: Built around LDC's champollion sentence aligner kernel, Champollion Tool Kit (CTK) aims to providing ready-to-use parallel text sentence alignment tools for as many language pairs as possible.
Champollion depends heavily on lexical information, but uses sentence length information as well. A translation lexicon is required. Past experiments indicate that champollion's performance improves as the translation lexicon become larger.

Monday, 30 July 2012

PML Tree Query

Intro: PML-TQ is an powerful open-source search tool for all kinds of linguistaically annotated treebanks with several client interfaces and two search backends (one based on a SQL database and one based on Perl and the TrEd toolkit). The tool works natively with treebanks encoded in the PML data format (conversion scripts are available for many established treebank formats).

Friday, 27 July 2012

PET - Post-Editing Translation Tool

Link: http://pers-www.wlv.ac.uk/~in1676/pet/
Intro: PET is a stand-alone, open-source (under LGPL) tool written in Java that should help you post-edit and assess machine or human translations while gathering detailed statistics about post-editing time amongst other effort indicators.

Tuesday, 24 July 2012

Subtitle Translation

Subtitle corpushttp://opus.lingfil.uu.se/ (more)

*** Google Translation API is no longer freely available. Can we use state-of-the-art SMT techniques to build a subtitle SMT system by ourself? What are challenges???

Monday, 23 July 2012

XML-RPC

Link: http://en.wikipedia.org/wiki/XML-RPC
Intro: XML-RPC is a remote procedure call (RPC) protocol which uses XML to encode its calls and HTTP as a transport mechanism.[1] "XML-RPC" also refers generically to the use of XML for remote procedure call, independently of the specific protocol. This article is about the protocol named "XML-RPC".

C++ Tool: (tested) http://xmlrpcpp.sourceforge.net/

OpenStreetMap

Linkhttp://www.openstreetmap.org/
Intro: OpenStreetMap is a free worldwide map, created by people like you.
Datahttp://planet.openstreetmap.org/

Monday, 16 July 2012

Very large-scale corpus (COCA)


COCA (Corpus of Contemporary American English)

Link: http://corpus.byu.edu/coca/
Intro: The Corpus of Contemporary American English (COCA) is the largest freely-available corpus of English, and the only large and balanced corpus of American English. The corpus was created by Mark Davies of Brigham Young University, and it is used by tens of thousands of users every month (linguists, teachers, translators, and other researchers). COCA is also related to other large corpora that we have created.
The corpus contains more than 450 million words of text and is equally divided among spoken, fiction, popular magazines, newspapers, and academic texts. It includes 20 million words each year from 1990-2012 and the corpus is also updated regularly (the most recent texts are from Summer 2012). Because of its design, it is perhaps the only corpus of English that is suitable for looking at current, ongoing changes in the language (see the 2011 article in Literary and Linguistic Computing).

***
Ngram corpus from COCA:
1) COCA Ngrams:
Link: see this post.

2) COHA Ngrams:
Link: http://www.ngrams.info/download_coha.asp
Intro: The Corpus of Historical American English (COHA) contain 400 million words of text from 1810-2009, and all of the n-grams from the corpus can be freely downloaded. They contain all n-grams that occur at least three times total in the corpus, and you can see the frequency of each of these n-grams in each decade from the 1810s-2000s. This data can be used offline to carry out powerful searches on a wide range of phenomena in the history of American English.

---------------------------------
My thoughts:
- I have been developing a language-generic n-gram-based spell checking tool. So, this ngram corpus will be very beneficial.
- Other tasks in English NLP may need this corpus.