Intro: OpenFst is a library for constructing, combining, optimizing, and searching weighted finite-state transducers (FSTs). Weighted finite-state transducers are automata where each transition has an input label, an output label, and a weight. The more familiar finite-state acceptor is represented as a transducer with each transition's input and output label equal. Finite-state acceptors are used to represent sets of strings (specifically, regular or rational sets); finite-state transducers are used to represent binary relations between pairs of strings (specifically, rational transductions). The weights can be used to represent the cost of taking a particular transition.
Thursday, 23 August 2012
OpenFst Library
Link: http://www.openfst.org/twiki/bin/view/FST/WebHome
Labels:
finite state transducer,
FST,
machine learning,
NLP,
toolkits
Tuesday, 21 August 2012
Wednesday, 15 August 2012
Champollion Tool Kit - Text Sentence Aligner
Link: http://champollion.sourceforge.net/
Intro: Built around LDC's champollion sentence aligner kernel, Champollion Tool Kit (CTK) aims to providing ready-to-use parallel text sentence alignment tools for as many language pairs as possible.
Champollion depends heavily on lexical information, but uses sentence length information as well. A translation lexicon is required. Past experiments indicate that champollion's performance improves as the translation lexicon become larger.
Monday, 30 July 2012
PML Tree Query
Intro: PML-TQ is an powerful open-source search tool for all kinds of linguistaically annotated treebanks with several client interfaces and two search backends (one based on a SQL database and one based on Perl and the TrEd toolkit). The tool works natively with treebanks encoded in the PML data format (conversion scripts are available for many established treebank formats).
Labels:
dependency parsing,
link,
parser,
parsing,
query,
tools,
treebank search
Friday, 27 July 2012
PET - Post-Editing Translation Tool
Intro: PET is a stand-alone, open-source (under LGPL) tool written in Java that should help you post-edit and assess machine or human translations while gathering detailed statistics about post-editing time amongst other effort indicators.
Labels:
machine translation,
open source,
post-editing,
SMT,
tools
Tuesday, 24 July 2012
Subtitle Translation
Subtitle corpus: http://opus.lingfil.uu.se/ (more)
*** Google Translation API is no longer freely available. Can we use state-of-the-art SMT techniques to build a subtitle SMT system by ourself? What are challenges???
Labels:
open source,
research,
SMT,
statistical machine translation,
subtitle,
tools
Monday, 23 July 2012
XML-RPC
Link: http://en.wikipedia.org/wiki/XML-RPC
C++ Tool: (tested) http://xmlrpcpp.sourceforge.net/
Intro: XML-RPC is a remote procedure call (RPC) protocol which uses XML to encode its calls and HTTP as a transport mechanism.[1] "XML-RPC" also refers generically to the use of XML for remote procedure call, independently of the specific protocol. This article is about the protocol named "XML-RPC".
C++ Tool: (tested) http://xmlrpcpp.sourceforge.net/
Labels:
C++,
links,
server/client programming,
tools,
XML RPC
Subscribe to:
Posts (Atom)