Jekyll

Links:
http://karpathy.github.io/2014/07/01/switching-to-jekyll/
http://jekyllrb.com/docs/home/
Intro: to transform your plain text into static websites and blogs.

Word Aligners for Machine Translation

Here is a not-complete list of word aligners used for Machine Translation:

1) Unsupervised Aligners
- GIZA++
- fast_align (with cdec)
- pialign
- BerkeleyAligner

2) Supervised Aligners
- BerkeleyAligner
- NILE

(to be updated ...)

Python

Python is very powerful programming language, especially for text processing (or NLP) in terms of speed, simplicity, and vastly supported libraries. I've just started using it for two years and already love it.

Here I collect my stuffs relating to Python:

Runtime Libraries

1) 

Link: https://www.python.org/downloads/

2) 

Link: https://cloud.google.com/appengine/docs/python/

IDE 

1) Microsoft Visual Studio

OS supported: Windows, Android, iOS

Debugging: fully supported

Auto completion: fully supported

Additional tools for Visual Studio: PTVS

2) Vim editor

OS supported: Linux

Debugging: none

Auto completion: none

3) More? See this.

Tutorials

1) Everything can be searched in the Internet :D.

2) http://stackoverflow.com/

Community-based question answering for everything (including Python).

Multeval

Link: https://github.com/jhclark/multeval

Intro: MultEval takes machine translation hypotheses from several runs of an optimizer and provides 3 popular metric scores, as well as, standard deviations (via bootstrap resampling) and p-values (via approximate randomization). This allows researchers to mitigate some of the risk of using unstable optimizers such as MERT, MIRA, and MCMC. It is intended to help in evaluating the impact of in-house experimental variations on translation quality; it is currently not setup to do bake-off style comparisons (bake-offs can't require multiple optimizer runs nor a standard tokenization).

Related: http://www.ark.cs.cmu.edu/MT/ (Code for Statistical Significance Testing for MT Evaluation Metrics)

CocoaHTTPServer

Links:
https://github.com/robbiehanson/CocoaHTTPServer
http://cocoawithlove.com/2009/07/simple-extensible-http-server-in-cocoa.html

Open-source implementation of Boostexter

Link: http://code.google.com/p/icsiboost/

Intro: Boosting is a meta-learning approach that aims at combining an ensemble of weak classifiers to form a strong classifier. Adaptive Boosting (Adaboost) is a greedy search for a linear combination of classifiers by overweighting the examples that are misclassified by each classifier. icsiboost implements Adaboost over stumps (one-level decision trees) on discrete and continuous attributes (words and real values)

TurboParser - Dependency Parser with Linear Programming

Link: http://www.ark.cs.cmu.edu/TurboParser/

Intro: TurboParser is a free C++ implementation of a multilingual non-projective dependency parser based on linear programming relaxations.

Text extraction from HTML pages

1) http://cogcomp.cs.illinois.edu/page/software_view/MSS
2) Link: http://researchlog-duyvuleo.blogspot.sg/2010/11/easy-way-to-extract-useful-text-from.html
3) Link: http://researchlog-duyvuleo.blogspot.sg/2012/06/justext.html
4) Link (PhD thesis): http://is.muni.cz/th/45523/fi_d/phdthesis.pdf

Fangorn: a system for querying very large treebanks

Link: http://nltk.ldc.upenn.edu:9090/index

Intro: Fangorn is an open source tool for querying very large treebanks, built on top of Apache Lucene.  Fangorn implements the LPath linguistic path language, which has an XPath-like syntax along with linguistically motivated extensions.  Result trees are annotated with the query in order to show how the query matched the tree, and these annotations can themselves be modified and submitted as further queries.

Free API for Search the Web instead of Google Search API

Entireweb: http://entireweb.com/services/
Quora: http://www.quora.com/What-can-I-do-with-Blekkos-API
...

PML Tree Query

Link: http://ufal.mff.cuni.cz/~pajas/pmltq/

Intro: PML-TQ is an powerful open-source search tool for all kinds of linguistaically annotated treebanks with several client interfaces and two search backends (one based on a SQL database and one based on Perl and the TrEd toolkit). The tool works natively with treebanks encoded in the PML data format (conversion scripts are available for many established treebank formats).

PET - Post-Editing Translation Tool

Link: http://pers-www.wlv.ac.uk/~in1676/pet/
Intro: PET is a stand-alone, open-source (under LGPL) tool written in Java that should help you post-edit and assess machine or human translations while gathering detailed statistics about post-editing time amongst other effort indicators.

Subtitle Translation

Subtitle corpus: http://opus.lingfil.uu.se/ (more)

Tool: http://www.jaist.ac.jp/~s1010205/translate_subs_doc/

*** Google Translation API is no longer freely available. Can we use state-of-the-art SMT techniques to build a subtitle SMT system by ourself? What are challenges???

XML-RPC

Link: http://en.wikipedia.org/wiki/XML-RPC

Intro: XML-RPC is a remote procedure call (RPC) protocol which uses XML to encode its calls and HTTP as a transport mechanism.[1] "XML-RPC" also refers generically to the use of XML for remote procedure call, independently of the specific protocol. This article is about the protocol named "XML-RPC".

C++ Tool: (tested) http://xmlrpcpp.sourceforge.net/

C&C semantic tools

CCG (Combinatory Categorial Grammar) Parser: http://svn.ask.it.usyd.edu.au/trac/candc/wiki

Boxer: http://svn.ask.it.usyd.edu.au/trac/candc/wiki/boxer

Intro: Boxer is developed by Johan Bos and generates semantic representations. It takes as input CCG (Combinatory Categorial Grammar) derivations and produces DRSs (Discourse Representation Structures, from Hans Kamp's Discourse Representation Theory) as output. It is distributed with the C&C tools.

ESAXX - suffix array tool

Link: http://code.google.com/p/esaxx/

Intro: esaxx is a C++ template library supporting to build an enhanced suffix array which is useful for various string algorithms. For an input text of length N, esaxx builds a suffix tree in linear time using almost 20N bytes working space (alphabet size independent).

Saffron - Extracting the Valuable Threads of Expertise

Link: http://saffron.deri.ie/acl

Intro: Saffron provides insights in a research community or organization by analysing its main topics of investigation and the experts associated with these topics.
Saffron analysis is fully automatic and is based on text mining and linked data principles.
This instance of Saffron analyzes the research community in Natural Language Processing based on the proceedings of the conferences organized by the Association for Computational Linguistics (ACL).

jusText

http://code.google.com/p/justext/

jusText is a tool for removing boilerplate content, such as navigation links, headers, and footers from HTML pages. It is designed to preserve mainly text containing full sentences and it is therefore well suited for creating linguistic resources such as Web corpora.

Layout-Aware Text Extraction from Full-text PDF of Scientific Articles

Link: http://code.google.com/p/lapdftext/

Description: The Portable Document Format (PDF) is the almost universally used file format for online scientific publications. It is also notoriously difficult to read and handle computationally, presenting challenges for developers of biomedical text mining or biocuration informatics systems that use the published literature as an information source. To facilitate the effective use of scientific literature in such systems we introduce Layout-Aware PDF Text Extraction (LA-PDFText). The LA-PDFText system focuses only on the textual content of the research articles and is meant as a baseline for further experiments into more advanced extraction methods that handle multi-modal content, such as images and graphs. The system works in a three-stage process: (1) Detecting contiguous text blocks using spatial layout processing to locate and identify blocks of contiguous text, (2) Classifying text blocks into rhetorical categories using a rule-based method and (3) Stitching classified text blocks together in the correct order resulting in the extraction of text from section-wise grouped blocks.

Linguistic Resources and Tools at the JRC

Link: http://langtech.jrc.ec.europa.eu/JRC_Resources.html