Google Books Ngrams Recompressed and Searchable

Szymon Grabowski; Jakub Swacha

doi:10.2478/v10209-011-0015-8

.blurhash-client-img { display: none !important; }

Google Books Ngrams Recompressed and Searchable

Foundations of Computing and Decision Sciences

Volume 37 (2012): Issue 4 (December 2012)

By: Szymon Grabowski and Jakub Swacha

Open Access

|Dec 2012

[1] Brants T., Popat A. C., Xu P., Och F. J., Dean J., Large language models in machine translation, in:, Prague, ACL 2007, 858-867.
Search in Google Scholar
[2] Gao J., Nguyen P., Li X., Thrasher C., Li M., Wang K., A Comparative Study of Bing Web N-gram Language Models for Web Search and Natural Language Processing, in:, Geneva 2010.
Search in Google Scholar
[3] Grabowski Sz., Swacha J., Compact Representation of URL Collections with Fast Access,,, 3, 2011, 349-355.
Search in Google Scholar
[4] Guthrie D., Hepple M., Liu W., Efficient Minimal Perfect Hash Language Models, in: N. Calzolari, K. Choukri, B. Maegaard, J. Mariani, J. Odijk, S. Piperidis, M. Rosner, D. Tapias (eds.),, Valetta, ELRA 2010.
Search in Google Scholar
[5] Michel J.-B. B., Kui Y., Presser A., Veres A., Gray M. K., Google Books Team, Picket J. P., Hoiberg D., Clancy D., Norvig P., Orwant J., Pinker S., Nowak M. A., Lieberman Aider E., Quantitative Analysis of Culture Using Millions of Digitized Books,,, 6014, 2011, 176-182.
Open DOI Search in Google Scholar
[6] Microsoft Research, Spelling Alteration for Web Search Workshop, City Center - Bellevue, WA, July 19, 2011. Materials available at http://webngram. research.microsoft.com/Spellerchallenge/Docs/Spelling_Alteration_Workshop. pdf (last checked: June 2012).
Search in Google Scholar
[7] Pauls A., Klein D., Faster and Smaller N-Gram Language Models, in: Y. Matsumoto, R. Mihalcea (eds.),, Stroudsburg, ACL 2011, 258-267.
Search in Google Scholar
[8] Procházka V., Pollák P., Analysis of Czech Web 1T 5-Gram Corpus and Its Comparison with Czech National Corpus Data, in: P. Sojka, A. Horák, I. Kopecek, K. Pala (eds.),, Brno, Springer 2010, 181-188.
Open DOI Search in Google Scholar
[9] Skibiński P., Grabowski Sz., Swacha J., Effective asymmetric XML compression,,, 10, 2008, 1027-1047.
Open DOI Search in Google Scholar
[10] Talbot D., Brants T., Randomized Language Models via Perfect Hash Functions, in:, Columbus, ACL 2008, 505-513.
Search in Google Scholar
[11] Witten I. H., Moffat A., Bell T. C.,, Morgan Kaufmann Publishers, Los Altos, 1999.
Search in Google Scholar
[12] Ziv, J., Lempel, A., A Universal Algorithm for Sequential Data Compression,,, 3, 1977, 337-343.
Open DOI Search in Google Scholar
[13] http://books.google.com/ngrams (last checked: June 2012).
Search in Google Scholar
[14] http://books.google.com/ngrams/datasets (last checked: June 2012).
Search in Google Scholar
[15] http://books.google.com/ngrams/info (last checked: June 2012).
Search in Google Scholar
[16] http://iiwz.wneiz.pl/jakubs/progs/ngram_compressor.zip (last checked: June 2012).
Search in Google Scholar
[17] http://research.microsoft.com/en-us/collaboration/focus/cs/web-ngram.aspx (last checked: June 2012).
Search in Google Scholar
[18] http://www.base2ti.com (last checked: June 2012).
Search in Google Scholar
[19] http://www.ldc.upenn.edu/Catalog/CatalogEntry.jsp?catalogId=LDC2006T13 (last checked: June 2012).
Search in Google Scholar
[20] http://www.ldc.upenn.edu/Catalog/catalogEntry.jsp?catalogId=LDC2011T07 (last checked: June 2012).
Search in Google Scholar