,
Dirk Sites [cph] (Author of CLD2 C++ library)| Title: | Google's Compact Language Detector 2 |
|---|---|
| Description: | Bindings to Google's C++ library Compact Language Detector 2 (see <https://github.com/cld2owners/cld2#readme> for more information). Probabilistically detects over 80 languages in plain text or HTML. For mixed-language input it returns the top three detected languages and their approximate proportion of the total classified text bytes (e.g. 80% English and 20% French out of 1000 bytes). There is also a 'cld3' package on CRAN which uses a neural network model instead. |
| Authors: | Jeroen Ooms [aut, cre] ,
Dirk Sites [cph] (Author of CLD2 C++ library) |
| Maintainer: | Jeroen Ooms <[email protected]> |
| License: | Apache License 2.0 |
| Version: | 1.2.5 |
| Built: | 2024-11-02 05:58:39 UTC |
| Source: | https://github.com/ropensci/cld2 |
The function detect_language() is vectorised and guesses the the language of each string
in text or returns NA if the language could not reliably be determined. The function
detect_language_multi() is not vectorised and analyses the entire character vector as a
whole. The output includes the top 3 detected languages including the relative proportion
and the total number of text bytes that was reliably classified.
detect_language(text, plain_text = TRUE, lang_code = TRUE) detect_language_mixed(text, plain_text = TRUE)detect_language(text, plain_text = TRUE, lang_code = TRUE) detect_language_mixed(text, plain_text = TRUE)
text |
a string with text to classify or a connection to read from |
plain_text |
if |
lang_code |
return a language code instead of name |
# Vectorized function text <- c("To be or not to be?", "Ce n'est pas grave.", "Nou breekt mijn klomp!") detect_language(text) ## Not run: # Read HTML from connection detect_language(url('http://www.un.org/ar/universal-declaration-human-rights/'), plain_text = FALSE) # More detailed classification output detect_language_mixed( url('http://www.un.org/fr/universal-declaration-human-rights/'), plain_text = FALSE) detect_language_mixed( url('http://www.un.org/zh/universal-declaration-human-rights/'), plain_text = FALSE) ## End(Not run)# Vectorized function text <- c("To be or not to be?", "Ce n'est pas grave.", "Nou breekt mijn klomp!") detect_language(text) ## Not run: # Read HTML from connection detect_language(url('http://www.un.org/ar/universal-declaration-human-rights/'), plain_text = FALSE) # More detailed classification output detect_language_mixed( url('http://www.un.org/fr/universal-declaration-human-rights/'), plain_text = FALSE) detect_language_mixed( url('http://www.un.org/zh/universal-declaration-human-rights/'), plain_text = FALSE) ## End(Not run)