Package: textreuse 1.0.1

Yaoxiang Li

textreuse: Detect Text Reuse and Document Similarity

Tools for measuring similarity among documents and detecting passages which have been reused. Implements shingled n-gram, skip n-gram, and other tokenizers; similarity/dissimilarity functions; pairwise comparisons; minhash and locality sensitive hashing algorithms; and a version of the Smith-Waterman local alignment algorithm suitable for natural language.

Authors:Lincoln Mullen [aut], Yaoxiang Li [aut, cre]

textreuse_1.0.1.tar.gz
textreuse_1.0.1.zip(r-4.7)textreuse_1.0.1.zip(r-4.6)textreuse_1.0.1.zip(r-4.5)
textreuse_1.0.1.tgz(r-4.6-x86_64)textreuse_1.0.1.tgz(r-4.6-arm64)textreuse_1.0.1.tgz(r-4.5-x86_64)textreuse_1.0.1.tgz(r-4.5-arm64)
textreuse_1.0.1.tar.gz(r-4.7-arm64)textreuse_1.0.1.tar.gz(r-4.7-x86_64)textreuse_1.0.1.tar.gz(r-4.6-arm64)textreuse_1.0.1.tar.gz(r-4.6-x86_64)
textreuse_1.0.1.tgz(r-4.6-emscripten)
manual.pdf |manual.html✨
card.svg |card.png
textreuse/json (API)
NEWS

# Install 'textreuse' in R:
install.packages('textreuse', repos = c('https://ropensci.r-universe.dev', 'https://cloud.r-project.org'))

Reviews:rOpenSci Software Review #20

Bug tracker:https://github.com/ropensci/textreuse/issues

Pkgdown/docs site:https://docs.ropensci.org

Uses libs:
  • c++– GNU Standard C++ Library v3

On CRAN:

Conda:

peer-reviewedcpp

8.82 score 200 stars 235 scripts 695 downloads 1 mentions 49 exports 28 dependencies

Last updated from:6f8cbe3802 (on master). Checks:14 OK. Indexed: yes.

TargetResultTimeFilesSyslog
linux-devel-arm64OK162
linux-devel-x86_64OK180
pkgdown docsOK170
source / vignettesOK200
linux-release-arm64OK181
linux-release-x86_64OK154
macos-release-arm64OK94
macos-release-x86_64OK239
macos-oldrel-arm64OK106
macos-oldrel-x86_64OK246
windows-develOK146
windows-releaseOK134
windows-oldrelOK120
wasm-releaseOK133

Exports:align_localas_sparse_matrixcontentcontent<-count_matchesfilenameshas_contenthas_hasheshas_minhasheshas_tokenshash_stringhasheshashes<-is.TextReuseCorpusis.TextReuseTextDocumentjaccard_bag_similarityjaccard_dissimilarityjaccard_similaritylshlsh_addlsh_candidateslsh_comparelsh_probabilitylsh_querylsh_subsetlsh_thresholdmatching_tokensmetameta<-minhash_generatorminhashesminhashes<-pairwise_candidatespairwise_compareratio_of_matchesrehashskippedTextReuseCorpusTextReuseTextDocumenttoken_indextoken_index_candidatestokenizetokenize_ngramstokenize_sentencestokenize_skip_ngramstokenize_wordstokenstokens<-wordcount

Dependencies:assertthatBHclicpp11digestdplyrgenericsgluelatticelifecyclemagrittrMatrixNLPpillarpkgconfigpurrrR6RcppRcppProgressrlangstringistringrtibbletidyrtidyselectutf8vctrswithr

Introduction to the textreuse package

Lincoln Mullen, Yaoxiang Li

Rendered fromtextreuse-introduction.Rmdusingknitr::rmarkdownon Jun 05 2026.

Last update: 2026-05-05
Started: 2015-10-22

Minhash and locality-sensitive hashing

Lincoln Mullen, Yaoxiang Li

Rendered fromtextreuse-minhash.Rmdusingknitr::rmarkdownon Jun 05 2026.

Last update: 2026-05-05
Started: 2015-10-22

Pairwise comparisons for document similarity

Lincoln Mullen, Yaoxiang Li

Rendered fromtextreuse-pairwise.Rmdusingknitr::rmarkdownon Jun 05 2026.

Last update: 2026-05-05
Started: 2015-10-22

Text Alignment

Lincoln Mullen, Yaoxiang Li

Rendered fromtextreuse-alignment.Rmdusingknitr::rmarkdownon Jun 05 2026.

Last update: 2026-05-05
Started: 2015-10-22

Readme and manuals

Help Manual

Help pageTopics
textreuse: Detect Text Reuse and Document Similaritytextreuse-package textreuse
Local alignment of natural language textsalign_local
Convert candidates data frames to other formatsas.matrix.textreuse_candidates as_sparse_matrix
Filenames from pathsfilenames
Hash a string to an integerhash_string
Locality sensitive hashing for minhashlsh
Add documents to a LSH cachelsh_add
Candidate pairs from LSH comparisonslsh_candidates
Compare candidates identified by LSHlsh_compare
Probability that a candidate pair will be detected with LSHlsh_probability lsh_threshold
Query a LSH cache for matches to a single documentlsh_query
List of all candidates in a corpuslsh_subset
Generate a minhash functionminhash_generator
Candidate pairs from pairwise comparisonspairwise_candidates
Pairwise comparisons among documents in a corpuspairwise_compare
Recompute the hashes for a document or corpusrehash
Measure similarity/dissimilarity in documentscount_matches jaccard_bag_similarity jaccard_dissimilarity jaccard_similarity matching_tokens ratio_of_matches similarity-functions
TextReuseCorpusis.TextReuseCorpus skipped TextReuseCorpus
TextReuseTextDocumenthas_content has_hashes has_minhashes has_tokens is.TextReuseTextDocument TextReuseTextDocument
Accessors for TextReuse objectshashes hashes<- minhashes minhashes<- TextReuseTextDocument-accessors tokens tokens<-
Build an index of tokens and documentstoken_index
Extract candidate document pairs from a token indextoken_index_candidates
Recompute the tokens for a document or corpustokenize
Split texts into tokenstokenizers tokenize_ngrams tokenize_sentences tokenize_skip_ngrams tokenize_words
Count wordswordcount