To cite package ‘robotstxt’ in publications use:

Meissner P, Ren K (2024). robotstxt: A 'robots.txt' Parser and 'Webbot'/'Spider'/'Crawler' Permissions Checker. R package version 0.7.15.9000, https://github.com/ropensci/robotstxt.

Corresponding BibTeX entry:

  @Manual{,
    title = {robotstxt: A 'robots.txt' Parser and
      'Webbot'/'Spider'/'Crawler' Permissions Checker},
    author = {Peter Meissner and Kun Ren},
    year = {2024},
    note = {R package version 0.7.15.9000},
    url = {https://github.com/ropensci/robotstxt},
  }