Repositories list

• SitemapParser

  Public
  XML Sitemap parser class compliant with the Sitemaps.org protocol.

  parsersitemaps-orgsitemap+ 2xmlxml-sitemap-parser

  PHP

  •

  MIT License

  •29•75•0•0•Updated Nov 27, 2023Nov 27, 2023

• RobotsTxtParser

  Public
  An extensible robots.txt parser and client library, with full support for every directive and specification.

  robots-txtrobots-parser

  PHP

  •

  MIT License

  •6•26•1•0•Updated Apr 10, 2021Apr 10, 2021

• UserAgentParser

  Public
  User-Agent parser for robots.txt, X-Robots-tag and Robots-meta-tag rule sets

  crawleruser-agentspider+ 8robots-txtreprobots-tagrobots-exclusion-protocolx-robots-tagrobots-meta-tagrobot+ 1

  PHP

  •

  MIT License

  •2•1•0•0•Updated Apr 4, 2021Apr 4, 2021

• RobotsTagParser

  Public
  X-Robots-Tag HTTP header parser class

  PHP

  •

  MIT License

  •2•1•0•0•Updated Jul 15, 2016Jul 15, 2016

• OPMLParser

  Public
  OPML parser for PHP

  PHP

  •

  MIT License

  •1•2•0•0•Updated May 6, 2016May 6, 2016

• CleanParam-URL-filter

  Public
  Clean-Param URL filtering class - Find and remove any duplicate URL

  PHP

  •

  MIT License

  •1•2•0•0•Updated Apr 6, 2016Apr 6, 2016