Skip to content

Minor improvements

Latest
Latest
Compare
Choose a tag to compare
@tokahuke tokahuke released this 30 Dec 13:47
· 106 commits to master since this release
v0.6.1
70b14d7
This commit was created on GitHub.com and signed with GitHub’s verified signature. The key has expired.
GPG key ID: 4AEE18F83AFDEB23
Expired
Learn about vigilant mode.

Minor improvements:

  • Added a new optional variable MAX_QUOTA which allows you to control the maximum number of crawled pages per process instance, instead of per crawl.
  • Added a new "recently completed" pages to the stats of the crawl.
  • Added a new seo.h2s analysis to the seo library, which collects all h2 headers in a page.
Assets 3
Loading