Changelog

All notable changes to this project will be documented in this file.

The format is based on Keep a Changelog, and this project adheres to Semantic Versioning.

3.2.0 (2024-04-04)

Features

add http error middleware (f937d89)
enable http error middleware by default in BasicSpider (450ed50)

3.1.0 (2024-03-22)

Features

drop php 8.1 support (738e5ee)

Miscellaneous Chores

bump php version to 8.3 in pipeline (8094704)
deps-dev: bump ergebnis/composer-normalize from 2.39.0 to 2.41.1 (0754a57)
deps-dev: bump ergebnis/php-cs-fixer-config from 6.11.0 to 6.20.0 (d448bb2)
deps-dev: bump phpunit/phpunit from 10.4.2 to 10.5.9 (97ec170)
deps-dev: bump spatie/browsershot from 3.60.0 to 3.61.0 (6f0c73e)
deps-dev: bump vimeo/psalm from 5.16.0 to 5.20.0 (f71d19a)
deps: bump guzzlehttp/guzzle from 7.8.0 to 7.8.1 (bd2b7bb)
deps: bump symfony/css-selector from 6.3.2 to 6.4.0 (695119c)
deps: bump symfony/event-dispatcher from 6.3.2 to 6.4.2 (b381b7e)
deps: bump symfony/options-resolver from 6.3.0 to 6.4.0 (4a74369)
drop php 8.1 support (ca85ab5)
fix psalm errors (653347a)

3.0.1 (2024-01-25)

Bug Fixes

fix psalm errors on latest release (2aec066)
fix race condition in SystemClock (c9d7d46)

3.0.0 (2024-01-05)

⚠ BREAKING CHANGES

add namespace to run and scheduler (#105)

Features

add namespace to run and scheduler (#105) (167e824)
add request proxy middleware (913b349)
add ResponseReceiving and ResponseReceived events (96c9332)
allow request middleware to set a response to bypass downloader (#106) (d8ae43e)
php 8.3 support (02772af)

Bug Fixes

rename integration tests so they actually get run (33eb25e)

Miscellaneous Chores

(deps): bump symfony/console from 6.2.5 to 6.2.7 (#93) (4f535da)
(deps): bump symfony/css-selector from 6.2.5 to 6.2.7 (20fc15b)
(deps): bump symfony/dom-crawler from 6.2.5 to 6.2.7 (#92) (25e4831)
add code of conduct (ed80fbe)
add CODEOWNERS file (9efec92)
add commitlint step to pipeline (64e785a)
add contribution guide (bdb57e0)
add issue templates (5c4fd81)
apply cs fixes (1c628d0)
deps-dev: bump ergebnis/composer-normalize from 2.29.0 to 2.30.2 (980b920)
deps-dev: bump ergebnis/php-cs-fixer-config from 5.3.1 to 5.3.2 (44d81c9)
deps-dev: bump ergebnis/php-cs-fixer-config from 5.3.2 to 5.3.3 (7b6f59f)
deps-dev: bump ergebnis/php-cs-fixer-config from 5.3.3 to 5.4.0 (#113) (cfaae68)
deps-dev: bump ergebnis/php-cs-fixer-config from 5.4.0 to 5.7.0 (#127) (61b2d2a)
deps-dev: bump phpunit/phpunit from 10.0.15 to 10.0.16 (57b4d03)
deps-dev: bump phpunit/phpunit from 10.0.16 to 10.0.18 (a5fe27a)
deps-dev: bump phpunit/phpunit from 10.0.18 to 10.2.0 (#130) (355a1e6)
deps-dev: bump phpunit/phpunit from 10.2.0 to 10.3.2 (9aded43)
deps-dev: bump vimeo/psalm from 5.6.0 to 5.8.0 (b60588a)
deps-dev: bump vimeo/psalm from 5.8.0 to 5.9.0 (#110) (0ef0d78)
deps-dev: bump vimeo/psalm from 5.9.0 to 5.15.0 (4835458)
deps: bump guzzlehttp/guzzle from 7.5.0 to 7.8.0 (0c4e817)
deps: bump guzzlehttp/psr7 from 2.4.3 to 2.5.0 (#120) (7572aae)
deps: bump psy/psysh from 0.11.12 to 0.11.13 (4542cbf)
deps: bump psy/psysh from 0.11.13 to 0.11.18 (#128) (8e940ef)
deps: bump psy/psysh from 0.11.22 to 0.12.0 (03da7a3)
deps: bump symfony/console from 6.2.7 to 6.2.8 (#111) (c24018c)
deps: bump symfony/css-selector from 6.2.7 to 6.3.2 (34e38b9)
deps: bump symfony/dom-crawler from 6.2.7 to 6.2.8 (#109) (8302a9a)
deps: bump symfony/dom-crawler from 6.2.8 to 6.2.9 (#118) (1099794)
deps: bump symfony/dom-crawler from 6.2.9 to 6.4.0 (40794f8)
deps: bump symfony/event-dispatcher from 6.2.5 to 6.2.7 (3a19510)
deps: bump symfony/event-dispatcher from 6.2.8 to 6.3.2 (fdfa495)
deps: bump symfony/options-resolver from 6.2.5 to 6.2.7 (#89) (fe24ee3)
deps: bump tj-actions/branch-names in /.github/workflows (cd125d2)
set up dependabot (29fb85e)
set up release please action (5a7df32)
update changelog (06f7e3d)
update changelog (e896c1a)
update copyright year (321626f)
upgrade to phpunit 10 (fd83095)

3.0.0 – 2024-01-05

Added

Added ProxyMiddleware (#185)
Added namespace to run and scheduler (#105) (167e824)
Added ResponseReceiving and ResponseReceived events (96c9332)
Allow request middleware to set a response to bypass downloader (#106) (d8ae43e)
Added PHP 8.3 support (02772af)

Fixed

Fixed bug where integration tests wouldn't get run (33eb25e)

2.0.1 – 2023-02-17

Fixed

Fixed version incompatibility with sebastian/version depenency

2.0.0 – 2023-02-06

Added

Added userAgent option to ExecuteJavascriptMiddleware (#82)
Added delay option to ExecuteJavascriptMiddleware (#72)

Changed

Dropped PHP 8.0 support
Updated various dependencies

1.1.1 — 2022-09-09

Changed

ExecuteJavascriptMiddleware now uses waitUntilNetworkIdle before returning the response body (#56)

1.1.0 — 2022-06-22

Added

Added a way to define custom item classes as well as item processors which only process certain types of items (#47)

Changed

Fixed deprecation warning in console commands for symfony/console:^6.1 (#44)

1.0.0 — 2022-04-19

Added

Added Roach::collectSpider method to start a spider run and return all scraped items.
Added array $context parameter to Roach::startSpider and Roach::collectSpider to pass arbitrary context data to a spider when starting a run.
Added roach:run <spider> command to start a spider through the CLI.
Added Roach::fake() method to test that a run for a given spider was started

Changed

Requests dropped by downloader middleware are no longer affected by requestDelay (fixes #27)
Move spatie/browsershot from a require to suggest as it's only necessary if the ExecuteJavascriptMiddleware is used. Remove ext-exif as a dependency for the same reason.

Removed

Removed default command from CLI. To start the REPL, you now need to explicitly invoke the roach:shell <url> command, instead.

0.2.0 - 2021-12-28

Added

Added ExecuteJavascriptMiddleware to retrieve a page’s body after executing Javascript (#7)

[0.1.0] - 2021-12-27

Added

Initial release