Skip to content

Scrapy based project, crawling and scraping all images that saved into a 3-level folders (Girl/Album/img). Selenium is utilised for "click for next image"

Notifications You must be signed in to change notification settings

I-m-PhD/mztScrapy

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

15 Commits
 
 
 
 
 
 
 
 

Repository files navigation

Introduction

Aims at 美姿图, which allows users to view upto 15 images per album from the browser (unlimited in its mobile App)

Specification

Built on macOS 13.1
with os built-in Python: 3.9.6
utilising scrapy pillow selenium

Contents

Contains two scrapy projects:

  • mzt_model starting with the page 模特
  • mzt_top starting with the page 最热

Miscellaneous

Selenium is not used as a middleware but directly coded in the spider

About

Scrapy based project, crawling and scraping all images that saved into a 3-level folders (Girl/Album/img). Selenium is utilised for "click for next image"

Topics

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published

Languages