Scrapy: Powerful Web Scraping & Crawling with Python

Python Scrapy Tutorial - Learn how to scrape websites and build a powerful web crawler using Scrapy, Splash and Python
4.21 (2785 reviews)
Udemy
platform
English
language
Programming Languages
category
Scrapy: Powerful Web Scraping & Crawling with Python
16 577
students
11 hours
content
Jan 2020
last update
$79.99
regular price

What you will learn

Creating a web crawler in Scrapy

Crawling a single or multiple pages and scrape data

Deploying & Scheduling Spiders to ScrapingHub

Logging into Websites with Scrapy

Running Scrapy as a Standalone Script

Integrating Splash with Scrapy to scrape JavaScript rendered websites

Using Scrapy with Selenium in Special Cases, e.g. to Scrape JavaScript Driven Web Pages

Building Scrapy Advanced Spider

More functions that Scrapy offers after Spider is Done with Scraping

Editing and Using Scrapy Parameters

Exporting data extracted by Scrapy into CSV, Excel, XML, or JSON files

Storing data extracted by Scrapy into MySQL and MongoDB databases

Several real-life web scraping projects, including Craigslist, LinkedIn and many others

Python source code for all exercises in this Scrapy tutorial can be downloaded

Q&A board to send your questions and get them answered quickly

Charts

Students
Price
Rating & Reviews
Enrollment Distribution

Comidoc Review

Our Verdict

This 4.25-star rated Scrapy course on Udemy provides in-depth, detailed instruction and real-life examples that enable learners to apply their web scraping skills in various contexts. With over 16K subscribers and updated as recently as early 2020, the course covers Scrapy's powerful features while providing Q&A support for students. However, prepare to invest time into fully understanding the content due to occasional pacing problems and potentially under-explained code rationales. Make sure you dedicate the required effort to ensure you derive the maximum benefit from this engaging, informative course. Note that the codes' functionality can vary, occasionally requiring additional work to achieve desired outcomes.

What We Liked

  • In-depth coverage of Scrapy and web scraping, touching on advanced topics like editing and using Scrapy parameters, building Scrapy advanced spiders, and more
  • Real-life web scraping projects utilizing Craigslist, LinkedIn, and others, enabling students to apply their knowledge in practical contexts
  • Rich supporting materials, such as downloadable Python source code for all exercises and Q&A board for queries
  • Comprehensive video delivery that covers numerous aspects of Scrapy without leaving essential details unexplained

Potential Drawbacks

  • Pacing and organization concerns raised by several users; some key points and information may require rewinding to fully grasp
  • Lack of clear motivation behind written code, which impacts students' understanding of the rationale and purpose behind specific actions taken within Scrapy files
  • The occasional issue with provided code not functioning as intended, resulting in time lost troubleshooting or learning from alternative sources
  • Subtitles need improvement for better clarity
1110366
udemy ID
11/02/2017
course created date
14/07/2019
course indexed date
Bot
course submited by
Scrapy: Powerful Web Scraping & Crawling with Python - Coupon | Comidoc