Web Scraping in Python Selenium, Scrapy + ChatGPT Prize 2024

Updated 2024 | 4 projects with Beautiful Soup, Selenium and Scrapy | ChatGPT for web scraping

4.71 (2017 reviews)

Udemy

platform

English

language

Programming Languages

What you will learn

Learn to scrape website from scratch with Beautiful Soup

Learn the essential stuff you need before learning web scraping (Python, HTML, XPath)

How to use ChatGPT for web scraping

4 web scraping projects (from beginner to advanced projects)

Handle pagination with any scraping tool

Learn to scrape JavaScript website with Selenium and Scrapy-Splash

Store the extracted Data in MongoDb & SQLite3

Scrape infinite scroll websites

Login to websites using Selenium & Scrapy

Course Gallery

Web Scraping in Python Selenium, Scrapy + ChatGPT Prize 2024 – Screenshot 1 — Screenshot 1 – Web Scraping in Python Selenium, Scrapy + ChatGPT Prize 2024

Web Scraping in Python Selenium, Scrapy + ChatGPT Prize 2024 – Screenshot 2 — Screenshot 2 – Web Scraping in Python Selenium, Scrapy + ChatGPT Prize 2024

Web Scraping in Python Selenium, Scrapy + ChatGPT Prize 2024 – Screenshot 3 — Screenshot 3 – Web Scraping in Python Selenium, Scrapy + ChatGPT Prize 2024

Web Scraping in Python Selenium, Scrapy + ChatGPT Prize 2024 – Screenshot 4 — Screenshot 4 – Web Scraping in Python Selenium, Scrapy + ChatGPT Prize 2024

Loading charts...

Comidoc Review

Our Verdict

This course undoubtedly provides a strong foundation in web scraping using popular tools and techniques. However, certain sections feel outdated and disorganized, which can hinder learners' progress. Given its overall positive aspects, we hope to see an update soon addressing these shortcomings while maintaining the wealth of knowledge provided.

What We Liked

Well-structured curriculum covering essential web scraping tools like Beautiful Soup, Selenium, and Scrapy.
Hands-on experience gained from working on 4 real-life projects, ranging from beginner to advanced levels.
Comprehensive introduction to using ChatGPT for web scraping tasks.
Thorough explanation of handling pagination, JavaScript websites, and infinite scroll websites.

Potential Drawbacks

Some course materials need updating, particularly regarding compatibility with newer software versions.
A few sections like Section 17 dealing with Selenium seem disorganized, causing confusion for learners.
Instances of outdated website references and broken code snippets found in the content.
Insufficient communication with students, leaving some critical issues unaddressed in the Q&A section.