Modern Web Scraping with Python using Scrapy Splash Selenium

Become an expert in web scraping and web crawling using Python 3, Scrapy, Splash and Selenium 2nd EDITION (2021)
4.41 (3805 reviews)
Udemy
platform
English
language
Programming Languages
category
instructor
Modern Web Scraping with Python using Scrapy Splash Selenium
25 352
students
9 hours
content
May 2021
last update
$29.99
regular price

Why take this course?

🌟 Modern Web Scraping with Python using Scrapy, Splash & Selenium ✈️ (2nd Edition, 2021)

🚀 Course Headline: Become an expert in web scraping and web crawling using Python 3, Scrapy, Splash, and Selenium!

🔍 What You Will Learn:

  • 📘 The fundamentals of Web Scraping without relying on paid tools, mastering the art of creating your own scraping tool (spider) using Scrapy.
  • 🔎 Understanding and utilizing XPath & CSS Selectors to locate content/nodes from the DOM effectively.
  • 💾 Storing data in various formats like JSON, CSV, or even external databases such as MongoDb & SQLite3.
  • 🎨 Writing your own custom Pipeline to process and refine your data.
  • 🚀 Grasping the fundamentals of Splash to handle Javascript websites and enhance your scraping capabilities with Selenium.
  • 🕸️ Managing the crawling behavior by building a CrawlSpider to navigate through complex webs of information.
  • 🔒 Learning how to avoid getting banned while scraping by implementing best practices.
  • 🛠️ Building a custom Middleware to extend Scrapy's functionality.
  • ✅ Implementing web scraping best practices and techniques.
  • 🌍 Scraping APIs, managing Request Cookies, and handling dynamic paging for a comprehensive data extraction experience.
  • 📈 Applying your newfound skills to extract unstructured data from web pages and structure it for data analysis.

🚀 Exclusive Features:

  • 🌟 Hosting spiders in Heroku and learning how to create scripts for periodic execution without manual intervention.
  • 🎓 A unique, in-depth approach focusing on the practical application of Splash in web scraping.
  • 💰 Backed by a 30 days money-back guarantee from Udemy.

🔥 Student Testimonials:

  • "I was particularly looking for web scraping using XPATHs, and this course is addressing that. It also covers dynamic paging. A proper mix of theory and practical. A must-have for those who want to do web scraping! GREAT learning experience !!!". - Hiran Kumar
  • "90% of what I was searching for!!! Great job with clear explanations and great communication with Ahmed". - Raylyson Estanista
  • "Ahmed’s Web scraping course is awesome. His approach using Python with Scrapy and Splash works well with all websites, especially those that make heavy use of JavaScript. Highly recommended this course and any of Ahmed Rafik’s Udemy courses!" - Richard Blackmon
  • "Great course, introduction to Scrapy (even with no prior Python experience). Quick and thorough at the same time." - I S
  • "Excellent course, responsive communication from Ahmed. Highest recommendation!" - Robert Nolte
  • "The course is very good and explanations are crystal clear! The instructor is very supportive in case of questions. Highly recommended." - Shubina Ekaterina
  • "I like the course, clear explanations, and good communication with Ahmed. All topics are interesting and full of information. I improved my skills in Scrapy thanks to this course. Author updates course content with new videos which is a big bonus!) Explained more advanced topics that I never saw in other courses. Thank you, Ahmed. Waiting for new videos!" - Ruslan Romanenko

📈 Why Join This Course?

If you're a data analyst looking to enhance your toolset or someone keen on extracting unstructured data from web pages and structuring it for analysis, this course is tailored for you. With a comprehensive curriculum, real-world applications, and a commitment to student success through clear communication and responsive support, Ahmed Rafik's course stands out as the go-to resource for mastering web scraping with Scrapy, Splash, and Selenium.

Join us now and embark on your journey to becoming a proficient web data extraction specialist! 🤝


Note: The course content is regularly updated with new videos and materials to ensure students receive the most up-to-date knowledge in the field. Always refer to the latest course updates for the best learning experience.

Course Gallery

Modern Web Scraping with Python using Scrapy Splash Selenium – Screenshot 1
Screenshot 1Modern Web Scraping with Python using Scrapy Splash Selenium
Modern Web Scraping with Python using Scrapy Splash Selenium – Screenshot 2
Screenshot 2Modern Web Scraping with Python using Scrapy Splash Selenium
Modern Web Scraping with Python using Scrapy Splash Selenium – Screenshot 3
Screenshot 3Modern Web Scraping with Python using Scrapy Splash Selenium
Modern Web Scraping with Python using Scrapy Splash Selenium – Screenshot 4
Screenshot 4Modern Web Scraping with Python using Scrapy Splash Selenium

Loading charts...

Comidoc Review

Our Verdict

Modern Web Scraping with Python using Scrapy Splash Selenium offers an extensive exploration of various web scraping techniques and tools. The course is enriched with numerous practical projects that help students understand the nuances of creating Spiders, storing data in databases, bypassing clouds and avoiding website bans while scraping. However, there are concerns regarding outdated information in a few areas along with occasional lapses in clear explanations. Furthermore, the strong accent is mentioned as an obstacle for some learners. Acknowledging these drawbacks, this course remains valuable, especially for aspiring web scrapers who wish to grow their skillset using Scrapy, Splash and Selenium.

What We Liked

  • In-depth coverage of web scraping techniques using various tools like Scrapy, Splash and Selenium
  • Covers creating a complete Spider from scratch, handling duplicated data and storing extracted data in MongoDb & SQLite3
  • Comprehensive projects to enhance understanding of web crawling and scraping concepts
  • Valuable insights on best practices for web scraping and avoiding bans

Potential Drawbacks

  • A few users have reported outdated content, non-functional links in projects and lack of instructor's responsiveness to queries
  • Strong accent may hinder understanding the lessons leading to slower learning
  • Incomplete or missing explanations for certain concepts, leaving students to figure out things on their own
  • Quality control issues with transcriptions

Related Topics

1757906
udemy ID
20/06/2018
course created date
22/10/2019
course indexed date
Bot
course submited by