Web Scraping Course in Python: BS4, Selenium and Scrapy

Become an expert in web scraping with projects in Beautiful Soup, Selenium and Scrapy

Have you ever thought about how important is data in our everyday life?

What you’ll learn

  • Learn to scrape website from scratch with Beautiful Soup.
  • Learn to scrape JavaScript website with Selenium and Scrapy-Splash.
  • Learn the most powerful web scraping framework in Python: Scrapy.
  • Learn the essential stuff you need before learning web scraping (Python, HTML, XPath).
  • How to handle pagination with any scraping tool.
  • Store the extracted Data in MongoDb & SQLite3.
  • 4 web scraping projects (from beginner to advanced projects).
  • Build a CrawlSpider.
  • Scrape APIs.
  • Build datasets.
  • Build a complete Spider from A to Z.
  • Web Scraping best practices.
  • Scrape infinite scroll websites.
  • Login to websites using Selenium & Scrapy.

Course Content

  • Introduction –> 7 lectures • 54min.
  • Introduction to Beautiful Soup –> 6 lectures • 26min.
  • Scraping Multiple Pages with Beautiful Soup –> 2 lectures • 35min.
  • XPath –> 3 lectures • 14min.
  • Introduction to Selenium –> 8 lectures • 45min.
  • Project #1: Dealing with Multiple Pages using Selenium (Amazon Audible Bot) –> 4 lectures • 52min.
  • Project #2: Infinite Scrolling & Login (Twitter Bot) –> 4 lectures • 55min.
  • Introduction to Scrapy –> 11 lectures • 49min.
  • Dealing with Multiple Pages using Scrapy –> 3 lectures • 28min.
  • Project #3: Building Crawlers with Scrapy –> 3 lectures • 21min.
  • Exporting Data to a Database: MongoDB and SQLite –> 3 lectures • 25min.
  • Scraping APIs & Login to website with Scrapy –> 3 lectures • 27min.
  • Splash Basics –> 3 lectures • 16min.
  • Project #4: Scraping JavaScript websites using Splash –> 4 lectures • 25min.

Web Scraping Course in Python: BS4, Selenium and Scrapy

Requirements

  • Basic knowledge in Python.
  • Internet Access.

Have you ever thought about how important is data in our everyday life?

It doesn’t matter if you’re a data scientist, data analyst, or programmer, getting access to the data you need is important! This is why some of the top Fortune 500 companies such as Walmart, Target, and CNN use web scraping to stay ahead with data. We can say this is one of their best secret weapons.

Welcome to Web Scraping in Python with BeautiuflSoup, Selenium, and Scrapy!

The most complete and project-oriented course. In this course, we’re going to learn web scraping solving cool projects that will help us scrape data off some of the most well-known websites. To name a few:

 

  • Amazon
  • Audible
  • Twitter
  • Google
  • Football Stats
  • Worldometers
  • Movie pages 

This is the most complete web scraping course in Python and is split into 3 parts: BeautiuflSoup, Selenium, and Scrapy. My goal is that you become an expert in web scraping. This is why only 10% of the content of this course is focused on Beautiful Soup, while 40% is dedicated to Selenium and 50% to Scrapy.

 

Why I built the course this way?

Beautiful Soup has a lot of limitations, but it’s still useful for a gentle introduction to web scraping. In contrast, if you learn both Selenium you will be able to scrape any website. and if you add Scrapy to your toolkit you will be able to scrape any website faster than with any other web scraping library. Throughout this course, you will see the power of web scraping with each Python library.

 

What makes this course different from the others, and why you should enroll?

  • This is the most updated and complete web scraping course in Python. You will be using Python 3.7, Scrapy 2.4, Selenium 3.1 and BS4
  • This is the most project-based course you will find. We will scrape many of the most well-known websites
  • You will have an in-depth step by step guide on how to become a professional web scraper.
  • You will learn how to use Selenium, Scrapy, and Splash to scrape JavaScript-driven websites. You won’t find any tutorials out there that teach how to use these web scraping tools the way I do in this course.
  • 30 days money back guarantee by Udemy

 

At the end of the course, you’ll know how to build your own web scraper to obtain new data, learn the best techniques for web scraping and more.

 

Join me now and let’s start scraping the web together!

 

Who this course is for:

  • Anyone who wants to scrape data from any website with Beautiful Soup, Selenium, and Scrapy
  • Data Scientists who want to take their skills to the next level
  • Web developers looking to obtain new information or automate tasks
  • Anyone who wants to stop spending hours manually copying data off a website, and wants to automate this task