Web Scraping with Python

Name: Web Scraping with Python
Availability: InStock
Author: FreeAcademy

Intermediate

Assumes foundational knowledge. Builds on basics.

Master web scraping techniques using Python. Learn to extract data from websites using BeautifulSoup and Selenium, handle pagination, deal with anti-scraping measures, and build production-ready data pipelines while following ethical practices.

Please sign in to enroll in this course

Course Content

10 modules • 30 lessons

Module 1: Introduction to Web Scraping

2 lessons

1.1

What is Web Scraping?

1.2

Legal and Ethical Considerations

Module 2: HTTP and Web Fundamentals

3 lessons

2.1

Web Scraping with Python

Course Content

Module 1: Introduction to Web Scraping

What is Web Scraping?

Legal and Ethical Considerations

Module 2: HTTP and Web Fundamentals

HTTP Basics

The Requests Library

HTML Structure Review

Module 3: BeautifulSoup Fundamentals

Introduction to BeautifulSoup

Finding Elements

Extracting Data

CSS Selectors

Module 4: Advanced Scraping Techniques

Handling Pagination

Forms and Authentication

Headers and Cookies

Module 5: JavaScript-Rendered Content

JavaScript Rendering Challenges

Selenium Basics

Browser Automation

Playwright as an Alternative

Module 6: Anti-Scraping Measures

Common Anti-Scraping Techniques

Rate Limiting and Delays

Proxies and Rotation

Module 7: Storing Scraped Data

Data Formats (CSV, JSON, Excel)

Database Storage

Data Cleaning and Validation

Module 8: Production Scraping

Scheduling Scrapers

Error Handling and Logging

Building a Scraping Pipeline

Module 9: APIs vs Scraping

When to Use APIs

Finding Hidden APIs

Module 10: Real-World Projects

Project: News Article Scraper

Project: Price Tracker

Project: Data Aggregator