Web Scraping with Python

Name: Web Scraping with Python
Availability: InStock
Author: FreeAcademy

Intermediate

Assumes foundational knowledge. Builds on basics.

Master web scraping techniques using Python. Learn to extract data from websites using BeautifulSoup and Selenium, handle pagination, deal with anti-scraping measures, and build production-ready data pipelines while following ethical practices.

Course Content

10 modules • 30 lessons

Module 1: Introduction to Web Scraping

2 lessons

1.1

What is Web Scraping?

1.2

Legal and Ethical Considerations

Module 2: HTTP and Web Fundamentals

3 lessons

2.1

HTTP Basics

2.2

The Requests Library

2.3

HTML Structure Review

Module 3: BeautifulSoup Fundamentals

4 lessons

3.1

CSS Selectors

Module 4: Advanced Scraping Techniques

3 lessons

4.1

Handling Pagination

4.2

Forms and Authentication

4.3

Headers and Cookies

Module 5: JavaScript-Rendered Content

4 lessons

5.1

JavaScript Rendering Challenges

5.2

Selenium Basics

5.3

Browser Automation

5.4

Playwright as an Alternative

Module 6: Anti-Scraping Measures

3 lessons

6.1

Common Anti-Scraping Techniques

6.2

Rate Limiting and Delays

6.3

Proxies and Rotation

Module 7: Storing Scraped Data

3 lessons

7.1

Data Formats (CSV, JSON, Excel)

7.2

Database Storage

7.3

Data Cleaning and Validation

Module 8: Production Scraping

3 lessons

8.1

Scheduling Scrapers

8.2

Error Handling and Logging

8.3

Building a Scraping Pipeline

Module 9: APIs vs Scraping

2 lessons

9.1

When to Use APIs

9.2

Finding Hidden APIs

Module 10: Real-World Projects

3 lessons

10.1

Project: News Article Scraper

10.2

Project: Price Tracker

10.3

Project: Data Aggregator

Web Scraping with Python

Intermediate

Assumes foundational knowledge. Builds on basics.

Course Content

10 modules • 30 lessons

Module 1: Introduction to Web Scraping

2 lessons

1.1

What is Web Scraping?

1.2

Legal and Ethical Considerations

Module 2: HTTP and Web Fundamentals

3 lessons

2.1

HTTP Basics

2.2

The Requests Library

2.3

HTML Structure Review

Module 3: BeautifulSoup Fundamentals

4 lessons

3.1

Introduction to BeautifulSoup

3.2

Finding Elements

3.3

Extracting Data

3.4

CSS Selectors

Module 4: Advanced Scraping Techniques

3 lessons

4.1

Handling Pagination

4.2

Forms and Authentication

4.3

Headers and Cookies

Module 5: JavaScript-Rendered Content

4 lessons

5.1

JavaScript Rendering Challenges

5.2

Selenium Basics

5.3

Browser Automation

5.4

Playwright as an Alternative

Module 6: Anti-Scraping Measures

3 lessons

6.1

Common Anti-Scraping Techniques

6.2

Rate Limiting and Delays

6.3

Proxies and Rotation

Module 7: Storing Scraped Data

3 lessons

7.1

Data Formats (CSV, JSON, Excel)

7.2

Database Storage

7.3

Data Cleaning and Validation

Module 8: Production Scraping

3 lessons

8.1

Scheduling Scrapers

8.2

Error Handling and Logging

8.3

Building a Scraping Pipeline

Module 9: APIs vs Scraping

2 lessons

9.1

When to Use APIs

9.2

Finding Hidden APIs

Module 10: Real-World Projects

3 lessons

10.1

Project: News Article Scraper

10.2

Project: Price Tracker

10.3