- Thread Starter
- #1
The Ultimate Web Scraping Course
Released 8/2024
MP4 | Video: h264, 1920x1080 | Audio: AAC, 44.1 KHz, 2 Ch
Genre: eLearning | Language: English | Duration: 48 Lessons ( 10h 40m ) | 3 GB
In the course I show you how to scrape these sites (and give you the code)
Tiktok
Zillow
Google Search
Google Maps
Amazon
Indeed
ESPN
Angi List
And more!
I'll also show you how I have gotten clients, and how I've gotten my 25k+ followers on social media (and how you can too)
What's Inside
9 hours of videos
Is web scraping legal?
Scrapers vs Hackers
All the services I use (proxies, coding language, servers, database, packages to get around getting blocked)
How websites get their data (how API's work)
My process for scraping ANY site
How to find where data is coming from
How to avoid getting blocked
All about proxies
Scraping by web framework (React, Next.js, static HTML/server rendered, ASP.NET, Java)
How to reverse engineer sites with good blocking
Scraping sites with Cursor Based Pagination (YouTube comments)
Scraping a chrome extension for free emails
How to scrape mobile apps
How to skip trace (find random people's phone numbers and emails)
How to get Puppeteer running on AWS Lambda
How to intercept requests with Puppeteer
Solving captchas with Puppeteer
How to get web scraping clients
How to charge clients
Product ideas that rely on web scraping
Disclaimers
The code is in JavaScript and I am using a Mac with VS Code editor
I only briefly talk about Puppeteer (there are MUCH better ways)
If you are dissatisfied at all with the content, I will give you 100% refund (contact me at adrian@thewebscrapingguy.com)
Scraping isn't magic ? you do have to have a source to scrape (a website). Like you can't scrape people's bank accounts or something. That would be more hacking, which is a different field.
Prerequisites
You should have a good understanding of JavaScript, or some programming language, to get the most out of this course.
If you don't know how to code at all, this is not the course for you.
I don't teach the basics of coding or JavaScript in this course.
