Build a Web Scraper in Go
Build an SEO-flavored crawler in Go that maps internal links and teaches you how scraping really works. Also available in:
Also available in:
Author
Boot.dev Team
Our expert in-house course authors are tenured software developers whose love for coding is only outstripped by a love for crafting addicting lessons.
6 Hours
of content
13 Addicting
lessons
Earn a certificate
of completion
Learn online
at your pace
What will you learn?
Use Go to build a web crawler that scrapes pages. It's a tool that any SEO expert would be happy to have. You'll make HTTP requests and parse HTML to generate reports that can easily marshaled to standard output or a file. If you're interested in getting a job doing data analysis, this project will teach you how Go can be used to build a command-line application.
Chapter List
Join 1,337 students in the Build a Web Scraper in Go course
Read reviews of their learning experiences
Building the same project but in Go solidified my love for Go. Handling concurrency in Go is so much more elegant.
Zafir Hossain Chowdhury
Dhaka, Bangladesh
This project was really fun. It was not easy but I understood everything. My favorite part was the chapter on concurrency--my first exposure to controlled concurrency.
Todd Naumann
United States
This course is amazing. It gets you ready to do web scraping with go.
Luis Octávio
RJ
As an advanced beginner, I found the project to be excellent and challenging. Covers testing, recursion, concurrency, outputting to CSV, and parsing html.
tim walker
Seattle, WA
This is one of the nice projects on applying goroutines
Stephen Kisengese
Kenya
A really cool project!
Bhuvnesh Bhuwan
Hyderabad, India
Good course
Oleksandr Azarov
Kyiv, Ukraine
Amazing course for both web crawler knowledge as well as pushing your understanding of concurrency!
Harold Hernandez
San Jose Del Monte City, Philippines
good course for understanding basic usage of goroutine with web crawling
yanmo
Seoul, Korea
Showing 1-9 of 14
Mediocrity doesn't cut it anymore
The only way to become a great developer is to write a lot of code
Avoid tutorial hell
by writing a ton of code
Stay motivated with
a game-like curriculum
Build portfolio projects
to prove your skills
Delve deeper
into foundational concepts
Learn flexibly online
without interrupting your life
For 1% the price of college
to minimize your financial risk
Frequently asked Questions
Got questions? We've got answers
Yes! It's free to create an account and start learning. You'll get all the immersive and interactive features for free for a few chapters. After that, if you still haven't paid for a membership, you'll be in read-only (content only) mode.
Platform
Languages
Subjects
Support
Pricing
Community
