OneBite.Dev - Coding blog in a bite size

Web scraping with javascript (Easy step by step)

Learn web scraping with JavaScript through this easy step-by-step guide, and start extracting data from websites effortlessly and efficiently!

JavaScript, a popular programming language, can be used to perform web scraping to gather data for various purposes, such as data analysis, price comparison, or content aggregation. In this article, I will show you how the process of web scraping using JavaScript.

web scraping with javascript cover.webp

What is Web Scraping?

Web scraping is the process of collecting data from websites. This is done by sending a request to the website’s server, fetching and parse the webpage’s raw HTML code, and then extracting the needed information from it.

Why using JavaScript for Web Scraping?

JavaScript is a versatile programming language that runs in the browser. This makes it a great choice for web scraping, as you can run your scraping code directly in the browser’s console, which provides a live interaction with the webpage.

Basic idea for scraping with Javascript

If you’re a web developer, you’ve probably play around with the Developer Tools in the browser. basic javascript web scraping with developer tools.webp

You can actually grab or scrape the data from a certain website using this method by playing with Javascript DOM.

Here is the step by step tutorial:

1. Open the Browser’s Developer Tools:

2. Find the Element’s Selector:

3. Write the JavaScript Code:

Example Code:

const element = document.querySelector('your-element-selector');

Replace your-element-selector with the selector of the element you want to scrape. This code will print the element’s text content to the console.

Handling Multiple Elements: If you want to scrape multiple elements (e.g., items in a list), you can use document.querySelectorAll and iterate through the results:

const elements = document.querySelectorAll('your-elements-selector');
elements.forEach(element => {

Manually opening each webpage one by one to extract data is undoubtedly a tedious and time-consuming task. Rest assured, automation is the key to efficiency in this scenario. Leveraging Node.js, we can utilize powerful and user-friendly web scraping tools such as Cheerio, Puppeteer, and others, which are specifically designed to streamline and optimize the process of data extraction in JavaScript.

I plan to create a series post for this! so we can cover it one by one. But for now, feel free to look at this other resource: Web Scraping in Javascript and Nodejs (Tutorial for Beginner).

Which is better for web scraping, Python or Javascript?

Web scraping involves extracting data from websites, and both JavaScript and Python are popular languages for this task. However, they have different strengths and weaknesses depending on the use case. Here’s a comparison to help you decide which might be better for your web scraping needs:

JavaScript for web scraping


  1. Runs in the Browser: JavaScript can run directly in the browser, allowing you to interact with the webpage in real-time. This is especially useful for scraping dynamic websites that load content asynchronously with JavaScript.

  2. Browser DevTools: You can use browser Developer Tools to inspect elements, run JavaScript code in the console, and debug your scraping script on the spot.

  3. Access to Browser APIs: JavaScript has access to various browser APIs, enabling you to perform actions like clicking buttons, filling out forms, and navigating between pages as a real user would.

  4. Node.js for Server-Side Scraping: With Node.js, you can run JavaScript on the server side and use libraries like Puppeteer or Playwright to control a headless browser, which is great for automating and scripting your scraping tasks.


Limited Libraries: Compared to Python, JavaScript has fewer libraries specifically dedicated to web scraping.

Python for web scraping


  1. Rich Ecosystem of Libraries: Python boasts a wealth of libraries for web scraping, such as Beautiful Soup, Scrapy, and Selenium, making it easier to parse HTML, navigate pages, and extract data.

  2. Ease of Use: Python’s simple and readable syntax makes it a great choice for beginners and for writing scripts quickly.

  3. Powerful for Data Processing: Python excels at data analysis and processing, with libraries like pandas and NumPy, which can be handy when you need to process and analyze the scraped data.

  4. Community and Resources: There is a large community of Python developers, which means plenty of tutorials, forums, and resources for learning and troubleshooting.


Not Natively in the Browser: Unlike JavaScript, Python does not run in the browser, so interacting with JavaScript-heavy sites can be more complex and might require tools like Selenium to automate a browser.

Choosing between JavaScript and Python for web scraping depends on your specific requirements:

Ultimately, both languages are capable of web scraping, and your personal or project-specific preferences will guide your choice.

Be Responsible! It’s important to use web scraping responsibly:

Web scraping occupies a gray area in terms of legality, and it largely depends on the website’s terms of service, the data being scraped, how the scraping is done, and the jurisdiction you are in.

javascript scraping