Скачать или смотреть Mastering Cheerio in Node.js: How to Loop Over Results Effectively

Learn how to properly loop over Cheerio results in Node.js, ensuring each item is its own object in the resulting array.
---
This video is based on the question https://stackoverflow.com/q/65539100/ asked by the user 'Waterfall' ( https://stackoverflow.com/u/14451141/ ) and on the answer https://stackoverflow.com/a/65539188/ provided by the user 'Tomalak' ( https://stackoverflow.com/u/18771/ ) at 'Stack Overflow' website. Thanks to these great users and Stackexchange community for their contributions.

Visit these links for original content and any more details, such as alternate solutions, latest updates/developments on topic, comments, revision history etc. For example, the original title of the Question was: how to loop over results using cheerio

Also, Content (except music) licensed under CC BY-SA https://meta.stackexchange.com/help/l...
The original Question post is licensed under the 'CC BY-SA 4.0' ( https://creativecommons.org/licenses/... ) license, and the original Answer post is licensed under the 'CC BY-SA 4.0' ( https://creativecommons.org/licenses/... ) license.

If anything seems off to you, please feel free to write me at vlogize [AT] gmail [DOT] com.
---
Mastering Cheerio in Node.js: How to Loop Over Results Effectively

When working with web scraping in Node.js, you might find yourself transitioning from powerful libraries like Python's Beautiful Soup to Cheerio. While Cheerio offers a familiar jQuery-like syntax for parsing HTML, certain nuances can trip up developers, especially when it comes to looping through elements. This guide addresses a common issue: ensuring each extracted item is placed into its own object in an array, rather than collapsing multiple contents into a single object. Let’s dissect this problem and provide a clear solution.

The Problem

Scenario Overview

You are attempting to scrape data from a web page using Cheerio, where multiple <text> elements exist within the same <div>, each containing numbers and labels. The challenge is that the elements share the same ID, making it tricky to isolate the data you want to extract. In Python, you might have successfully appended individual items to a list, but you find that your Node.js implementation results in one array object encompassing all data.

Example HTML Structure

Consider the following HTML snippet:

[[See Video to Reveal this Text or Code Snippet]]

Incorrect Implementation

Your initial attempt might look something like this:

[[See Video to Reveal this Text or Code Snippet]]

This code aggregates the numbers and labels into a single object, which is not the desired output structure.

The Solution

Using the map() Method

To ensure that each number and label are stored in their distinct objects within an array, you can leverage Cheerio's map() method. Here's a step-by-step breakdown of an effective approach:

Fetch the HTML Content: Start by retrieving the HTML content from the page you want to scrape.

Load the HTML into Cheerio: Use Cheerio to parse the HTML document and create a jQuery-like interface for traversal.

Use map() to Create Individual Objects: Access the .numbers elements and for each of them, construct an object that includes the number and its corresponding label using the .next() method.

Correct Implementation

Here's how the revised code would look:

[[See Video to Reveal this Text or Code Snippet]]

Key Benefits of This Approach

Contextual this: Using map() allows you to use this in the context of the current iteration, making it easy to extract related data.

Adjacent Element Retrieval: The .next() function helps to find the immediate sibling element (the corresponding label) for a number, ensuring accurate pairing.

Array Conversion: Finally, converting the result to an array with .toArray() makes it ready for further processing or output.

Conclusion

By following this structured approach with Cheerio in Node.js, you can efficiently scrape data, ensuring that each number-label pair is encapsulated within its own object in the resulting array. This not only enhances code readability but also simplifies data manipulation thereafter. Happy scraping!