Скачать или смотреть Extracting URLs from JSON Based on Status with jq

Learn how to efficiently extract URL values from JSON data where status equals 200 using jq, making data manipulation a breeze!
---
This video is based on the question https://stackoverflow.com/q/62907100/ asked by the user 'Joel Deleep' ( https://stackoverflow.com/u/8474328/ ) and on the answer https://stackoverflow.com/a/62907224/ provided by the user 'Benjamin W.' ( https://stackoverflow.com/u/3266847/ ) at 'Stack Overflow' website. Thanks to these great users and Stackexchange community for their contributions.

Visit these links for original content and any more details, such as alternate solutions, latest updates/developments on topic, comments, revision history etc. For example, the original title of the Question was: Extract value from JSON based on another value

Also, Content (except music) licensed under CC BY-SA https://meta.stackexchange.com/help/l...
The original Question post is licensed under the 'CC BY-SA 4.0' ( https://creativecommons.org/licenses/... ) license, and the original Answer post is licensed under the 'CC BY-SA 4.0' ( https://creativecommons.org/licenses/... ) license.

If anything seems off to you, please feel free to write me at vlogize [AT] gmail [DOT] com.
---
Extracting URLs from JSON Based on Status with jq

JSON (JavaScript Object Notation) is a widely used data format for storing and exchanging information, especially in web development and APIs. However, parsing and extracting specific information from JSON can sometimes be challenging, particularly when it involves filtering based on certain conditions. In this post, we will address a common problem: how to extract URLs from a JSON dataset based on a specific status code using the command-line tool jq.

The Problem

Imagine you have a file (file.txt) containing results in JSON format, as shown below:

[[See Video to Reveal this Text or Code Snippet]]

In this dataset, you want to extract all URLs that have a status of 200. In this example, the expected output is the URL https://www.example.com/newfuzz. Initially, you tried using grep to filter the results, but quickly realized that extracting data from a JSON array requires a different approach.

The Solution

The good news is that you can accomplish this task efficiently using the jq command-line utility. Here’s the command you need to run:

[[See Video to Reveal this Text or Code Snippet]]

Breaking Down the Command

Let’s understand each part of this command:

jq: This is the command you'll be using to process JSON files.

-r: This flag tells jq to output raw strings rather than JSON-encoded strings, making it easier to read and process the output.

'.results[]: This expression iterates through each element in the results array of the JSON data.

select(.status == 200): This function filters the elements of the array, passing through only those with a status of 200.

.url: This extracts the value of the url field for the filtered objects.

Example Output

When you run the command above on your JSON data, the output will be:

[[See Video to Reveal this Text or Code Snippet]]

This simple yet powerful command allows you to filter and extract only the URLs you're interested in based on the specified condition.

Conclusion

Extracting specific data from JSON can be daunting, but tools like jq make it much more manageable. By understanding how to navigate through JSON arrays and apply selections, you can effectively retrieve the information you need. This technique is particularly useful in web development, API testing, and data analysis.

Now that you have this knowledge, you can confidently manipulate JSON data and extract exactly what you're looking for with just a few lines of code.