When working with web data extraction, one might need to locate specific pages on a website quickly. This blog post will walk you through how you can use custom code, generated by ChatGPT, to find pricing pages on any website. Don't worry; this won't require you to look at any code directly!

To get started with this process, ChatGPT is capable of generating custom code that assists in extracting specific parts of a website. In this case, we want to find pricing pages. Here’s a broad overview of how the code operates:

Let's say we want to test this on seotesteronline.com. Here's how you go about it:

Open your browser and run the provided custom code. Initially, you might not see any immediate outputs, as the code may not log data directly in the browser console. This is because, in an effort to return specific data, the logging statements could have been removed.

Although direct visual feedback may be missing, the custom code works in the background. The right-hand side of the environment should reveal the URL that the custom code detected. This URL is likely the pricing page or any relevant page of interest.

Once the custom code has executed and returned the URL, this can be utilized in subsequent steps of your workflow. For example, if the desired page is found, this could be passed on to another script or tool for further processing, analysis, or reporting.

Using custom code generated by ChatGPT to find specific pages on a website, such as pricing pages, is an efficient and powerful method. By ensuring the code is correctly returning results and executing in the intended manner, you can streamline a significant part of your data extraction and web analysis tasks.

Step 1- Click on Inspect

Step 2- This automation runs and open the pricing page

Okay, so don't want you to have to look at code obviously, but what chatgbt did is inside of here It was just displaying the answer instead of returning it This whatever you have should probably end in return So if it's showing undefined, that's probably what's missing Unless nothing was found. Which, actually, you'd see it say null if nothing was found.

Unless you adjust your default. Anyways, this is what this'll do. This is gonna go to seotesteronline. com, and then it's gonna run our custom code.

So, here, if we open the browser, we may not see anything, cause I think when I told it to return something, it took out the code that was logging it here. Um, but what we'll see is on the right over here, the custom code will say the URL that was returned or at least whatever this custom code found, it'll return that.

And then we can use that in another step. So this went to their pricing page.