Introduction: Automation is a powerful tool that can streamline repetitive tasks and save time for businesses. In this blog post, we will explore how to automate the pagination process on the Cloudways website using a simple recording and scraping technique. By following the steps outlined below, you can efficiently handle pagination and extract valuable data with ease.

Step 1: Setting Up the Automation To initiate the automation process, the first step involves launching a new browser recording and navigating to the desired page on the Cloudways website. This initial setup allows us to prepare for the following steps seamlessly.

Step 2: Scrolling Down and Locating the Load More Button Once on the page, the next step is to scroll down to locate the "Load More" button. By recording a scroll down action, we can visually identify the button and prepare to interact with it during the automation process.

Step 3: Recording, Scraping, and Clicking the Load More Button After locating the button, we proceed by recording a scrape step specifically targeting the "Load More" button. This step is crucial as it enables us to determine the presence of new content to load. Subsequently, we click on the button to trigger the loading of additional results.

Step 4: Implementing a Filtering Mechanism To enhance the automation logic, we introduce a filter step to verify the necessity of clicking the "Load More" button. This filtering mechanism ensures efficient decision-making based on the availability of more content to load.

Step 5: Optimizing the Automation Process In refining the automation sequence, we revisit the steps to streamline the process. By adjusting the order of actions – scrolling down, clicking, scraping, and filtering – we optimize the automation flow for improved performance.

Finalizing the Automation Cycle At the conclusion of the automation cycle, we incorporate a final scraping step to gather all the extracted results comprehensively. By systematically selecting and capturing the data elements, we complete the automation process successfully.

Conclusion: Automating pagination on the Cloudways website offers a practical solution for efficiently handling large datasets and extracting valuable information. By following the step-by-step guide outlined in this blog post, you can leverage automation tools to streamline repetitive tasks and boost productivity in your workflow.

Step 1-Click on New automation

Step 2-Click on Web

Step 3-Click on Guided Templates

Step 4-Paste the link in URL column—Click on Save go to URL

Step 5-Click on Scroll down button—Scroll the webpage to record

Step 6-Click on Scrape single

Step 7-Scrape the elements and Confirm this

Step 8-Click on Click button to record a click step

Step 9-Click on Filter button to filter

Step 10-Select the required options in all column of Filter—Click on Save

Step 11-Finally Scrape a list to scrape few elements

So to handle pagination on the cloudways website, we can launch a new browser recording and go to that page is our first step.

So I'll paste that here and then we can go to that page. Then we're going to want to do is record a scroll down step so that we can scroll down to look for this load more button. Then we're going to scrape it and click it. The reason that helps us is we can apply a filter to decide if we still need to click this button and decide if it's still on the page.

So first step is going to be this scroll down step. So I'll record this and we see that blue border on the left telling us that was highlighted. Next, we can record a scrape step of the load more button, and then we will confirm this, and then we can add a click step of this load more button. The reason we're doing this is we are going to add a filter step so that we can decide on resetting part of this logic in case there's more to click because we want to continue scrolling and there's quite a few to click here.

Next we are going to add a filter. I think I mixed up some of the logic here. Actually, we're going to want to. Scroll down, then click, then scrape, then we're gonna add a filter where if step 4 is not empty, that means we need to click it again, then let's go back up to the scroll down step, or the click step, uh, we should actually probably switch to click in the scroll down step.

Otherwise, continue. We'll go back through this in a second. Okay, so we're going to go to Cloudways, then we're going to click load more, then we're going to scroll a little bit with all the new results, try to scrape the button if the button exists. Which means it's not empty. Then we want to go back to step three.

Nope. We want to go back to step two

and Perfect. Okay. So this is what we want this to do. We go to cloudways. We click load more Scroll down a little bit Then we scrape this button to check if it's still on the page If it is we go all the way back up to step two which clicks it and repeats that scroll down process At the very end of this, we're going to add a scrape a list step so that we can grab all of these results.

So I'll select the first name and then the second name, which got everything. And then we can add a new column and get the descriptions. And that is all for this automation.