What is “TM ai-smart detection” that i see checked while scraping and how does it help my automation?

What is “TM ai-smart detection” that i see checked while scraping and how does it help my automation?

Unlocking the Power of TM AI-Smart Detection for Seamless Automation

In the world of web scraping, navigating through intricate flows can sometimes be a daunting task. This is where TM AI-Smart Detection comes into play, revolutionizing the way we approach automation in complex scenarios.

Understanding TM AI Smart Detection

When delving into the realm of TM AI smart detection, we encounter a tool that proves invaluable in handling elaborate scraping flows. Often, the elements on a webpage undergo changes, making it challenging to extract the desired information. The AI smart detection algorithm serves as a beacon in this sea of fluctuating data, providing a stable point of reference.

The Anchor Point Concept

Imagine wanting to extract a series of listings, like horse listings, from a webpage. Amidst these listings, variations in elements such as buttons can arise. The first step involves identifying a consistent identifier, our anchor point. By capturing this stable element, subsequent columns can be located in relation to this anchor. Clicking on different elements triggers the algorithm to trace and extract relevant data based on the established anchor point.

Customizing Scraping Strategies

In scenarios where the data structure isn't interconnected, turning off smart detection proves to be a strategic move. By disengaging this feature, new columns are not interlinked with the positions of previous columns. This flexibility is particularly beneficial when scraping from platforms like Amazon or Shopify, where the content layout may be complex and dynamic.

Embracing Efficiency in Data Extraction

TM AI-Smart Detection streamlines the scraping process on platforms with diverse and evolving content structures. By pinpointing a consistent anchor point, extracting data becomes a streamlined and efficient task. Whether it's extracting product information or analyzing trends, this tool empowers automation with precision and adaptability.

Video


 

Steps

Step 1-when we see the TM AI smart detection, this is really useful in more complicated scraping flows, we can list the horses name in the column and price

Notion image
 

Step 2- We can uncheck the TM AI Smart detection to add new column

Notion image
 

VIDEO TRANSCRIPT

So when we see the TM AI smart detection, this is really useful in more complicated scraping flows, where sometimes the elements on the page, the items that we want to scrape, um, a lot of internal things about them change. So the way that the AI smart detection works is this first column that we have is treated like a, kind of like an anchor point.

So for example, let's say that we wanted to get all of these horse listings, but in between the horse listings, um, sometimes there was a, you know, a button difference, things like that. Our first step is going to be recording this name that we have that's extremely consistent. And we can see that get populated.

Now, any other columns are found in relation to that anchor point. So if I was to click the fee here, it's able to find the rest of the fees based off that first columns anchor, um, telling it where each item is separated. Now, if we wanted to be scraping a list that was not connected in this way, we would want to turn off smart detection so that any new columns are not calculated based on previous columns positions.

Again, that's really helpful on things like Amazon, Shopify, um, or other sites where these cards have a lot of information that might be missing or changing. That way we can really easily find that anchor point to start with.

 
Did this answer your question?
😞
😐
🤩