Help me make sense of the automation

[aayush]

Are you using our SaaS platform (Baserow.io) or self-hosting Baserow?

SaaS

What do you need help with?

• Before importing a list of new companies, I want to go through all the companies already inside my database to check against any duplicates.
• I want the companies that already exist in the database to be updated in specific fields (the existing update field option when importing overwrites all fields, rather than adding to select fields).

I thought maybe I could just run a code and add some tag like duplicate: true for companies that are duplicates, and the separate those duplicates with a router and then use baserow’s edit option to edit the specific field I want.

I’m stuck at the very start of it - I’m not even able to get all the existing companies’ data - so obviously I won’t be able to identify the duplicates either.

It’s saying that there’s some limit of 200. I don’t know how to accomplish what I want, or even if the workflow I described is the most efficient way to do this. Can someone help me out?

Please attach screenshots or videos if they help illustrate your question.

[AgustinCarozo]

Hi Aayush

Indeed there is a limit of 200 results. To overcome it you will need to use 3 special nodes, the branching node, iteration and “go to node”.
To illustrate some parts I’m attaching a flow I created for a client to create a system to mass delete all table rows.

1. First you get all rows
2. Then you use a branch node to do your checks in my case I was checking if there were rows still existing in the table.
3. If I still had rows I go to the next node which is the “Iterate” which is a For loop, which will loop over each row listed.
4. I delete the row.
5. I go to my final special node that restarts my entire automation so it creates a loop.

You will need to use a similar architecture + checks to see duplication probably

Hope this gets you started in the right direction