Write a Filter Formula using Magic ETL Filter Tile

leeloo_dallas
leeloo_dallas ⚪️
in Dataflows

Hey guys,

so I am trying to utilize the filter formula feature in magic etl, but I can't seem to get it to work. When I run the following formula, no data appears.

Using Excel, I performed a concatenate on all 517 websites that I would like to be filtered out from my data in order to build my formula.

image.png

I've also used AND as well.

Any tips?

Tagged:

Best Answer

  • MarkSnodgrass
    MarkSnodgrass Portland, Oregon 🟤
    Accepted Answer

    I would use the NOT IN condition, which would look like this for you:

    `domain_2` NOT IN ('url1','url2')

    Replace url1 and url2 with your actual values. This would exclude these values and include any others.

Answers

  • GrantSmith
    GrantSmith Indiana 🔴

    Hi @leeloo_dallas

    I'd recommend reading in your list of URLs as a dataset and then doing a left join from your dataset (on the URLs) you want to filter to this URL filter data and then use a filter to say where the URL is NULL . This will make it much more manageable and easier to maintain moving forward.

  • leeloo_dallas
    leeloo_dallas ⚪️

    Thanks @MarkSnodgrass

    this actually worked pretty well.

    I thought to perform a join, but since the tile already has this feature, I'd rather learn how to utilize it.

Categories