Write a Filter Formula using Magic ETL Filter Tile

leeloo_dallas
leeloo_dallas ⚪️
in Dataflows

Hey guys,

so I am trying to utilize the filter formula feature in magic etl, but I can't seem to get it to work. When I run the following formula, no data appears.

Using Excel, I performed a concatenate on all 517 websites that I would like to be filtered out from my data in order to build my formula.

image.png

I've also used AND as well.

Any tips?

Tagged:

Best Answer

  • MarkSnodgrass
    MarkSnodgrass Portland, Oregon 🥷
    Answer ✓

    I would use the NOT IN condition, which would look like this for you:

    `domain_2` NOT IN ('url1','url2')

    Replace url1 and url2 with your actual values. This would exclude these values and include any others.



    **Make sure to <3 any users posts that helped you.
    **Please mark as accepted the ones who solved your issue.

Answers

  • GrantSmith
    GrantSmith Indiana 🥷

    Hi @leeloo_dallas

    I'd recommend reading in your list of URLs as a dataset and then doing a left join from your dataset (on the URLs) you want to filter to this URL filter data and then use a filter to say where the URL is NULL . This will make it much more manageable and easier to maintain moving forward.



    **Was this post helpful? Click the heart icon**

    **Did this solve your problem? Accept it as a solution!**
  • leeloo_dallas
    leeloo_dallas ⚪️

    Thanks @MarkSnodgrass

    this actually worked pretty well.

    I thought to perform a join, but since the tile already has this feature, I'd rather learn how to utilize it.

Categories