Filter Rows in Magic ETL based on Text

Reply
Purple Belt

Filter Rows in Magic ETL based on Text

I am using the Filter Rows aspect of Magic ETL and having trouble filtering if the text filed ins not one word. For example if I create a filter that says ColumnA equals TESTWORD - I get rows where the columns had the value TESTWORD. If I create a filter that tries to filter ColumnA equals TEST WORD - (space between test and word)the filter does not work Even if I change the filter to be ColumnA Starts with TEST - the filter does not return rows where it is TEST WORD Thoughts?
Dojo Community Member
** Please like responses by clicking on the thumbs up
** Please Accept / check the answer that solved your problem / answered your question.
Moderator

Re: Filter Rows in Magic ETL based on Text

Hi all,


Can anybody help @Shevy with their situation?

Thanks!

Major Brown Belt

Re: Filter Rows in Magic ETL based on Text

Hello @Shevy

This would be a great thing to ask the DOMO Support Team. You can reach them at the following url https://support.domo.com/

**Say “Thanks" by clicking the thumbs up in the post that helped you.
**Please mark the post that solves your problem by clicking on "Accept as Solution"
Purple Belt

Re: Filter Rows in Magic ETL based on Text

Hello @Shevy,

As a reminder, I contacted you via email asking for a link to your dataflow so that I may help troubleshoot this issue for you.

When you're ready to proceed, please reply to my email, and I can help you then.

Thank you!

Steve Cook

Domo Support

Starlord
**Say “Thanks” by clicking the “heart” in the post that helped you.
**Please mark the post that solves your problem by clicking on "Accept as Solution"
White Belt

Re: Filter Rows in Magic ETL based on Text

I am having a similar issue. I want to filter rows *only* when their value is specific (Labor). I have used "Labor", 'Labor', and Labor and each itteration nets 0 records.  Please advise. 

Chad Bishop
Data Analyst
Bolt Express
Yellow Belt

Re: Filter Rows in Magic ETL based on Text

Anyone have an answer for this?

Visitor

Re: Filter Rows in Magic ETL based on Text

I have found that filtering on TEXT fields in ETL Data Flows is unreliable. My work around is to use the VALUE MAPPER to create a NEW COLUMN with a NUMBER in it for those text fields I want to filter on. I then use COLUMN TYPE to set the column type to WHOLE NUMBER (it defaulted to a text field when I created the new column in Value Mapper.) Then I FILTER to include only those rows with the number I identified in the new column created in Value Mapper. Additionally, I have found one other unreliable responses with FILTER: Multiple filter values in one FILTER sometimes don't work, so I do one FILTER step for each field I want to Filter on. I discovered all this attempting to create a MaxDate field. I also found in the GROUP BY feature using large file with many rows, the process stopped after processing only part of the file. So I added a filter to further reduce my row count to get an accurate result for MaxDate.
Purple Belt

Re: Filter Rows in Magic ETL based on Text

@Asydnor Have you reported these behaviors in tickets to Domo Support? I would very much like to have examples of these issues you see brought to our attention.

 

If you have open tickets, please reference them here for me. You should have been provided a CASE ID for each ticket opened.

 

If you do not have open tickets, please do open some via the Support portal here: support.domo.com 

 

If at all possible, please provide examples for us of where you see this.

 

Thank you!

Starlord
**Say “Thanks” by clicking the “heart” in the post that helped you.
**Please mark the post that solves your problem by clicking on "Accept as Solution"
Visitor

Re: Filter Rows in Magic ETL based on Text

Hi All, 

 

I am having the same issue. When applying multiple filters for a TEXT field, it doesn't seem to work. If I have one rule, it works fine, but after adding multiple, it doesn't work at all. Thanks!

 

Major Blue Belt

Re: Filter Rows in Magic ETL based on Text

I personally never use the equals but always contains and does not contains. Have you tried going to the dataset and copying the text and then pasting that in the filter field? Sometimes there are whitespaces there and just typing them in does not catch them. Also, make sure your column is actually a text field by setting the column type. I have never had any issues with filtering text fields so if it persists I would definitely put in a ticket. 

Announcements
Looking for the latest Community solutions? Please visit our accepted solutions board here!