Apache NiFi: Identifying csv records containing special characters
Using Apache NiFi I need to filter out the records in a csv which have a set of special characters.
As an example if the set of special characters are "FFF". My csv would be
name,age,city
John,23,New York
FFF,45,London
Himsara,18,Adelaide
Then the second record must be taken out from the csv and put into another csv. Also even if "FFF" is in the city or age columns the whole record must be removed.
Please suggest me the processors that are needed for me to achieve this. Also it would be really helpful if u can list out the configurations, that are needed to be changed.
As an alternative, you can use the RouteText processor. It will split the flow file based on a condition. Lines containing FFF will route to the matched relationship, the other lines will route to the unmatched relationship.
RouteText processor setup:
- Pandas Error: need to escape, but no escapechar set
- How to stream DataFrame using FastAPI without saving the data to csv file?
- How can decimal values be totalled in a Windows batch file for loop
- Laravel validator and excel files error
- Parse very large CSV files with C++
- Java - Having a huge ArrayList (1 million +), how to create a String of it in a acceptable amount of time?
- convert a C# datetime object into Excel date format
- Sort CSV file based on first column
- Reading csv file converts it to json but it takes every row in it as a string in karate
- Is there is Limition of using opencsv API or Apache Poi Api?
- How to convert CSV or Object-Array to an object but with the first column as properties
- Python | Pyodbc | Encoding FetchAll() to Utf-8 with .Encode('utf-8')
- Python: Split CSV with character count
- how to download a csv generated from papaparse?
- csv.reader() is separating values by individual character
- Read csv value in loop controller Jmeter
- How to delete columns in a CSV file?
- csv.Error: iterator should return strings, not bytes
- How to correctly read a CSV file while escaping delimiter comma placed within square brackets using Apache Spark and Scala?
- Parse a tab-delimited, multiline text into an array of associative arrays using predefined column names
- sqlite3 import csv with column and row separator
- Convert every two values in a comma-separated string into associative array elements
- How can I separate tokens when there are some null tokens
- Writing dictionary items in csv correct format
- Handling empty cells and using null in Examples from a CSV file
- How to concatenate text from multiple rows into a single text string in SQL Server
- Retrieve whole lyrics from URL
- Export table to file with column headers (column names) using the bcp utility and SQL Server 2008
- read csv file delimited by file separator control character (FS/ASCII 28/UTF-8 0x1C) into duckdb using the CLI
- Efficiently filtering comma separated strings in pandas/dask