Search code examples
stringfileparsingerlang

How can I read a text file with size 6GB in Erlang?


I have 6 GB of text file. I want to read this file and parse the data from each line and save it in my database. But it is not possible to the entire 6 GB file at once due to memory issues. So How can I read the data chunk by chunk and then process it?


Solution

  • Maybe you can try the read function. It allows for an argument to limit the number of bytes or characters from the file.