CSV file to Parquet using C#

Question

I am new to C#, We have requirement to generate parquet files from csv. Our file sizes up to 30gb, so performance is the matter while generating.

I do not get any help/suggestions from google to handle.

Can someone suggest or share solution please (Either console /Script task).

Answer 1

You can use this NuGet Package, which includes automatic serializer/deserializer from C# classes into parquet files that works by generating MSIL (bytecode) on the fly and is therefore super fast.