I plan to change data file format from parquet to feather. Parquet has compression options(lz4, etc) and I have used them. But I can not find them in feather or Arrow file. Is compression not supported?
The Arrow file format, which is designed for memory-resident-data, does not support compression algorithms such as lz4, snappy, gzip, and zlib. The only compression currently supported by Arrow is dictionary compression, a scheme that usually does not require decompression before data processing.