To create a new Parquet profile configuration, click the New Configuration button in the upper left part of the Desktop window, and then select Parquet Profile from the menu. The contents of the menus in the menu bar may change depending on which configuration type has been opened. The Parquet profile uses the standard menu items and buttons that are visible for all configurations, and these are described in 2.1 Menus and Buttons.n the Advanced tab you can configure Advanced tab includes additional properties for optimizing the performance of the Parquet . Depending on selected ....encoding. Note that these parameters are only used by the Parquet Encoder. None of these are choices when decoding.
The Parquet profile's Advanced tab
Setting | Description | ||
---|---|---|---|
Compression Codec | Uncompressed Snappy | Block Size | The compression algorithm used to compress pages when encoding. Valid choices are Uncompressed, Snappy, Gzip, Lzo, Brotli, Lz4, and Zstd. Default is Uncompressed. |
Block Size | The Block Size is the size of a row group buffered in memory. Block size limits the memory usage when writing. Larger values improve I/O when reading, but consumes more memory when writing. The Default Block Size is set to134217728. | ||
Page Size | The page is the smallest unit that must be read fully to access a single record. When reading, each page can be decompressed independently. If this value is too small, the compression deteriorates. The Default Page Size is 1048576. | ||
Dictionary Page Size | There is one dictionary page per column per row group when dictionary encoding is used. Dictionary page size works like the page size, but for dictionary encoding. Default is 1048576. | ||
Enable Dictionary | Select this checkbox to include the dictionary compression strategy in the generated Parquet document. Enable Dictionary allows for building a dictionary of values encountered in columns. | ||
Validating | Select this checkbox to enable schema validation. | ||
Writer Version | Parquet format version to use when writing. Version 1.0 (v1) ensures compatibility with older readers. Default is v1. There is also the option is to set v2. |
Scroll ignore | ||||||||||||||||
---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|---|
| ||||||||||||||||