Class ArrowWriterProperties

Namespace

ParquetSharp.Arrow

Assembly

ParquetSharp.dll

Configures Arrow specific options for writing Parquet files

public sealed class ArrowWriterProperties : IDisposable

Inheritance

object

ArrowWriterProperties

Implements

IDisposable

Inherited Members

object.Equals(object)

object.Equals(object, object)

object.GetHashCode()

object.GetType()

object.ReferenceEquals(object, object)

object.ToString()

Properties

CoerceTimestampsEnabled

Whether timestamps will be coerced to a specified unit

public bool CoerceTimestampsEnabled { get; }

Property Value

bool

CoerceTimestampsUnit

The unit timestamps will be coerced to if timestamp coercion is enabled

public TimeUnit CoerceTimestampsUnit { get; }

Property Value

TimeUnit

CompliantNestedTypes

Whether nested types are named according to the parquet specification.

Older versions of arrow wrote out field names for nested lists based on the name of the field. According to the parquet specification they should always be "element".

public bool CompliantNestedTypes { get; }

Property Value

bool

EngineVersion

The version of the underlying engine used to write Arrow data to Parquet

V2 is currently the latest V1 is considered deprecated but left in place in case there are bugs detected in V2.

public ArrowWriterProperties.WriterEngineVersion EngineVersion { get; }

Property Value

ArrowWriterProperties.WriterEngineVersion

StoreSchema

Whether binary serialized Arrow schema will be written to the file

public bool StoreSchema { get; }

Property Value

bool

TruncatedTimestampsAllowed

Whether loss of data when truncating timestamps will be allowed (won't raise an error)

public bool TruncatedTimestampsAllowed { get; }

Property Value

bool

UseThreads

Whether to use multiple threads to write columns in parallel

public bool UseThreads { get; }

Property Value

bool

Methods

Dispose()

Performs application-defined tasks associated with freeing, releasing, or resetting unmanaged resources.

public void Dispose()

GetDefault()

Create a new ArrowWriterProperties with default values.

public static ArrowWriterProperties GetDefault()

Returns

ArrowWriterProperties