Overview
PyArrow 14.0, released on November 2, 2023, improves the Arrow-backed Pandas backend for better DataFrame performance.
Main Features
The Pandas ArrowDtype backend natively uses Arrow types, reducing memory consumption and speeding up operations.
python
import pandas as pd
df = pd.read_parquet(
'data.parquet',
dtype_backend='pyarrow',
)
print(df.dtypes)