Overview
PyArrow 20.0, released on April 27, 2025, resolves 259 issues and improves Parquet reading performance.
Main Features
Improved Parquet reading
The Parquet reader is optimized with better parallel decoding and improved memory management for large files.
python
import pyarrow.parquet as pq
# Optimized Parquet file reading
table = pq.read_table(
'data.parquet',
columns=['id', 'value'],
use_threads=True,
)
print(f'Rows: {table.num_rows}')
Extended compute functions
The pyarrow.compute module gains new transformation and aggregation functions on Arrow arrays.
python
import pyarrow as pa
import pyarrow.compute as pc
arr = pa.array([3, 1, 4, 1, 5, 9])
sorted_arr = pc.sort_indices(arr)
print(pc.take(arr, sorted_arr)) # [1, 1, 3, 4, 5, 9]
print(f'Mean: {pc.mean(arr).as_py():.2f}')
