Pandas 3.1 CSV loading: Multi-threaded, but PyArrow is still faster

Pandas 3.1 CSV loading: Multi-threaded, but PyArrow is still faster

Reading a CSV into a Python Pandas data frame?

Before version 3.1, loading CSV was single-threaded and slow. My test file took 1.03s.

In 3.1, it’s now multi-threaded and much faster, taking 252 ms.

However, it’s still far slower than PyArrow, which took 25.5 ms.