GH-25118: [Python] Make NumPy an optional runtime dependency #41904

Merged

pitrou merged 66 commits intoapache:mainfrom raulcd:GH-25118

Sep 2, 2024

+1,008-420

Commits on Sep 2, 2024

Minimal changes to make possible to import pyarrow and create a pyarrow.array without numpy

raulcd
authored and
pitrou
committed
Add minimal CI test

raulcd
authored and
pitrou
committed
Add minor linting fixes

raulcd
authored and
pitrou
committed
Minor fix for function call instead of dict access

raulcd
authored and
pitrou
committed
Refactor tests to be able to run test_array.py with and without numpy

raulcd
authored and
pitrou
committed
Fix linting for C++ files

raulcd
authored and
pitrou
committed
Fix a bunch more tests

raulcd
authored and
pitrou
committed
Several changes related to initial code review comments

raulcd
authored and
pitrou
committed
Fix wrong mark

raulcd
authored and
pitrou
committed
Minor lint

raulcd
authored and
pitrou
committed
Add HAS_NUMPY in order to avoid 'numpy' in sys.modules every time

raulcd
authored and
pitrou
committed
Add last bits that crashed some tests

raulcd
authored and
pitrou
committed
Some more improvements

raulcd
authored and
pitrou
committed
Use PYTEST_PYARGS to define module to test

raulcd
authored and
pitrou
committed
Add test_without_numpy test module and nonumpy marker. Add automarker if numpy/pandas/ndarray is part of the test name

raulcd
authored and
pitrou
committed
Add tensor test

raulcd
authored and
pitrou
committed
Add missing license

raulcd
authored and
pitrou
committed
Minor tests refactor

raulcd
authored and
pitrou
committed
Add some more tests

raulcd
authored and
pitrou
committed
Rollback change on pyarrow/tests/test_adhoc_memory_leak.py

raulcd
authored and
pitrou
committed
Remove HAS_NUMPY helper variable

raulcd
authored and
pitrou
committed
Some other import modules and test changes

raulcd
authored and
pitrou
committed
Remove stray import

raulcd
authored and
pitrou
committed
Remove without_numpy from test_array and mark the numpy tests

raulcd
authored and
pitrou
committed
Remove without_numpy from test_compute and mark the numpy tests

raulcd
authored and
pitrou
committed
Remove without_numpy from test_dataset and mark the numpy tests

raulcd
authored and
pitrou
committed
Remove without_numpy from test_flight

raulcd
authored and
pitrou
committed
Collect from test_cpp_internals only tests that do not require numpy or pandas if numpy is not present

raulcd
authored and
pitrou
committed
Mark numpy tests for pyarrow/tests/test_csv.py

raulcd
authored and
pitrou
committed
Add pytest.mark.numpy to all test_cuda and test_cuda_numba_interop tests

raulcd
authored and
pitrou
committed
Fix test collection and add corresponding marks for numpy

raulcd
authored and
pitrou
committed
Fix linting

raulcd
authored and
pitrou
committed
Fix if on Digest and Quantile Options

raulcd
authored and
pitrou
committed
Remove unnecessary test fixture and last review comments

raulcd
authored and
pitrou
committed
Fix tests that without numpy where an ImportError is raised instead of ValueError

raulcd
authored and
pitrou
committed
Review comments: Update base image from no-numpy, use mamba uninstall, update Numpy to NumPy and add correct markers for test_cpp_internals

raulcd
authored and
pitrou
committed
Some more review comments to remove usage of numpy on some tests

raulcd
authored and
pitrou
committed
Remove numpy from CSV tests

raulcd
authored and
pitrou
committed
Remove unnecessary numpy usages from test_dataset

raulcd
authored and
pitrou
committed
Fix several tests to do not require numpy on test_io

raulcd
authored and
pitrou
committed
Fix tests and remove usages of numpy mark on test_ipc, fix fixture

raulcd
authored and
pitrou
committed
Revert back and use fixture for np types using strings

raulcd
authored and
pitrou
committed
Simplify if by using SUPPORTED_INPUT_ARR_TYPES

raulcd
authored and
pitrou
committed
Add numpy or pandas mark to wrapper when collection C++ injected tests

raulcd
authored and
pitrou
committed
Remove skip when numpy on test_convert_builtin.py and add individual test skips

raulcd
authored and
pitrou
committed
Remove empty stray lines

raulcd
authored and
pitrou
committed
Fix stray change

raulcd
authored and
pitrou
committed
Remove stray import

raulcd
authored and
pitrou
committed
Mark hypothesis tests that require numpy

raulcd
authored and
pitrou
committed
Use available SEQUENCE_TYPES to inner sequence on nested arrays

raulcd
authored and
pitrou
committed
Fix test collection for tests/interchange/test_conversion.py

raulcd
authored and
pitrou
committed
Fix test collection for tests/interchange/test_interchange_spec.py

raulcd
authored and
pitrou
committed
Remove numpy dependency from pyarrow/tests/test_dataset_encryption.py

raulcd
authored and
pitrou
committed
Apply suggestions from code review

raulcd
and
pitrou
committed
Fix test collection for pyarrow/tests/test_dlpack.py

raulcd
authored and
pitrou
committed
Fix test collection for pyarrow/tests/test_extension_type.py

raulcd
authored and
pitrou
committed
Fix test collection for pyarrow/tests/scalars.py

raulcd
authored and
pitrou
committed
Add comment to why cython tests require NumPy (still a build dependency)

raulcd
authored and
pitrou
committed
Fix test collection for pyarrow/tests/pandas.py

raulcd
authored and
pitrou
committed
Fixes to numpy tests

raulcd
authored and
pitrou
committed
Update python/pyarrow/tests/test_pandas.py

authored and
pitrou
committed
Update python/pyarrow/tests/test_csv.py

raulcd
and
pitrou
committed
Update python/pyarrow/tests/test_csv.py

raulcd
and
pitrou
committed
Remove numpy mark and add np guard to test

raulcd
authored and
pitrou
committed
Rebase main and add mark to skip new tests that require numpy

raulcd
authored and
pitrou
committed
Add comment on why we duplicate test_basics_np_required for float16

raulcd
authored and
pitrou
committed