Python error during tornado --devices command

[vgroenewold]

I hope this is a good place to ask, if not please close it and I'll find a better place.

I successfully compiled Tornado, I don't have mingw-w64-x86_64-python installed and am running on Windows 11. I'm using GraalVM 22.3.2. I get a very simple error message for a path that can't be found, apparently because spaces are not recognized, any tips on how to solve this?

Error:

$ tornado --devices
Traceback (most recent call last):
  File "/d/MingW64-Projects/TornadoVM/bin/bin/tornado", line 464, in <module>
    tornadoVMRunner = TornadoVMRunnerTool()
                      ^^^^^^^^^^^^^^^^^^^^^
  File "/d/MingW64-Projects/TornadoVM/bin/bin/tornado", line 127, in __init__
    self.java_version, self.isGraalVM = self.getJavaVersion()
                                        ^^^^^^^^^^^^^^^^^^^^^
  File "/d/MingW64-Projects/TornadoVM/bin/bin/tornado", line 133, in getJavaVersion
    versionCommand = subprocess.Popen(shlex.split(self.commands["java"] + " -version"), stdout=subprocess.PIPE, stderr=subprocess.PIPE)
                     ^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^^
  File "/usr/lib/python3.11/subprocess.py", line 1026, in __init__
    self._execute_child(args, executable, preexec_fn, close_fds,
  File "/usr/lib/python3.11/subprocess.py", line 1950, in _execute_child
    raise child_exception_type(errno_num, err_msg, err_filename)
FileNotFoundError: [Errno 2] No such file or directory: 'C:/Program'

[jjfumero]

Did you follow the guidelines here? https://tornadovm.readthedocs.io/en/latest/installation.html#tornadovm-for-windows-10-11-using-graalvm . You will also need Python 3.

I do not have my Windows PC at hand, but I have checked during the latest release with msys64, and it worked fine. Are you running with msys64? Note that the Windows port is experimental and we get access through this emulator.

Alternatively, you can install it on WSL: https://learn.microsoft.com/en-us/windows/wsl/install. You will also need the GPU drivers.

[jjfumero]

I just checked on Windows 11 and the latest TornadoVM version b842802, and it works.

jjfum@xps8950 MINGW64 ~/TornadoVM
$ make tests
rm -f tornado_unittests.log
tornado --devices
Number of Tornado drivers: 1
Driver: OpenCL
  Total number of OpenCL devices  : 4
  Tornado device=0:0  (DEFAULT)
        OPENCL --  [Intel(R) OpenCL Graphics] -- Intel(R) UHD Graphics 770
                Global Memory Size: 12.7 GB
                Local Memory Size: 64.0 KB
                Workgroup Dimensions: 3
                Total Number of Block Threads: [512]
                Max WorkGroup Configuration: [512, 512, 512]
                Device OpenCL C version: OpenCL C 1.2

  Tornado device=0:1
        OPENCL --  [NVIDIA CUDA] -- NVIDIA GeForce RTX 3070
                Global Memory Size: 8.0 GB
                Local Memory Size: 48.0 KB
                Workgroup Dimensions: 3
                Total Number of Block Threads: [1024]
                Max WorkGroup Configuration: [1024, 1024, 64]
                Device OpenCL C version: OpenCL C 1.2

  Tornado device=0:2
        OPENCL --  [Intel(R) OpenCL] -- 12th Gen Intel(R) Core(TM) i7-12700K
                Global Memory Size: 31.7 GB
                Local Memory Size: 32.0 KB
                Workgroup Dimensions: 3
                Total Number of Block Threads: [8192]
                Max WorkGroup Configuration: [8192, 8192, 8192]
                Device OpenCL C version: OpenCL C 3.0

  Tornado device=0:3
        OPENCL --  [Intel(R) FPGA Emulation Platform for OpenCL(TM)] -- Intel(R) FPGA Emulation Device
                Global Memory Size: 31.7 GB
                Local Memory Size: 256.0 KB
                Workgroup Dimensions: 3
                Total Number of Block Threads: [67108864]
                Max WorkGroup Configuration: [67108864, 67108864, 67108864]
                Device OpenCL C version: OpenCL C 1.2


tornado-test --ea --verbose
tornado -ea  --jvm "-Xmx6g -Dtornado.recover.bailout=False -Dtornado.unittests.verbose=True "  -m  tornado.unittests/uk.ac.manchester.tornado.unittests.tools.TornadoTestRunner  --params "uk.ac.manchester.tornado.unittests.foundation.TestIntegers"
WARNING: Using incubator modules: jdk.incubator.foreign, jdk.incubator.vector

Test: class uk.ac.manchester.tornado.unittests.foundation.TestIntegers
        Running test: test01                     ................  [PASS]
        Running test: test02                     ................  [PASS]
        Running test: test03                     ................  [PASS]
        Running test: test05                     ................  [PASS]
        Running test: test04                     ................  [PASS]
Test ran: 5, Failed: 0, Unsupported: 0
...
...

Can you give more details about your setup? Maybe it is something related to the MSys64 packages version since I already had all dependencies installed.

[vgroenewold]

Apologies for my delayed answer! Thank you very much for testing on Windows. I'm wondering, did you use the script to automatically install it or by doing it all manually?

[jjfumero]

For Windows MSys64, the installation is manual, not through the script. The script for automatic installation only works for Linux and OSx.

Guidelines here: https://tornadovm.readthedocs.io/en/latest/installation.html#tornadovm-for-windows-10-11-using-graalvm

[vgroenewold]

Check, I did it manually indeed. I'll try that again and will report, thanks for the help.