anything in mojo about reading large csv files

[j215chic]

Hi there
starting to look at mojo for a new project, VERY excited. Before I head down the python route to process my files ( 2gb csv is the smallest up to 5tb csv ) I wanted to check if there exists a mojo approach to the problem?

I can get it done in python and julia but want to use pure mojo for this project. I have 128gb ram and my machine has

System:    Kernel: 5.4.0-156-generic x86_64 bits: 64 compiler: gcc v: 9.4.0 Desktop: Cinnamon 5.2.7 wm: muffin 
           dm: GDM3, LightDM Distro: Linux Mint 20.3 Una base: Ubuntu 20.04 focal 
Machine:   Type: Desktop System: Hewlett-Packard product: HP Z840 Workstation v: N/A serial: <filter> Chassis: type: 6 
           serial: <filter> 
           Mobo: Hewlett-Packard model: 2129 v: 1.01 serial: <filter> UEFI: Hewlett-Packard v: M60 v02.32 date: 05/02/2017 
CPU:       Topology: 2x 18-Core model: Intel Xeon E5-2699 v3 bits: 64 type: MCP SMP arch: Haswell rev: 2 L2 cache: 90.0 MiB 
           flags: avx avx2 lm nx pae sse sse2 sse3 sse4_1 sse4_2 ssse3 vmx bogomips: 165264 
           Speed: 1198 MHz min/max: 1200/3600 MHz Core speeds (MHz): 1: 1197 2: 1198 3: 1197 4: 1198 5: 1198 6: 1198 7: 1197 
           8: 1197 9: 1198 10: 1198 11: 1198 12: 1198 13: 1198 14: 1198 15: 1197 16: 1198 17: 1198 18: 1198 19: 1197 20: 1197 
           21: 1198 22: 1197 23: 1198 24: 1198 25: 1198 26: 1198 27: 1197 28: 1297 29: 1198 30: 1197 31: 1198 32: 1198 
           33: 1198 34: 1198 35: 1197 36: 1198 
Graphics:  Device-1: NVIDIA GK104GL [Quadro K5000] vendor: Hewlett-Packard driver: nvidia v: 470.199.02 bus ID: 04:00.0 
           chip ID: 10de:11ba 
           Display: x11 server: X.Org 1.20.13 driver: nvidia unloaded: fbdev,modesetting,nouveau,vesa 
           resolution: 1920x1080~60Hz, 3840x2160~30Hz 
           OpenGL: renderer: Quadro K5000/PCIe/SSE2 v: 4.6.0 NVIDIA 470.199.02 direct render: Yes 

[ksandvik]

For the time being most likely you need to use python modules for at least the file import, there's no official standard library for I/O work.

[j215chic]

thank you. REALLY looking forward to a fresh start using mojo thinking. We're dumping all our julia code. Expensive in time but we learnt what doesn't work which is something I suppose. Thank you for the quick reply a great start. Just finished watched the full Fridman/ Dr Lattner youtube. WOW music to our ears.