Adding LlaVa

[rabiulcste]

No description provided.

[Delaunay]

loss is None because label is not provided inside inputs

llava.D0 [stderr] Traceback (most recent call last):
llava.D0 [stderr]   File "/tmp/workspace/cuda/results/venv/torch/bin/voir", line 8, in <module>
llava.D0 [stderr]     sys.exit(main())
llava.D0 [stderr]   File "/tmp/workspace/cuda/results/venv/torch/lib/python3.10/site-packages/voir/cli.py", line 128, in main
llava.D0 [stderr]     ov(sys.argv[1:] if argv is None else argv)
llava.D0 [stderr]   File "/tmp/workspace/cuda/results/venv/torch/lib/python3.10/site-packages/voir/phase.py", line 331, in __call__
llava.D0 [stderr]     self._run(*args, **kwargs)
llava.D0 [stderr]   File "/tmp/workspace/cuda/results/venv/torch/lib/python3.10/site-packages/voir/overseer.py", line 242, in _run
llava.D0 [stderr]     set_value(func())
llava.D0 [stderr]   File "/tmp/workspace/cuda/results/venv/torch/lib/python3.10/site-packages/voir/scriptutils.py", line 37, in <lambda>
llava.D0 [stderr]     return lambda: exec(mainsection, glb, glb)
llava.D0 [stderr]   File "/home/mila/d/delaunap/milabench/benchmarks/llava/main.py", line 130, in <module>
llava.D0 [stderr]     main()
llava.D0 [stderr]   File "/home/mila/d/delaunap/milabench/benchmarks/llava/main.py", line 114, in main
llava.D0 [stderr]     accelerator.backward(loss)
llava.D0 [stderr]   File "/tmp/workspace/cuda/results/venv/torch/lib/python3.10/site-packages/accelerate/accelerator.py", line 2149, in backward
llava.D0 [stderr]     loss = loss / self.gradient_accumulation_steps
llava.D0 [stderr] TypeError: unsupported operand type(s) for /: 'NoneType' and 'int'

[rabiulcste]

I will look into this! I know why it's happening.