-
Notifications
You must be signed in to change notification settings - Fork 0
/
Report-1028973.out
5599 lines (4602 loc) · 97.4 KB
/
Report-1028973.out
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
---------------------------------------
Begin Slurm Prolog: Dec-07-2024 12:34:52
Job ID: 1028973
User ID: yxu846
Account: scs
Job name: visagent
Partition: ice-gpu
---------------------------------------
2024-12-07 12:35:08.587906: I tensorflow/core/util/port.cc:153] oneDNN custom operations are on. You may see slightly different numerical results due to floating-point round-off errors from different computation orders. To turn them off, set the environment variable `TF_ENABLE_ONEDNN_OPTS=0`.
2024-12-07 12:35:08.602476: E external/local_xla/xla/stream_executor/cuda/cuda_fft.cc:485] Unable to register cuFFT factory: Attempting to register factory for plugin cuFFT when one has already been registered
2024-12-07 12:35:08.619057: E external/local_xla/xla/stream_executor/cuda/cuda_dnn.cc:8454] Unable to register cuDNN factory: Attempting to register factory for plugin cuDNN when one has already been registered
2024-12-07 12:35:08.623898: E external/local_xla/xla/stream_executor/cuda/cuda_blas.cc:1452] Unable to register cuBLAS factory: Attempting to register factory for plugin cuBLAS when one has already been registered
2024-12-07 12:35:08.636451: I tensorflow/core/platform/cpu_feature_guard.cc:210] This TensorFlow binary is optimized to use available CPU instructions in performance-critical operations.
To enable the following instructions: AVX2 AVX512F AVX512_VNNI AVX512_BF16 AVX512_FP16 AVX_VNNI AMX_TILE AMX_INT8 AMX_BF16 FMA, in other operations, rebuild TensorFlow with the appropriate compiler flags.
2024-12-07 12:35:11.988591: W tensorflow/compiler/tf2tensorrt/utils/py_utils.cc:38] TF-TRT Warning: Could not find TensorRT
/home/hice1/yxu846/.conda/envs/py39/lib/python3.9/site-packages/timm/models/layers/__init__.py:48: FutureWarning: Importing from timm.models.layers is deprecated, please import via timm.layers
warnings.warn(f"Importing from {__name__} is deprecated, please import via timm.layers", FutureWarning)
Registering LOC step
Registering COUNT step
Registering CROP step
Registering CROP_RIGHTOF step
Registering CROP_LEFTOF step
Registering CROP_FRONTOF step
Registering CROP_INFRONTOF step
Registering CROP_INFRONT step
Registering CROP_BEHIND step
Registering CROP_AHEAD step
Registering CROP_BELOW step
Registering CROP_ABOVE step
Registering VQA step
Registering EVAL step
Registering RESULT step
Registering CAP step
Registering RETRIEVE step
Registering RELATIVE_POS step
Registering MERGE step
0%| | 0/1962 [00:00<?, ?it/s]/home/hice1/yxu846/.conda/envs/py39/lib/python3.9/site-packages/transformers/generation/utils.py:1375: UserWarning: Using the model-agnostic default `max_length` (=20) to control the generation length. We recommend setting `max_new_tokens` to control the maximum length of the generation.
warnings.warn(
0%| | 1/1962 [00:10<5:55:13, 10.87s/it] 0%| | 2/1962 [00:14<3:27:04, 6.34s/it] 0%| | 3/1962 [00:16<2:33:38, 4.71s/it] 0%| | 4/1962 [00:18<1:59:13, 3.65s/it] 0%| | 5/1962 [00:20<1:40:22, 3.08s/it] 0%| | 6/1962 [00:23<1:35:51, 2.94s/it] 0%| | 7/1962 [00:26<1:37:37, 3.00s/it] 0%| | 8/1962 [00:29<1:33:43, 2.88s/it] 0%| | 9/1962 [00:32<1:39:51, 3.07s/it] 1%| | 10/1962 [00:35<1:35:45, 2.94s/it] 1%| | 11/1962 [00:37<1:25:50, 2.64s/it] 1%| | 12/1962 [00:39<1:19:57, 2.46s/it] 1%| | 13/1962 [00:42<1:25:44, 2.64s/it] 1%| | 14/1962 [00:44<1:19:23, 2.45s/it] 1%| | 15/1962 [00:47<1:21:37, 2.52s/it] 1%| | 16/1962 [00:50<1:26:43, 2.67s/it] 1%| | 17/1962 [00:52<1:27:18, 2.69s/it] 1%| | 18/1962 [00:54<1:17:16, 2.39s/it] 1%| | 19/1962 [00:58<1:26:57, 2.69s/it] 1%| | 20/1962 [01:00<1:29:01, 2.75s/it] 1%| | 21/1962 [01:04<1:36:36, 2.99s/it] 1%| | 22/1962 [01:07<1:32:59, 2.88s/it] 1%| | 23/1962 [01:09<1:32:44, 2.87s/it] 1%| | 24/1962 [01:13<1:40:22, 3.11s/it] 1%|▏ | 25/1962 [01:15<1:30:49, 2.81s/it] 1%|▏ | 26/1962 [01:17<1:23:39, 2.59s/it] 1%|▏ | 27/1962 [01:19<1:15:48, 2.35s/it] 1%|▏ | 28/1962 [01:21<1:13:58, 2.29s/it] 1%|▏ | 29/1962 [01:24<1:14:36, 2.32s/it] 2%|▏ | 30/1962 [01:26<1:12:05, 2.24s/it] 2%|▏ | 31/1962 [01:28<1:15:20, 2.34s/it] 2%|▏ | 32/1962 [01:32<1:24:53, 2.64s/it] 2%|▏ | 33/1962 [01:34<1:26:51, 2.70s/it] 2%|▏ | 34/1962 [01:38<1:33:07, 2.90s/it] 2%|▏ | 35/1962 [01:39<1:20:37, 2.51s/it] 2%|▏ | 36/1962 [01:42<1:21:53, 2.55s/it] 2%|▏ | 37/1962 [01:45<1:22:15, 2.56s/it] 2%|▏ | 38/1962 [01:48<1:28:15, 2.75s/it] 2%|▏ | 39/1962 [01:50<1:19:25, 2.48s/it] 2%|▏ | 40/1962 [01:52<1:19:25, 2.48s/it] 2%|▏ | 41/1962 [01:55<1:22:42, 2.58s/it] 2%|▏ | 42/1962 [01:58<1:26:41, 2.71s/it] 2%|▏ | 43/1962 [02:01<1:33:36, 2.93s/it] 2%|▏ | 44/1962 [02:04<1:30:57, 2.85s/it] 2%|▏ | 45/1962 [02:07<1:27:31, 2.74s/it] 2%|▏ | 46/1962 [02:10<1:33:36, 2.93s/it] 2%|▏ | 47/1962 [02:13<1:31:54, 2.88s/it] 2%|▏ | 48/1962 [02:14<1:21:32, 2.56s/it] 2%|▏ | 49/1962 [02:18<1:34:23, 2.96s/it] 3%|▎ | 50/1962 [02:20<1:25:27, 2.68s/it] 3%|▎ | 51/1962 [02:23<1:22:24, 2.59s/it] 3%|▎ | 52/1962 [02:25<1:21:28, 2.56s/it] 3%|▎ | 53/1962 [02:29<1:28:20, 2.78s/it] 3%|▎ | 54/1962 [02:31<1:22:18, 2.59s/it] 3%|▎ | 55/1962 [02:32<1:13:22, 2.31s/it] 3%|▎ | 56/1962 [02:35<1:16:05, 2.40s/it] 3%|▎ | 57/1962 [02:39<1:27:56, 2.77s/it] 3%|▎ | 58/1962 [02:41<1:19:35, 2.51s/Does the plate have a different color than the artwork?
reference answer: Yes, the artwork is black and the plate is white.
LOC
CROP
LOC
CROP
VQA
VQA
EVAL
RESULT
no
What kind of device is made of the same material as the device above the desk?
reference answer: The computer monitor is made of the same material as the keyboard.
LOC
CROP
LOC
CROP_ABOVE
VQA
VQA
RESULT
computer
Is there a teddy bear that is not lying?
reference answer: No, there is a teddy bear but it is lying.
LOC
COUNT
EVAL
Which company are the shorts from?
reference answer: The shorts are from adidas.
VQA
RESULT
adidas
Which company are the shoes from?
reference answer: The shoes are from adidas.
VQA
RESULT
adidas
Is this a table or a bed?
reference answer: This is a table.
LOC
LOC
COUNT
COUNT
EVAL
RESULT
table
Do the cabinets hang from the beige wall?
reference answer: Yes, the cabinets hang from the wall.
LOC
CROP
LOC
COUNT
EVAL
RESULT
yes
Is the knife on a napkin?
reference answer: No, the knife is on the table.
LOC
CROP
LOC
COUNT
EVAL
RESULT
yes
Does the necktie have a different color than the shoe?
reference answer: No, both the necktie and the shoe are black.
LOC
CROP
LOC
CROP
VQA
VQA
EVAL
RESULT
yes
Is the ceiling above a toilet?
reference answer: Yes, the ceiling is above a toilet.
LOC
CROP_BELOW
LOC
COUNT
EVAL
RESULT
no
Is this the zoo?
reference answer: No, it is the garden.
VQA
RESULT
no
Which place is it?
reference answer: It is a street.
VQA
RESULT
restaurant
Are there cyclists or men that are riding?
reference answer: Yes, the cyclist is riding.
LOC
LOC
COUNT
COUNT
EVAL
RESULT
yes
What is the weather like today?
reference answer: It is clear.
VQA
RESULT
cloudy
Is there a fence in front of the trees?
reference answer: No, there is a boy in front of the trees.
LOC
CROP_FRONT
Are there any ovens or cabinets that are black?
reference answer: Yes, the oven is black.
LOC
LOC
VQA
VQA
EVAL
RESULT
yes
Is the cake to the left or to the right of the bowl?
reference answer: The cake is to the left of the bowl.
LOC
CROP
LOC
COUNT
EVAL
RESULT
right
Are the people of the same gender?
reference answer: Yes, all the people are female.
VQA
RESULT
yes
What type of device is made of the same material as the remote the man is to the left of?
reference answer: The telephone is made of the same material as the remote.
LOC
CROP_LEFTOF
LOC
CROP
VQA
VQA
RESULT
remote
Do you see any large couch or desk?
reference answer: No, there is a desk but it is small.
LOC
LOC
COUNT
COUNT
EVAL
RESULT
yes
Do both the people have the same gender?
reference answer: No, they are both male and female.
LOC
CROP
VQA
VQA
EVAL
RESULT
yes
Is there any tea in this photograph that is not wet?
reference answer: No, there is tea but it is wet.
LOC
CROP
LOC
COUNT
EVAL
RESULT
yes
Are the curtains made of cloth?
reference answer: Yes, the curtains are made of cloth.
LOC
CROP
VQA
EVAL
RESULT
no
Who seems to be older, the woman or the girl?
reference answer: The woman is older than the girl.
LOC
CROP
LOC
CROP
VQA
VQA
EVAL
RESULT
woman
What kind of furniture is cracked?
reference answer: The furniture is a table.
LOC
VQA
RESULT
table
Where is the girl that is young looking at?
reference answer: The girl is looking up.
LOC
CROP
VQA
RESULT
up
Are the animals of different species?
reference answer: Yes, they are dogs and birds.
VQA
RESULT
yes
How is the weather, clear or stormy?
reference answer: It is stormy.
VQA
EVAL
RESULT
stormy
Do you see birds there that are not sitting?
reference answer: Yes, there is a bird that is standing .
LOC
VQA
EVAL
RESULT
yes
Is this a white cabinet?
reference answer: No, this is a brown cabinet.
VQA
EVAL
RESULT
no
On which side of the image is the male person?
reference answer: The skateboarder is on the left of the image.
LOC
CROP
LOC
COUNT
EVAL
RESULT
right
Does the shirt have the same color as the chair?
reference answer: Yes, both the shirt and the chair are white.
LOC
CROP
LOC
CROP
VQA
VQA
EVAL
RESULT
no
Are there both a door and a window in this scene?
reference answer: Yes, there are both a window and a door.
LOC
LOC
COUNT
COUNT
EVAL
RESULT
yes
Do the sky and the flag have the same color?
reference answer: Yes, both the sky and the flag are blue.
LOC
CROP
LOC
CROP
VQA
VQA
EVAL
RESULT
yes
How is the weather?
reference answer: It is partly cloudy.
VQA
RESULT
cloudy
Are there both a chair and a cup in the photo?
reference answer: Yes, there are both a cup and a chair.
LOC
LOC
COUNT
COUNT
EVAL
RESULT
yes
Is the bread on the left side?
reference answer: No, the bread is on the right of the image.
LOC
CROP
LOC
COUNT
EVAL
RESULT
yes
Are there any chairs or mugs that are black?
reference answer: Yes, the mug is black.
LOC
LOC
VQA
VQA
EVAL
RESULT
yes
What is the woman doing?
reference answer: The woman is looking down.
VQA
RESULT
texting
Do you see any short grass?
reference answer: Yes, there is short grass.
LOC
VQA
EVAL
RESULT
yes
Is the boat in the bottom part or in the top of the picture?
reference answer: The boat is in the bottom of the image.
LOC
CROP
LOC
COUNT
EVAL
RESULT
bottom
Are there buckets or sugar packets?
reference answer: No, there are no sugar packets or buckets.
LOC
LOC
COUNT
COUNT
EVAL
RESULT
no
Does the speaker to the left of the other speaker look blue?
reference answer: No, the speaker is silver.
LOC
CROP_LEFTOF
LOC
CROP
VQA
EVAL
RESULT
no
What's in front of the wall?
reference answer: The tree is in front of the wall.
LOC
CROP
LOC
VQA
RESULT
christmas tree
Is there an airplane in the picture that is black?
reference answer: No, there is an airplane but it is white.
LOC
CROP
VQA
EVAL
RESULT
no
What piece of furniture is the rug in front of, a cabinet or a couch?
reference answer: The rug is in front of a cabinet.
LOC
CROP_FRONT
Are there either helmets or mirrors that are black?
reference answer: Yes, the helmet is black.
LOC
LOC
COUNT
COUNT
EVAL
RESULT
yes
What is this appliance called?
reference answer: This is a toaster.
VQA
RESULT
stove
What is the item of furniture that is made of same material as the storage box that is not empty called?
reference answer: The piece of furniture is a desk.
LOC
CROP
VQA
LOC
CROP
VQA
EVAL
RESULT
furniture
How long are the trousers?
reference answer: The trousers are short.
VQA
RESULT
short
Who is wearing the pants?
reference answer: The woman is wearing pants.
LOC
CROP
VQA
RESULT
man
Are there any new dishwashers?
reference answer: Yes, there is a new dishwasher.
LOC
COUNT
EVAL
RESULT
yes
Is the shape of the log different than the tree?
reference answer: No, both the log and the tree are round.
LOC
CROP
LOC
CROP
VQA
VQA
EVAL
RESULT
no
What is the white clothing item called?
reference answer: The clothing item is a coat.
LOC
VQA
RESULT
tuxedo
What item of furniture is made of plastic?
reference answer: The piece of furniture is a desk.
VQA
RESULT
table
What device is the same color as the lamp?
reference answer: The cellphone is the same color as the lamp.
LOC
CROP
VQA
VQA
RESULT
snowboard
What is the vehicle that is made of same material as the pole that is not short called?
reference answer: The vehicle is a van.
LOC
CROP
VQA
LOC
CROP
VQA
EVAL
RESULT
yes
Is this a little table?
reference answer: No, this is a large table.
VQA
RESULT
no
Is the clock to the right or to the left of the person that the lady is to the left of?
reference answer: The clock is to the right of the person.
LOC
CROP_LEFTOF
LOC
CROP_LEFTOF
LOC
COUNT
EVAL
RESULT
right
Are there both glasses and ties in the image?
reference answer: Yes, there are both a tie and glasses.
LOC
LOC
COUNT
COUNT
EVAL
RESULT
yes
Are the trousers wet?
reference answer: No, the trousers are dry.
LOC
CROP
VQA
RESULT
no
What is the person in front of the chair typing on, a phone or a laptop?
reference answer: The person is typing on a phone.
LOC
CROP_FRONT
Is there any pillow that is not red?
reference answer: Yes, there is a white pillow.
LOC
VQA
EVAL
RESULT
yes
In which part of the photo is the red candle, the bottom or the top?
reference answer: The candle is in the top of the image.
LOC
CROP
LOC
COUNT
EVAL
RESULT
top
Who in this image is standing?
it] 3%|▎ | 59/1962 [02:44<1:26:28, 2.73s/it] 3%|▎ | 60/1962 [02:47<1:28:03, 2.78s/it] 3%|▎ | 61/1962 [02:49<1:22:48, 2.61s/it] 3%|▎ | 62/1962 [02:52<1:25:40, 2.71s/it] 3%|▎ | 63/1962 [02:55<1:26:02, 2.72s/it] 3%|▎ | 64/1962 [02:57<1:26:16, 2.73s/it] 3%|▎ | 65/1962 [03:00<1:21:36, 2.58s/it] 3%|▎ | 66/1962 [03:03<1:29:39, 2.84s/it] 3%|▎ | 67/1962 [03:06<1:34:15, 2.98s/it] 3%|▎ | 68/1962 [03:09<1:29:47, 2.84s/it] 4%|▎ | 69/1962 [03:11<1:25:41, 2.72s/it] 4%|▎ | 70/1962 [03:14<1:25:14, 2.70s/it] 4%|▎ | 71/1962 [03:17<1:24:06, 2.67s/it] 4%|▎ | 72/1962 [03:18<1:16:09, 2.42s/it] 4%|▎ | 73/1962 [03:21<1:19:04, 2.51s/it] 4%|▍ | 74/1962 [03:23<1:17:31, 2.46s/it] 4%|▍ | 75/1962 [03:26<1:17:45, 2.47s/it] 4%|▍ | 76/1962 [03:29<1:26:56, 2.77s/it] 4%|▍ | 77/1962 [03:31<1:17:07, 2.46s/it] 4%|▍ | 78/1962 [03:34<1:19:38, 2.54s/it] 4%|▍ | 79/1962 [03:36<1:13:01, 2.33s/it] 4%|▍ | 80/1962 [03:39<1:22:54, 2.64s/it] 4%|▍ | 81/1962 [03:42<1:28:50, 2.83s/it] 4%|▍ | 82/1962 [03:45<1:28:03, 2.81s/it] 4%|▍ | 83/1962 [03:47<1:21:06, 2.59s/it] 4%|▍ | 84/1962 [03:50<1:22:14, 2.63s/it] 4%|▍ | 85/1962 [03:53<1:28:01, 2.81s/it] 4%|▍ | 86/1962 [03:56<1:25:58, 2.75s/it] 4%|▍ | 87/1962 [03:58<1:20:39, 2.58s/it] 4%|▍ | 88/1962 [04:00<1:11:36, 2.29s/it] 5%|▍ | 89/1962 [04:02<1:12:16, 2.32s/it] 5%|▍ | 90/1962 [04:05<1:24:21, 2.70s/it] 5%|▍ | 91/1962 [04:08<1:24:49, 2.72s/it] 5%|▍ | 92/1962 [04:11<1:25:06, 2.73s/it] 5%|▍ | 93/1962 [04:14<1:26:18, 2.77s/it] 5%|▍ | 94/1962 [04:16<1:20:02, 2.57s/it] 5%|▍ | 95/1962 [04:19<1:28:39, 2.85s/it] 5%|▍ | 96/1962 [04:22<1:27:55, 2.83s/it] 5%|▍ | 97/1962 [04:25<1:31:16, 2.94s/it] 5%|▍ | 98/1962 [04:28<1:26:14, 2.78s/it] 5%|▌ | 99/1962 [04:31<1:25:55, 2.77s/it] 5%|▌ | 100/1962 [04:33<1:19:47, 2.57s/it] 5%|▌ | 101/1962 [04:36<1:22:11, 2.65s/it] 5%|▌ | 102/1962 [04:40<1:38:38, 3.18s/it] 5%|▌ | 103/1962 [04:42<1:27:25, 2.82s/it] 5%|▌ | 104/1962 [04:45<1:28:57, 2.87s/it] 5%|▌ | 105/1962 [04:47<1:19:08, 2.56s/it] 5%|▌ | 106/1962 [04:49<1:19:50, 2.58s/it] 5%|▌ | 107/1962 [04:52<1:19:33, 2.57s/it] 6%|▌ | 108/1962 [04:54<1:19:13, 2.56s/it] 6%|▌ | 109/1962 [04:57<1:19:56, 2.59s/it] 6%|▌ | 110/1962 [05:00<1:18:10, 2.53s/it] 6%|▌ | 111/1962 [05:04<1:39:14, 3.22s/it] 6%|▌ | 112/1962 [05:07<1:33:18, 3.03s/it] 6%|▌ | 113/1962 [05:09<1:24:08, 2.73s/it] 6%|▌ | 114/1962 [05:11<1:21:03, 2.63s/it] 6%|▌ | 115/1962 [reference answer: The woman is standing.
LOC
CROP
VQA
RESULT
no one
Are the street lights made of the same material as the cars?
reference answer: Yes, both the street lights and the cars are made of metal.
LOC
CROP
LOC
CROP
VQA
VQA
EVAL
RESULT
yes
Is there any coffee to the left of the man that is to the left of the paintings?
reference answer: No, there is wine to the left of the man.
LOC
CROP_LEFTOF
LOC
CROP_LEFTOF
LOC
COUNT
EVAL
RESULT
yes
Do you see calculators that are not made of plastic?
reference answer: No, there is a calculator but it is made of plastic.
LOC
VQA
EVAL
RESULT
no
Is the boy on the right side?
reference answer: No, the boy is on the left of the image.
LOC
CROP
LOC
COUNT
EVAL
RESULT
yes
What is the name of the piece of furniture that is made of the same material as the door?
reference answer: The piece of furniture is a drawer.
LOC
CROP
VQA
LOC
What kind of furniture is made of the same material as the frame?
reference answer: The end table is made of the same material as the frame.
LOC
CROP
VQA
VQA
RESULT
wood
What is the rounded appliance?
reference answer: The appliance is a toaster.
VQA
RESULT
stove
What kind of vegetable is to the right of the giraffe?
reference answer: The vegetable is a carrot.
LOC
CROP_RIGHTOF
LOC
VQA
RESULT
carrot
Which kind of furniture is the door behind of?
reference answer: The door is behind the chair.
LOC
CROP_BEHIND
VQA
RESULT
chairs
Is this a yellow fire hydrant?
reference answer: Yes, this is a yellow fire hydrant.
LOC
CROP
VQA
EVAL
RESULT
yes
Is the color of the building the same as the color of the SUV?
reference answer: No, the building is red and the SUV is black.
LOC
CROP
LOC
CROP
VQA
VQA
EVAL
RESULT
no
Which kind of furniture is it?
reference answer: The piece of furniture is a bed.
VQA
RESULT
bed
Is this a train or a bus?
reference answer: This is a bus.
LOC
LOC
COUNT
COUNT
EVAL
RESULT
train
Are these animals of the same species?
reference answer: No, there are both horses and deer.
VQA
RESULT
no
Is the color of the sidewalk different than the street sign?
reference answer: Yes, the street sign is red and the sidewalk is black.
LOC
CROP
LOC
CROP
VQA
VQA
EVAL
RESULT
yes
Is there an ottoman or a bed in the image?
reference answer: Yes, there is an ottoman.
LOC
LOC
COUNT
COUNT
EVAL
RESULT
yes
Are there tomatoes or potatoes that are not round?
reference answer: No, there is a potato but it is round.
LOC
LOC
COUNT
COUNT
EVAL
RESULT
yes
Which material was used to make that watch, stainless steel or leather?
reference answer: The watch is made of stainless steel.
VQA
EVAL
RESULT
leather
Is this a cabinet or a coffee table?
reference answer: This is a cabinet.
LOC
LOC
COUNT
COUNT
EVAL
RESULT
cabinet
Are there cones behind the hydrant made of metal?
reference answer: Yes, there is a cone behind the hydrant.
LOC
CROP_BEHIND
LOC
COUNT
EVAL
RESULT
yes
What device is the same color as the umbrella?
reference answer: The ipod is the same color as the umbrella.
LOC
CROP
VQA
VQA
RESULT
cell phone
Do you think the squash is raw?
reference answer: Yes, the squash is raw.
LOC
CROP
VQA
RESULT
no
Is it an outdoors scene?
reference answer: Yes, it is outdoors.
VQA
RESULT
yes
Is there a tie that is not black?
reference answer: No, there is a tie but it is black.
LOC
VQA
EVAL
RESULT
no
What is the man behind of, a cat or a horse?
reference answer: The man is behind a cat.
LOC
CROP_BEHIND
LOC
LOC
COUNT
COUNT
EVAL
RESULT
cat
Is there a seagull in this scene that is not standing?
reference answer: No, there is a seagull but it is standing.
LOC
CROP
LOC
COUNT
EVAL
RESULT
yes
Are there either old men or women in the picture?
reference answer: Yes, there is an old woman.
LOC
LOC
COUNT
COUNT
EVAL
RESULT
yes
Are there either any black couches or mirrors?
reference answer: No, there is a couch but it is red.
LOC
LOC
COUNT
COUNT
EVAL
RESULT
yes
Which are less healthy, the cupcakes or the carrots?
reference answer: The cupcakes are less healthy than the carrots.
VQA
RESULT
carrots
Which kind of clothing is not white, the baseball mitt or the sweater?
reference answer: The baseball mitt is not white.
LOC
CROP
LOC
CROP
VQA
VQA
EVAL
RESULT
baseball mitt
Is the soccer ball in the top part or in the bottom of the image?
reference answer: The soccer ball is in the bottom of the image.
LOC
CROP
LOC
COUNT
EVAL
RESULT
top
Do you see any fences near the vehicle behind the flag?
reference answer: No, there is a person near the train.
LOC
CROP_BEHIND
LOC
CROP_NEAR
How is the weather in the picture?
reference answer: It is partly cloudy.
VQA
RESULT
cloudy