ant_metrics.hdf5 not generated when only ONE file is fed in

[Zhilei]

When trying to use the makeflow function, we only feed one data file while the setting for Antenna Matrice is:

prereqs = "FIX_DATAFILE"
chunk_size = 10
stride_length = 10
time_centered = false
collect_stragglers = true
args = ["${ANT_METRICS_OPTS:crossCut}",
       "${ANT_METRICS_OPTS:deadCut}",
       "${ANT_METRICS_OPTS:Nbls_per_load}",
       "${ANT_METRICS_OPTS:good_extension}",
       "${ANT_METRICS_OPTS:good_statuses}",
       "{obsid_list}",
      ]

Then we run into the error as:
OSError: Unable to open file (unable to open file: name = 'zen.2458937.29002.sum.known_good.ant_metrics.hdf5', errno = 2, error message = 'No such file or directory', flags = 0, o_flags = 0)
in the '...sum.uvh5.REDCAL_KNOWN_GOOD.log.error' file. Ig seems like the ant_metrics file was not generated.

[jsdillon]

ant_metrics should be able to run on a single 4-polarization file. Can you post the shell command that was actually run (check the log, sit should have been echoed).

[plaplant]

@jsdillon what we saw was that there was no ant metrics job generated when the list of inputs contained just a single file. So when redcal went to fetch the ant metrics file, it wasn't there. My guess is this is a corner-case we missed where even if collect_stragglers = True for ant metrics, it doesn't make any jobs is there isn't at least one full set. I think I need to slightly tweak the logic to make sure a job is generated in this case.

[jsdillon]

That makes sense.