lscd_compare task

[kuan-yu-lin]

Here is the command lines:

python main.py \
    dataset=dwug_de_210 \
    dataset/split=dev \
    dataset/spelling_normalization=german \
    dataset/preprocessing=raw \
    evaluation=none \
    task=lscd_compare \
    task/[email protected]=cluster_jsd \
    task/[email protected]=cluster_correlation \
    task/[email protected]=contextual_embedder \
    task/wic/[email protected]_metric=cosine \
    task.model.wsi.wic.ckpt=bert-base-german-cased \
    task.model.wsi.wic.gpu=1

Different task/[email protected] setting ended up in different errors.
task/[email protected]=apd_compare_all raised the error:

/mount/arbeitsdaten20/projekte/cik/users/kuan-yu/LSCDBenchmark/.venv/lib64/python3.10/site-packages/hydra/_internal/callbacks.py:26: UserWarning: Callback ResultCollector.on_run_end raised NotImplementedError: 
    warnings.warn(
    Error executing job with overrides: ['dataset=dwug_de_210', 'dataset/split=dev', 'dataset/spelling_normalization=german', 'dataset/preprocessing=raw', 'evaluation=none', 'task=lscd_compare', 'task/[email protected]=apd_compare_all', 'task/[email protected]=contextual_embedder', 'task/wic/[email protected]_metric=cosine', 'task.model.wic.ckpt=bert-base-german-cased', 'task.model.wic.gpu=1']
    Error locating target 'src.lscd.ApdCompareAll', see chained exception above.
    full_key: task.model

task/[email protected]=cos raised the error:

/mount/arbeitsdaten20/projekte/cik/users/kuan-yu/LSCDBenchmark/.venv/lib64/python3.10/site-packages/hydra/_internal/callbacks.py:26: UserWarning: Callback ResultCollector.on_run_end raised NotImplementedError: 
    warnings.warn(

task/[email protected]=cluster_jsd raised the error:

/mount/arbeitsdaten20/projekte/cik/users/kuan-yu/LSCDBenchmark/.venv/lib64/python3.10/site-packages/hydra/_internal/callbacks.py:26: UserWarning: Callback ResultCollector.on_run_end raised NotImplementedError: 
    warnings.warn(
    Error executing job with overrides: ['dataset=dwug_de_210', 'dataset/split=dev', 'dataset/spelling_normalization=german', 'dataset/preprocessing=raw', 'evaluation=none', 'task=lscd_compare', 'task/[email protected]=cluster_jsd', 'task/[email protected]=cluster_correlation', 'task/[email protected]=contextual_embedder', 'task/wic/[email protected]_metric=cosine', 'task.model.wsi.wic.ckpt=bert-base-german-cased', 'task.model.wsi.wic.gpu=1']
    Error in call to target 'src.lscd.cluster_jsd.ClusterJSD':
    TypeError("Can't instantiate abstract class ClusterJSD with abstract method predict_all")
    full_key: task.model