Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

bug for ModelCheckpoint(monitor='val_0_loss_epoch/dataloader_idx_0') #2

Open
mingyueqingfeng2022 opened this issue Apr 26, 2024 · 0 comments

Comments

@mingyueqingfeng2022
Copy link

Hello!

Thanks for open-sourcing the code! In reproducing your code of objcet detection I encountered the following issue:

lightning.fabric.utilities.exceptions.MisconfigurationException: ModelCheckpoint(monitor='val_0_loss_epoch/dataloader_idx_0') could not find the monitored key in the returned metrics: ['lr-AdamW/pg1', 'lr-AdamW/pg2', 'lr-AdamW/pg3', 'lr-AdamW/pg4', 'lr-AdamW/pg5', 'train_loss', 'val_mAP_pascal', 'val_mAP_50_pascal', 'pascal_eval_2007_val_mAP_pascal', 'pascal_eval_2007_val_mAP_50_pascal', 'pascal_eval_2007_val_mAP_75_pascal', 'pascal_eval_2012_val_mAP_pascal', 'pascal_eval_2012_val_mAP_50_pascal', 'pascal_eval_2012_val_mAP_75_pascal', 'epoch', 'step']. HINT: Did you call log('val_0_loss_epoch/dataloader_idx_0', value) in the LightningModule? → This issues allows your code to run only one training epoch, resulting in an inability to reproduce the results of your paper.

My training environment is:

_libgcc_mutex 0.1 main https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
_openmp_mutex 5.1 1_gnu https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
absl-py 2.1.0 pypi_0 pypi
aiohttp 3.9.5 pypi_0 pypi
aiosignal 1.3.1 pypi_0 pypi
antlr4-python3-runtime 4.9.3 pypi_0 pypi
anyio 4.3.0 pypi_0 pypi
arrow 1.3.0 pypi_0 pypi
async-timeout 4.0.3 pypi_0 pypi
attrs 23.2.0 pypi_0 pypi
beautifulsoup4 4.12.3 pypi_0 pypi
black 24.4.0 pypi_0 pypi
blas 1.0 mkl https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
blessed 1.20.0 pypi_0 pypi
brotli-python 1.0.9 py38h6a678d5_7 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
bzip2 1.0.8 h5eee18b_5 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
ca-certificates 2024.3.11 h06a4308_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
cachetools 5.3.3 pypi_0 pypi
certifi 2024.2.2 py38h06a4308_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
chainer 7.8.1 pypi_0 pypi
chainercv 0.13.1 pypi_0 pypi
charset-normalizer 2.0.4 pyhd3eb1b0_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
click 8.1.7 pypi_0 pypi
clip 1.0 dev_0
contourpy 1.1.1 pypi_0 pypi
croniter 1.3.15 pypi_0 pypi
cuda-cudart 11.7.99 0 nvidia
cuda-cupti 11.7.101 0 nvidia
cuda-libraries 11.7.1 0 nvidia
cuda-nvrtc 11.7.99 0 nvidia
cuda-nvtx 11.7.91 0 nvidia
cuda-runtime 11.7.1 0 nvidia
cycler 0.12.1 pypi_0 pypi
dateutils 0.6.12 pypi_0 pypi
deepdiff 7.0.1 pypi_0 pypi
detectron2 0.6 dev_0
diffusers 0.24.0 pypi_0 pypi
docker-pycreds 0.4.0 pypi_0 pypi
editor 1.6.6 pypi_0 pypi
efficientnet-pytorch 0.7.1 pypi_0 pypi
einops 0.3.0 pypi_0 pypi
exceptiongroup 1.2.1 pypi_0 pypi
fastapi 0.88.0 pypi_0 pypi
ffmpeg 4.3 hf484d3e_0 pytorch
filelock 3.13.1 py38h06a4308_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
fonttools 4.51.0 pypi_0 pypi
freetype 2.12.1 h4a9f257_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
frozenlist 1.4.1 pypi_0 pypi
fsspec 2023.12.2 pypi_0 pypi
ftfy 6.2.0 pypi_0 pypi
fvcore 0.1.5.post20221221 pypi_0 pypi
gitdb 4.0.11 pypi_0 pypi
gitpython 3.1.43 pypi_0 pypi
gmp 6.2.1 h295c915_3 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
gmpy2 2.1.2 py38heeb90bb_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
gnutls 3.6.15 he1e5248_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
google-auth 2.29.0 pypi_0 pypi
google-auth-oauthlib 1.0.0 pypi_0 pypi
grpcio 1.62.2 pypi_0 pypi
h11 0.14.0 pypi_0 pypi
huggingface-hub 0.22.2 pypi_0 pypi
hydra-core 1.3.2 pypi_0 pypi
idna 3.4 py38h06a4308_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
imageio 2.34.1 pypi_0 pypi
importlib-metadata 7.1.0 pypi_0 pypi
importlib-resources 6.4.0 pypi_0 pypi
inquirer 3.2.4 pypi_0 pypi
intel-openmp 2023.1.0 hdb19cb5_46306 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
iopath 0.1.9 pypi_0 pypi
itsdangerous 2.2.0 pypi_0 pypi
jinja2 3.1.3 py38h06a4308_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
jmespath 1.0.1 pypi_0 pypi
jpeg 9e h5eee18b_1 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
kiwisolver 1.4.5 pypi_0 pypi
kornia 0.6.0 pypi_0 pypi
kornia-rs 0.1.3 pypi_0 pypi
lame 3.100 h7b6447c_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
lazy-loader 0.4 pypi_0 pypi
lcms2 2.12 h3be6417_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
ld_impl_linux-64 2.38 h1181459_1 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
lerc 3.0 h295c915_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
libcublas 11.10.3.66 0 nvidia
libcufft 10.7.2.124 h4fbf590_0 nvidia
libcufile 1.9.1.3 0 nvidia
libcurand 10.3.5.147 0 nvidia
libcusolver 11.4.0.1 0 nvidia
libcusparse 11.7.4.91 0 nvidia
libdeflate 1.17 h5eee18b_1 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
libedit 3.1.20230828 h5eee18b_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
libffi 3.4.4 h6a678d5_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
libgcc-ng 11.2.0 h1234567_1 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
libgomp 11.2.0 h1234567_1 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
libiconv 1.16 h7f8727e_2 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
libidn2 2.3.4 h5eee18b_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
libnpp 11.7.4.75 0 nvidia
libnvjpeg 11.8.0.2 0 nvidia
libpng 1.6.39 h5eee18b_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
libstdcxx-ng 11.2.0 h1234567_1 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
libtasn1 4.19.0 h5eee18b_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
libtiff 4.5.1 h6a678d5_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
libunistring 0.9.10 h27cfd23_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
libwebp-base 1.3.2 h5eee18b_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
lightning 2.0.0 pypi_0 pypi
lightning-cloud 0.5.68 pypi_0 pypi
lightning-utilities 0.11.2 pypi_0 pypi
lz4-c 1.9.4 h6a678d5_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
markdown 3.6 pypi_0 pypi
markdown-it-py 3.0.0 pypi_0 pypi
markupsafe 2.1.3 py38h5eee18b_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
matplotlib 3.7.5 pypi_0 pypi
mdurl 0.1.2 pypi_0 pypi
mkl 2023.1.0 h213fc3f_46344 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
mkl-service 2.4.0 py38h5eee18b_1 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
mkl_fft 1.3.8 py38h5eee18b_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
mkl_random 1.2.4 py38hdb19cb5_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
mpc 1.1.0 h10f8cd9_1 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
mpfr 4.0.2 hb69a4c5_1 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
mpmath 1.3.0 py38h06a4308_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
multidict 6.0.5 pypi_0 pypi
munch 4.0.0 pypi_0 pypi
mypy-extensions 1.0.0 pypi_0 pypi
ncurses 6.4 h6a678d5_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
nettle 3.7.3 hbbd107a_1 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
networkx 3.1 py38h06a4308_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
numpy 1.24.3 py38hf6e8229_1 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
numpy-base 1.24.3 py38h060ed82_1 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
oauthlib 3.2.2 pypi_0 pypi
omegaconf 2.3.0 pypi_0 pypi
opencv-python 4.9.0.80 pypi_0 pypi
openh264 2.1.1 h4ff587b_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
openjpeg 2.4.0 h3ad879b_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
openssl 3.0.13 h7f8727e_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
ordered-set 4.1.0 pypi_0 pypi
packaging 24.0 pypi_0 pypi
pandas 2.0.3 pypi_0 pypi
pathspec 0.12.1 pypi_0 pypi
pillow 10.2.0 py38h5eee18b_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
pip 23.3.1 py38h06a4308_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
platformdirs 4.2.1 pypi_0 pypi
pretrainedmodels 0.7.4 pypi_0 pypi
protobuf 4.25.3 pypi_0 pypi
psutil 5.9.8 pypi_0 pypi
pyasn1 0.6.0 pypi_0 pypi
pyasn1-modules 0.4.0 pypi_0 pypi
pycocotools 2.0.7 pypi_0 pypi
pydantic 1.10.15 pypi_0 pypi
pygments 2.17.2 pypi_0 pypi
pyjwt 2.8.0 pypi_0 pypi
pyparsing 3.1.2 pypi_0 pypi
pysocks 1.7.1 py38h06a4308_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
python 3.8.19 h955ad1f_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
python-dateutil 2.9.0.post0 pypi_0 pypi
python-multipart 0.0.9 pypi_0 pypi
pytorch 2.0.1 py3.8_cuda11.7_cudnn8.5.0_0 pytorch
pytorch-cuda 11.7 h778d358_5 pytorch
pytorch-lightning 2.2.3 pypi_0 pypi
pytorch-mutex 1.0 cuda pytorch
pytz 2024.1 pypi_0 pypi
pywavelets 1.4.1 pypi_0 pypi
pyyaml 6.0.1 pypi_0 pypi
readchar 4.0.6 pypi_0 pypi
readline 8.2 h5eee18b_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
regex 2024.4.16 pypi_0 pypi
requests 2.31.0 py38h06a4308_1 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
requests-oauthlib 2.0.0 pypi_0 pypi
rich 13.7.1 pypi_0 pypi
rsa 4.9 pypi_0 pypi
runs 1.2.2 pypi_0 pypi
safetensors 0.4.3 pypi_0 pypi
scikit-image 0.21.0 pypi_0 pypi
scipy 1.10.1 pypi_0 pypi
segmentation-models-pytorch 0.3.3 pypi_0 pypi
sentry-sdk 1.45.0 pypi_0 pypi
setproctitle 1.3.3 pypi_0 pypi
setuptools 68.2.2 py38h06a4308_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
six 1.16.0 pypi_0 pypi
smmap 5.0.1 pypi_0 pypi
sniffio 1.3.1 pypi_0 pypi
soupsieve 2.5 pypi_0 pypi
sqlite 3.41.2 h5eee18b_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
starlette 0.22.0 pypi_0 pypi
starsessions 1.3.0 pypi_0 pypi
sympy 1.12 py38h06a4308_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
tabulate 0.9.0 pypi_0 pypi
taming-transformers 0.0.1 dev_0
tbb 2021.8.0 hdb19cb5_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
tensorboard 2.14.0 pypi_0 pypi
tensorboard-data-server 0.7.2 pypi_0 pypi
termcolor 2.4.0 pypi_0 pypi
tifffile 2023.7.10 pypi_0 pypi
timm 0.9.2 pypi_0 pypi
tk 8.6.12 h1ccaba5_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
tokenizers 0.19.1 pypi_0 pypi
tomli 2.0.1 pypi_0 pypi
torchaudio 2.0.2 py38_cu117 pytorch
torchmetrics 1.3.2 pypi_0 pypi
torchtriton 2.0.0 py38 pytorch
torchvision 0.15.2 py38_cu117 pytorch
tqdm 4.66.2 pypi_0 pypi
traitlets 5.14.3 pypi_0 pypi
transformers 4.41.0.dev0 pypi_0 pypi
types-python-dateutil 2.9.0.20240316 pypi_0 pypi
typing_extensions 4.9.0 py38h06a4308_1 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
tzdata 2024.1 pypi_0 pypi
urllib3 1.26.18 pypi_0 pypi
uvicorn 0.29.0 pypi_0 pypi
wandb 0.16.6 pypi_0 pypi
wcwidth 0.2.13 pypi_0 pypi
websocket-client 1.8.0 pypi_0 pypi
websockets 11.0.3 pypi_0 pypi
werkzeug 3.0.2 pypi_0 pypi
wheel 0.41.2 py38h06a4308_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
xmod 1.8.1 pypi_0 pypi
xz 5.4.6 h5eee18b_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
yacs 0.1.8 pypi_0 pypi
yarl 1.9.4 pypi_0 pypi
zipp 3.18.1 pypi_0 pypi
zlib 1.2.13 h5eee18b_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main
zstd 1.5.5 hc292b87_0 https://mirrors.tuna.tsinghua.edu.cn/anaconda/pkgs/main

My training command is :python train_tadp.py

Looking forward to your reply.Thanks a lot!

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

1 participant