Skip to content
This repository has been archived by the owner on Oct 31, 2023. It is now read-only.

change dim=-1 to dim=1 in bounding_box.py for the purpose of tracing using jit #1022

Open
wants to merge 47 commits into
base: main
Choose a base branch
from

Conversation

zimenglan-sysu-512
Copy link
Contributor

@zimenglan-sysu-512 zimenglan-sysu-512 commented Aug 6, 2019

when trace the rpn and rcnn heads using torch.jit.trace, it encouters the problem vector::_M_range_check: __n (which is 18446744073709551615) >= this->size() (which is 2), and find that it is caused by the dim=-1 in bounding_box.py file. so changing all of dim=-1 to dim=1 can solve it.

…d use 'BaseStem'&'Bottleneck' to simply codes
@facebook-github-bot facebook-github-bot added the CLA Signed Do not delete this pull request or issue due to inactivity. label Aug 6, 2019
@botcs
Copy link
Contributor

botcs commented Sep 16, 2019

Hi @zimenglan-sysu-512 ,
Thanks for spotting this!

Can you please provide a short script to reproduce this error?

Sign up for free to subscribe to this conversation on GitHub. Already have an account? Sign in.
Labels
awaiting response bug Something isn't working CLA Signed Do not delete this pull request or issue due to inactivity.
Projects
None yet
Development

Successfully merging this pull request may close these issues.

3 participants