Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Use Ref to IRCode #9

Merged
merged 1 commit into from
Oct 21, 2024
Merged

Use Ref to IRCode #9

merged 1 commit into from
Oct 21, 2024

Conversation

willtebbutt
Copy link
Member

@willtebbutt willtebbutt commented Oct 21, 2024

This resolves a performance problem that Mooncake has with some Turing.jl models, without changing the functionality of this package. However, the interface changes very slightly, so this change is technically breaking.

edit: in short, if you construct very many MistyClosures which contain quite quick functions (e.g. 20ns running time) and shove them in a Vector, and then call them in sequence, having them take up 48B rather than 176B can actually make quite a substantial difference to performance.

@willtebbutt willtebbutt self-assigned this Oct 21, 2024
@willtebbutt willtebbutt requested a review from yebai October 21, 2024 07:30
@willtebbutt
Copy link
Member Author

@yebai could you please take a quick look at this and let me know what you think? I'm not going to make a breaking release without at least having one other person taking a look at this.

@willtebbutt
Copy link
Member Author

Alternatively, @oxinabox if you're free, could you take a look?

@willtebbutt willtebbutt requested a review from oxinabox October 21, 2024 07:59
@willtebbutt willtebbutt merged commit 2c7f9be into main Oct 21, 2024
1 check passed
@willtebbutt willtebbutt deleted the wct/ref-ir branch October 21, 2024 08:55
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

2 participants