Missing jemalloc dependency

[akoshchiy]

Seems that duckdb sources is not bundled with jemalloc. duckdb/duckdb#13075
It could be the reason of some memory issues, e.g. duckdb/duckdb#9712

[brianwyka]

@lnkuiper , do you think this could be the issue?

[lnkuiper]

@akoshchiy, indeed, the JDBC client has not been bundled with jemalloc since we moved it out of the main repository to this repository. I don't see why it can't be bundled with jemalloc, so we should look into this.

@brianwyka, I'm not sure. I have been able to reproduce a similar memory retention issue, but only on MacOS regardless of whether jemalloc was bundled. On Linux, I was not able to reproduce this issue.

[brianwyka]

@lnkuiper , do you have instructions on how to bundle it? Perhaps I can contribute if its not on the roadmap or radar.

[lnkuiper]

You can enable jemalloc by adding it to the list of extensions in vendor.py and calling python3 scripts/vendor.py --duckdb=/path/to/duckdb/repo, and then make release in duckdb-jdbc repo.

For other clients, we only bundle jemalloc on x86 linux, and we'd like to keep it the same for JDBC, so it needs to check this. You can check how we do this in duckdb repo at tools/pythonpkg/setup.py.