Only keep track of recently used stacks in memory.

[vicsn]

Motivation

RSS growth is correlated with deployments. By lazy loading deployments, hopefully unbounded memory growth is eliminated.

The cache will take up at most MAX_PROGRAM_DEPTH x MAX_IMPORTS x 100kb x 10 ~= 4GB of data.

Note that programs, represented as Stacks, have imports. This means the cache is essentially a DAG with multiple roots. To avoid memory leaks, we only evict root stacks from the cache. In the following diagram, you can see in the call graph below where the cache is (temporarily) locked and updated. The "long" loop has some nasty edge cases, it would be better to pass all imports directly into load_deployment and Stack::new, but that would be a much bigger refactor.

Test Plan

• Unit tests pass. Requires [Refactor] simplify and unify the storage setup for tests #2590 to fix the test_real_example_cache_evict test.
• Local network passes, using tx-cannon to deploy and fetch multiple sets of maximally nested deployments.
• Deployed network passes, using tx-cannon to deploy and fetch multiple sets of maximally nested deployments.
• Consider fixing how test storage works, which currently leaks states across tests.

Related PRs

#2519
#2553
#2578

[ljedrz]

Suggested change

	.map_or(ProgramID::<N>::from_str("credits.aleo").unwrap(), |stack| *stack.program_id());
	.map_or_else(|| ProgramID::<N>::from_str("credits.aleo").unwrap(), |stack| *stack.program_id());

(to avoid eager evaluation)

[ljedrz]

Suggested change

	.unique_by(|(id, _)|*id) // don't add duplicates.
	.unique_by(|(id, _)| *id) // don't add duplicates.

tiny nit, rustfmt might have missed it

[ljedrz]

Suggested change

	let mut process = Self {
	universal_srs: Arc::new(UniversalSRS::load()?),
	credits: None,
	stacks: Arc::new(Mutex::new(LruCache::new(NonZeroUsize::new(N::MAX_STACKS).unwrap()))),
	store: None,
	};
	let mut process = Self::load_no_storage()?;

[ljedrz]

Suggested change

	let mut process = Self {
	universal_srs: Arc::new(UniversalSRS::load()?),
	credits: None,
	stacks: Arc::new(Mutex::new(LruCache::new(NonZeroUsize::new(N::MAX_STACKS).unwrap()))),
	store: Some(store),
	};
	let mut process = Self::load_no_storage()?;
	process.store = Some(store);

[ljedrz]

2nd review pass complete, left a few comments; also, it seems like one of the new tests is currently failing.