[SearchSpace] Un-intuative behaviour for a search space with a fidelity parameter when ignored, i.e. RandomSearch

[eddiebergman]

When introducing a fidelity parameter with is_fidelity=True in RandomSearch, it will return configs where the value of the key, for example "epoch" will be set to None, rather than the maximum fidelity.

This occurs in SearchSpace.sample:

neps/neps/search_spaces/search_space.py

Lines 335 to 338 in 82b4890

	for name, hp in self.hyperparameters.items():
	if hp.is_fidelity and ignore_fidelity:
	sampled_hps[name] = hp.clone()
	continue

This is problematic as if you want to compare RS to some MF algorithm like SH, then you can't just switch out your optimizer with specific code to account for this