Semantic caching

[ciprianjichici]

Semantic caching

The issue or feature being addressed

Introduces a semantic cache that can be enabled on a per agent basis.

Details on the issue fix or feature implementation

The semantic cache relies on user prompt rewriting to ensure that all cached user prompts are unambiguous.
The user prompt rewriting is also configurable on a per agent basis.

Confirm the following

• I started this PR by branching from the head of the default branch
• I have targeted the PR to merge into the default branch
• This PR needs to be cherry-picked into at least one release branch
• I have included unit tests for the issue/feature
• I have included inline docs for my changes, where applicable
• I have successfully run a local build
• I have provided the required update scripts, where applicable
• I have updated relevant docs, where applicable

Note

Instead of adding X's inside the checkboxes you wish to check above, first submit the PR, then check the boxes in the rendered description.