Skip to content

Commit

Permalink
create a copy of the Q-value map
Browse files Browse the repository at this point in the history
  • Loading branch information
Roman Andriushchenko committed Dec 6, 2023
1 parent 4b75c14 commit 165c9ec
Showing 1 changed file with 2 additions and 1 deletion.
3 changes: 2 additions & 1 deletion paynt/quotient/pomdp_family.py
Original file line number Diff line number Diff line change
Expand Up @@ -241,10 +241,11 @@ def compute_qvalues_for_fsc(self, dtmc_sketch):
product_state_to_value = result.get_values()

# map state values to the resulting map
product_state_to_state_memory_action = self.product_pomdp_fsc.product_state_to_state_memory_action.copy()
state_memory_action_to_value = {}
invalid_action = self.num_actions
for product_state in range(product.nr_states):
state,memory_action = self.product_pomdp_fsc.product_state_to_state_memory_action[product_state]
state,memory_action = product_state_to_state_memory_action[product_state]
memory,action = memory_action
if action == invalid_action:
continue
Expand Down

0 comments on commit 165c9ec

Please sign in to comment.