Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

Sign up for GitHub

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Dec-POMDP support added #42

Merged
merged 108 commits into from
Jun 20, 2024
Merged

Dec-POMDP support added #42

Show file tree
Hide file tree
Changes from 105 commits
Commits
Show all changes
108 commits
Select commit Hold shift + click to select a range
2266633
added alias-paynt
Jan 8, 2024
da559fb
add memory
Jan 8, 2024
61800d1
build state space
Jan 8, 2024
a36ddd6
simplify constructQuotientMdp
Jan 9, 2024
d64fab2
add count successors
Jan 9, 2024
ba52d67
change prints
Jan 9, 2024
b27d7ef
change discount factor
Jan 9, 2024
aa46e67
fix build state space
Jan 9, 2024
5953bc8
add max_successor_memory_size and fix global memory set
Jan 9, 2024
e61caa6
add buildTransitionMatrixSpurious
Jan 9, 2024
bbb471d
add constructQuotientStateLabeling
Jan 9, 2024
121ced7
fix prototype row index
Jan 10, 2024
4adcca1
fix row prototype
Jan 13, 2024
4304976
add choice labeling
Jan 13, 2024
b3823f8
fix row prototype
Jan 13, 2024
781da98
fix constructing choice labeling
Jan 13, 2024
e2f9272
construct transition matrix
Jan 14, 2024
6384a73
fix transition matrix and add reward model
Jan 14, 2024
19938e3
add supporting functions to coloring
vojtavojta Jan 16, 2024
76ae008
add reset design space
vojtavojta Jan 16, 2024
8875ca9
add nr_agent_actions_at_observation to cpp
vojtavojta Jan 16, 2024
6c2b49f
add holes in cpp
vojtavojta Jan 16, 2024
df404e9
fix row prototype
vojtavojta Jan 17, 2024
5e4bd9f
fix row prototype again
vojtavojta Jan 17, 2024
45bc948
unfinished version of buildDesignSpaceSpurious
Jan 17, 2024
117e0f2
add buildDesignSpaceSpurious
Jan 17, 2024
6459eff
set memory
Jan 18, 2024
022b42b
error coloring
vojtavojta Jan 25, 2024
059d5d1
number of rows does not match state count.
vojtavojta Feb 4, 2024
8c2aa5f
add basic model
vojtavojta Feb 5, 2024
9555da6
-
vojtavojta Feb 6, 2024
1b295db
change for cycle in coloring
vojtavojta Feb 6, 2024
12640d6
mem fixed
vojtavojta Feb 6, 2024
d199c77
add agent_max_successor_memory_size
vojtavojta Feb 7, 2024
8985e31
fix creating memory holes
vojtavojta Feb 7, 2024
84fa4cc
Merge branch 'fixmem'
vojtavojta Feb 7, 2024
c9370ee
fixed coloring
vojtavojta Feb 7, 2024
68bb727
changed discount in dectiger
vojtavojta Feb 7, 2024
7c3b69e
delete prints
vojtavojta Feb 8, 2024
5c395ef
removed prints
vojtavojta Feb 8, 2024
0f10c21
coloring run with fixed memory
vojtavojta Feb 9, 2024
b95bc58
add models
vojtavojta Feb 13, 2024
d78c633
remove discounted conditions
vojtavojta Feb 19, 2024
40f92dd
added decpomdp models
Feb 21, 2024
608efa8
added experiment
Feb 21, 2024
f9c5cdd
added experiments
Feb 26, 2024
451eb9d
new split method
vojtavojta Mar 3, 2024
30cb27b
added made_memory_joint_observation()
vojtavojta Mar 3, 2024
b5d9104
added construct_acton_to_memory_joint_observation
vojtavojta Mar 4, 2024
d5ba908
changes in scheduler_selection
vojtavojta Mar 5, 2024
5fb26ce
complete acton_to_memory_joint_observation
vojtavojta Mar 5, 2024
7315835
prefers inconsistency of the second type
vojtavojta Mar 5, 2024
22d096f
removed prints
vojtavojta Mar 9, 2024
03c7869
added state_to_memory_joint_observation and alternative function
vojtavojta Mar 10, 2024
bc470ed
added nr_memory_joint_observations
vojtavojta Mar 10, 2024
5bc3316
added alternativeComputeInconsistentHoleVariance
vojtavojta Mar 11, 2024
c91a4f7
score prefer inconsistency of 1 type
vojtavojta Mar 11, 2024
d0f3db1
fixed prefer 1st type
vojtavojta Mar 11, 2024
5c68448
fixed prefer 1st type
vojtavojta Mar 11, 2024
3096530
add models
Mar 15, 2024
0da89bc
Merge branch 'spliting'
Mar 15, 2024
3bf7597
added possibility to don't use discount transformation
Mar 15, 2024
67393d8
added direct setting of target states
Mar 15, 2024
3de00c8
fixed direct setting of target states
Mar 16, 2024
d8973d0
added setting of target states from file
Mar 16, 2024
4d70b3f
added setting of props from file
vojtavojta Mar 16, 2024
46b4ad2
added infinite models
vojtavojta Apr 6, 2024
214f588
added models
vojtavojta Apr 11, 2024
07c241a
Merge branch 'infinite-horizon'
vojtavojta Apr 11, 2024
444a58d
changed circle model
vojtavojta Apr 11, 2024
b988032
Merge branch 'reducedFCS'
vojtavojta Apr 11, 2024
eba4c36
added iterative function
vojtavojta Apr 13, 2024
85dd4e7
Merge branch 'iterative'
vojtavojta Apr 13, 2024
26ecec0
added new grid
vojtavojta May 8, 2024
612f49f
changes in grids ERROR
vojtavojta May 8, 2024
f60e746
change small bug
vojtavojta May 9, 2024
d092e04
Merge branch 'targetbyobservation'
vojtavojta May 9, 2024
e80fe1f
fix numbers in max succ
vojtavojta May 9, 2024
3b384b9
Revert "fix numbers in max succ"
vojtavojta May 9, 2024
c3f0992
fixed effectivity of coloring
vojtavojta May 9, 2024
bb7878a
fix 0 in max_mem_size
vojtavojta May 9, 2024
852b25a
Merge branch 'bugfix'
vojtavojta May 9, 2024
af34ec5
added prints
vojtavojta May 9, 2024
a5e94b6
added generator of target states
vojtavojta May 9, 2024
d51362b
return FSC but not working
vojtavojta May 9, 2024
66edebf
after experiments
vojtavojta May 10, 2024
f12f775
Merge branch 'bugfix'
vojtavojta May 10, 2024
76789e0
addeed coments
vojtavojta May 10, 2024
17c1a60
changed agent action labels
vojtavojta May 10, 2024
4ec3d38
fixing grid
vojtavojta May 10, 2024
5a2f194
added coments
vojtavojta May 11, 2024
2afca9f
added universal labels
vojtavojta May 11, 2024
9f0bcf0
Merge branch 'action_labels'
vojtavojta May 11, 2024
1f99716
+
vojtavojta May 11, 2024
1a91993
added grid target
vojtavojta May 11, 2024
d973b9d
working
vojtavojta May 12, 2024
f589928
Merge branch 'new_grid'
vojtavojta May 12, 2024
cbb6112
deleted comments
vojtavojta May 13, 2024
6e653ba
Merge remote-tracking branch 'vojta/master' into dec-pomdp
TheGreatfpmK Jun 5, 2024
7677311
Added simple iterative strategy for dec-POMDPs; renamed pomdp-memory-…
TheGreatfpmK Jun 11, 2024
30456dd
Preparing dec-POMDP implementation to support flexible memory update;…
TheGreatfpmK Jun 12, 2024
bc6f5dd
dec-POMDP WIP
TheGreatfpmK Jun 14, 2024
518fb7d
dec-POMDP implementation WIP
TheGreatfpmK Jun 14, 2024
6333959
Finished Dec-POMDP quotient implementation
TheGreatfpmK Jun 18, 2024
854bed9
Merge branch 'randriu:master' into dec-pomdp
TheGreatfpmK Jun 18, 2024
c14710e
Final improvements of the Dec-POMDP code
TheGreatfpmK Jun 20, 2024
37432c4
updated README
TheGreatfpmK Jun 20, 2024
6806669
Merge remote-tracking branch 'origin/master' into dec-pomdp
TheGreatfpmK Jun 20, 2024
File filter

Filter by extension

Filter by extension
Conversations
Failed to load comments.
Loading
Jump to
Jump to file
Failed to load files.
Loading
Diff view
Diff view
2 changes: 2 additions & 0 deletions .gitignore
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -2,3 +2,5 @@ __pycache__/
*.egg-info/

prerequisites/

.vscode
2 changes: 1 addition & 1 deletion models/cassandra/decpomdp/2generals.dpomdp
View file
Open in desktop
Original file line number Diff line number Diff line change
Expand Up @@ -12,7 +12,7 @@
# agents: agent1_name, name-of-agent2, ...
agents: 2
# discount: %f
discount: 1
discount: 0.3
#.0
# values: [ reward, cost ]
values: reward
Expand Down
Loading