Differences
This shows you the differences between two versions of the page.
| Both sides previous revision Previous revision Next revision | Previous revision Last revision Both sides next revision | ||
|
problem_domains [2013/12/22 22:20] chris [General Dec-POMDPs] |
problem_domains [2019/01/08 16:40] matthijs [Transition and observation independent Dec-POMDPs] Updated URLs |
||
|---|---|---|---|
| Line 1: | Line 1: | ||
| ====== Dec-POMDP problem domains ====== | ====== Dec-POMDP problem domains ====== | ||
| - | On this page we are collecting a number of Dec-POMDP problem descriptions, to create a repository containing several standard problem domains that can be used for benchmarking. Contributions are welcome. The models are provided in the .dpomdp file format, which is an extension of [[http://pomdp.org/pomdp/examples/index.shtml|Tony's POMDP file format]]. The file format is explained in example.dpomdp, and can be used in the [[http://www.science.uva.nl/~faolieho/index.php?fuseaction=software.madp|Multiagent decision process (MADP)]] Toolbox, which contains a parser for it. More information about this software toolbox can be found on its [[http://www.science.uva.nl/~faolieho/index.php?fuseaction=software.madp|homepage]] or in this [[http://users.isr.ist.utl.pt/~mtjspaan/pub/Spaan08msdm.pdf|MSDM 2008 paper]]. | + | On this page we are collecting a number of Dec-POMDP problem descriptions, to create a repository containing several standard problem domains that can be used for benchmarking. Contributions are welcome. The models are provided in the .dpomdp file format, which is an extension of [[http://pomdp.org/pomdp/examples/index.shtml|Tony's POMDP file format]]. The file format is explained in example.dpomdp, and can be used in the [[http://www.fransoliehoek.net/madp|Multiagent decision process (MADP)]] Toolbox, which contains a parser for it. More information about this software toolbox can be found on its [[http://www.fransoliehoek.net/madp|homepage]], on [[https://github.com/MADPToolbox/MADP|GitHub]] or in this [[http://users.isr.ist.utl.pt/~mtjspaan/pub/Spaan08msdm.pdf|MSDM 2008 paper]]. |
| ===== General Dec-POMDPs ===== | ===== General Dec-POMDPs ===== | ||
| ^ File ^ Name ^ Reference and Notes ^ | ^ File ^ Name ^ Reference and Notes ^ | ||
| - | | [[http://www.st.ewi.tudelft.nl/~mtjspaan/decpomdp/dectiger.dpomdp|dectiger.dpomdp]] | Decentralized Tiger | (Nair, Tambe, Yokoo, Pynadath & Marsella, IJCAI 2003) | | + | | [[http://www.st.ewi.tudelft.nl/mtjspaan/decpomdp/dectiger.dpomdp|dectiger.dpomdp]] | Decentralized Tiger | (Nair, Tambe, Yokoo, Pynadath & Marsella, IJCAI 2003) | |
| - | | [[http://www.st.ewi.tudelft.nl/~mtjspaan/decpomdp/broadcastChannel.dpomdp|broadcastChannel.dpomdp]] | Broadcast Channel problem | (Hansen, Bernstein & Zilberstein, AAAI 2004) | | + | | [[http://www.st.ewi.tudelft.nl/mtjspaan/decpomdp/broadcastChannel.dpomdp|broadcastChannel.dpomdp]] | Broadcast Channel problem | (Hansen, Bernstein & Zilberstein, AAAI 2004) | |
| - | | [[http://www.st.ewi.tudelft.nl/~mtjspaan/decpomdp/GridSmall.dpomdp|GridSmall.dpomdp]] | Meeting in a 2x2 Grid | originally from (Bernstein, Hansen & Zilberstein, IJCAI 2005), this is the two observations per agent version of (Amato, Bernstein & Zilberstein, AAMAS Workshop on Multi-Agent Sequential Decision Making in Uncertain Domains (MSDM) 2006) | | + | | [[http://www.st.ewi.tudelft.nl/mtjspaan/decpomdp/GridSmall.dpomdp|GridSmall.dpomdp]] | Meeting in a 2x2 Grid | originally from (Bernstein, Hansen & Zilberstein, IJCAI 2005), this is the two observations per agent version of (Amato, Bernstein & Zilberstein, AAMAS Workshop on Multi-Agent Sequential Decision Making in Uncertain Domains (MSDM) 2006) | |
| - | | [[http://www.st.ewi.tudelft.nl/~mtjspaan/decpomdp/oneDoor_2_7_0.20_0.00_0_2.dpomdp|oneDoor_2_7_0.20_0.00_0_2.dpomdp]] | One Door | (Oliehoek, Spaan & Vlassis, AAMAS Workshop on Multi-Agent Sequential Decision Making in Uncertain Domains (MSDM) 2007). Other versions of this problem are available upon request. | | + | | [[http://www.st.ewi.tudelft.nl/mtjspaan/decpomdp/oneDoor_2_7_0.20_0.00_0_2.dpomdp|oneDoor_2_7_0.20_0.00_0_2.dpomdp]] | One Door | (Oliehoek, Spaan & Vlassis, AAMAS Workshop on Multi-Agent Sequential Decision Making in Uncertain Domains (MSDM) 2007). Other versions of this problem are available upon request. | |
| - | | [[http://www.st.ewi.tudelft.nl/~mtjspaan/decpomdp/boxPushingUAI07.dpomdp|boxPushingUAI07.dpomdp]] | Cooperative Box Pushing | (Seuken & Zilberstein, UAI 2007) | | + | | [[http://www.st.ewi.tudelft.nl/mtjspaan/decpomdp/boxPushingUAI07.dpomdp|boxPushingUAI07.dpomdp]] | Cooperative Box Pushing | (Seuken & Zilberstein, UAI 2007) | |
| - | | [[http://www.st.ewi.tudelft.nl/~mtjspaan/decpomdp/recycling.dpomdp|recycling.dpomdp]] | Recycling Robots | (Amato, Bernstein & Zilberstein, UAI 2007) | | + | | [[http://www.st.ewi.tudelft.nl/mtjspaan/decpomdp/recycling.dpomdp|recycling.dpomdp]] | Recycling Robots | (Amato, Bernstein & Zilberstein, UAI 2007) | |
| - | | [[http://www.st.ewi.tudelft.nl/~mtjspaan/decpomdp/fireFighting_2_3_3.dpomdp.gz|fireFighting_2_3_3.dpomdp.gz]] | Fire Fighting problem with 3 houses and 3 fire levels | (Oliehoek, Spaan & Vlassis, JAIR 2008) | | + | | [[http://www.st.ewi.tudelft.nl/mtjspaan/decpomdp/fireFighting_2_3_3.dpomdp.gz|fireFighting_2_3_3.dpomdp.gz]] | Fire Fighting problem with 3 houses and 3 fire levels | (Oliehoek, Spaan & Vlassis, JAIR 2008) | |
| - | | [[http://www.st.ewi.tudelft.nl/~mtjspaan/decpomdp/fireFighting_2_4_3.dpomdp.gz|fireFighting_2_4_3.dpomdp.gz]] | Fire Fighting problem with 4 houses and 3 fire levels | (Oliehoek, Spaan & Vlassis, JAIR 2008) | | + | | [[http://www.st.ewi.tudelft.nl/mtjspaan/decpomdp/fireFighting_2_4_3.dpomdp.gz|fireFighting_2_4_3.dpomdp.gz]] | Fire Fighting problem with 4 houses and 3 fire levels | (Oliehoek, Spaan & Vlassis, JAIR 2008) | |
| - | | [[http://www.st.ewi.tudelft.nl/~mtjspaan/decpomdp/Mars.dpomdp.gz|Mars.dpomdp.gz]] | Mars rover | (Amato & Zilberstein, AAMAS 2009) | | + | | [[http://www.st.ewi.tudelft.nl/mtjspaan/decpomdp/Mars.dpomdp.gz|Mars.dpomdp.gz]] | Mars rover | (Amato & Zilberstein, AAMAS 2009) | |
| - | | [[http://www.st.ewi.tudelft.nl/~mtjspaan/decpomdp/Grid3x3corners.dpomdp.gz|Grid3x3corners.dpomdp.gz]]| Meeting in a 3x3 grid | (Amato, Dibangoye & Zilberstein, ICAPS 2009) | | + | | [[http://www.st.ewi.tudelft.nl/mtjspaan/decpomdp/Grid3x3corners.dpomdp.gz|Grid3x3corners.dpomdp.gz]]| Meeting in a 3x3 grid | (Amato, Dibangoye & Zilberstein, ICAPS 2009) | |
| - | | [[http://www.st.ewi.tudelft.nl/~mtjspaan/decpomdp/alignment_2x4.dpomdp|alignment_2x4.dpomdp]], [[http://www.st.ewi.tudelft.nl/~mtjspaan/decpomdp/alignment_noisy.tar.gz| Three larger versions of this problem]] | [[http://orca.st.usm.edu/~banerjee/alignment/|Robot Alignment]] | (Kraemer and Banerjee, AAMAS 2013) | | + | | [[http://www.st.ewi.tudelft.nl/mtjspaan/decpomdp/alignment_2x4.dpomdp|alignment_2x4.dpomdp]], [[http://www.st.ewi.tudelft.nl/mtjspaan/decpomdp/alignment_noisy.tar.gz| Three larger versions of this problem]] | [[http://orca.st.usm.edu/~banerjee/alignment/|Robot Alignment]] | (Kraemer and Banerjee, AAMAS 2013) | |
| | [[http://rbr.cs.umass.edu/camato/decpomdp/down/wirelessDelay.dpomdp|wirelessDelay.dpomdp]] | Wireless networking problem | (Pajarinen and Peltonen, NIPS 2011) | | | [[http://rbr.cs.umass.edu/camato/decpomdp/down/wirelessDelay.dpomdp|wirelessDelay.dpomdp]] | Wireless networking problem | (Pajarinen and Peltonen, NIPS 2011) | | ||
| | [[http://rbr.cs.umass.edu/camato/decpomdp/down/wirelessWithOverhead.dpomdp|wirelessWithOverhead.dpomdp]], [[http://rbr.cs.umass.edu/camato/decpomdp/down/longFireFight.dpomdp|longFireFight.dpomdp]] | Other problems from PP EMCL 2013 | (Pajarinen and Peltonen, ECML 2013) | | | [[http://rbr.cs.umass.edu/camato/decpomdp/down/wirelessWithOverhead.dpomdp|wirelessWithOverhead.dpomdp]], [[http://rbr.cs.umass.edu/camato/decpomdp/down/longFireFight.dpomdp|longFireFight.dpomdp]] | Other problems from PP EMCL 2013 | (Pajarinen and Peltonen, ECML 2013) | | ||
| Line 22: | Line 22: | ||
| ===== Transition and observation independent Dec-POMDPs ===== | ===== Transition and observation independent Dec-POMDPs ===== | ||
| - | * [[http://www.st.ewi.tudelft.nl/~mtjspaan/decpomdp/hotel1.tar.gz|hotel1.tar.gz]], [[http://www.st.ewi.tudelft.nl/~mtjspaan/decpomdp/hotel2.tar.gz|hotel2.tar.gz]], the two Hotel problems introduced in (Spaan & Melo, AAMAS 2008). | + | * [[http://www.st.ewi.tudelft.nl/mtjspaan/decpomdp/hotel1.tar.gz|hotel1.tar.gz]], [[http://www.st.ewi.tudelft.nl/mtjspaan/decpomdp/hotel2.tar.gz|hotel2.tar.gz]], the two Hotel problems introduced in (Spaan & Melo, AAMAS 2008). |
| - | * [[http://www.st.ewi.tudelft.nl/~mtjspaan/decpomdp/ISR_2.tar.gz|ISR_2.tar.gz]], [[http://www.st.ewi.tudelft.nl/~mtjspaan/decpomdp/Pent_2.tar.gz|Pent_2.tar.gz]], [[http://www.st.ewi.tudelft.nl/~mtjspaan/decpomdp/MIT_2.tar.gz|MIT_2.tar.gz]], [[http://www.st.ewi.tudelft.nl/~mtjspaan/decpomdp/SUNY_2.tar.gz|SUNY_2.tar.gz]], [[http://www.st.ewi.tudelft.nl/~mtjspaan/decpomdp/CIT_2.tar.gz|CIT_2.tar.gz]], [[http://www.st.ewi.tudelft.nl/~mtjspaan/decpomdp/CMU_2.tar.gz|CMU_2.tar.gz]], the two-robot navigation problems introduced in (Spaan & Melo, AAMAS 2008), inspired by Tony Cassandra's single-agent navigation domains. | + | * [[http://www.st.ewi.tudelft.nl/mtjspaan/decpomdp/ISR_2.tar.gz|ISR_2.tar.gz]], [[http://www.st.ewi.tudelft.nl/mtjspaan/decpomdp/Pent_2.tar.gz|Pent_2.tar.gz]], [[http://www.st.ewi.tudelft.nl/mtjspaan/decpomdp/MIT_2.tar.gz|MIT_2.tar.gz]], [[http://www.st.ewi.tudelft.nl/mtjspaan/decpomdp/SUNY_2.tar.gz|SUNY_2.tar.gz]], [[http://www.st.ewi.tudelft.nl/mtjspaan/decpomdp/CIT_2.tar.gz|CIT_2.tar.gz]], [[http://www.st.ewi.tudelft.nl/mtjspaan/decpomdp/CMU_2.tar.gz|CMU_2.tar.gz]], the two-robot navigation problems introduced in (Spaan & Melo, AAMAS 2008), inspired by Tony Cassandra's single-agent navigation domains. |
