Multiagent Sequential Decision Making under Uncertainty http://masplan.org/ 2026-04-03T20:30:05+00:00 http://masplan.org/ http://masplan.org/_media/wiki:dokuwiki.svg text/html 2014-07-15T11:21:59+00:00 Anonymous (anonymous@undisclosed.example.com) http://masplan.org/easss2014?rev=1405423319&do=diff Sequential Decision Making for Cooperative Agents Event: EASSS-2014 in Crete Date: July 15, 2014 Tutors: João Messias and Stefan Witwicki Theoretical Session outline of material Slides from Part 1 Slides from Part 2 Slides from Part 3 Practical Session Practical Exercises - Part 1 Practical Exercises - Part 2 text/html 2013-12-06T22:05:10+00:00 Anonymous (anonymous@undisclosed.example.com) http://masplan.org/msdm2014?rev=1386367510&do=diff AAMAS Workshop on Multiagent Sequential Decision Making Under Uncertainty, MSDM 2014 May 5-6, 2014 in Paris, France <http://masplan.org/msdm2014> Overview In sequential decision making, an agent's objective is to choose actions based on observations of its environment that will maximize the expected performance over multiple steps. In worlds where actions are not deterministic or observations incomplete, Markov Decision Processes (MDPs) and Partially-Observable MDPs (POMDPs) serve as the bas… text/html 2015-04-07T04:02:44+00:00 Anonymous (anonymous@undisclosed.example.com) http://masplan.org/msdm2015?rev=1428379364&do=diff AAMAS Workshop on Multiagent Sequential Decision Making Under Uncertainty, MSDM 2015 May 5, 2015 in Istanbul, Turkey <http://masplan.org/msdm2015> Overview In sequential decision making, an agent's objective is to choose actions based on observations of its environment that will maximize the expected performance over multiple steps. In worlds where actions are not deterministic or observations incomplete, Markov Decision Processes (MDPs) and Partially-Observable MDPs (POMDPs) serve as the ba… text/html 2014-11-17T04:26:31+00:00 Anonymous (anonymous@undisclosed.example.com) http://masplan.org/optimal_values?rev=1416198391&do=diff Optimal values for Finite-Horizon Dec-POMDPs Here we provide the value of an optimal solution for some of above problems for several horizons, which can for instance be used to benchmark approximate solutions. The table also notes in which papers the problem had been first solved optimally for a given horizon. Note that values reported are for the undiscounted setting, i.e., the discount factor (often denoted by gamma) was set to 1.0, overriding sometimes the discount factor specified in the .d… text/html 2019-02-14T12:41:10+00:00 Anonymous (anonymous@undisclosed.example.com) http://masplan.org/problem_domains?rev=1550148070&do=diff Dec-POMDP problem domains On this page we are collecting a number of Dec-POMDP problem descriptions, to create a repository containing several standard problem domains that can be used for benchmarking. Contributions are welcome. The models are provided in the .dpomdp file format, which is an extension of text/html 2015-11-04T07:31:54+00:00 Anonymous (anonymous@undisclosed.example.com) http://masplan.org/sdmia_accepted_papers?rev=1446622314&do=diff SDMIA Symposium: List of Accepted Papers SDMIA Main Page Authors Title Erwin Walraven and Matthijs T. J. Spaan Planning under Uncertainty with Weighted State Scenarios Yusen Zhan and Matthew Taylor Online Transfer Learning in Reinforcement Learning Domains Christopher Amato, George Konidaris, Shayegan Omidshafiei, Ali-Akbar Agha-Mohammadi, Jonathan How and Leslie Kaelbling text/html 2015-09-18T15:13:52+00:00 Anonymous (anonymous@undisclosed.example.com) http://masplan.org/sdmia_cfp?rev=1442589232&do=diff SDMIA Fall Symposium: Call for Papers SDMIA Main Page Sequential decision making under uncertainty (SDM) is a powerful paradigm for probabilistic planning. The emergence of various models that analyze SDM under different sets of assumptions, e.g., as single- and multi-agent Markov Decision Processes (MDPs) and Partially Observable MDPs (POMDPs), has gone hand in hand with the split of this field into many subareas, each with a quite distinct research community. The Sequential Decision Making … text/html 2015-11-13T12:07:29+00:00 Anonymous (anonymous@undisclosed.example.com) http://masplan.org/sdmia_invited_speakers?rev=1447416449&do=diff SDMIA Fall Symposium: Invited Speakers SDMIA Main Page Craig Boutilier Google Title: Large-scale MDPs in Practice: Opportunities and Challenges Abstract: Markov decision processes (MDPs) have been very well-studied in AI over the past 20 years and offer great promise as a model for sophisticated decision making. However, the practical applications of MDPs and reinforcement learning (RL) text/html 2015-11-13T12:08:49+00:00 Anonymous (anonymous@undisclosed.example.com) http://masplan.org/sdmia_schedule?rev=1447416529&do=diff SDMIA Fall Symposium: Schedule SDMIA Main Page Thursday, November 12 Authors Title 09:00am 09:15am Welcome and introductions 09:15am 10:00amMilind Tambe, USC Assisting HIV Prevention Amongst Homeless Youth using POMDPs 10:00am 10:30am application discussion 10:30am 11:00am Coffee break text/html 2015-10-19T18:54:23+00:00 Anonymous (anonymous@undisclosed.example.com) http://masplan.org/sdmia?rev=1445280863&do=diff Sequential Decision Making for Intelligent Agents AAAI Fall Symposium November 12–14, 2015 Westin Arlington Gateway in Arlington, Virginia adjacent to Washington, DC <http://masplan.org/sdmia> * List of Accepted Papers * Schedule * Invited Speakers * Call for Papers * Overview of the symposium Sequential decision making under uncertainty has gained significant traction at major AI conferences such as AAAI, IJCAI, AAMAS (Best Paper award 2014 on this topic) and ICAPS. In m… text/html 2013-05-26T14:25:17+00:00 Anonymous (anonymous@undisclosed.example.com) http://masplan.org/sidebar?rev=1369578317&do=diff Home * Introduction * Problem domains * Optimal values * Tutorials * Workshops * Software * Links text/html 2014-05-11T21:27:58+00:00 Anonymous (anonymous@undisclosed.example.com) http://masplan.org/sidebarmsdm2014?rev=1399843678&do=diff Important Dates Paper submission deadline (EXTENDED) February 5, 2014 Author notification March 7, 2014 Camera-ready submission deadline March 14, 2014 Early registration March 25, 2014 Late registration April 25, 2014 Workshop dates text/html 2015-03-14T13:49:55+00:00 Anonymous (anonymous@undisclosed.example.com) http://masplan.org/sidebarmsdm2015?rev=1426340995&do=diff Important Dates Paper submission deadline (EXTENDED) February 18, 2015 Author notification March 14, 2015 Camera-ready submission deadline March 19, 2015 Early registration March 20, 2015 Late registration April 24, 2015 Workshop date text/html 2015-10-03T09:33:21+00:00 Anonymous (anonymous@undisclosed.example.com) http://masplan.org/software?rev=1443864801&do=diff Multiagent Decision Process Toolbox The Multiagent decision process (MADP) Toolbox is a free C++ software toolbox for scientific research in decision-theoretic planning and learning in multiagent systems (MASs), developed by Frans Oliehoek and Matthijs Spaan. The term MADP is used to refer to a collection of mathematical models for multiagent planning: multiagent Markov decision processes (MMDPs), decentralized MDPs (Dec-MDPs), decentralized partially observable MDPs (Dec-POMDPs), partially obs… text/html 2014-05-06T04:59:09+00:00 Anonymous (anonymous@undisclosed.example.com) http://masplan.org/start?rev=1399352349&do=diff MASPlan.org aims to provide a web presence for scientific research on multiagent sequential decision making under uncertainty (MSDM). * Introduction * Problem domains * Optimal values * Models and Methods * Tutorials * Workshops * Software * Links Contact For any comments or questions, or would like to contribute, please contact text/html 2014-03-19T21:45:44+00:00 Anonymous (anonymous@undisclosed.example.com) http://masplan.org/tabsmsdm2014?rev=1395265544&do=diff Call for Participation Invited Talk Panel Accepted Papers Program Schedule Attending MSDM 2014 Instructions to Authors Committees text/html 2015-01-07T18:10:12+00:00 Anonymous (anonymous@undisclosed.example.com) http://masplan.org/tabsmsdm2015?rev=1420654212&do=diff Call for Papers Invited Talk Panel Accepted Papers Program Schedule Attending MSDM 2015 Instructions to Authors Committees text/html 2014-07-15T10:53:38+00:00 Anonymous (anonymous@undisclosed.example.com) http://masplan.org/tutorials?rev=1405421618&do=diff Tutorials at conferences * AAMAS'13 Tutorial on Cooperative/Self-interesed Decision Making in Sequential Multiagent Settings * 2012 CTS Conference tutorial on Models of Coordination in Multiagent Decision Making * AAMAS'12 Tutorial on Decision Making in Multiagent Settings * AAMAS'11 Tutorial on Decision Making in Multiagent Settings * AAMAS'10 Tutorial on Decision Making in Multiagent Settings * IJCAI'09 Tutorial on Decision-Theoretic Planning for Multi-Agent Systems: New Direction… text/html 2015-01-07T18:07:05+00:00 Anonymous (anonymous@undisclosed.example.com) http://masplan.org/workshops?rev=1420654025&do=diff MSDM workshop series There has been a series of workshops on Multi-agent Sequential Decision Making in Uncertain Domains (MSDM) at the International Conference on Autonomous Agents and Multiagent Systems (AAMAS) since 2006. Below is an overview of all workshops sofar, but note that some webpages are dead.