Closed Projects

Journal Papers

[1] Matthijs Spaan, Tiago Veiga, Pedro Lima, Decision-theoretic Planning Under Uncertainty with Information Rewards for Active Cooperative Perception, Journal of Autonomous Agents and Multi-Agent Systems, Springer US, Print ISSN: 1387-2532, Online ISSN:1573-7454, December,, 2014
[2] Rajneesh Sharma, Matthijs Spaan, Bayesian Game Based Fuzzy Reinforcement Learning Control for Decentralized POMDPs, IEEE Transactions on Computational Intelligence and AI in Games, 4(4): 309328, 2012
[3] A. Sanfeliu, J. Andrade-Cetto, M. Barbosa, R. Bowden, J. Capitan, A. Corominas, A. Gilbert, J. Illingworth, L. Merino, J. M. Mirats, Plinio Moreno, A. Ollero, João Sequeira, Matthijs Spaan, Decentralized Sensor Fusion for Ubiquitous Networking Robotics in Urban Areas, Sensors, 10(3):22742314, 2010
[4] N. Vlassis, Optimal and Approximate Q-value Functions for Decentralized POMDPs, Journal of Artificial Intelligence Research, Vol. 32, pp. 289-353, 2008

Book Chapters

[5] Matthijs Spaan, Partially Observable Markov Decision Processes, In Marco Wiering and Martijn van Otterlo, editors, Reinforcement Learning: State of the Art, pp. 387414, Springer Verlag, 2012

Conference Papers

[6] Tiago Veiga, Matthijs Spaan, Pedro Lima, Improving Value Function Approximation in Factored POMDPs by Exploiting Model Structure (Extended Abstract), Proc. of AAMAS 2015 - 14th International Conference on Autonomous Agents and Multiagent Systems, Istanbul, Turkey, pp. 1827-1828, 2015
[7] Tiago Veiga, Matthijs Spaan, Pedro Lima, Point-based POMDP solving with factored value function approximation, Proc. of AAAI 2014 - 28th AAAI Conference on Artificial Intelligence, Quebec City, Quebec, Canada, 2014
[8] S. Witwicki, J. C. Montoya, João Messias, J. Reis, Jesús Capitán, Francisco Melo, Pedro Lima, Matthijs Spaan, A Testbed for Autonomous Robot Surveillance (Demonstration), Proc. of AAMAS 2014 - 13th International Conference on Autonomous Agents and Multiagent Systems, pp. 1635-1636, Paris, France, 2014 - PDF
[9] João Messias, Matthijs Spaan, Pedro Lima, Multiagent POMDPs with Asynchronous Execution, Proc. of AAMAS 2013 - 12th International Conference on Autonomous Agents and Multiagent Systems, Saint Paul Minnesota, USA, 2013 - PDF
[10] João Messias, Matthijs Spaan, Pedro Lima, GSMDPs for Multi-Robot Sequential Decision-Making, Proc. of AAAI 2013 - 27th Conference on Artificial Intelligence, Bellevue, Washington, USA , 2013
[11] J. Capitan, Matthijs Spaan, L. Merino, A. Ollero, Decentralized Multi-Robot Cooperation with Auctioned POMDPs, Proc. MSDM 2011 - Workshop on Multi-agent Sequential Decision Making in Uncertain Domains, part of AAMAS 2011 - 10th International Conference on Autonomous Agents and Multiagent Systems, Taipei, Taiwan, 2012
[12] Jesús Capitán, Matthijs Spaan, L. Merino, Role-based Cooperation for Environmental Monitoring with Multiple UAVs, IROS Workshop on Robotics for Environmental Monitoring, Vilamoura, Portugal, 2012 - PDF
[13] L. Merino, A. Ollero, Jesús Capitán, Matthijs Spaan, Decentralized Multi-Robot Cooperation with Auctioned POMDPs, Proc. of ICRA 2012 - IEEE International Conference on Robotics and Automation, St. Paul, USA, 2012
[14] F. Oliehoek, C. Amato, Matthijs Spaan, Scaling Up Optimal Heuristic Search in Dec-POMDPs via Incremental Expansion, Proc. of IJCAI 2011 - 22nd International Joint Conference on Artificial Intelligence, Barcelona, Spain, 2011
[15] Rajneesh Sharma, Matthijs Spaan, Fuzzy Reinforcement Learning Control for Decentralized Partially Observable Markov Decision Processes, Proc. of FUZZ-IEEE 2011- IEEE International Conference on Fuzzy Systems, Taipei, Taiwan, 2011
[16] Matthijs Spaan, F. Oliehoek, C. Amato, Scaling Up Optimal Heuristic Search in Dec-POMDPs via Incremental Expansion, Proc. MSDM 2011 - Workshop on Multi-agent Sequential Decision Making in Uncertain Domains, part of AAMAS 2011 - 10th International Conference on Autonomous Agents and Multiagent Systems, Taipei, Taiwan, 2011
[17] João Messias, Matthijs Spaan, Pedro Lima, Efficient Offline Communication Policies for Factored Multiagent POMDPs, Proc. of NIPS 2011 - 25th Annual Conference on Neural Information Processing Systems, Granada, Spain, 2011
[18] Matthijs Spaan, Tiago Veiga, Pedro Lima, Active Cooperative Perception in Networked Robot Systems Using POMDPs, Proc. of IROS 2010 - IEEE/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan, 2010
[19] Abdolkarim Pahliani, Matthijs Spaan, Pedro Lima, Fault-tolerant Probabilistic Sensor Fusion for Distributed Multi-Agent Systems, Proc. of IROS 2010 - IEEE/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan, 2010
[20] João Messias, Matthijs Spaan, Pedro Lima, Multi-robot planning under uncertainty with communication: a case study, AAMAS 2010 Workshop on Multi-Agent Sequential Decision Making in Uncertain Domains, Toronto, Canada, 2010 - PDF
[21] Matthijs Spaan, Nelson Gonçalves, João Sequeira, Multirobot Coordination by Auctioning POMDPs, Proc. of ICRA 2010 - IEEE International Conference on Robotics and Automation, Anchorage, Alaska, 2010
[22] Rajneesh Sharma, Matthijs Spaan, A Bayesian Game based Adaptive Fuzzy Controller for Multiagent POMDPs, Proc. of FUZZ IEEE 2010 - International Conference on Fuzzy Systems, Barcelona, Spain, 2010
[23] F. Oliehoek, Matthijs Spaan, J. S. Dibangoye, C. Amato, Heuristic Search for Identical Payoff Bayesian Games, Proc. of AAMAS 2010 - 9th International Conference on Autonomous Agents and Multiagent Systems, Toronto, Canada, 2010
[24] Alexandre Bernardino, Plinio Moreno, ISRobotNet: A Testbed for Sensor and Robot Network Systems, Proc. of IROS 2009 - The IEEE/RSJ International Conference on Intelligent Robots and Systems, St. Louis, MO, USA, 2009 - PDF
[25] Abdolkarim Pahliani, Decision-Theoretic Robot Guidance for Active Cooperative Perception, Proc. of IROS 2009 - The IEEE/RSJ International Conference on Intelligent Robots and Systems, St. Louis, MO, USA, 2009 - PDF
[26] Matthijs Spaan, A Decision-theoretic Approach to Dynamic Sensor Selection in Camera Networks, Proc. of ICAPS 2009 - 19th International Conference on Automated Planning and Scheduling, Thessaloniki, Greece, 2009 - PDF
[27] Matthijs Spaan, Multi-agent Sequential Decision Making in Uncertain Domains, Proc. of AAMAS 2009 Workshop on Multi-agent Sequential Decision-Making in Uncertain Domains, Budapest, Hungary, 2009 - PDF
[28] Matthijs Spaan, Lossless Clustering of Histories in Decentralized POMDPs, Proc. of AAMAS 2009 - 8th International Conference on Autonomous Agents and Multiagent Systems, Budapest, Hungary, 2009 - PDF
[29] Matthijs Spaan, Pedro Lima, Decision-theoretic Planning under Uncertainty for Cooperative Active Perception, Proc. of NIPS 2009 Workshop on Adaptive Sensing, Active Learning and Experimental Design, Vancouver, B. C., Canada, 2009
[30] Alberto Reyes, Matthijs Spaan, L. Enrique Sucar, An Intelligent Assistant for Power Plants based on Factored MDPs, Proc. of ISAP 2009 - 15th International Conference on Intelligent System Applications to Power Systems, Curitiba, Brazil, 2009
[31] N. Vlassis, Multiagent Planning under Uncertainty with Stochastic Communication Delays, Proc. of ICAPS 2008 - 18th International Conference on Automated Planning and Scheduling, Sydney, Australia, 2008
[32] Matthijs Spaan, Exploiting Locality of Interaction in Factored Dec-POMDPs, Proc. of AAMAS 2008 - the 7th International Conference on Autonomous Agents and Multiagent Systems, Estoril, Portugal, 2008
[33] Francisco Melo, Interaction-Driven Markov Games for Decentralized Multiagent Planning under Uncertainty, Proc. of AAMAS 2008 - the 7th International Conference on Autonomous Agents and Multiagent Systems, Estoril, Portugal, 2008 - PDF
[34] N. Vlassis, Dec-POMDPs with delayed communication, Proc. MSDM2007 - Workshop on Multi-agent Sequential Decision Making in Uncertain Domains, part of AAMAS 2007 - International Conference on Autonomous Agents and Multiagent Systems, Honolulu, Hawaii, 2007 - PDF

MSc Theses

[35] Matthijs Spaan, Cooperative Active Perception using POMDPs, Master Thesis, Instituto Superior Tecnico, Universidade Tecnica de Lisboa, 2010
[36] Ana Rita Mendes, Ana Mendes, Matthijs Spaan, Pedro Lima, Planning under Uncertainty for Search and Rescue, Master Thesis, Instituto Superior Tecnico, Universidade Tecnica de Lisboa, 2010
[1] Matthijs Spaan, Tiago Veiga, Pedro Lima, Decision-theoretic Planning Under Uncertainty with Information Rewards for Active Cooperative Perception, Journal of Autonomous Agents and Multi-Agent Systems, Springer US, Print ISSN: 1387-2532, Online ISSN:1573-7454, December,, 2014
[2] Rajneesh Sharma, Matthijs Spaan, Bayesian Game Based Fuzzy Reinforcement Learning Control for Decentralized POMDPs, IEEE Transactions on Computational Intelligence and AI in Games, 4(4): 309328, 2012
[3] A. Sanfeliu, J. Andrade-Cetto, M. Barbosa, R. Bowden, J. Capitan, A. Corominas, A. Gilbert, J. Illingworth, L. Merino, J. M. Mirats, Plinio Moreno, A. Ollero, João Sequeira, Matthijs Spaan, Decentralized Sensor Fusion for Ubiquitous Networking Robotics in Urban Areas, Sensors, 10(3):22742314, 2010
[4] N. Vlassis, Optimal and Approximate Q-value Functions for Decentralized POMDPs, Journal of Artificial Intelligence Research, Vol. 32, pp. 289-353, 2008
[1] Matthijs Spaan, Partially Observable Markov Decision Processes, In Marco Wiering and Martijn van Otterlo, editors, Reinforcement Learning: State of the Art, pp. 387414, Springer Verlag, 2012
[1] Tiago Veiga, Matthijs Spaan, Pedro Lima, Improving Value Function Approximation in Factored POMDPs by Exploiting Model Structure (Extended Abstract), Proc. of AAMAS 2015 - 14th International Conference on Autonomous Agents and Multiagent Systems, Istanbul, Turkey, pp. 1827-1828, 2015
[2] Tiago Veiga, Matthijs Spaan, Pedro Lima, Point-based POMDP solving with factored value function approximation, Proc. of AAAI 2014 - 28th AAAI Conference on Artificial Intelligence, Quebec City, Quebec, Canada, 2014
[3] S. Witwicki, J. C. Montoya, João Messias, J. Reis, Jesús Capitán, Francisco Melo, Pedro Lima, Matthijs Spaan, A Testbed for Autonomous Robot Surveillance (Demonstration), Proc. of AAMAS 2014 - 13th International Conference on Autonomous Agents and Multiagent Systems, pp. 1635-1636, Paris, France, 2014 - PDF
[4] João Messias, Matthijs Spaan, Pedro Lima, Multiagent POMDPs with Asynchronous Execution, Proc. of AAMAS 2013 - 12th International Conference on Autonomous Agents and Multiagent Systems, Saint Paul Minnesota, USA, 2013 - PDF
[5] João Messias, Matthijs Spaan, Pedro Lima, GSMDPs for Multi-Robot Sequential Decision-Making, Proc. of AAAI 2013 - 27th Conference on Artificial Intelligence, Bellevue, Washington, USA , 2013
[6] J. Capitan, Matthijs Spaan, L. Merino, A. Ollero, Decentralized Multi-Robot Cooperation with Auctioned POMDPs, Proc. MSDM 2011 - Workshop on Multi-agent Sequential Decision Making in Uncertain Domains, part of AAMAS 2011 - 10th International Conference on Autonomous Agents and Multiagent Systems, Taipei, Taiwan, 2012
[7] Jesús Capitán, Matthijs Spaan, L. Merino, Role-based Cooperation for Environmental Monitoring with Multiple UAVs, IROS Workshop on Robotics for Environmental Monitoring, Vilamoura, Portugal, 2012 - PDF
[8] L. Merino, A. Ollero, Jesús Capitán, Matthijs Spaan, Decentralized Multi-Robot Cooperation with Auctioned POMDPs, Proc. of ICRA 2012 - IEEE International Conference on Robotics and Automation, St. Paul, USA, 2012
[9] F. Oliehoek, C. Amato, Matthijs Spaan, Scaling Up Optimal Heuristic Search in Dec-POMDPs via Incremental Expansion, Proc. of IJCAI 2011 - 22nd International Joint Conference on Artificial Intelligence, Barcelona, Spain, 2011
[10] Rajneesh Sharma, Matthijs Spaan, Fuzzy Reinforcement Learning Control for Decentralized Partially Observable Markov Decision Processes, Proc. of FUZZ-IEEE 2011- IEEE International Conference on Fuzzy Systems, Taipei, Taiwan, 2011
[11] Matthijs Spaan, F. Oliehoek, C. Amato, Scaling Up Optimal Heuristic Search in Dec-POMDPs via Incremental Expansion, Proc. MSDM 2011 - Workshop on Multi-agent Sequential Decision Making in Uncertain Domains, part of AAMAS 2011 - 10th International Conference on Autonomous Agents and Multiagent Systems, Taipei, Taiwan, 2011
[12] João Messias, Matthijs Spaan, Pedro Lima, Efficient Offline Communication Policies for Factored Multiagent POMDPs, Proc. of NIPS 2011 - 25th Annual Conference on Neural Information Processing Systems, Granada, Spain, 2011
[13] Matthijs Spaan, Tiago Veiga, Pedro Lima, Active Cooperative Perception in Networked Robot Systems Using POMDPs, Proc. of IROS 2010 - IEEE/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan, 2010
[14] Abdolkarim Pahliani, Matthijs Spaan, Pedro Lima, Fault-tolerant Probabilistic Sensor Fusion for Distributed Multi-Agent Systems, Proc. of IROS 2010 - IEEE/RSJ International Conference on Intelligent Robots and Systems, Taipei, Taiwan, 2010
[15] João Messias, Matthijs Spaan, Pedro Lima, Multi-robot planning under uncertainty with communication: a case study, AAMAS 2010 Workshop on Multi-Agent Sequential Decision Making in Uncertain Domains, Toronto, Canada, 2010 - PDF
[16] Matthijs Spaan, Nelson Gonçalves, João Sequeira, Multirobot Coordination by Auctioning POMDPs, Proc. of ICRA 2010 - IEEE International Conference on Robotics and Automation, Anchorage, Alaska, 2010
[17] Rajneesh Sharma, Matthijs Spaan, A Bayesian Game based Adaptive Fuzzy Controller for Multiagent POMDPs, Proc. of FUZZ IEEE 2010 - International Conference on Fuzzy Systems, Barcelona, Spain, 2010
[18] F. Oliehoek, Matthijs Spaan, J. S. Dibangoye, C. Amato, Heuristic Search for Identical Payoff Bayesian Games, Proc. of AAMAS 2010 - 9th International Conference on Autonomous Agents and Multiagent Systems, Toronto, Canada, 2010
[19] Alexandre Bernardino, Plinio Moreno, ISRobotNet: A Testbed for Sensor and Robot Network Systems, Proc. of IROS 2009 - The IEEE/RSJ International Conference on Intelligent Robots and Systems, St. Louis, MO, USA, 2009 - PDF
[20] Abdolkarim Pahliani, Decision-Theoretic Robot Guidance for Active Cooperative Perception, Proc. of IROS 2009 - The IEEE/RSJ International Conference on Intelligent Robots and Systems, St. Louis, MO, USA, 2009 - PDF
[21] Matthijs Spaan, A Decision-theoretic Approach to Dynamic Sensor Selection in Camera Networks, Proc. of ICAPS 2009 - 19th International Conference on Automated Planning and Scheduling, Thessaloniki, Greece, 2009 - PDF
[22] Matthijs Spaan, Multi-agent Sequential Decision Making in Uncertain Domains, Proc. of AAMAS 2009 Workshop on Multi-agent Sequential Decision-Making in Uncertain Domains, Budapest, Hungary, 2009 - PDF
[23] Matthijs Spaan, Lossless Clustering of Histories in Decentralized POMDPs, Proc. of AAMAS 2009 - 8th International Conference on Autonomous Agents and Multiagent Systems, Budapest, Hungary, 2009 - PDF
[24] Matthijs Spaan, Pedro Lima, Decision-theoretic Planning under Uncertainty for Cooperative Active Perception, Proc. of NIPS 2009 Workshop on Adaptive Sensing, Active Learning and Experimental Design, Vancouver, B. C., Canada, 2009
[25] Alberto Reyes, Matthijs Spaan, L. Enrique Sucar, An Intelligent Assistant for Power Plants based on Factored MDPs, Proc. of ISAP 2009 - 15th International Conference on Intelligent System Applications to Power Systems, Curitiba, Brazil, 2009
[26] N. Vlassis, Multiagent Planning under Uncertainty with Stochastic Communication Delays, Proc. of ICAPS 2008 - 18th International Conference on Automated Planning and Scheduling, Sydney, Australia, 2008
[27] Matthijs Spaan, Exploiting Locality of Interaction in Factored Dec-POMDPs, Proc. of AAMAS 2008 - the 7th International Conference on Autonomous Agents and Multiagent Systems, Estoril, Portugal, 2008
[28] Francisco Melo, Interaction-Driven Markov Games for Decentralized Multiagent Planning under Uncertainty, Proc. of AAMAS 2008 - the 7th International Conference on Autonomous Agents and Multiagent Systems, Estoril, Portugal, 2008 - PDF
[29] N. Vlassis, Dec-POMDPs with delayed communication, Proc. MSDM2007 - Workshop on Multi-agent Sequential Decision Making in Uncertain Domains, part of AAMAS 2007 - International Conference on Autonomous Agents and Multiagent Systems, Honolulu, Hawaii, 2007 - PDF
[1] Matthijs Spaan, Cooperative Active Perception using POMDPs, Master Thesis, Instituto Superior Tecnico, Universidade Tecnica de Lisboa, 2010
[2] Ana Rita Mendes, Ana Mendes, Matthijs Spaan, Pedro Lima, Planning under Uncertainty for Search and Rescue, Master Thesis, Instituto Superior Tecnico, Universidade Tecnica de Lisboa, 2010

In the same group

Pedro Abreu
José Acevedo
Daniel Afonso
Meysam Basiri
Carlos Bispo
Miguel Borges
Oscar Lima
José Corujeira
Luís Custódio
Duarte Dias
Francisco Girbal Eiras
Pedro Fazenda
Tiago Ferreira
Nuno Fialho
Duarte Gameiro
João Garcia
José Iglésias
Guilherme Lawless
Pedro Lima
Luís Luz
André Mateus
João Mendes
Pedro Miraldo
Carlos Neves
João O'Neill
Carlos Pinto-Ferreira
Pedro Resende
Isabel Ribeiro
Rômulo Rodrigues
Pedro Roque
Pedro Santos
Jose
João Sequeira
Diogo Serra
Porfírio Silva
Tiago Dias
Tiago Sousa
Rodrigo Ventura