2018

Edward Newell, Jackie Chi Kit Cheung:
Constructing a Lexicon of Relational Nouns. LREC 2018 [Link]
Valentin Thomas, Emmanuel Bengio, William Fedus, Jules Pondard, Philippe Beaudoin, Hugo Larochelle, Joelle Pineau, Doina Precup, Yoshua Bengio:
Disentangling the independently controllable factors of variation by interacting with the world. CoRR abs/1802.09484 (2018) [Link]
Ryan Faulkner, Doina Precup:
Dyna Planning using a Feature Based Generative Model. CoRR abs/1805.10129 (2018) [Link]
Ali Emami, Adam Trischler, Kaheer Suleman, Jackie Chi Kit Cheung:
A Generalized Knowledge Hunting Framework for the Winograd Schema Challenge. NAACL-HLT (Student Research Workshop) 2018: 25-31 [Link]
Tianyu Li, Guillaume Rabusseau, Doina Precup:
Nonlinear Weighted Finite Automata. AISTATS 2018: 679-688 [Link]
Andrei Lupu, Doina Precup:
Imitation Upper Confidence Bound for Bandits on a Graph. AAAI 2018 [Link]
Joshua Romoff, Alexandre Piché, Peter Henderson, Vincent François-Lavet, Joelle Pineau:
Reward Estimation for Variance Reduction in Deep Reinforcement Learning. CoRR abs/1805.03359 (2018) [Link]
Yuri Grinberg, Hossein Aboutalebi, Melanie Lyman-Abramovitch, Borja Balle, Doina Precup:
Learning Predictive State Representations From Non-Uniform Sampling. AAAI 2018 [Link]
Mahmoud Ghorbel, Joelle Pineau, Richard Gourdeau, Shervin Javdani, Siddhartha Srinivasa:
A Decision-Theoretic Approach for the Collaborative Control of a Smart Wheelchair. I. J. Social Robotics 10(1): 131-145 (2018) [Link]
Pierre-Luc Bacon, Doina Precup:
Constructing Temporal Abstractions Autonomously in Reinforcement Learning. AI Magazine 39(1): 39-50 (2018) [Link]
Stanislaw Jastrzebski, Dzmitry Bahdanau, Seyedarian Hosseini, Michael Noukhovitch, Yoshua Bengio, Jackie Chi Kit Cheung:
Commonsense mining as knowledge base completion? A study on the impact of novelty. CoRR abs/1804.09259 (2018) [Link]
Anna Harutyunyan, Peter Vrancx, Pierre-Luc Bacon, Doina Precup, Ann Nowé:
Learning With Options That Terminate Off-Policy. AAAI 2018 [Link]
Radu Mardare, Prakash Panangaden, Gordon D. Plotkin:
Free complete Wasserstein algebras. CoRR abs/1802.07366 (2018) [Link]
Laura Kallmeyer, Behrang QasemiZadeh, Jackie Chi Kit Cheung:
Coarse Lexical Frame Acquisition at the Syntax-Semantics Interface Using a Latent-Variable PCFG Model. *SEM@NAACL-HLT 2018: 130-141 [Link]
Kian Kenyon-Dean, Jackie Chi Kit Cheung, Doina Precup:
Resolving Event Coreference with Supervised Representation Learning and Clustering-Oriented Regularization. *SEM@NAACL-HLT 2018: 1-10 [Link]
Jessie Huang, Fa Wu, Doina Precup, Yang Cai:
Learning Safe Policies with Expert Guidance. CoRR abs/1805.08313 (2018) [Link]
Nicolas Gagné, Prakash Panangaden:
A Categorical Characterization of Relative Entropy on Standard Borel Spaces. Electr. Notes Theor. Comput. Sci. 336: 135-153 (2018) [Link]
Amy Zhang, Harsh Satija, Joelle Pineau:
Decoupling Dynamics and Reward for Transfer Learning. CoRR abs/1804.10689 (2018) [Link]
Peter Henderson, Wei-Di Chang, Pierre-Luc Bacon, David Meger, Joelle Pineau, Doina Precup:
OptionGAN: Learning Joint Reward-Policy Options Using Generative Adversarial Inverse Reinforcement Learning. AAAI 2018 [Link]
Radu Mardare, Prakash Panangaden, Gordon D. Plotkin:
On the Axiomatizability of Quantitative Algebras. CoRR abs/1804.01682 (2018) [Link]
Kian Kenyon-Dean, Jackie Chi Kit Cheung, Doina Precup:
Resolving Event Coreference with Supervised Representation Learning and Clustering-Oriented Regularization. CoRR abs/1805.10985 (2018) [Link]
Ebrahim Bagheri, Jackie Chi Kit Cheung:
Advances in Artificial Intelligence - 31st Canadian Conference on Artificial Intelligence, Canadian AI 2018, Toronto, ON, Canada, May 8-11, 2018, Proceedings. Lecture Notes in Computer Science 10832, Springer 2018, ISBN 978-3-319-89655-7 [contents] [Link]
Jean Harb, Pierre-Luc Bacon, Martin Klissarov, Doina Precup:
When Waiting Is Not an Option: Learning Options With a Deliberation Cost. AAAI 2018 [Link]

2017

Jesús Alejandro Cárdenes Cabré, Doina Precup, Ricardo Sanz:
Horizontal and Vertical Self-Adaptive Cloud Controller with Reward Optimization for Resource Allocation. ICCAC 2017: 184-185 [Link]
Pierre-Luc Bacon, Jean Harb, Doina Precup:
The Option-Critic Architecture. AAAI 2017: 1726-1734 [Link]
Borja Balle, Pascale Gourdeau, Prakash Panangaden:
Bisimulation Metrics for Weighted Automata. ICALP 2017: 103:1-103:14 [Link]
Charles C. Onu, Lara J. Kanbar, Wissam Shalish, Karen A. Brown, Guilherme M. Sant'Anna, Robert E. Kearney, Doina Precup:
A semi-Markov chain approach to modeling respiratory patterns prior to extubation in preterm infants. EMBC 2017: 2022-2026 [Link]
Ryan Lowe, Michael Noseworthy, Iulian Vlad Serban, Nicolas Angelard-Gontier, Yoshua Bengio, Joelle Pineau:
Towards an Automatic Turing Test: Learning to Evaluate Dialogue Responses. CoRR abs/1708.07149 (2017) [Link]
Prakash Panangaden:
The 2017 Alonzo Church award. SIGLOG News 4(3): 3-9 (2017) [Link]
Borja Balle, Prakash Panangaden, Doina Precup:
Singular value automata and approximate minimization. CoRR abs/1711.05994 (2017) [Link]
Peter Henderson, Wei-Di Chang, Pierre-Luc Bacon, David Meger, Joelle Pineau, Doina Precup:
OptionGAN: Learning Joint Reward-Policy Options using Generative Adversarial Inverse Reinforcement Learning. CoRR abs/1709.06683 (2017) [Link]
Iulian Vlad Serban, Alessandro Sordoni, Ryan Lowe, Laurent Charlin, Joelle Pineau, Aaron C. Courville, Yoshua Bengio:
A Hierarchical Latent Variable Encoder-Decoder Model for Generating Dialogues. AAAI 2017: 3295-3301 [Link]
Martin Klissarov, Pierre-Luc Bacon, Jean Harb, Doina Precup:
Learnings Options End-to-End for Continuous Action Tasks. CoRR abs/1712.00004 (2017) [Link]
Ryan Thomas Lowe, Nissan Pow, Iulian Vlad Serban, Laurent Charlin, Chia-Wei Liu, Joelle Pineau:
Training End-to-End Dialogue Systems with the Ubuntu Dialogue Corpus. D&D 8(1): 31-65 (2017) [Link]
Jean Harb, Pierre-Luc Bacon, Martin Klissarov, Doina Precup:
When Waiting is not an Option : Learning Options with a Deliberation Cost. CoRR abs/1709.04571 (2017) [Link]
Robert Furber, Dexter Kozen, Kim G. Larsen, Radu Mardare, Prakash Panangaden:
Unrestricted stone duality for Markov processes. LICS 2017: 1-9 [Link]
Nathanaël Fijalkow, Bartek Klin, Prakash Panangaden:
Expressiveness of Probabilistic Modal Logics, Revisited. ICALP 2017: 105:1-105:12 [Link]
Louis Chartrand, Jackie Chi Kit Cheung, Mohamed Bouguessa:
Detecting Large Concept Extensions for Conceptual Analysis. CoRR abs/1706.05723 (2017) [Link]
Jean Harb, Doina Precup:
Investigating Recurrence and Eligibility Traces in Deep Q-Networks. CoRR abs/1704.05495 (2017) [Link]
Tianyu Li, Guillaume Rabusseau, Doina Precup:
Neural Network Based Nonlinear Weighted Finite Automata. CoRR abs/1709.04380 (2017) [Link]
Audrey Durand, Odalric-Ambrym Maillard, Joelle Pineau:
Streaming kernel regression with provably adaptive mean, variance, and regularization. CoRR abs/1708.00768 (2017) [Link]
Teng Long, Emmanuel Bengio, Ryan Lowe, Jackie Chi Kit Cheung, Doina Precup:
World Knowledge for Reading Comprehension: Rare Entity Prediction with Hierarchical LSTMs Using External Descriptions. EMNLP 2017: 825-834 [Link]
Andrew Doyle, Doina Precup, Douglas L. Arnold, Tal Arbel:
Predicting Future Disease Activity and Treatment Responders for Multiple Sclerosis Patients Using a Bag-of-Lesions Brain Representation. MICCAI (3) 2017: 186-194 [Link]
Prakash Panangaden:
2017 LICS test-of-time award. SIGLOG News 4(3): 10 (2017) [Link]
Guillaume Rabusseau, Borja Balle, Joelle Pineau:
Multitask Spectral Learning of Weighted Automata. NIPS 2017: 2585-2594 [Link]
Ahmed Touati, Pierre-Luc Bacon, Doina Precup, Pascal Vincent:
Convergent Tree-Backup and Retrace with Function Approximation. CoRR abs/1705.09322 (2017) [Link]
Riashat Islam, Peter Henderson, Maziar Gomrokchi, Doina Precup:
Reproducibility of Benchmarked Deep Reinforcement Learning Tasks for Continuous Control. CoRR abs/1708.04133 (2017) [Link]
Peeyush Kumar, Doina Precup:
Multi-Timescale, Gradient Descent, Temporal Difference Learning with Linear Options. CoRR abs/1703.06471 (2017) [Link]
Lara J. Kanbar, Wissam Shalish, Doina Precup, Karen Brown, Guilherme M. Sant'Anna, Robert E. Kearney:
APEX_SCOPE: A graphical user interface for visualization of multi-modal data in inter-disciplinary studies. EMBC 2017: 2602-2605 [Link]
Prakash Panangaden:
Editorial comments on the short note by Barry Jay. J. Log. Algebr. Meth. Program. 87: 4 (2017) [Link]
Anna Harutyunyan, Peter Vrancx, Pierre-Luc Bacon, Doina Precup, Ann Nowé:
Learning with Options that Terminate Off-Policy. CoRR abs/1711.03817 (2017) [Link]
Iulian Vlad Serban, Alexander G. Ororbia II, Joelle Pineau, Aaron C. Courville:
Piecewise Latent Variables for Neural Variational Text Processing. EMNLP 2017: 422-432 [Link]
Philip Bachman, Doina Precup:
Variational Generative Stochastic Networks with Collaborative Shaping. CoRR abs/1708.00805 (2017) [Link]
Sharmin Nilufar, D. S. Wang, J. Girgis, C. G. Palii, D. Yang, A. Blais, M. Brand, Doina Precup, Theodore J. Perkins:
Learning-based interactive segmentation using the maximum mean cycle weight formalism. Medical Imaging: Image Processing 2017: 101332S [Link]
Charles C. Onu, Lara J. Kanbar, Wissam Shalish, Karen A. Brown, Guilherme M. Sant'Anna, Robert E. Kearney, Doina Precup:
Predicting extubation readiness in extreme preterm infants based on patterns of breathing. SSCI 2017: 1-7 [Link]
Timothy Arthur Mann, Shie Mannor, Doina Precup:
Approximate Value Iteration with Temporally Extended Actions (Extended Abstract). IJCAI 2017: 5035-5039 [Link]
Negar Ghourchian, Michel Allegue-Martínez, Doina Precup:
Real-Time Indoor Localization in Smart Homes Using Semi-Supervised Learning. AAAI 2017: 4670-4677 [Link]
Xingwei Cao, Guillaume Rabusseau, Joelle Pineau:
Tensor Regression Networks with various Low-Rank Tensor Approximations. CoRR abs/1712.09520 (2017) [Link]
Lu Wang, Jackie Chi Kit Cheung, Giuseppe Carenini, Fei Liu:
Proceedings of the Workshop on New Frontiers in Summarization, NFiS@EMNLP 2017, Copenhagen, Denmark, September 7, 2017. Association for Computational Linguistics 2017, ISBN 978-1-945626-89-0 [contents] [Link]
Nicolas Gagné, Prakash Panangaden:
A categorical characterization of relative entropy on Polish spaces. CoRR abs/1703.08853 (2017) [Link]
Borja Balle, Pascale Gourdeau, Prakash Panangaden:
Bisimulation Metrics for Weighted Automata. CoRR abs/1702.08017 (2017) [Link]
Radu Mardare, Prakash Panangaden, Gordon D. Plotkin:
On the axiomatizability of quantitative algebras. LICS 2017: 1-12 [Link]
Louis Chartrand, Jackie Chi Kit Cheung, Mohamed Bouguessa:
Detecting Large Concept Extensions for Conceptual Analysis. MLDM 2017: 78-90 [Link]
Ryan Lowe, Michael Noseworthy, Iulian Vlad Serban, Nicolas Angelard-Gontier, Yoshua Bengio, Joelle Pineau:
Towards an Automatic Turing Test: Learning to Evaluate Dialogue Responses. ACL (1) 2017: 1116-1126 [Link]
Prakash Panangaden:
2017 Kleene award. SIGLOG News 4(3): 10 (2017) [Link]
Matthew Smith, Laurent Charlin, Joelle Pineau:
A Sparse Probabilistic Model of User Preference Data. Canadian Conference on AI 2017: 316-328 [Link]
Hoai Phuoc Truong, Prasanna Parthasarathi, Joelle Pineau:
MACA: A Modular Architecture for Conversational Agents. SIGDIAL Conference 2017: 93-102 [Link]
Di Wu, Boyu Wang, Doina Precup, Benoit Boulet:
Boosting Based Multiple Kernel Learning and Transfer Regression for Electricity Load Forecasting. ECML/PKDD (3) 2017: 39-51 [Link]
Michael Noseworthy, Jackie Chi Kit Cheung, Joelle Pineau:
Predicting Success in Goal-Driven Human-Human Dialogues. SIGDIAL Conference 2017: 253-262 [Link]
Doina Precup, Yee Whye Teh:
Proceedings of the 34th International Conference on Machine Learning, ICML 2017, Sydney, NSW, Australia, 6-11 August 2017. Proceedings of Machine Learning Research 70, PMLR 2017 [contents] [Link]
Iulian Vlad Serban, Alexander Ororbia, Joelle Pineau, Aaron C. Courville:
Piecewise Latent Variables for Neural Variational Text Processing. SPNLP@EMNLP 2017: 52-62 [Link]

2016

Mohammad Ghavamzadeh, Shie Mannor, Joelle Pineau, Aviv Tamar:
Bayesian Reinforcement Learning: A Survey. CoRR abs/1609.04436 (2016) [Link]
Borja Balle, Maziar Gomrokchi, Doina Precup:
Differentially Private Policy Evaluation. ICML 2016: 2130-2138 [Link]
Teng Long, Ryan Lowe, Jackie Chi Kit Cheung, Doina Precup:
Leveraging Lexical Resources for Learning Entity Embeddings in Multi-Relational Data. ACL (2) 2016 [Link]
André da Motta Salles Barreto, Rafael L. Beirigo, Joelle Pineau, Doina Precup:
Incremental Stochastic Factorization for Online Reinforcement Learning. AAAI 2016: 1468-1475 [Link]
Radu Mardare, Prakash Panangaden, Gordon D. Plotkin:
Quantitative Algebraic Reasoning. LICS 2016: 700-709 [Link]
Meng Xuan Xia, Jackie Chi Kit Cheung:
Accurate Pinyin-English Codeswitched Language Identification. CodeSwitch@EMNLP 2016: 71-79 [Link]
Pierre Thodoroff, Joelle Pineau, Andrew Lim:
Learning Robust Features using Deep Learning for Automatic Seizure Detection. MLHC 2016: 178-190 [Link]
Victor Chenal, Jackie Chi Kit Cheung:
Predicting sentential semantic compatibility for aggregation in text-to-text generation. COLING 2016: 1061-1070 [Link]
Chenghui Zhou, Borja Balle, Joelle Pineau:
Learning time series models for pedestrian motion prediction. ICRA 2016: 3323-3330 [Link]
Jad Kabbara, Yulan Feng, Jackie Chi Kit Cheung:
Capturing Pragmatic Knowledge in Article Usage Prediction using LSTMs. COLING 2016: 2625-2634 [Link]
Ryan Lowe, Iulian Vlad Serban, Michael Noseworthy, Laurent Charlin, Joelle Pineau:
On the Evaluation of Dialogue Systems with Next Utterance Classification. SIGDIAL Conference 2016: 264-269 [Link]
Boyu Wang, Joelle Pineau:
Online Bagging and Boosting for Imbalanced Data Streams. IEEE Trans. Knowl. Data Eng. 28(12): 3353-3366 (2016) [Link]
Iulian Vlad Serban, Ryan Lowe, Laurent Charlin, Joelle Pineau:
Generative Deep Neural Networks for Dialogue: A Short Review. CoRR abs/1611.06216 (2016) [Link]
Kian Kenyon-Dean, Jackie Chi Kit Cheung, Doina Precup:
Verb Phrase Ellipsis Resolution Using Discriminative and Margin-Infused Algorithms. EMNLP 2016: 1734-1743 [Link]
Ryan Lowe, Iulian Vlad Serban, Michael Noseworthy, Laurent Charlin, Joelle Pineau:
On the Evaluation of Dialogue Systems with Next Utterance Classification. CoRR abs/1605.05414 (2016) [Link]
Tal Arbel, Manuel Jorge Cardoso, William M. Wells III, Albert C. S. Chung, Doina Precup:
Editorial on Special Issue on Probabilistic Models for Biomedical Image Analysis. Computer Vision and Image Understanding 151: 1-2 (2016) [Link]
Ichiro Hasuo, Prakash Panangaden:
Special Issue on Quantum Physics and Logic. New Generation Comput. 34(1-2): 1-2 (2016) [Link]
Beomjoon Kim, Joelle Pineau:
Socially Adaptive Path Planning in Human Environments Using Inverse Reinforcement Learning. I. J. Social Robotics 8(1): 51-66 (2016) [Link]
Borja Balle, Maziar Gomrokchi, Doina Precup:
Differentially Private Policy Evaluation. CoRR abs/1603.02010 (2016) [Link]
Lara J. Kanbar, Wissam Shalish, Doina Precup, Karen A. Brown, Guilherme M. Sant'Anna, Robert E. Kearney:
Automated ongoing data validation and quality control of multi-institutional studies. EMBC 2016: 2504-2507 [Link]
Teng Long, Ryan Lowe, Jackie Chi Kit Cheung, Doina Precup:
Leveraging Lexical Resources for Learning Entity Embeddings in Multi-Relational Data. CoRR abs/1605.05416 (2016) [Link]
Boyu Wang, Joelle Pineau:
Generalized Dictionary for Multitask Learning with Boosting. IJCAI 2016: 2097-2103 [Link]
Chia-Wei Liu, Ryan Lowe, Iulian Serban, Michael Noseworthy, Laurent Charlin, Joelle Pineau:
How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generation. EMNLP 2016: 2122-2132 [Link]
Pierre Thodoroff, Joelle Pineau, Andrew Lim:
Learning Robust Features using Deep Learning for Automatic Seizure Detection. CoRR abs/1608.00220 (2016) [Link]
Pierre-Luc Bacon, Doina Precup:
A Matrix Splitting Perspective on Planning with Options. CoRR abs/1612.00916 (2016) [Link]
Pierre-Luc Bacon, Jean Harb, Doina Precup:
The Option-Critic Architecture. CoRR abs/1609.05140 (2016) [Link]
Boyu Wang, Joelle Pineau, Borja Balle:
Multitask Generalized Eigenvalue Program. AAAI 2016: 2115-2121 [Link]
Meltem Demirkus, Doina Precup, James J. Clark, Tal Arbel:
Hierarchical Spatio-Temporal Probabilistic Graphical Model with Multiple Feature Fusion for Binary Facial Attribute Classification in Real-World Face Videos. IEEE Trans. Pattern Anal. Mach. Intell. 38(6): 1185-1203 (2016) [Link]
Iulian Vlad Serban, Alessandro Sordoni, Yoshua Bengio, Aaron C. Courville, Joelle Pineau:
Building End-To-End Dialogue Systems Using Generative Hierarchical Neural Network Models. AAAI 2016: 3776-3784 [Link]
Chia-Wei Liu, Ryan Lowe, Iulian Vlad Serban, Michael Noseworthy, Laurent Charlin, Joelle Pineau:
How NOT To Evaluate Your Dialogue System: An Empirical Study of Unsupervised Evaluation Metrics for Dialogue Response Generation. CoRR abs/1603.08023 (2016) [Link]
Faizy Ahsan, Doina Precup, Mathieu Blanchette:
Prediction of Cell Type Specific Transcription Factor Binding Site Occupancy. BCB 2016: 497-498 [Link]
André da Motta Salles Barreto, Doina Precup, Joelle Pineau:
Practical Kernel-Based Reinforcement Learning. Journal of Machine Learning Research 17: 67:1-67:70 (2016) [Link]
Iulian Vlad Serban, Alessandro Sordoni, Ryan Lowe, Laurent Charlin, Joelle Pineau, Aaron C. Courville, Yoshua Bengio:
A Hierarchical Latent Variable Encoder-Decoder Model for Generating Dialogues. CoRR abs/1605.06069 (2016) [Link]
Lucas Langer, Borja Balle, Doina Precup:
Learning Multi-Step Predictive State Representations. IJCAI 2016: 1662-1668 [Link]

2015

Nastaran Jafarpour, Masoumeh T. Izadi, Doina Precup, David L. Buckeridge:
Quantifying the determinants of outbreak detection performance through simulation and machine learning. Journal of Biomedical Informatics 53: 180-187 (2015) [Link]
André da Motta Salles Barreto, Rafael L. Beirigo, Joelle Pineau, Doina Precup:
An Expectation-Maximization Algorithm to Compute a Stochastic Factorization From Data. IJCAI 2015: 3329-3336 [Link]
Pascale Gourdeau, Lara J. Kanbar, Wissam Shalish, Guilherme M. Sant'Anna, Robert E. Kearney, Doina Precup:
Feature selection and oversampling in analysis of clinical data for extubation readiness in extreme preterm infants. EMBC 2015: 4427-4430 [Link]
Prakash Panangaden:
Probabilistic bisimulation. SIGLOG News 2(3): 72-84 (2015) [Link]
Emmanuel Bengio, Pierre-Luc Bacon, Joelle Pineau, Doina Precup:
Conditional Computation in Neural Networks for faster models. CoRR abs/1511.06297 (2015) [Link]
Ryan Lowe, Nissan Pow, Iulian Serban, Joelle Pineau:
The Ubuntu Dialogue Corpus: A Large Dataset for Research in Unstructured Multi-Turn Dialogue Systems. CoRR abs/1506.08909 (2015) [Link]
Iulian Vlad Serban, Alessandro Sordoni, Yoshua Bengio, Aaron C. Courville, Joelle Pineau:
Hierarchical Neural Network Generative Models for Movie Dialogues. CoRR abs/1507.04808 (2015) [Link]
Costin Badescu, Prakash Panangaden:
Quantum Alternation: Prospects and Problems. QPL 2015: 33-42 [Link]
Priya Sidhaye, Jackie Chi Kit Cheung:
Indicative Tweet Generation: An Extractive Summarization Problem? EMNLP 2015: 138-147 [Link]
Iulian Vlad Serban, Ryan Lowe, Peter Henderson, Laurent Charlin, Joelle Pineau:
A Survey of Available Corpora for Building Data-Driven Dialogue Systems. CoRR abs/1512.05742 (2015) [Link]
Nagesh K. Subbanna, Doina Precup, Douglas L. Arnold, Tal Arbel:
IMaGe: Iterative Multilevel Probabilistic Graphical Model for Detection and Segmentation of Multiple Sclerosis Lesions in Brain MRI. IPMI 2015: 514-526 [Link]
Meltem Demirkus, Doina Precup, James J. Clark, Tal Arbel:
Hierarchical temporal graphical model for head pose estimation and subsequent attribute classification in real-world videos. Computer Vision and Image Understanding 136: 128-145 (2015) [Link]
Philip Bachman, David Krueger, Doina Precup:
Testing Visual Attention in Dynamic Environments. CoRR abs/1510.08949 (2015) [Link]
Lara J. Kanbar, Wissam Shalish, Carlos A. Robles-Rubio, Doina Precup, Karen A. Brown, Guilherme M. Sant'Anna, Robert E. Kearney:
Organizational principles of cloud storage to support collaborative biomedical research. EMBC 2015: 1231-1234 [Link]
Hang Ma, Joelle Pineau:
Information Gathering and Reward Exploitation of Subgoals for POMDPs. AAAI 2015: 3320-3326 [Link]
Ryan Lowe, Nissan Pow, Iulian Serban, Joelle Pineau:
The Ubuntu Dialogue Corpus: A Large Dataset for Research in Unstructured Multi-Turn Dialogue Systems. SIGDIAL Conference 2015: 285-294 [Link]
Mohamed Yousri Mahmoud, Prakash Panangaden, Sofiène Tahar:
On the Formal Verification of Optical Quantum Gates in HOL. FMICS 2015: 198-211 [Link]
Philip Bachman, Doina Precup:
Data Generation as Sequential Decision Making. CoRR abs/1506.03504 (2015) [Link]
Pierre-Luc Bacon, Borja Balle, Doina Precup:
Learning and Planning with Timing Information in Markov Decision Processes. UAI 2015: 111-120 [Link]
Joelle Pineau:
Improving the Design and Discovery of Dynamic Treatment Strategies Using Recent Results in Sequential Decision-Making. ICAPS 2015: 373- [Link]
Timothy Arthur Mann, Shie Mannor, Doina Precup:
Approximate Value Iteration with Temporally Extended Actions. J. Artif. Intell. Res. 53: 375-438 (2015) [Link]
Philip Bachman, Doina Precup:
Data Generation as Sequential Decision Making. NIPS 2015: 3249-3257 [Link]
HiuKim Yuen, Joelle Pineau, Philippe Archambault:
Automatically characterizing driving activities onboard smart wheelchairs from accelerometer data. IROS 2015: 5011-5018 [Link]
Joelle Pineau, Pierre-Luc Bacon:
Analyzing Open Data from the City of Montreal. MUD@ICML 2015: 11-16 [Link]
Angus Leigh, Joelle Pineau, Nicolas A. Olmedo, Hong Zhang:
Person tracking and following with 2D laser scanners. ICRA 2015: 726-733 [Link]
Sherry Shanshan Ruan, Gheorghe Comanici, Prakash Panangaden, Doina Precup:
Representation Discovery for MDPs Using Bisimulation Metrics. AAAI 2015: 4202-4203 [Link]
Borja Balle, Prakash Panangaden, Doina Precup:
A Canonical Form for Weighted Automata and Applications to Approximate Minimization. LICS 2015: 701-712 [Link]
Boyu Wang, Joelle Pineau:
Online Boosting Algorithms for Anytime Transfer and Multitask Learning. AAAI 2015: 3038-3044 [Link]
Gheorghe Comanici, Doina Precup, Prakash Panangaden:
Basis refinement strategies for linear value function approximation in MDPs. NIPS 2015: 2899-2907 [Link]
Sherry Shanshan Ruan, Gheorghe Comanici, Prakash Panangaden, Doina Precup:
Representation Discovery for MDPs Using Bisimulation Metrics. AAAI 2015: 3578-3584 [Link]
Borja Balle, Prakash Panangaden, Doina Precup:
A Canonical Form for Weighted Automata and Applications to Approximate Minimization. CoRR abs/1501.06841 (2015) [Link]
Philip Bachman, Doina Precup:
Variational Generative Stochastic Networks with Collaborative Shaping. ICML 2015: 1964-1972 [Link]
Lara J. Kanbar, Wissam Shalish, Carlos A. Robles-Rubio, Doina Precup, Karen A. Brown, Guilherme M. Sant'Anna, Robert E. Kearney:
Correlation of clinical parameters with cardiorespiratory behavior in successfully extubated extremely preterm infants. EMBC 2015: 4431-4434 [Link]
Lucas Lehnert, Doina Precup:
Policy Gradient Methods for Off-policy Control. CoRR abs/1512.04105 (2015) [Link]

2014

William L. Hamilton, Mahdi Milani Fard, Joelle Pineau:
Efficient learning and planning with compressed predictive states. Journal of Machine Learning Research 15(1): 3395-3439 (2014) [Link]
Dexter Kozen, Radu Mardare, Prakash Panangaden:
A Metrized Duality Theorem for Markov Processes. Electr. Notes Theor. Comput. Sci. 308: 211-227 (2014) [Link]
Richard S. Sutton, Ashique Rupam Mahmood, Doina Precup, Hado van Hasselt:
A new Q(lambda) with interim forward view and Monte Carlo equivalence. ICML 2014: 568-576 [Link]
Yuri Grinberg, Doina Precup, Michel Gendreau:
Optimizing Energy Production Using Policy Search and Predictive State Representations. NIPS 2014: 2969-2977 [Link]
Bob Coecke, Ichiro Hasuo, Prakash Panangaden:
Proceedings of the 11th workshop on Quantum Physics and Logic, QPL 2014, Kyoto, Japan, 4-6th June 2014. EPTCS 172, 2014 [contents] [Link]
Ouais Alsharif, Philip Bachman, Joelle Pineau:
Lifelong Learning of Discriminative Representations. CoRR abs/1404.4108 (2014) [Link]
Mahdi Milani Fard, Joelle Pineau:
Non-Deterministic Policies in Markovian Decision Processes. CoRR abs/1401.3871 (2014) [Link]
Meltem Demirkus, Doina Precup, James J. Clark, Tal Arbel:
Multi-layer temporal graphical model for head pose estimation in real-world videos. ICIP 2014: 3392-3396 [Link]
Philip Bachman, Amir-massoud Farahmand, Doina Precup:
Sample-based approximate regularization. ICML 2014: 1926-1934 [Link]
Norm Ferns, Doina Precup, Sophia Knight:
Bisimulation for Markov Decision Processes through Families of Functional Expressions. Horizons of the Mind 2014: 319-342 [Link]
Sara M. McCarthy, Doina Precup:
Theoretical results on the effect of 'shortcut' actions in MDPs. Connect. Sci. 26(2): 179-193 (2014) [Link]
Amir-massoud Farahmand, Doina Precup, André da Motta Salles Barreto, Mohammad Ghavamzadeh:
Classification-based Approximate Policy Iteration: Experiments and Extended Discussions. CoRR abs/1407.0449 (2014) [Link]
Philip Bachman, Ouais Alsharif, Doina Precup:
Learning with Pseudo-Ensembles. CoRR abs/1412.4864 (2014) [Link]
Nagesh K. Subbanna, Doina Precup, Tal Arbel:
Iterative Multilevel MRF Leveraging Context and Voxel Information for Brain Tumour Segmentation in MRI. CVPR 2014: 400-405 [Link]
André da Motta Salles Barreto, Joelle Pineau, Doina Precup:
Policy Iteration Based on Stochastic Factorization. J. Artif. Intell. Res. 50: 763-803 (2014) [Link]
Ross Duncan, Prakash Panangaden:
Proceedings 9th Workshop on Quantum Physics and Logic, QPL 2012, Brussels, Belgium, 10-12 October 2012. EPTCS 158, 2014 [contents] [Link]
Negar Ghourchian, Doina Precup:
Analyzing User Trajectories from Mobile Device Data with Hierarchical Dirichlet Processes. Canadian Conference on AI 2014: 107-118 [Link]
Manuel Jorge Cardoso, Ivor J. A. Simpson, Tal Arbel, Doina Precup, Annemie Ribbens:
Bayesian and grAphical Models for Biomedical Imaging - First International Workshop, BAMBI 2014, Cambridge, MA, USA, September 18, 2014, Revised Selected Papers. Lecture Notes in Computer Science 8677, Springer 2014, ISBN 978-3-319-12288-5 [contents] [Link]
Borja Balle, William L. Hamilton, Joelle Pineau:
Methods of Moments for Learning Stochastic Languages: Unified Presentation and Empirical Comparison. ICML 2014: 1386-1394 [Link]
Norman Ferns, Doina Precup:
Bisimulation Metrics are Optimal Value Functions. UAI 2014: 210-219<a href="https://dslpitt.org/uai/displayArticleDetails.jsp?mmnu=1&smnu=2&article_id=2456&proceeding_id=30"> [Link]
André da Motta Salles Barreto, Doina Precup, Joelle Pineau:
Practical Kernel-Based Reinforcement Learning. CoRR abs/1407.5358 (2014) [Link]
Philip Bachman, Ouais Alsharif, Doina Precup:
Learning with Pseudo-Ensembles. NIPS 2014: 3365-3373 [Link]
Philippe Chaput, Vincent Danos, Prakash Panangaden, Gordon D. Plotkin:
Approximating Markov Processes by Averaging. J. ACM 61(1): 5:1-5:45 (2014) [Link]
Meltem Demirkus, Doina Precup, James J. Clark, Tal Arbel:
Probabilistic Temporal Head Pose Estimation Using a Hierarchical Graphical Model. ECCV (1) 2014: 328-344 [Link]
Filippo Bonchi, Marcello M. Bonsangue, Helle Hvid Hansen, Prakash Panangaden, Jan J. M. M. Rutten, Alexandra Silva:
Algebra-coalgebra duality in Brzozowski's minimization algorithm. ACM Trans. Comput. Log. 15(1): 3:1-3:29 (2014) [Link]
Volodymyr Kuleshov, Doina Precup:
Algorithms for multi-armed bandit problems. CoRR abs/1402.6028 (2014) [Link]
Prakash Panangaden:
Causality in physics and computation. Theor. Comput. Sci. 546: 10-16 (2014) [Link]

2013

Beomjoon Kim, Amir-massoud Farahmand, Joelle Pineau, Doina Precup:
Learning from Limited Demonstrations. NIPS 2013: 2859-2867 [Link]
Bob Coecke, Luke Ong, Prakash Panangaden:
Computation, Logic, Games, and Quantum Foundations. The Many Facets of Samson Abramsky - Essays Dedicated to Samson Abramsky on the Occasion of His 60th Birthday. Lecture Notes in Computer Science 7860, Springer 2013, ISBN 978-3-642-38163-8 [contents] [Link]
Joelle Pineau:
Designing Intelligent Wheelchairs: Reintegrating AI. AAAI Spring Symposium: Designing Intelligent Robots 2013 [Link]
Arian Hosseinzadeh, Masoumeh T. Izadi, Aman Verma, Doina Precup, David L. Buckeridge:
Assessing the Predictability of Hospital Readmission Using Machine Learning. IAAI 2013 [Link]
Jordan Frank, Shie Mannor, Joelle Pineau, Doina Precup:
Time Series Analysis Using Geometric Template Matching. IEEE Trans. Pattern Anal. Mach. Intell. 35(3): 740-754 (2013) [Link]
Ouais Alsharif, Joelle Pineau:
End-to-End Text Recognition with Hybrid HMM Maxout Models. CoRR abs/1310.1811 (2013) [Link]
Guy Shani, Joelle Pineau, Robert Kaplow:
A survey of point-based POMDP solvers. Autonomous Agents and Multi-Agent Systems 27(1): 1-51 (2013) [Link]
Negar Ghourchian, Doina Precup:
Smart Classifier Selection for Activity Recognition on Wearable Devices. ICPRAM 2013: 581-585 [Link]
Clement Gehring, Doina Precup:
Smart exploration in reinforcement learning using absolute temporal difference errors. AAMAS 2013: 1037-1044 [Link]
William L. Hamilton, Mahdi Milani Fard, Joelle Pineau:
Efficient Learning and Planning with Compressed Predictive States. CoRR abs/1312.0286 (2013) [Link]
Nastaran Jafarpour, Doina Precup, Masoumeh T. Izadi, David L. Buckeridge:
Using Hierarchical Mixture of Experts Model for Fusion of Outbreak Detection Methods. AMIA 2013 [Link]
Prakash Panangaden:
Duality in Logic and Computation. LICS 2013: 4-11 [Link]
Beomjoon Kim, Joelle Pineau:
Maximum Mean Discrepancy Imitation Learning. Robotics: Science and Systems 2013 [Link]
Philip Bachman, Doina Precup:
Greedy Confidence Pursuit: A Pragmatic Approach to Multi-bandit Optimization. ECML/PKDD (1) 2013: 241-256 [Link]
Yuri Grinberg, Doina Precup:
Average Reward Optimization Objective In Partially Observable Domains. ICML (1) 2013: 320-328 [Link]
Nagesh K. Subbanna, Doina Precup, D. Louis Collins, Tal Arbel:
Hierarchical Probabilistic Gabor and MRF Segmentation of Brain Tumours in MRI Volumes. MICCAI (1) 2013: 751-758 [Link]
S. Barry Cooper, Elham Kashefi, Prakash Panangaden:
Preface to special issue: Developments In Computational Models 2010. Mathematical Structures in Computer Science 23(2): 201-203 (2013) [Link]
Mahdi Milani Fard, Yuri Grinberg, Amir-massoud Farahmand, Joelle Pineau, Doina Precup:
Bellman Error Based Feature Generation using Random Projections on Sparse Spaces. NIPS 2013: 3030-3038 [Link]
William L. Hamilton, Mahdi Milani Fard, Joelle Pineau:
Modelling Sparse Dynamical Systems with Compressed Predictive State Representations. ICML (1) 2013: 178-186 [Link]
Jordan Frank, Shie Mannor, Doina Precup:
Generating storylines from sensor data. Pervasive and Mobile Computing 9(6): 838-847 (2013) [Link]
Dexter Kozen, Radu Mardare, Prakash Panangaden:
Strong Completeness for Markovian Logics. MFCS 2013: 655-666 [Link]
Dexter Kozen, Kim G. Larsen, Radu Mardare, Prakash Panangaden:
Stone Duality for Markov Processes. LICS 2013: 321-330 [Link]
Sylvie C. W. Ong, Yuri Grinberg, Joelle Pineau:
Mixed Observability Predictive State Representations. AAAI 2013 [Link]
Boyu Wang, Joelle Pineau:
Online Ensemble Learning for Imbalanced Data Streams. CoRR abs/1310.8004 (2013) [Link]

2012

Mahdi Milani Fard, Yuri Grinberg, Amir Massoud Farahmand, Joelle Pineau, Doina Precup:
Bellman Error Based Feature Generation using Random Projections on Sparse Spaces. CoRR abs/1207.5554 (2012) [Link]
Mahdi Milani Fard, Yuri Grinberg, Joelle Pineau, Doina Precup:
Compressed Least-Squares Regression on Sparse Spaces. AAAI 2012 [Link]
Finale Doshi-Velez, Joelle Pineau, Nicholas Roy:
Reinforcement learning with limited reinforcement: Using Bayes risk for active learning in POMDPs. Artif. Intell. 187: 115-132 (2012) [Link]
Joelle Pineau, Geoffrey J. Gordon, Sebastian Thrun:
Policy-contingent abstraction for robust robot control. CoRR abs/1212.2495 (2012) [Link]
Sophia Knight, Radu Mardare, Prakash Panangaden:
Combining Epistemic Logic and Hennessy-Milner Logic. Logic and Program Semantics 2012: 219-243 [Link]
Norman Ferns, Prakash Panangaden, Doina Precup:
Metrics for Finite Markov Decision Processes. CoRR abs/1207.4114 (2012) [Link]
John Langford, Joelle Pineau:
Proceedings of the 29th International Conference on Machine Learning (ICML-12). CoRR abs/1207.4676 (2012) [Link]
Yuri Grinberg, Doina Precup:
On Average Reward Policy Evaluation in Infinite-State Partially Observable Systems. AISTATS 2012: 449-457 [Link]
Konstantinos Chatzikokolakis, Sophia Knight, Catuscia Palamidessi, Prakash Panangaden:
Epistemic Strategies and Games on Concurrent Processes. ACM Trans. Comput. Log. 13(4): 28:1-28:35 (2012) [Link]
Sophia Knight, Catuscia Palamidessi, Prakash Panangaden, Frank D. Valencia:
Spatial and Epistemic Modalities in Constraint-Based Process Calculi. CONCUR 2012: 317-332 [Link]
Norman Ferns, Pablo Samuel Castro, Doina Precup, Prakash Panangaden:
Methods for computing state similarity in Markov Decision Processes. CoRR abs/1206.6836 (2012) [Link]
Arian Hosseinzadeh, Masoumeh T. Izadi, Doina Precup, David L. Buckeridge:
Mining Administrative Data to Predict Falls in the Elderly Population. Canadian Conference on AI 2012: 305-311 [Link]
Meltem Demirkus, Doina Precup, James J. Clark, Tal Arbel:
Soft biometric trait classification from real-world face videos conditioned on head pose estimation. CVPR Workshops 2012: 130-137 [Link]
Kim Guldstrand Larsen, Radu Mardare, Prakash Panangaden:
Taking It to the Limit: Approximate Reasoning for Markov Processes. MFCS 2012: 681-692 [Link]
Emily Tsang, Sylvie C. W. Ong, Joelle Pineau:
Design and Evaluation of a Flexible Interface for Spatial Navigation. CRV 2012: 353-360 [Link]
Mahdi Milani Fard, Joelle Pineau, Csaba Szepesvári:
PAC-Bayesian Policy Evaluation for Reinforcement Learning. CoRR abs/1202.3717 (2012) [Link]
Kun Deng, Joelle Pineau, Susan A. Murphy:
Active Learning for Developing Personalized Treatment. CoRR abs/1202.3714 (2012) [Link]
Richard Blute, Prakash Panangaden, Sergey Slavnov:
Deep Inference and Probabilistic Coherence Spaces. Applied Categorical Structures 20(3): 209-228 (2012) [Link]
André da Motta Salles Barreto, Doina Precup, Joelle Pineau:
On-line Reinforcement Learning Using Incremental Kernel-Based Stochastic Factorization. NIPS 2012: 1493-1501 [Link]
Prakash Panangaden:
Dexter Kozen's Influence on the Theory of Labelled Markov Processes. Logic and Program Semantics 2012: 334-337 [Link]
Susanne Still, Doina Precup:
An information-theoretic approach to curiosity-driven reinforcement learning. Theory in Biosciences 131(3): 139-148 (2012) [Link]
Gheorghe Comanici, Prakash Panangaden, Doina Precup:
On-the-Fly Algorithms for Bisimulation Metrics. QEST 2012: 94-103 [Link]
Philip A. Warrick, Emily F. Hamilton, Robert E. Kearney, Doina Precup:
A Machine Learning Approach to the Detection of Fetal Hypoxia during Labor and Delivery. AI Magazine 33(2): 79-90 (2012) [Link]
ShaoWei Png, Joelle Pineau, Brahim Chaib-draa:
Building Adaptive Dialogue Systems Via Bayes-Adaptive POMDPs. J. Sel. Topics Signal Processing 6(8): 917-927 (2012) [Link]
Amir Massoud Farahmand, Doina Precup:
Value Pursuit Iteration. NIPS 2012: 1349-1357 [Link]
Stéphane Ross, Joelle Pineau:
Model-Based Bayesian Reinforcement Learning in Large Structured Domains. CoRR abs/1206.3281 (2012) [Link]
Cosmin Paduraru, Doina Precup, Joelle Pineau, Gheorghe Comanici:
An Empirical Analysis of Off-policy Learning in Discrete MDPs. EWRL 2012: 89-102 [Link]
Norman Ferns, Prakash Panangaden, Doina Precup:
Metrics for Markov Decision Processes with Infinite State Spaces. CoRR abs/1207.1386 (2012) [Link]
Doina Precup, Carlos A. Robles-Rubio, Karen A. Brown, Lara J. Kanbar, J. Kaczmarek, S. Chawla, Guilherme M. Sant'Anna, Robert E. Kearney:
Prediction of extubation readiness in extreme preterm infants based on measures of cardiorespiratory variability. EMBC 2012: 5630-5633 [Link]
Doina Precup, Philip Bachman:
Improved Estimation in Time Varying Models. ICML 2012 [Link]

2011

Kun Deng, Joelle Pineau, Susan A. Murphy:
Active learning for personalizing treatment. ADPRL 2011: 32-39 [Link]
Mahdi Milani Fard, Joelle Pineau, Csaba Szepesvári:
PAC-Bayesian Policy Evaluation for Reinforcement Learning. UAI 2011: 195-202<a href="https://dslpitt.org/uai/displayArticleDetails.jsp?mmnu=1&smnu=2&article_id=2218&proceeding_id=27"> [Link]
Prakash Panangaden:
The Meaning of Semantics. LICS 2011: 4-5 [Link]
Robert D. Vincent, Aaron C. Courville, Joelle Pineau:
A bistable computational model of recurring epileptiform activity as observed in rodent slice preparations. Neural Networks 24(6): 526-537 (2011) [Link]
Mahdi Milani Fard, Joelle Pineau:
Non-Deterministic Policies in Markovian Decision Processes. J. Artif. Intell. Res. 40: 1-24 (2011) [Link]
Jordan Frank, Shie Mannor, Doina Precup:
Activity Recognition with Mobile Phones. ECML/PKDD (3) 2011: 630-633 [Link]
Prakash Panangaden:
Quantum Information Channels in Curved Spacetime. CiE 2011: 221-229 [Link]
ShaoWei Png, Joelle Pineau:
Bayesian reinforcement learning for POMDP-based dialogue systems. ICASSP 2011: 2156-2159 [Link]
Philip Bachman, Doina Precup:
Learning Compact Representations of Time-Varying Processes. AAAI 2011 [Link]
Athena K. Moghaddam, Joelle Pineau, Jordan Frank, Philippe Archambault, François Routhier, Therese Audet, Jan Polgar, François Michaud, Patrick Boissy:
Mobility profile and wheelchair driving skills of powered wheelchair users: Sensor-based event recognition using a support vector machine classifier. EMBC 2011: 7336-7339 [Link]
Richard S. Sutton, Joseph Modayil, Michael Delp, Thomas Degris, Patrick M. Pilarski, Adam White, Doina Precup:
Horde: a scalable real-time architecture for learning knowledge from unsupervised sensorimotor interaction. AAMAS 2011: 761-768<a href="http://portal.acm.org/citation.cfm?id=2031726&CFID=54178199&CFTOKEN=61392764"> [Link]
Gheorghe Comanici, Doina Precup:
Basis function discovery using spectral clustering and bisimulation metrics. AAMAS 2011: 1079-1080<a href="http://portal.acm.org/citation.cfm?id=2034427&CFID=69154334&CFTOKEN=45298625"> [Link]
Prakash Panangaden:
The Search for Structure in Quantum Computation. FOSSACS 2011: 1-11 [Link]
Stéphane Ross, Joelle Pineau, Brahim Chaib-draa, Pierre Kreitmann:
A Bayesian Approach for Learning and Planning in Partially Observable Markov Decision Processes. Journal of Machine Learning Research 12: 1729-1770 (2011) [Link]
Nagesh K. Subbanna, Simon J. Francis, Doina Precup, D. Louis Collins, Douglas L. Arnold, Tal Arbel:
Adapted MRF Segmentation of Multiple Sclerosis Lesions Using Local Contextual Information. MIUA 2011: 351-356 [Link]
André da Motta Salles Barreto, Doina Precup, Joelle Pineau:
Reinforcement Learning using Kernel-Based Stochastic Factorization. NIPS 2011: 720-728 [Link]
Norm Ferns, Prakash Panangaden, Doina Precup:
Bisimulation Metrics for Continuous Markov Decision Processes. SIAM J. Comput. 40(6): 1662-1714 (2011) [Link]
Joelle Pineau, Geoffrey J. Gordon, Sebastian Thrun:
Anytime Point-Based Approximations for Large POMDPs. CoRR abs/1110.0027 (2011) [Link]
Guillaume Saulnier, Joelle Pineau:
Automatic Seizure Detection in an In-Vivo Model of Epilepsy. AAAI Spring Symposium: Computational Physiology 2011 [Link]
Sylvie C. W. Ong, Yuri Grinberg, Joelle Pineau:
Goal-Directed Online Learning of Predictive Models. EWRL 2011: 18-29 [Link]
Gheorghe Comanici, Doina Precup:
Basis Function Discovery Using Spectral Clustering and Bisimulation Metrics. AAAI 2011 [Link]
Monica Dinculescu, Christopher Hundt, Prakash Panangaden, Joelle Pineau, Doina Precup:
The Duality of State and Observation in Probabilistic Transition Systems. TbiLLC 2011: 206-230 [Link]
Cosmin Paduraru, Doina Precup, Joelle Pineau:
A Framework for Computing Bounds for the Return of a Policy. EWRL 2011: 201-212 [Link]
Susan M. Shortreed, Eric B. Laber, Daniel J. Lizotte, T. Scott Stroup, Joelle Pineau, Susan A. Murphy:
Informing sequential clinical decision-making through reinforcement learning: an empirical study. Machine Learning 84(1-2): 109-136 (2011) [Link]
Gheorghe Comanici, Doina Precup:
Basis Function Discovery Using Spectral Clustering and Bisimulation Metrics. ALA 2011: 85-99 [Link]
Pablo Samuel Castro, Doina Precup:
Automatic Construction of Temporally Extended Actions for MDPs Using Bisimulation Metrics. EWRL 2011: 140-152 [Link]
Kun Deng, Joelle Pineau, Susan A. Murphy:
Active Learning for Developing Personalized Treatment. UAI 2011: 161-168<a href="https://dslpitt.org/uai/displayArticleDetails.jsp?mmnu=1&smnu=2&article_id=2196&proceeding_id=27"> [Link]

2010

Keith Bush, Joelle Pineau:
Treating Epilepsy by Reinforcement Learning Via Manifold-Based Simulation. AAAI Fall Symposium: Manifold Learning and Its Applications 2010 [Link]
Jordan Frank, Shie Mannor, Doina Precup:
A novel similarity measure for time series data with applications to gait and activity recognition. UbiComp (Adjunct Papers) 2010: 407-408 [Link]
Arthur Guez, Joelle Pineau:
Multi-tasking SLAM. ICRA 2010: 377-384 [Link]
Robert Kaplow, Amin Atrash, Joelle Pineau:
Variable resolution decomposition for robotic navigation under a POMDP framework. ICRA 2010: 369-376 [Link]
Mahdi Milani Fard, Joelle Pineau:
PAC-Bayesian Model Selection for Reinforcement Learning. NIPS 2010: 1624-1632 [Link]
Pablo Samuel Castro, Doina Precup:
Smarter Sampling in Model-Based Bayesian Reinforcement Learning. ECML/PKDD (1) 2010: 200-214 [Link]
Jordan Frank, Shie Mannor, Doina Precup:
Activity and Gait Recognition with Time-Delay Embeddings. AAAI 2010 [Link]
Pablo Samuel Castro, Doina Precup:
Using Bisimulation for Policy Transfer in MDPs. AAAI 2010 [Link]
Philip A. Warrick, Emily F. Hamilton, Robert E. Kearney, Doina Precup:
A Machine Learning Approach to the Detection of Fetal Hypoxia during Labor and Delivery. IAAI 2010 [Link]
Josée Desharnais, Vineet Gupta, Radha Jagadeesan, Prakash Panangaden:
Weak bisimulation is sound and complete for pCTL*. Inf. Comput. 208(2): 203-219 (2010) [Link]
Gheorghe Comanici, Doina Precup:
Optimal policy switching algorithms for reinforcement learning. AAMAS 2010: 709-714 [Link]
Pablo Samuel Castro, Doina Precup:
Using bisimulation for policy transfer in MDPs. AAMAS 2010: 1399-1400 [Link]
Joelle Pineau, Robert West, Amin Atrash, Julien Villemure, François Routhier:
Towards a standardized test for intelligent wheelchairs. PerMIS 2010: 169-174 [Link]
Prakash Panangaden, Mehrnoosh Sadrzadeh:
Learning in a Changing World, an Algebraic Modal Logical Approach. AMAST 2010: 128-141 [Link]
Philip A. Warrick, Emily F. Hamilton, Doina Precup, Robert E. Kearney:
Classification of Normal and Hypoxic Fetuses From Systems Modeling of Intrapartum Cardiotocography. IEEE Trans. Biomed. Engineering 57(4): 771-779 (2010) [Link]
Susanna Donatelli, Prakash Panangaden, Gerardo Rubino:
Special Issue on "Quantitative Evaluation of Systems". Perform. Eval. 67(9): 757-758 (2010) [Link]
Fabian Kaelin, Doina Precup:
A Study of Approximate Inference in Probabilistic Relational Models. ACML 2010: 315-330 [Link]
S. Barry Cooper, Prakash Panangaden, Elham Kashefi:
Proceedings Sixth Workshop on Developments in Computational Models: Causality, Computation, and Physics, DCM 2010, Edinburgh, Scotland, 9-10th July 2010. EPTCS 26, 2010 [contents] [Link]
Monica Dinculescu, Doina Precup:
Approximate Predictive Representations of Partially Observable Systems. ICML 2010: 895-902 [Link]
Robert West, Doina Precup, Joelle Pineau:
Automatically suggesting topics for augmenting text documents. CIKM 2010: 929-938 [Link]
Prakash Panangaden, Mehrnoosh Sadrzadeh:
Towards a Logic for Reasoning About Learning in a Changing World. LAM@LICS 2010: 82-95 [Link]

2009

Robert West, Doina Precup, Joelle Pineau:
Completing wikipedia's hyperlink structure through dimensionality reduction. CIKM 2009: 1097-1106 [Link]
Joelle Pineau, Arthur Guez, Robert D. Vincent, Gabriella Panuccio, Massimo Avoli:
Treating Epilepsy via Adaptive Neurostimulation: a Reinforcement Learning Approach. Int. J. Neural Syst. 19(4): 227-240 (2009) [Link]
Amin Atrash, Robert Kaplow, Julien Villemure, Robert West, Hiba Yamani, Joelle Pineau:
Development and Validation of a Robust Speech Interface for Improved Human-Robot Interaction. I. J. Social Robotics 1(4): 345-356 (2009) [Link]
Philip A. Warrick, Emily F. Hamilton, Doina Precup, Robert E. Kearney:
Identification of the Dynamic Relationship Between Intrapartum Uterine Pressure and Fetal Heart Rate for Normal and Hypoxic Fetuses. IEEE Trans. Biomed. Engineering 56(6): 1587-1597 (2009) [Link]
Richard S. Sutton, Hamid Reza Maei, Doina Precup, Shalabh Bhatnagar, David Silver, Csaba Szepesvári, Eric Wiewiora:
Fast gradient-descent methods for temporal-difference learning with linear function approximation. ICML 2009: 993-1000 [Link]
Sami Zhioua, Doina Precup, François Laviolette, Josée Desharnais:
Learning the Difference between Partially Observable Dynamical Systems. ECML/PKDD (2) 2009: 664-677 [Link]
Keith Bush, Joelle Pineau:
Manifold Embeddings for Model-Based Reinforcement Learning under Partial Observability. NIPS 2009: 189-197 [Link]
Pablo Samuel Castro, Prakash Panangaden, Doina Precup:
Equivalence Relations in Fully and Partially Observable Markov Decision Processes. IJCAI 2009: 1653-1658 [Link]
Prakash Panangaden:
Labelled Markov Processes. Imperial College Press 2009, ISBN 978-1-84816-287-7, pp. I-XII, 1-199 [Link]
Konstantinos Chatzikokolakis, Sophia Knight, Prakash Panangaden:
Epistemic Strategies and Games on Concurrent Processes. SOFSEM 2009: 153-166 [Link]
Robert West, Joelle Pineau, Doina Precup:
Wikispeedia: An Online Game for Inferring Semantic Distances between Concepts. IJCAI 2009: 1598-1603 [Link]
Amin Atrash, Joelle Pineau:
A bayesian reinforcement learning approach for customizing human-robot interfaces. IUI 2009: 355-360 [Link]
Philippe Chaput, Vincent Danos, Prakash Panangaden, Gordon D. Plotkin:
Approximating Markov Processes by Averaging. ICALP (2) 2009: 127-138 [Link]
Philippe Chaput, Vincent Danos, Prakash Panangaden, Gordon D. Plotkin:
Approximating Labelled Markov Processes Again! CALCO 2009: 145-156 [Link]
Hamid Reza Maei, Csaba Szepesvári, Shalabh Bhatnagar, Doina Precup, David Silver, Richard S. Sutton:
Convergent Temporal-Difference Learning with Arbitrary Smooth Function Approximation. NIPS 2009: 1204-1212 [Link]

2008

Yannick Delbecque, Prakash Panangaden:
Game Semantics for Quantum Stores. Electr. Notes Theor. Comput. Sci. 218: 153-170 (2008) [Link]
Stéphane Ross, Joelle Pineau:
Model-Based Bayesian Reinforcement Learning in Large Structured Domains. UAI 2008: 476-483<a href="https://dslpitt.org/uai/displayArticleDetails.jsp?mmnu=1&smnu=2&article_id=1967&proceeding_id=24"> [Link]
Mahdi Milani Fard, Joelle Pineau:
MDPs with Non-Deterministic Policies. NIPS 2008: 1065-1072 [Link]
Prakash Panangaden:
Knowledge and Information in Probabilistic Systems. CONCUR 2008: 4 [Link]
Arthur Guez, Robert D. Vincent, Massimo Avoli, Joelle Pineau:
Adaptive Treatment of Epilepsy via Batch-mode Reinforcement Learning. AAAI 2008: 1671-1678 [Link]
Joelle Pineau, Stéphane Ross, Brahim Chaib-draa:
Bayes-Adaptive POMDPs: A New Perspective on the Explore-Exploit Tradeoff in Partially Observable Domains. ISAIM 2008 [Link]
Jonathan Taylor, Doina Precup, Prakash Panangaden:
Bounding Performance Loss in Approximate MDP Homomorphisms. NIPS 2008: 1649-1656 [Link]
Stéphane Ross, Joelle Pineau, Sébastien Paquet, Brahim Chaib-draa:
Online Planning Algorithms for POMDPs. J. Artif. Intell. Res. 32: 663-704 (2008) [Link]
Rupert Brooks, Tal Arbel, Doina Precup:
Anytime similarity measures for faster alignment. Computer Vision and Image Understanding 110(3): 378-389 (2008) [Link]
Mahdi Milani Fard, Joelle Pineau, Peng Sun:
A Variance Analysis for POMDP Policy Evaluation. AAAI 2008: 1056-1061 [Link]
Keye Martin, Prakash Panangaden:
A Technique for Verifying Measurements. Electr. Notes Theor. Comput. Sci. 218: 261-273 (2008) [Link]
Masoumeh T. Izadi, Doina Precup:
Point-Based Planning for Predictive State Representations. Canadian Conference on AI 2008: 126-137 [Link]
Finale Doshi, Joelle Pineau, Nicholas Roy:
Reinforcement Learning with Limited Reinforcement: Using Bayes Risk for Active Learning in POMDPs. ISAIM 2008 [Link]
Konstantinos Chatzikokolakis, Catuscia Palamidessi, Prakash Panangaden:
On the Bayes risk in information-hiding protocols. Journal of Computer Security 16(5): 531-571 (2008) [Link]
Stéphane Ross, Brahim Chaib-draa, Joelle Pineau:
Bayesian reinforcement learning in continuous POMDPs with application to robot navigation. ICRA 2008: 2845-2851 [Link]
Keye Martin, Prakash Panangaden:
Domain Theory and the Causal Structure of Space-Time. CiE 2008: 428-430 [Link]
Jordan Frank, Shie Mannor, Doina Precup:
Reinforcement learning in the presence of rare events. ICML 2008: 336-343 [Link]
Finale Doshi, Joelle Pineau, Nicholas Roy:
Reinforcement learning with limited reinforcement: using Bayes risk for active learning in POMDPs. ICML 2008: 256-263 [Link]

2007

Robin Jaulmes, Joelle Pineau, Doina Precup:
Apprentissage actif dans les processus décisionnels de Markov partiellement observables L'algorithme MEDUSA. Revue d'Intelligence Artificielle 21(1): 9-34 (2007) [Link]
Vincent Danos, Elham Kashefi, Prakash Panangaden:
The measurement calculus. J. ACM 54(2): 8 (2007) [Link]
Rupert Brooks, Tal Arbel, Doina Precup:
Fast Image Alignment Using Anytime Algorithms. IJCAI 2007: 2078-2083 [Link]
Konstantinos Chatzikokolakis, Catuscia Palamidessi, Prakash Panangaden:
Probability of Error in Information-Hiding Protocols. CSF 2007: 341-354 [Link]
Marc G. Bellemare, Doina Precup:
Context-Driven Predictions. IJCAI 2007: 250-255 [Link]
Joelle Pineau, Amin Atrash:
SmartWheeler: A Robotic Wheelchair Test-Bed for Investigating New Models of Human-Robot Interaction. AAAI Spring Symposium: Multidisciplinary Collaboration for Socially Assistive Robotics 2007: 59-64 [Link]
Stéphane Ross, Brahim Chaib-draa, Joelle Pineau:
Bayes-Adaptive POMDPs. NIPS 2007: 1225-1232 [Link]
Ralph Kopperman, Prakash Panangaden, Michael B. Smyth, Dieter Spreen:
Computational Structures for Modelling Space, Time and Causality, 20.08. - 25.08.2006. Dagstuhl Seminar Proceedings 06341, Internationales Begegnungs- und Forschungszentrum fuer Informatik (IBFI), Schloss Dagstuhl, Germany 2007 [contents] [Link]
Pablo Samuel Castro, Doina Precup:
Using Linear Programming for Bayesian Exploration in Markov Decision Processes. IJCAI 2007: 2437-2442 [Link]
Romain Beauxis, Konstantinos Chatzikokolakis, Catuscia Palamidessi, Prakash Panangaden:
Formal Approaches to Information-Hiding (Tutorial). TGC 2007: 347-362 [Link]
Stéphane Ross, Joelle Pineau, Brahim Chaib-draa:
Theoretical Analysis of Heuristic Search Methods for Online POMDPs. NIPS 2007: 1233-1240 [Link]
Robin Jaulmes, Joelle Pineau, Doina Precup:
A formal framework for robot learning and control under model uncertainty. ICRA 2007: 2104-2110 [Link]
Vincent Danos, Ellie D'Hondt, Elham Kashefi, Prakash Panangaden:
Distributed Measurement-based Quantum Computation. Electr. Notes Theor. Comput. Sci. 170: 73-94 (2007) [Link]
Robert D. Vincent, Joelle Pineau, Philip de Guzman, Massimo Avoli:
Recurrent Boosting for Classification of Natural and Synthetic Time-Series Data. Canadian Conference on AI 2007: 192-203 [Link]
Richard Blute, Prakash Panangaden, Dorette Pronk:
Conformal Field Theory as a Nuclear Functor. Electr. Notes Theor. Comput. Sci. 172: 101-132 (2007) [Link]

2006

Christopher Hundt, Prakash Panangaden, Joelle Pineau, Doina Precup:
Representing Systems with Hidden State. AAAI 2006: 368-374 [Link]
Beibei Zou, Xuesong Ma, Bettina Kemme, Glen Newton, Doina Precup:
Data Mining Using Relational Database Management Systems. PAKDD 2006: 657-667 [Link]
Masoumeh T. Izadi, Doina Precup, Danielle Azar:
Belief Selection in Point-Based Planning Algorithms for POMDPs. Canadian Conference on AI 2006: 383-394 [Link]
Ricard Gavaldà, Philipp W. Keller, Joelle Pineau, Doina Precup:
PAC-Learning of Markov Models with Hidden State. ECML 2006: 150-161 [Link]
Vincent Danos, Josee Desharnais, François Laviolette, Prakash Panangaden:
Bisimulation and cocongruence for probabilistic systems. Inf. Comput. 204(4): 503-523 (2006) [Link]
Ralph Kopperman, Prakash Panangaden, Michael B. Smyth, Dieter Spreen:
06341 Abstracts Collection -- Computational Structures for Modelling Space, Time and Causality. Computational Structures for Modelling Space, Time and Causality 2006 [Link]
Norm Ferns, Pablo Samuel Castro, Doina Precup, Prakash Panangaden:
Methods for Computing State Similarity in Markov Decision Processes. UAI 2006<a href="https://dslpitt.org/uai/displayArticleDetails.jsp?mmnu=1&smnu=2&article_id=1296&proceeding_id=22"> [Link]
Joelle Pineau, Geoffrey J. Gordon, Sebastian Thrun:
Anytime Point-Based Approximations for Large POMDPs. J. Artif. Intell. Res. 27: 335-380 (2006) [Link]
Konstantinos Chatzikokolakis, Catuscia Palamidessi, Prakash Panangaden:
Anonymity Protocols as Noisy Channels. TGC 2006: 281-300 [Link]
Nikos A. Vlassis, Geoffrey J. Gordon, Joelle Pineau:
Planning under uncertainty in robotics. Robotics and Autonomous Systems 54(11): 885-886 (2006) [Link]
Philipp W. Keller, Shie Mannor, Doina Precup:
Automatic basis function construction for approximate dynamic programming and reinforcement learning. ICML 2006: 449-456 [Link]
Vineet Gupta, Radha Jagadeesan, Prakash Panangaden:
Approximate reasoning for real-time probabilistic processes. Logical Methods in Computer Science 2(1) (2006) [Link]
Daniel Burfoot, Joelle Pineau, Gregory Dudek:
RRT-Plan: A Randomized Algorithm for STRIPS Planning. ICAPS 2006: 362-365 [Link]
Ellie D'Hondt, Prakash Panangaden:
The computational power of the W And GHZ States. Quantum Information & Computation 6(2): 173-183 (2006) [Link]
Vincent Danos, Elham Kashefi, Prakash Panangaden:
The One Way to Quantum Computation. ICALP (2) 2006: 13-21 [Link]

2005

Robin Jaulmes, Joelle Pineau, Doina Precup:
Active Learning in Partially Observable Markov Decision Processes. ECML 2005: 601-608 [Link]
Masoumeh T. Izadi, Ajit V. Rajwade, Doina Precup:
Using core beliefs for point-based value iteration. IJCAI 2005: 1751-1753 [Link]
Doina Precup, Richard S. Sutton, Cosmin Paduraru, Anna Koop, Satinder P. Singh:
Off-policy Learning with Options and Recognizers. NIPS 2005: 1097-1104 [Link]
Ralph Kopperman, Prakash Panangaden, Michael B. Smyth, Dieter Spreen, Julian Webster:
04351 Summary - Spatial Representation: Discrete vs. Continuous Computational Models. Spatial Representation 2005 [Link]
Norm Ferns, Prakash Panangaden, Doina Precup:
Metrics for Markov Decision Processes with Infinite State Spaces. UAI 2005: 201-208<a href="https://dslpitt.org/uai/displayArticleDetails.jsp?mmnu=1&smnu=2&article_id=1175&proceeding_id=21"> [Link]
Alexandre Bouchard-Côté, Norm Ferns, Prakash Panangaden, Doina Precup:
An approximation algorithm for labelled Markov processes: towards realistic approximation. QEST 2005: 54-62 [Link]
Joelle Pineau, Geoffrey J. Gordon:
POMDP Planning for Robust Robot Control. ISRR 2005: 69-82 [Link]
Ellie D'Hondt, Prakash Panangaden:
Reasoning About Quantum Knowledge. FSTTCS 2005: 553-564 [Link]
Vineet Gupta, Radha Jagadeesan, Prakash Panangaden:
Approximate reasoning for real-time probabilistic processes. CoRR abs/cs/0505063 (2005) [Link]
Masoumeh T. Izadi, Doina Precup:
Model minimization by linear PSR. IJCAI 2005: 1749-1750 [Link]
Keye Martin, Prakash Panangaden:
A domain of spacetime intervals in general relativity. Spatial Representation 2005 [Link]
Masoumeh T. Izadi, Doina Precup:
Using Rewards for Belief State Updates in Partially Observable Markov Decision Processes. ECML 2005: 593-600 [Link]
Ralph Kopperman, Prakash Panangaden, Michael B. Smyth, Dieter Spreen, Julian Webster:
04351 Abstracts Collection - Spatial Representation: Discrete vs. Continuous Computational Models. Spatial Representation 2005 [Link]

2004

Philipp W. Keller, Felix-Olivier Duguay, Doina Precup:
RedAgent-2003: An Autonomous Market-Based Supply-Chain Management Agent. AAMAS 2004: 1182-1189 [Link]
Norm Ferns, Prakash Panangaden, Doina Precup:
Metrics for Finite Markov Decision Processes. UAI 2004: 162-169<a href="https://dslpitt.org/uai/displayArticleDetails.jsp?mmnu=1&smnu=2&article_id=1103&proceeding_id=20"> [Link]
Riccardo Pucella, Prakash Panangaden:
On the Expressive Power of First-Order Boolean Functions in PCF. CoRR cs.PL/0405085 (2004) [Link]
Bohdana Ratitch, Doina Precup:
Sparse Distributed Memories for On-Line Value-Based Reinforcement Learning. ECML 2004: 347-358 [Link]
Vincent Danos, Josée Desharnais, Prakash Panangaden:
Labelled Markov Processes: Stronger and Faster Approximations. Electr. Notes Theor. Comput. Sci. 87: 157-203 (2004) [Link]
Philipp W. Keller, Felix-Olivier Duguay, Doina Precup:
Redagent: winner of TAC SCM 2003. SIGecom Exchanges 4(3): 1-8 (2004) [Link]
Thomas T. Hildebrandt, Prakash Panangaden, Glynn Winskel:
A relational model of non-deterministic dataflow. Mathematical Structures in Computer Science 14(5): 613-649 (2004) [Link]
Doina Precup, Paul E. Utgoff:
Classification Using Phi-Machines and Constructive Function Approximation. Machine Learning 55(1): 31-52 (2004) [Link]
Vineet Gupta, Radha Jagadeesan, Prakash Panangaden:
Approximate Reasoning for Real-Time Probabilistic Processes. QEST 2004: 304-313 [Link]
Josee Desharnais, Vineet Gupta, Radha Jagadeesan, Prakash Panangaden:
Metrics for labelled Markov processes. Theor. Comput. Sci. 318(3): 323-354 (2004) [Link]
Norm Ferns, Prakash Panangaden, Doina Precup:
Metrics for Finite Markov Decision Processes. AAAI 2004: 950-951 [Link]

2003

Uwe Nestmann, Prakash Panangaden:
Guest Editors' Foreword. Nord. J. Comput. 10(2): 69 (2003) [Link]
François Rivest, Doina Precup:
Combining TD-learning with Cascade-correlation Networks. ICML 2003: 632-639 [Link]
Bohdana Ratitch, Doina Precup:
Using MDP Characteristics to Guide Exploration in Reinforcement Learning. ECML 2003: 313-324 [Link]
Josee Desharnais, Prakash Panangaden:
Continuous stochastic logic characterizes bisimulation of continuous-time Markov processes. J. Log. Algebr. Program. 56(1-2): 99-115 (2003) [Link]
Masoumeh T. Izadi, Doina Precup:
A Planning Algorithm for Predictive State Representations. IJCAI 2003: 1520-1521 [Link]
Josee Desharnais, Vineet Gupta, Radha Jagadeesan, Prakash Panangaden:
Approximating labelled Markov processes. Inf. Comput. 184(1): 160-200 (2003) [Link]
Vincent Danos, Josee Desharnais, Prakash Panangaden:
Conditional Expectation and the Approximation of Labelled Markov Processes. CONCUR 2003: 468-482 [Link]

2002

Danielle Azar, Doina Precup, Salah Bouktif, Balázs Kégl, Houari A. Sahraoui:
Combining and Adapting Software Quality Predictive Models by Genetic Algorithms. ASE 2002: 285-288 [Link]
Josee Desharnais, Radha Jagadeesan, Vineet Gupta, Prakash Panangaden:
The Metric Analogue of Weak Bisimulation for Probabilistic Processes. LICS 2002: 413-422 [Link]
Theodore J. Perkins, Doina Precup:
A Convergent Form of Approximate Policy Iteration. NIPS 2002: 1595-1602 [Link]
Josee Desharnais, Vineet Gupta, Radha Jagadeesan, Prakash Panangaden:
Weak Bisimulation is Sound and Complete for PCTL*. CONCUR 2002: 355-370 [Link]
Martin Stolle, Doina Precup:
Learning Options in Reinforcement Learning. SARA 2002: 212-223 [Link]
Bohdana Ratitch, Doina Precup:
Characterizing Markov Decision Processes. ECML 2002: 391-404 [Link]
Josee Desharnais, Abbas Edalat, Prakash Panangaden:
Bisimulation for Labelled Markov Processes. Inf. Comput. 179(2): 163-193 (2002) [Link]
Luca Aceto, Prakash Panangaden:
Guest Editors' Foreword. Nord. J. Comput. 9(1): 69 (2002) [Link]
Ioan Alfred Letia, Doina Precup:
Developing Collaborative Golog Agents by Reinforcement Learning. International Journal on Artificial Intelligence Tools 11(2): 233-246 (2002) [Link]

2001

Riccardo Pucella, Prakash Panangaden:
On the expressive power of first-order boolean functions in PCF. Theor. Comput. Sci. 266(1-2): 543-567 (2001) [Link]
Ioan Alfred Letia, Doina Precup:
Developing Collaborative Golog Agents by Reinforcement Learning. ICTAI 2001: 195-202 [Link]
Prakash Panangaden:
Does Combining Nondeterminism and Probability Make Sense? Bulletin of the EATCS 75: 182-189 (2001) [Link]
Doina Precup, Richard S. Sutton, Sanjoy Dasgupta:
Off-Policy Temporal Difference Learning with Function Approximation. ICML 2001: 417-424 [Link]
Prakash Panangaden:
Does Concurrency Theory Have Anything to Say About Parallel Programming? Current Trends in Theoretical Computer Science 2001: 439-446 [Link]
Prakash Panangaden:
Measure and probability for concurrency theorists. Theor. Comput. Sci. 253(2): 287-309 (2001) [Link]

2000

Josee Desharnais, Vineet Gupta, Radha Jagadeesan, Prakash Panangaden:
Approximating Labeled Markov Processes. LICS 2000: 95-106 [Link]
Prakash Panangaden:
From logic to stochastic processes (abstract only). PPDP 2000: 1-2 [Link]
Prakash Panangaden, Clark Verbrugge:
Generating irregular partitionable data structures. Theor. Comput. Sci. 238(1-2): 31-80 (2000) [Link]

1999

Prakash Panangaden:
The Category of Markov Kernels. Electr. Notes Theor. Comput. Sci. 22: 171-187 (1999) [Link]
Josee Desharnais, Vineet Gupta, Radha Jagadeesan, Prakash Panangaden:
Metrics for Labeled Markov Systems. CONCUR 1999: 258-273 [Link]
Vineet Gupta, Radha Jagadeesan, Prakash Panangaden:
Stochastic Processes as Concurrent Constraint Programs. POPL 1999: 189-202 [Link]

1998

Thomas T. Hildebrandt, Prakash Panangaden, Glynn Winskel:
A Relational Model of Non-deterministic Dataflow. CONCUR 1998: 613-628 [Link]
Josee Desharnais, Abbas Edalat, Prakash Panangaden:
A Logical Characterization of Bisimulation for Labeled Markov Processes. LICS 1998: 478-487 [Link]

1997

Richard Blute, Josee Desharnais, Abbas Edalat, Prakash Panangaden:
Bisimulation for Labelled Markov Processes. LICS 1997: 149-158 [Link]