Detailed Program – HHAI Conference

	Wednesday, 15. June (Day 1)	Thursday, 16. June (Day 2)	Friday, 17. June (Day 3)
8:00 am	Registration 8:00 am - 6:00 pm
8:30 am
9:00 am	Welcome 9:15 am - 9:30 am	Paper Presentations 9:00 am - 10:30 am Capable but Amoral? Comparing AI and Human Expert Collaboration in Ethical Decision Making (#3) 9:00 am - 9:15 am Suzanne Tolmeijer, Markus Christen, Serhiy Kandul, Markus Kneer and Abraham Bernstein Neural Prototype Trees for Interpretable Fine-grained Image Recognition (#17) 9:15 am - 9:30 am Meike Nauta, Ron van Bree and Christin Seifert
9:30 am	Minute madness 9:30 am - 10:30 am	Privacy risk of global explanainers (#69) 9:30 am - 9:45 am Francesca Naretto, Anna Monreale and Fosca Giannotti Abstracting Minds: Computational Theory of Mind for Human-Agent Collaboration (#70) ** 9:45 am - 10:10 am Emre Erdogan, Frank Dignum, Rineke Verbrugge and Pinar Yolum	Community Meeting 9:30 am - 10:00 am
10:00 am		Discovering the Rationale of Decisions (#12) 10:10 am - 10:25 am Cor Steging, Silja Renooij and Bart Verheij	Keynote by Fernanda Viegas 10:00 am - 11:00 am Designing AI systems with a variety of users in mind
10:30 am	Coffee Break 10:30 am - 11:00 am
11:00 am	Paper Presentations 11:00 am - 12:30 pm Knowledge Graphs in Support of Human Machine Intelligence (#67) 11:00 am - 11:15 am Christophe Guéret Exemplars and Counterexemplars Explanations for Skin Lesion Classifiers (#82) 11:15 am - 11:30 am Carlo Metta, Riccardo Guidotti, Yuan Yin, Patrick Gallinari and Salvatore Rinzivillo	Paper Presentations 11:00 am - 12:30 pm Estimating Rapport in Conversations: An Interpretable and Dyadic Multi-Modal Approach (#48) * 11:00 am - 11:25 am Gustav Grimberg, Thomas Janssoone, Chloé Clavel and Justine Cassell Challenges of the adoption of AI in High Risk High consequence time compressed decision-making environments (#96) * 11:25 am - 11:50 am Bart van Leeuwen, Richard Gasaway and Gerke Spaling	Coffee Break 11:00 am - 11:30 am
11:30 am	Does Personalization Help? Predicting How Social Situations Affect Personal Values (#51) 11:30 am - 11:55 am Ilir Kola, Ralvi Isufaj and Catholijn M. Jonker MiniCoDe Workshops: Minimise Algorithmic Bias in Collaborative Decision Making with Design Fiction (#58) 11:55 am - 12:10 pm Alessio Malizia, Silvio Carta, Tommaso Turchi and Clara Crivellaro	How Can This Be Split Into Parts? Training Intelligent Tutors on User Simulators Using Reinforcement Learning (#46) 11:50 am - 12:05 pm Paul Bricman and Matthia Sabatelli	Paper Presentations 11:30 am - 1:00 pm A Song of (Dis)agreement: Evaluating the Evaluation of Explainable Artificial Intelligence in Natural Language Processing (#21) 11:30 am - 11:55 am Michael Neely, Stefan Schouten, Maurits Bleeker and Ana Lucic An Empirical Investigation of Reliance on AI-Assistance in a Noisy-Image Classification Task (#92) 11:55 am - 12:20 pm Heliodoro Tejeda Lemus, Aakriti Kumar and Mark Steyvers
12:00 pm	Open, multiple, adjunct. Decision support at the time of relational AI (#37) 12:10 pm - 12:25 pm Federico Cabitza and Chiara Natali	An experiment in measuring understanding (#28) * 12:05 pm - 12:30 pm Luc Steels, Lara Verheyen and Remi van Trijp	The games we play: how critical complexity improves machine learning (#7) 12:20 pm - 12:45 pm Abeba Birhane and David J. Sumpter
12:30 pm	Lunch 12:30 pm - 1:30 pm	Monitoring Fairness in HOLDA (#66) * 12:45 pm - 1:00 pm Michele Fontana, Francesca Naretto, Anna Monreale and Fosca Giannotti
1:00 pm			Lunch 1:00 pm - 2:00 pm
1:30 pm	Keynote by Joanna Bryson 1:30 pm - 2:30 pm With whom do we hybridise? Principle Agents of AI	Keynote by Wendy Mackay 1:30 pm - 2:30 pm Creating Human-Computer Partnerships
2:00 pm			Paper Presentations 2:00 pm - 3:05 pm Best-Response Bayesian Reinforcement Learning with Bayes-adaptive POMDPs for Centaurs (#78) 2:00 pm - 2:25 pm Mustafa Mert Çelikok, Frans Oliehoek and Samuel Kaski HyEnA: A Hybrid Method for Extracting Arguments from Opinions (#16) ** 2:25 pm - 2:50 pm Michiel van der Meer, Enrico Liscio, Catholijn M. Jonker, Aske Plaat, Piek Vossen and Pradeep K. Murukannaiah
2:30 pm	Paper Presentations 2:30 pm - 3:30 pm A Sequence-Based Dialog Management Framework for Enhancing Co-Regulated Dialog (#40) 2:30 pm - 2:55 pm Florian Kunneman and Koen Hindriks POMDP-based adaptive interaction through physiological computing (#18) 2:55 pm - 3:10 pm Gaganpreet Singh, Raphaëlle N. Roy and Caroline Ponzoni Carvalho Chanel	Paper Presentations 2:30 pm - 3:30 pm Exosoul: ethical profiling in the digital world (#39) 2:30 pm - 2:55 pm Costanza Alfieri, Paola Inverardi, Patrizio Migliarini and Massimiliano Palmiero Effective Task Allocation in Ad Hoc Human-Agent Teams (#53) 2:55 pm - 3:20 pm Sami Abuhaimed and Sandip Sen	What AI Practitioners Say about Human-AI Trust: Its Role, Importance, and Factors That Affect It (#93) 2:50 pm - 3:05 pm Oleksandra Vereschak, Gilles Bailly and Baptiste Caramiaux
3:00 pm	Learning to Cooperate with Human Evaluative Feedback and Demonstrations (#19) 3:10 pm - 3:25 pm Mehul Verma and Erman Acar Coffee Break 3:25 pm - 3:55 pm	Coffee Break 3:25 pm - 3:55 pm	Closing and Award Ceremony 3:05 pm - 3:20 pm Coffee Break 3:15 pm - 3:45 pm
3:30 pm
4:00 pm	Paper Presentations 4:00 pm - 5:30 pm Landmarks in Case-based Reasoning: From Theory to Data (#81) ** 4:00 pm - 4:25 pm Wijnand van Woerkom, Davide Grossi, Henry Prakken and Bart Verheij Can AI reduce motivated reasoning in news consumption? Investigating the role of attitudes towards AI and motivated reasoning in shaping trust perceptions of news (#59) 4:25 pm - 4:40 pm Magdalena Wischnewski and Nicole Krämer	Paper Presentations 4:00 pm - 5:00 pm Estimating Value Preferences in a Hybrid Participatory System (#31) ** 4:00 pm - 4:25 pm Luciano Cavalcante Siebert, Enrico Liscio, Pradeep Kumar Murukannaiah, Lionel Kaptein, Shannon Spruit, Jeroen Van den Hoven and Catholijn Jonker Legitimacy of what?: a call for democratic AI design (#35) 4:25 pm - 4:40 pm Jonne Maas and Juan Durán
4:30 pm	Trust in Clinical AI: Expanding the Unit of Analysis (#30) ** 4:40 pm - 5:05 pm Jacob Browne, Saskia Bakker, Bin Yu, Peter Lloyd and Somaya Ben Allouch	Monitoring AI systems: A Problem Analysis, Framework and Outlook (#23) 4:40 pm - 4:55 pm Annet Onnes
5:00 pm	Towards an AI assistant for power grid operators (#22) 5:10 pm - 5:35 pm Antoine Marot, Alexandre Rozier, Matthieu Dussartre, Laure Crochepiere a and Benjamin Donnot	Conference Dinner 5:00 pm - 10:00 pm
5:30 pm	Posters & Demos Session 5:30 pm - 7:30 pm
6:00 pm
6:30 pm
7:00 pm
7:30 pm
8:00 pm
8:30 pm
9:00 pm
9:30 pm

	Wednesday, 15. June (Day 1)	Thursday, 16. June (Day 2)	Friday, 17. June (Day 3)
9:00 am	Welcome 9:15 am - 9:30 am

	Wednesday, 15. June (Day 1)	Thursday, 16. June (Day 2)	Friday, 17. June (Day 3)
10:30 am	Coffee Break 10:30 am - 11:00 am
11:00 am			Coffee Break 11:00 am - 11:30 am
3:00 pm	Coffee Break 3:25 pm - 3:55 pm	Coffee Break 3:15 pm - 3:45 pm
3:30 pm

	Wednesday, 15. June (Day 1)	Thursday, 16. June (Day 2)	Friday, 17. June (Day 3)
11:00 am	Knowledge Graphs in Support of Human Machine Intelligence (#67) 11:00 am - 11:15 am Christophe Guéret

	Wednesday, 15. June (Day 1)	Thursday, 16. June (Day 2)	Friday, 17. June (Day 3)
11:00 am	Exemplars and Counterexemplars Explanations for Skin Lesion Classifiers (#82) 11:15 am - 11:30 am Carlo Metta, Riccardo Guidotti, Yuan Yin, Patrick Gallinari and Salvatore Rinzivillo

	Wednesday, 15. June (Day 1)	Thursday, 16. June (Day 2)	Friday, 17. June (Day 3)
11:30 am	Does Personalization Help? Predicting How Social Situations Affect Personal Values (#51) 11:30 am - 11:55 am Ilir Kola, Ralvi Isufaj and Catholijn M. Jonker

	Wednesday, 15. June (Day 1)	Thursday, 16. June (Day 2)	Friday, 17. June (Day 3)
12:00 pm	Open, multiple, adjunct. Decision support at the time of relational AI (#37) 12:10 pm - 12:25 pm Federico Cabitza and Chiara Natali

	Wednesday, 15. June (Day 1)	Thursday, 16. June (Day 2)	Friday, 17. June (Day 3)
2:30 pm	A Sequence-Based Dialog Management Framework for Enhancing Co-Regulated Dialog (#40) 2:30 pm - 2:55 pm Florian Kunneman and Koen Hindriks

	Wednesday, 15. June (Day 1)	Thursday, 16. June (Day 2)	Friday, 17. June (Day 3)
3:00 pm	Learning to Cooperate with Human Evaluative Feedback and Demonstrations (#19) 3:10 pm - 3:25 pm Mehul Verma and Erman Acar

	Wednesday, 15. June (Day 1)	Thursday, 16. June (Day 2)	Friday, 17. June (Day 3)
4:00 pm	Landmarks in Case-based Reasoning: From Theory to Data (#81) ** 4:00 pm - 4:25 pm Wijnand van Woerkom, Davide Grossi, Henry Prakken and Bart Verheij

	Wednesday, 15. June (Day 1)	Thursday, 16. June (Day 2)	Friday, 17. June (Day 3)
9:00 am		Capable but Amoral? Comparing AI and Human Expert Collaboration in Ethical Decision Making (#3) 9:00 am - 9:15 am Suzanne Tolmeijer, Markus Christen, Serhiy Kandul, Markus Kneer and Abraham Bernstein

	Wednesday, 15. June (Day 1)	Thursday, 16. June (Day 2)	Friday, 17. June (Day 3)
9:00 am		Neural Prototype Trees for Interpretable Fine-grained Image Recognition (#17) 9:15 am - 9:30 am Meike Nauta, Ron van Bree and Christin Seifert

	Wednesday, 15. June (Day 1)	Thursday, 16. June (Day 2)	Friday, 17. June (Day 3)
9:30 am		Privacy risk of global explanainers (#69) 9:30 am - 9:45 am Francesca Naretto, Anna Monreale and Fosca Giannotti

	Wednesday, 15. June (Day 1)	Thursday, 16. June (Day 2)	Friday, 17. June (Day 3)
10:00 am		Discovering the Rationale of Decisions (#12) 10:10 am - 10:25 am Cor Steging, Silja Renooij and Bart Verheij

	Wednesday, 15. June (Day 1)	Thursday, 16. June (Day 2)	Friday, 17. June (Day 3)
11:00 am		Estimating Rapport in Conversations: An Interpretable and Dyadic Multi-Modal Approach (#48) * 11:00 am - 11:25 am Gustav Grimberg, Thomas Janssoone, Chloé Clavel and Justine Cassell

	Wednesday, 15. June (Day 1)	Thursday, 16. June (Day 2)	Friday, 17. June (Day 3)
12:00 pm		An experiment in measuring understanding (#28) * 12:05 pm - 12:30 pm Luc Steels, Lara Verheyen and Remi van Trijp

	Wednesday, 15. June (Day 1)	Thursday, 16. June (Day 2)	Friday, 17. June (Day 3)
2:30 pm		Exosoul: ethical profiling in the digital world (#39) 2:30 pm - 2:55 pm Costanza Alfieri, Paola Inverardi, Patrizio Migliarini and Massimiliano Palmiero

	Wednesday, 15. June (Day 1)	Thursday, 16. June (Day 2)	Friday, 17. June (Day 3)
4:00 pm		Estimating Value Preferences in a Hybrid Participatory System (#31) ** 4:00 pm - 4:25 pm Luciano Cavalcante Siebert, Enrico Liscio, Pradeep Kumar Murukannaiah, Lionel Kaptein, Shannon Spruit, Jeroen Van den Hoven and Catholijn Jonker

	Wednesday, 15. June (Day 1)	Thursday, 16. June (Day 2)	Friday, 17. June (Day 3)
4:30 pm		Monitoring AI systems: A Problem Analysis, Framework and Outlook (#23) 4:40 pm - 4:55 pm Annet Onnes

	Wednesday, 15. June (Day 1)	Thursday, 16. June (Day 2)	Friday, 17. June (Day 3)
9:30 am			Community Meeting 9:30 am - 10:00 am

	Wednesday, 15. June (Day 1)	Thursday, 16. June (Day 2)	Friday, 17. June (Day 3)
11:30 am			A Song of (Dis)agreement: Evaluating the Evaluation of Explainable Artificial Intelligence in Natural Language Processing (#21) 11:30 am - 11:55 am Michael Neely, Stefan Schouten, Maurits Bleeker and Ana Lucic

	Wednesday, 15. June (Day 1)	Thursday, 16. June (Day 2)	Friday, 17. June (Day 3)
12:30 pm			Monitoring Fairness in HOLDA (#66) * 12:45 pm - 1:00 pm Michele Fontana, Francesca Naretto, Anna Monreale and Fosca Giannotti

	Wednesday, 15. June (Day 1)	Thursday, 16. June (Day 2)	Friday, 17. June (Day 3)
2:00 pm			Best-Response Bayesian Reinforcement Learning with Bayes-adaptive POMDPs for Centaurs (#78) 2:00 pm - 2:25 pm Mustafa Mert Çelikok, Frans Oliehoek and Samuel Kaski

	Wednesday, 15. June (Day 1)	Thursday, 16. June (Day 2)	Friday, 17. June (Day 3)
3:00 pm			Closing and Award Ceremony 3:05 pm - 3:20 pm

	Thursday, 16. June (Day 2)
8:00 am	Registration 8:00 am - 6:00 pm
8:30 am
9:00 am	Paper Presentations 9:00 am - 10:30 am Session #4 Capable but Amoral? Comparing AI and Human Expert Collaboration in Ethical Decision Making (#3) 9:00 am - 9:15 am Neural Prototype Trees for Interpretable Fine-grained Image Recognition (#17) 9:15 am - 9:30 am
9:30 am	Privacy risk of global explanainers (#69) 9:30 am - 9:45 am Abstracting Minds: Computational Theory of Mind for Human-Agent Collaboration (#70) ** 9:45 am - 10:10 am
10:00 am	Discovering the Rationale of Decisions (#12) 10:10 am - 10:25 am
10:30 am	Coffee Break 10:30 am - 11:00 am
11:00 am	Paper Presentations 11:00 am - 12:30 pm Session #5 Estimating Rapport in Conversations: An Interpretable and Dyadic Multi-Modal Approach (#48) * 11:00 am - 11:25 am Challenges of the adoption of AI in High Risk High consequence time compressed decision-making environments (#96) * 11:25 am - 11:50 am
11:30 am	How Can This Be Split Into Parts? Training Intelligent Tutors on User Simulators Using Reinforcement Learning (#46) 11:50 am - 12:05 pm
12:00 pm	An experiment in measuring understanding (#28) * 12:05 pm - 12:30 pm
12:30 pm	Lunch 12:30 pm - 1:30 pm
1:00 pm
1:30 pm	Keynote by Wendy Mackay 1:30 pm - 2:30 pm Despite incredible advances in hardware, much of today’s software remains stuck in assumptions that date back to the 1970s. As software becomes ever more ‘intelligent’, users often find themselves in a losing battle, unable to explain what they really want. Their role can easily shift from generating new content to correcting or putting up with the system’s errors. This is partly due to the assumptions from AI that treat human users primarily as a source of data for their algorithm—the so-called “human-in-the-loop”— while traditional Human-Computer Interaction practitioners focus on creating the “user experience” with simple icon and menu interfaces, without considering the details of the user’s interaction with an intelligent system. I argue that we need to develop methods for creating human-computer partnerships that take advantage of advances in machine learning, but also leave the user in control. I illustrate how we use generative theory, especially instrumental interaction and reciprocal co-adaptation, to create interactive intelligent systems that are discoverable, appropriable and expressive. Our goal is to design robust interactive systems that augment rather than replace human capabilities, and are actually worth learning over time.
2:00 pm
2:30 pm	Paper Presentations 2:30 pm - 3:30 pm Session #6 Exosoul: ethical profiling in the digital world (#39) 2:30 pm - 2:55 pm Effective Task Allocation in Ad Hoc Human-Agent Teams (#53) 2:55 pm - 3:20 pm
3:00 pm	Coffee Break 3:25 pm - 3:55 pm
3:30 pm
4:00 pm	Paper Presentations 4:00 pm - 5:00 pm Session #7 Estimating Value Preferences in a Hybrid Participatory System (#31) ** 4:00 pm - 4:25 pm Legitimacy of what?: a call for democratic AI design (#35) 4:25 pm - 4:40 pm
4:30 pm	Monitoring AI systems: A Problem Analysis, Framework and Outlook (#23) 4:40 pm - 4:55 pm
5:00 pm	Conference Dinner 5:00 pm - 10:00 pm Moving to location 17:00-18:00
5:30 pm
6:00 pm
6:30 pm
7:00 pm
7:30 pm
8:00 pm
8:30 pm
9:00 pm
9:30 pm

	Thursday, 16. June (Day 2)
8:00 am	Registration 8:00 am - 6:00 pm
8:30 am
9:00 am
9:30 am
10:00 am
10:30 am
11:00 am
11:30 am
12:00 pm
12:30 pm
1:00 pm
1:30 pm
2:00 pm
2:30 pm
3:00 pm
3:30 pm
4:00 pm
4:30 pm
5:00 pm
5:30 pm

	Thursday, 16. June (Day 2)
9:00 am	Paper Presentations 9:00 am - 10:30 am Session #4
9:30 am
10:00 am
11:00 am	Paper Presentations 11:00 am - 12:30 pm Session #5
11:30 am
12:00 pm
2:30 pm	Paper Presentations 2:30 pm - 3:30 pm Session #6
3:00 pm
4:00 pm	Paper Presentations 4:00 pm - 5:00 pm Session #7
4:30 pm

Thursday, 16. June (Day 2)

Registration
8:00 am - 6:00 pm
Paper Presentations
9:00 am - 10:30 am

Session #4
Capable but Amoral? Comparing AI and Human Expert Collaboration in Ethical Decision Making (#3)
9:00 am - 9:15 am
Neural Prototype Trees for Interpretable Fine-grained Image Recognition (#17)
9:15 am - 9:30 am
Privacy risk of global explanainers (#69)
9:30 am - 9:45 am
Abstracting Minds: Computational Theory of Mind for Human-Agent Collaboration (#70) **
9:45 am - 10:10 am
Discovering the Rationale of Decisions (#12)
10:10 am - 10:25 am
Coffee Break
10:30 am - 11:00 am
Paper Presentations
11:00 am - 12:30 pm

Session #5
Estimating Rapport in Conversations: An Interpretable and Dyadic Multi-Modal Approach (#48) *
11:00 am - 11:25 am
Challenges of the adoption of AI in High Risk High consequence time compressed decision-making environments (#96) *
11:25 am - 11:50 am
How Can This Be Split Into Parts? Training Intelligent Tutors on User Simulators Using Reinforcement Learning (#46)
11:50 am - 12:05 pm
An experiment in measuring understanding (#28) *
12:05 pm - 12:30 pm
Lunch
12:30 pm - 1:30 pm
Keynote by Wendy Mackay
1:30 pm - 2:30 pm

Despite incredible advances in hardware, much of today’s software remains stuck in assumptions that date back to the 1970s. As software becomes ever more ‘intelligent’, users often find themselves in a losing battle, unable to explain what they really want. Their role can easily shift from generating new content to correcting or putting up with the system’s errors. This is partly due to the assumptions from AI that treat human users primarily as a source of data for their algorithm—the so-called “human-in-the-loop”— while traditional Human-Computer Interaction practitioners focus on creating the “user experience” with simple icon and menu interfaces, without considering the details of the user’s interaction with an intelligent system. I argue that we need to develop methods for creating human-computer partnerships that take advantage of advances in machine learning, but also leave the user in control. I illustrate how we use generative theory, especially instrumental interaction and reciprocal co-adaptation, to create interactive intelligent systems that are discoverable, appropriable and expressive. Our goal is to design robust interactive systems that augment rather than replace human capabilities, and are actually worth learning over time.
Paper Presentations
2:30 pm - 3:30 pm

Session #6
Exosoul: ethical profiling in the digital world (#39)
2:30 pm - 2:55 pm
Effective Task Allocation in Ad Hoc Human-Agent Teams (#53)
2:55 pm - 3:20 pm
Coffee Break
3:25 pm - 3:55 pm
Paper Presentations
4:00 pm - 5:00 pm

Session #7
Estimating Value Preferences in a Hybrid Participatory System (#31) **
4:00 pm - 4:25 pm
Legitimacy of what?: a call for democratic AI design (#35)
4:25 pm - 4:40 pm
Monitoring AI systems: A Problem Analysis, Framework and Outlook (#23)
4:40 pm - 4:55 pm
Conference Dinner
5:00 pm - 10:00 pm

Moving to location 17:00-18:00