Awesome Human-AI Interaction

Awesome HAI is a collection of academic materials related to the topic of Human-AI interaction.

• We include both research papers that discuss challenges and opportunities in interaction design with general AI from the Human-Computer Interaction (HCI) perspective and that specifically discuss how advances in Deep Learning can address interactive challenges from the AI perspective. We also include Human-AI Interaction courses from universities worldwide.
• The collection is maintained by a community of volunteered students, make a pull request if you want to contribute :)

Table of Contents

• Research Papers
• Courses

Research Papers

ACM Conference on Human Factors in Computing Systems (CHI)

Year	Paper
2020	Co-Designing Checklists to Understand Organizational Challenges and Opportunities around Fairness in AI
2020	Re-examining Whether, Why, and How Human-AI Interaction Is Uniquely Difficult to Design
2020	What is AI Literacy? Competencies and Design Considerations
2020	Questioning the AI: Informing Design Practices for Explainable AI User Experiences
2020	Mental Models of AI Agents in a Cooperative Game Setting
2020	Reinforcement Learning for the Adaptive Scheduling of Educational Activities
2020	Predicting Mid-Air Interaction Movements and Fatigue Using Deep Reinforcement Learning
2020	Enemy Within: Long-term Motivation Effects of Deep Player Behavior Models for Dynamic Difficulty Adjustment
2020	OralCam: Enabling Self-Examination and Awareness of Oral Health Using a Smartphone Camera
2020	A Human-Centered Evaluation of a Deep Learning System Deployed in Clinics for the Detection of Diabetic Retinopathy
2020	Modeling Human Visual Search Performance on Realistic Webpages Using Analytical and Deep Learning Methods
2020	EarBuddy: Enabling On-Face Interaction via Wireless Earbuds
2020	"Why is 'Chicago' deceptive?" Towards Building Model-Driven Tutorials for Humans
2020	Novice-AI Music Co-Creation via AI-Steering Tools for Deep Generative Models
2020	EmoG: Supporting the Sketching of Emotional Expressions for Storyboarding
2020	Affective State Prediction Based on Semi-Supervised Learning from Smartphone Touch Data
2020	Automated Class Discovery and One-Shot Interactions for Acoustic Activity Recognition
2020	Optimizing User Interface Layouts via Gradient Descent
2020	AL: An Adaptive Learning Support System for Argumentation Skills
2020	Studying the Effects of Cognitive Biases in Evaluation of Conversational Agents
2019	Guidelines for Human-AI Interaction
2019	Caring for Vincent: A Chatbot for Self-compassion
2019	Unremarkable AI: Fitting Intelligent Decision Support into Critical, Clinical Decision-Making Processes
2019	What Makes a Good Conversation? Challenges in Designing Truly Conversational Agents
2019	Metaphoria: An Algorithmic Companion for Metaphor Creation
2019	Implicit Communication of Actionable Information in Human-AI teams
2019	AI-Mediated Communication: How the Perception that Profile Text was Written by AI Affects Trustworthiness
2019	Designing Theory-Driven User-Centric Explainable AI
2019	Will You Accept an Imperfect AI? Exploring Designs for Adjusting End-user Expectations of AI Systems
2019	ATMSeer: Increasing Transparency and Controllability in Automated Machine Learning
2019	Resilient Chatbots: Repair Strategy Preferences for Conversational Breakdowns
2019	In a Silent Way: Communication Between AI and Improvising Musicians Beyond Sound
2019	Beyond Dyadic Interactions: Considering Chatbots as Community Members
2019	An Exploration of Speech-Based Productivity Support in the Car
2019	Exploring Factors that Influence Connected Drivers to (Not) Use or Follow Recommended Optimal Routes
2019	SmartEye: Assisting Instant Photo Taking via Integrating User Preference with Deep View Proposal Network
2019	Hands Holding Clues for Object Recognition in Teachable Machines
2019	QuizBot: A Dialogue-based Adaptive Learning System for Factual Knowledge
2019	Gamut: A Design Probe to Understand How Data Scientists Understand Machine Learning Models
2019	Automation Accuracy Is Good, but High Controllability May Be Better
2018	All Work and No Play? Conversations with a Question-and-Answer Chatbot in the Wild
2018	Cognitive Load Estimation in the Wild
2018	Emotional Dialogue Generation using Image-Grounded Language Models
2018	DeepWriting: Making Digital Ink Editable via Deep Generative Modeling
2018	Evorus: A Crowd-powered Conversational Assistant Built to Automate Itself Over Time
2018	RecipeScape: An Interactive Tool for Analyzing Cooking Instructions at Scale
2018	ExtVision: Augmentation of Visual Experiences with Generation of Context Images for a Peripheral Vision Using Deep Neural Network
2018	HindSight: Enhancing Spatial Awareness by Sonifying Detected Objects in Real-Time 360-Degree Video
2018	Deep Thermal Imaging: Proximate Material Type Recognition in the Wild through Deep Learning of Spatial Surface Temperature Patterns
2018	Predicting Human Performance in Vertical Menu Selection Using Deep Learning
2018	Trends and Trajectories for Explainable, Accountable and Intelligible Systems: An HCI Research Agenda
2018	Touch Your Heart: A Tone-aware Chatbot for Customer Care on Social Media
2018	Mapping Machine Learning Advances from HCI Research to Reveal Starting Places for Design Innovation
2018	Analysis and Modeling of Grid Performance on Touchscreen Mobile Devices
2018	“Trust Us”: Mobile Phone Use Patterns Can Predict Individual Trust Propensity
2018	Norms Matter: Contrasting Social Support Around Behavior Change in Online Weight Loss Communities
2017	UX Design Innovation: Challenges for Working with Machine Learning as a Design Material
2017	A New Chatbot for Customer Service on Social Media
2017	Multimodal Classification of Moderated Online Pro-Eating Disorder Content
2017	People with Visual Impairment Training Personal Object Recognizers: Feasibility and Challenges
2016	Augur: Mining Human Behaviors from Fiction to Power Interactive Systems
2016	“Like Having a Really bad PA”: The Gulf between User Expectation and Experience of Conversational Agents

ACM User Interface and Software Technology Symposium (UIST)

Year	Paper
2020	Decoding Surface Touch Typing from Hand-Tracking
2020	MonoEye: Multimodal Human Motion Capture System Using A Single Ultra-Wide Fisheye Camera
2020	DeepFisheye: Near-Surface Multi-Finger Tracking Technology Using Fisheye Camera
2020	Rescribe: Authoring and Automatically Editing Audio Descriptions
2020	C-Face: Continuously Reconstructing Facial Expressions by Deep Learning Contours of the Face with Ear-mounted Miniature Cameras
2020	Interactive Exploration and Refinement of Facial Expression using Manifold Learning
2020	Brain Relevance Feedback for Interactive Image Generation
2020	Predicting Visual Importance Across Graphic Design Types
2020	Back-Hand-Pose: 3D Hand Pose Estimation for a Wrist-worn Camera via Dorsum Deformation Network
2020	Skyline: Interactive In-Editor Computational Performance Profiling for Deep Neural Network Training
2019	Mallard: Turn the Web into a Contextualized Prototyping nvironment for Machine Learning
2019	Type, Then Correct: Intelligent Text Correction Techniques for Mobile Text Entry Using Neural Networks
2019	Learning Cooperative Personalized Policies from Gaze Data
2018	Ubicoustics: Plug-and-Play Acoustic Activity Recognition
2018	Lip-Interact: Improving Mobile Device Interaction with Silent Speech Commands
2018	The Exploratory Labeling Assistant: Mixed-Initiative Label Curation with Large Document Collections
2018	Adasa: A Conversational In-Vehicle Digital Assistant for Advanced Driver Assistance Features
2017	Everyday Eye Contact Detection Using Unsupervised Gaze Target Discovery
2017	Learning Visual Importance for Graphic Designs and Data Visualizations
2017	Rico: A Mobile App Dataset for Building Data-Driven Design Applications
2016	Interacting with Soli: Exploring Fine-Grained Dynamic Gesture Recognition in the Radio-Frequency Spectrum

ACM Annual Meeting of the Intelligent User Interfaces Community (IUI)

Year	Paper
2019	When People and Algorithms Meet: Assessing User-reported Problems to Inform Support in Intelligent Everyday Applications
2019	What AI can do for me: Evaluating Machine Learning Interpretations in Cooperative Play
2019	SearchLens: Composing and Capturing Complex User Interests for Exploratory Search
2019	Proactive Information Retrieval by Capturing Search Intent from Primary Task Context
2019	A Review of User Interface Design for Interactive Machine Learning
2019	BigBlueBot: Teaching Strategies for Successful Human-Agent Interactions
2019	The Effect of Explanations and Algorithmic Accuracy on Visual Recommender Systems of Artistic Images
2019	To Explain or not to Explain: the Effects of Personal Characteristics when Explaining Music Recommendations
2018	AlterEgo: A Personalized Wearable Silent Speech Interface
2018	Creative Writing with a Machine in the Loop: Case Studies on Slogans and Stories
2018	Detecting Memory-Based Interaction Obstacles with a Recurrent Neural Model of User Behavior
2018	User Modelling for Avoiding Overfitting in Interactive Knowledge Elicitation for Prediction
2018	Every Little Movement Has a Meaning of Its Own: Using Past Mouse Movements to Predict the Next Interaction
2018	An Active Tangible User Interface Framework for Teaching and Learning Artificial Intelligence

ACM Conference on Computer-Supported Cooperative Work and Social Computing (CSCW)

Year	Paper
2018	Fact or Fiction
2018	Data-Driven Proactive Policy Assurance of Post Quality in Community q&a Sites
2018	By the Community & For the Community: A Deep Learning Approach to Assist Collaborative Editing in Q&A Sites

ACM Interactive, Mobile, Wearable and Ubiquitous Technologies (IMWUT/UbiComp)

Year	Paper
2019	TurnsMap: Enhancing Driving Safety at Intersections with Mobile Crowdsensing and Deep Learning
2019	AdaRF: Adaptive RFID-based Indoor Localization Using Deep Learning Enhanced Holography
2019	Deep Multi-Task Learning Based Urban Air Quality Index Modelling
2018	What Will You Do for the Rest of the Day? An Approach to Continuous Trajectory Prediction
2018	GymCam: Detecting, Recognizing and Tracking Simultaneous Exercises in Unconstrained Scenes
2018	Crowd-AI Camera Sensing in the Real World
2018	DeepType: On-Device Deep Learning for Input Personalization Service with Minimal Privacy Concern
2018	Performance Characterization of Deep Learning Models for Breathing-based Authentication on Resource-Constrained Devices
2018	Online Deep Ensemble Learning for Predicting Citywide Human Mobility
2018	Deep Room Recognition Using Inaudible Echos
2018	SenseGAN: Enabling Deep Learning for Internet of Things with a Semi-Supervised Framework
2018	DeActive: Scaling Activity Recognition with Active Deep Learning
2018	Deep ROI-Based Modeling for Urban Human Mobility Prediction
2017	Multimodal Deep Learning for Activity and Context Recognition
2017	RDeepSense: Reliable Deep Mobile Computing Models with Uncertainty Estimations
2017	Mitigating Bystander Privacy Concerns in Egocentric Activity Recognition with Deep Learning and Intentional Image Degradation
2017	Low-resource Multi-task Audio Sensing for Mobile and Embedded Devices via Shared Deep Neural Network Representations
2017	Ensembles of Deep LSTM Learners for Activity Recognition using Wearables
2016	A weakly supervised activity recognition framework for real-time synthetic biology laboratory assistance
2016	SpotGarbage: smartphone app to detect garbage using deep learning

ACM International Symposium on Wearable Computers (ISWC)

Year	Paper
2018	Understanding and improving recurrent networks for human activity recognition by continuous attention
2018	On attention models for human activity recognition
2018	Deepauth: in-situ authentication for smartwatches via deeply learned behavioural biometrics
2017	CNN-based sensor fusion techniques for multimodal human activity recognition
2016	Deep convolutional feature transfer across mobile activity recognition domains, sensor modalities and locations

IEEE Transactions on Visualization and Computer Graphics (Proceedings of IEEE InfoVis, VAST, SciVis)

Year	Paper
2020	CNN Explainer: Learning Convolutional Neural Networks with Interactive Visualization
2020	explAIner: A Visual Analytics Framework for Interactive and Explainable Machine Learning
2019	DeepVID: Deep Visual Interpretation and Diagnosis for Image Classifiers via Knowledge Distillation
2019	SANVis: Visual Analytics for Understanding Self-Attention Networks
2019	Seq2seq-Vis: A Visual Debugging Tool for Sequence-to-Sequence Models
2019	Evaluating 'Graphical Perception' with CNNs
2019	InkPlanner: Supporting Prewriting via Intelligent Visual Diagramming
2019	Summit: Scaling Deep Learning Interpretability by Visualizing Activation and Attribution Summarizations
2018	DQNViz: A Visual Analytics Approach to Understand Deep Q-Networks
2018	Visual Analytics in Deep Learning: An Interrogative Survey for the Next Frontiers
2018	LSTMVis: A Tool for Visual Analysis of Hidden State Dynamics in Recurrent Neural Networks
2018	GAN Lab: Understanding Complex Deep Generative Models using Interactive Visual Experimentation
2017	ActiVis: Visual Exploration of Industry-Scale Deep Neural Network Models

Computer Graphics Forum (Proceedings of EuroVis and EuroGraphics)

Year	Paper
2020	Peax: Interactive Visual Pattern Search in Sequential Data Using Unsupervised Deep Representation Learning
2020	DRLViz: Understanding Decisions and Memory in Deep Reinforcement Learning

Fairness, Accountability, and Transparency in Machine Learning (FAT/ML)

Year	Paper
2018	Achieving Fairness through Adversarial Learning: an Application toRecidivism Prediction

Association for the Advancement of Artificial Intelligence (AAAI)

Year	Paper
2019	Updates in Human-AI Teams: Understanding and Addressing the Performance/Compatibility Tradeoff
2019	Zero Shot Learning for Code Education:Rubric Sampling with Deep Learning Inference

Neural Information Processing Systems (NeurIPS)

Year	Paper
2019	On the Utility of Learning about Humans for Human-AI Coordination
2015	Deep Knowledge Tracing

International Conference on Machine Learning (ICML)

Year	Paper
2015	Learning Program Embeddings to Propagate Feedback

Educational Data Mining (EDM)

Year	Paper
2015	Tuning Peer Grading

Proceedings of the National Academy of Sciences (PNAS)

Year	Paper
2019	Agency plus automation: Designing artificial intelligence into interactive systems
2019	Scaling up analogical innovation with crowds and AI
2019	Citizen science frontiers: Efficiency, engagement, and serendipitous discovery with human–machine systems

Communications of the ACM (CACM)

Year	Paper
2018	The Challenge of Crafting Intelligible Intelligence

Distill

Year	Paper
2019	AI Safety Needs Social Scientists
2017	Using Artificial Intelligence to Augment Human Intelligence

arXiv

Year	Paper
2020	GNNVis: A Visual Analytics Approach for Prediction Error Diagnosis of Graph Neural Networks
2017	Machine Teaching: A New Paradigm for Building Machine Learning Systems

Courses

There are also some awesome course resources discussing Intelligent User Interface/ Human-AI interaction

School	Course	Lecturer
Carnegie Mellon University	Human-AI Interaction	Jeff Bigham and Joseph Seering
Carnegie Mellon University	Software Engineering for AI-Enabled Systems (SE4AI)	Christian Kaestner
Aalto University	Intelligent User Interfaces Studio	Kashyap Todi and Sunjun Kim
Penn State University	Crowdsourcing & Crowd-AI Systems	Kenneth Huang
University of Colorado Boulder	Human-centered Machine Learning	Chenhao Tan
Stanford University	Designing AI to Cultivate Human Well-Being	Jennifer Aaker and Fei-Fei Li
Georgia Tech	Data and Visual Analytics
Columbia University	Intelligent Decision Support: History, Paradigms, Applications	Lena Mamykina

Curators

The repo is jointly contributed by researchers from different institutions, please refer to the contributor page.

License