ABCDEFGHIJKLMNOPQRSTUVWXY
1
DateTopicReadingPresenter
2
21-AugIntroduction and Course OverviewLicklider, Joseph CR. "Man-computer symbiosis." IRE transactions on human factors in electronics 1 (1960): 4-11. (read in class) DO NOT SIGN UP
3
Shyam Sankar. The Rise of Human Computer Cooperation. TED Talk Video, 2012 (12 mins).
4
23-AugPrimer on AILubars, Brian, and Chenhao Tan. "Ask not what AI can do, but what AI should do: Towards a framework of task delegability." In Advances in Neural Information Processing Systems, pp. 57-67. 2019.
5
Xu, Anbang, Zhe Liu, Yufan Guo, Vibha Sinha, and Rama Akkiraju. "A new chatbot for customer service on social media." In Proceedings of the 2017 CHI Conference on Human Factors in Computing Systems, pp. 3506-3510. 2017.
6
Nityesh Agarwal. "Getting started with reading Deep Learning Research papers: The Why and the How", a blog post at Towards Data Science (2018).
7
28-AugLLM OverviewShanahan, M. (2022). Talking about large language models. arXiv preprint arXiv:2212.03551.
Optional: Zhao, W. X., Zhou, K., Li, J., Tang, T., Wang, X., Hou, Y., ... & Wen, J. R. (2023). A survey of large language models. arXiv preprint arXiv:2303.18223.
8
1. Can Computers Learn Common Sense?, The New Yorker, 2022 (optional)The Race to Make A.I. Smaller (and Smarter)
2. A mental health tech company ran an AI experiment on real users. Nothing’s stopping apps from conducting more.
9
30-AugPrimer on HCI Amershi, Saleema, et al. "Guidelines for human-AI interaction." Proceedings of the 2019 chi conference on human factors in computing systems. 2019.
10
Yang et al., Re-examining Whether, Why, and How Human-AI Interaction Is Uniquely Difficult to Design (CHI 2020)
11
Shneiderman, B., "Human-Centered Artificial Intelligence: Reliable, Safe & Trustworthy." International Journal of Human-Computer Interaction 36, 6, 495-504. 2020.
12
4-SepLabor Day No Classes
13
14
6-SepLLM Tutorial - 1 (come to class with laptop)
15
11-SepPrompting - 1Zamfirescu-Pereira, J. D., Wong, R. Y., Hartmann, B., & Yang, Q. (2023, April). Why Johnny can’t prompt: how non-AI experts try (and fail) to design LLM prompts. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (pp. 1-21).Zihao Lin + Sophia Stil
16
AI Chains: Transparent and Controllable Human-AI Interaction by Chaining Large Language Model Prompts, Tongshuang Wu, Michael Terry, Carrie J Cai - CHI 2022Lance Wilhelm
17
Skim: Liu, P., Yuan, W., Fu, J., Jiang, Z., Hayashi, H., & Neubig, G. (2023). Pre-train, prompt, and predict: A systematic survey of prompting methods in natural language processing. ACM Computing Surveys, 55(9), 1-35.Hossein Naderi
18
13-SepPrompting - 2PromptChainer: Chaining Large Language Model Prompts through Visual Programming, Tongshuang Wu, Ellen Jiang, Aaron Donsbach, Jeff Gray, Alejandra Molina, Michael Terry, Carrie J Cai - CHI 2022Kaike Ping
19
Wei, Jason, et al. "Chain-of-thought prompting elicits reasoning in large language models." Advances in Neural Information Processing Systems 35 (2022): 24824-24837.Yeana Bond
20
18-SepLLM Tutorial - 2 (come to class with laptop)
21
20-SepFairness, Accountability, Transparency & Ethics in LLMs - 1Prabhakaran, Vinodkumar, Ben Hutchinson, and Margaret Mitchell. "Perturbation sensitivity analysis to detect unintended model biases." arXiv preprint arXiv:1910.04210 (2019).Haritha Gnanasegar
22
Goyal, Nitesh, et al. "Is Your Toxicity My Toxicity? Exploring the Impact of Rater Identity on Toxicity Annotation." Proceedings of the ACM on Human-Computer Interaction 6.CSCW2 (2022): 1-28.Srujan Vithalani
23
Clark, Elizabeth, et al. "All that's' human'is not gold: Evaluating human evaluation of generated text." arXiv preprint arXiv:2107.00061 (2021).Daniel Palamarchuk
24
25-SepFairness, Accountability, Transparency & Ethics in LLMs - 2Jakesch, M., Bhat, A., Buschek, D., Zalmanson, L., & Naaman, M. (2023, April). Co-writing with opinionated language models affects users’ views. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (pp. 1-15).Steven DeVerteuil
25
Wenzel, K., Devireddy, N., Davison, C., & Kaufman, G. (2023, April). Can Voice Assistants Be Microaggressors? Cross-Race Psychological Responses to Failures of Automatic Speech Recognition. In Proceedings of the 2023 CHI Conference on Human Factors in ComLemara Williams
26
27-SepFairness, Accountability, Transparency & Ethics in LLMs - 3“Because AI is 100% right and safe”: User Vulnerabilities and Sources of AI Authority in India, Shivani Kapania, Oliver Siy, Gabe Clapper, Azhagu SP, Nithya Sambasivan - CHI 2022
27
Mendelsohn, J., Bras, R. L., Choi, Y., & Sap, M. (2023). From Dogwhistles to Bullhorns: Unveiling Coded Rhetoric with Language Models. arXiv preprint arXiv:2305.17174.Balu
28
2-OctProject Pitch Presentations
29
4-OctProject Pitch Presentations
30
9-OctColumbus Day
31
11-OctLLM-Supported Health CareJo, E., Epstein, D. A., Jung, H., & Kim, Y. H. (2023, April). Understanding the benefits and challenges of deploying conversational AI leveraging large language models for public health intervention. (CHI 2023)Xiaozheng
32
Chen, S., Wu, M., Zhu, K. Q., Lan, K., Zhang, Z., & Cui, L. (2023). LLM-empowered Chatbots for Psychiatrist and Patient Simulation: Application and Evaluation. arXiv preprint arXiv:2305.13614.Ashish
33
October 16 - 18Instuctor is out of town for CSCW
34
23-OctTutorial: Web Application Hosting for LLM-Powered Tools (come to class with laptop)
35
25-OctLLM Accesibility and NeurodiversityValencia, S., Cave, R., Kallarackal, K., Seaver, K., Terry, M., & Kane, S. K. (2023, April). “The less I type, the better”: How AI Language Models can Enhance or Impede Communication for AAC Users. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (pp. 1-14).Andrew Fang
36
For Some Autistic People, ChatGPT Is a Lifeline, WIRED, 2023Stanley Gabriel + Malik
37
Elshentenawy, M., Ahmed, M., Elalfy, M., Bakr, A., Heidar, M., & Amer, E. (2023, July). Intellibot: A Personalized Behavioral Analysis Chatbot Framework Powered by GPT-3. In 2023 Intelligent Methods, Systems, and Applications (IMSA) (pp. 136-141). IEEE.
38
30-OctLLM-Supported Work: WritingCoAuthor: Designing a Human-AI Collaborative Writing Dataset for Exploring Language Model Capabilities Mina Lee, Percy Liang, Qian Yang CHI 2022Siddharth Chintamaneni
39
Tale Brush: Sketching Stories with Generative Pretrained Language Models, John Joon Young Chung, Wooseok Kim, Kang Min Yoo, Hwaran Lee, Eytan Adar, Minsuk Chang CHI2022Taufiq Daryanto
40
1-NovLLM-Supported Work: ResearchHämäläinen, P., Tavast, M., & Kunnari, A. (2023, April). Evaluating large language models in generating synthetic hci research data: a case study. In Proceedings of the 2023 CHI Conference on Human Factors in Computing Systems (pp. 1-19).Nicholas Kong
41
Park, Joon Sung, et al. "Social Simulacra: Creating Populated Prototypes for Social Computing Systems." Proceedings of the 35th Annual ACM Symposium on User Interface Software and Technology. 2022.Kaiyi Chen
42
6-NovPrototype + Midterm Presentation
43
8-NovPrototype + Midterm Presentation
44
13-NovMultimodality Zhao, L., Yu, E., Ge, Z., Yang, J., Wei, H., Zhou, H., ... & Zhang, X. (2023). ChatSpot: Bootstrapping Multimodal LLMs via Precise Referring Instruction Tuning. arXiv preprint arXiv:2307.09474. (Demo: https://chatspot.streamlit.app/)Nikhil Narra
45
Chameleon: Plug-and-Play Compositional Reasoning with Large Language Models (demo: https://www.youtube.com/watch?v=EWFixIk4vjs&t=2s)Luis Lazcano
46
15-NovText to Visual/ AudioLyu, C., Wu, M., Wang, L., Huang, X., Liu, B., Du, Z., ... & Tu, Z. (2023). Macaw-LLM: Multi-Modal Language Modeling with Image, Audio, Video, and Text Integration. arXiv preprint arXiv:2306.09093.Ragul S
47
Make-An-Audio: Text-To-Audio Generation with Prompt-Enhanced Diffusion Models; Demo: HuggingFace Suno Bark Application or Demo of ChoicePremith Kumar Chilukuri
48
November 19 - 23Thanksgiving Break
49
27-NovCreative ApplicationsFaceChat: An Emotion-Aware Face-to-face Dialogue FrameworkTong Zeng
50
Park, J. S., O'Brien, J. C., Cai, C. J., Morris, M. R., Liang, P., & Bernstein, M. S. (2023). Generative agents: Interactive simulacra of human behavior. arXiv preprint arXiv:2304.03442.Adnan Abbas
51
29-NovNo Class, Work on Final Project
52
4-DecFinal Presentation
53
6-DecFinal Presentation