An AI-Generated Semantic Communication Platform in Human-Computer Interaction Course

Authors: Yi Yang, Jiasong Sun

Abstract:

Almost every aspect of our daily lives is now intertwined with some degree of Human-Computer Interaction (HCI). HCI courses draw on knowledge from disciplines as diverse as computer science, psychology, design principles, anthropology and more. The HCI courses in the Department of Electronics at Tsinghua University, known as the Media and Cognition course, is constantly updated to reflect the most advanced technological advances, such as virtual reality, augmented reality and artificial intelligence-based interaction. For more than a decade, this course has used an interest-based approach to teaching, in which students proactively propose some research-based questions and collaborate with teachers, using course knowledge to explore potential solutions. Semantic communication plays a key role in facilitating understanding and interaction between users and computer systems, ultimately enhancing system usability and user experience. The advancements in AI-generated technology, which has gained significant attention from both academia and industry in recent years, are exemplified by language models like GPT-3 that generate human-like dialogues from given prompts. The latest version of the HCI course practices a semantic communication platform based on AI-generated techniques. We explored a student-centered model and proposed an interest-based teaching method. Students are no longer just recipients of knowledge, but become active participants in the learning process driven by personal interests, thereby encouraging students to take responsibility for their own education. One of the latest results of this teaching approach in the course "Media and Cognition" is a student proposal to develop a semantic communication platform rooted in artificial intelligence generative technologies. The platform solves a key challenge in communications technology: the ability to preserve visual signals. The interest-based approach emphasizes personal curiosity and active participation, and the proposal of an artificial intelligence-generated semantic communication platform is an example and successful result of how students can exert greater creativity when they have the power to control their own learning.

Keywords: Human-computer interaction, media and cognition course, semantic communication, retain ability, prompts.

References:

[1] https://hci.stanford.edu/courses/
[2] https://cap.csail.mit.edu/professional-programs/human-computer- interaction-user-experience-design
[3] Reimer Y J, Douglas S A. Teaching HCI design with the studio approach (J). Computer science education, 2003, 13(3): 191-205.
[4] Day J A, Foley J D. Evaluating a web lecture intervention in a human– computer interaction courses (J). IEEE Transactions on education, 2006, 49(4): 420-431.
[5] Pastel R. Integrating science and research in a HCI design course (J). ACM SIGCSE Bulletin, 2005, 37(1): 31-35.
[6] de Souza Vieira A, Ribeiro Filho M, Neto C S S. Production and evaluation of an educational process for human–computer interaction (HCI) courses (J). IEEE Transactions on Education, 2020, 64(2): 172- 179.
[7] Wilcox L, DiSalvo B, Henneman D, et al. Design in the HCI classroom: Setting a research agenda (C). Proceedings of the 2019 on Designing Interactive Systems Conference. 2019: 871-883.
[8] Read J, Horton M. Respecting and Facilitating Children's Contributions to Research, Design and Evaluation in HCI: Course Submission (C). CHI Conference on Human Factors in Computing Systems Extended Abstracts. 2022: 1-3.
[9] Yi Y, Shengjin W, Jiasong S, et al. Interest-based learning for teaching a human-computer interaction course: media and cognition course (C). Proceedings of the International Conference on Frontiers in Education: Computer Science and Computer Engineering (FECS). The Steering Committee of the World Congress in Computer Science, Computer Engineering and Applied Computing (WorldComp), 2017: 62-67.
[10] Wu J, Gan W, Chen Z, et al. Ai-generated content (aigc): A survey (J). arXiv preprint arXiv:2304.06632, 2023.
[11] Bao J, Basu P, Dean M, et al. Towards a theory of semantic communication (C). 2011 IEEE Network Science Workshop. IEEE, 2011: 110-117.