Skip to content. | Skip to navigation

Citation and Metadata
Document Actions
Full Text

1 Introduction

COVID-19 and the resulting increased pace of digitalization have changed teaching in higher and further education (Grogorick & Robra-Bissantz, 2021; Luebcke et al., 2022). Therefore, teaching via digital media has gained more frequent application and focus, in practice, research and politics (Atif et al., 2021; Prattico et al., 2022). Another influencing factor is technological progress in the field of artificial intelligence that led to the development of conversational agents, which have a wide range of applications (Allouch et al., 2021; Feidakis et al., 2019; Perez et al., 2020). One area of application is education. These so-called pedagogical conversational agents (PCAs) offer personalized support adapted to the learner’s individual needs and reduce the teachers’ workload or help cope with increasing numbers of students (Hobert & von Wolff, 2019; Schlimbach et al., 2022). Individually supporting a learner with a PCA enhances the learning process and success (Schlimbach et al., 2022). Even friendship-like relationships with the PCA have become possible (Strohmann, 2021). To additionally promote learning progress online, a learning environment that is perceived as pleasant for the user is recommended (Khosrawi-Rad et al., 2022). Virtual worlds (VWs) could support creating that pleasant atmosphere due to their spatial and social presence (Lecon & Koot, 2015; Riva et al., 2007). There are studies underpinning that VWs also improve the learning process and success (Girvan, 2018). Combining both technologies promises scalability and individualization at the same time. Therefore, the combination is a promising field for theoretical and practical implementation in the context of the current development of the Digital Networked Infrastructure for Education. This educational infrastructure is meant to support life-long learning for all target groups, academic and non-academic. The infrastructure it is not meant to be another learning environment but rather it is designed to connect current and future educational platforms like virtual worlds and related technologies to perform steps toward the vision of the metaverse.

There are literature reviews on PCAs in education (e.g., Khosrawi-Rad et al., 2022; Schlimbach et al., 2022) and VWs in education (e.g., Clutterbuck et al., 2015; Dalgarno & Lee, 2010) but to our knowledge, there is no literature review with a combined view. Since this combination raises new questions, e.g., in terms of technical compatibility or the visual design of the PCA, an isolated view of both technologies is not sufficient.

This paper aims to determine the current state of research on the design of PCAs in VWs and to identify research gaps relevant in the context of the Digital Networked Infrastructure for Education. Thereby we focus on design areas that become relevant when combining PCAs and VWs. We aim to identify relevant design knowledge and its applicability so we can conclude on design knowledge research gaps. For this purpose, we use the methodology of a systematic literature review (SLR) as proposed by Webster & Watson (2002).

2 Related Work

The definition of VW and related terms is ambiguous (Girvan, 2018). “Virtual worlds are persistent online computer-generated environments where multiple users in remote physical locations can interact in real time for the purposes of work or play” (Dionisio et al., 2013, p. 1). The definition of Pannicke & Zarnekow (2009) is more generic and does not include the aspect of persistency nor the application for playing. It defines VWs as 3D environments that can be entered using avatars to navigate and communicate with. Both definitions stress the synchronicity and the multi-user capability in a virtual environment that can be entered. We regard these aspects as the core elements of the definition and ground our work on it. Following Dionisio et al. (2013), VWs can be regarded as a subset or predecessor of the metaverse, which has, besides other factors, gained importance through the renaming of “Facebook” to “Meta” and the corresponding efforts (Zhang et al., 2022). Bringing the metaverse idea of the convergence of the virtual and real world to practice, additional technologies like artificial intelligence (AI), haptic communication, and motion capturing are necessary (Zhang et al., 2022). Social presence, one of the key features of VWs (e.g., Edirisingha et al., 2009), is defined as “the degree of salience of the other person in the interaction and the consequent salience of the interpersonal relationships” (Short et al., 1976, p. 65). Thus, it supports the social aspect of learning due to the multi-user attendance (Stahl, 2004). VWs can also be used for simulations, e.g., the operation and maintenance of technical systems like airplanes or automobiles (e.g., Pletz & Zinn, 2020). Another application example is behavioral training in critical situations (e.g., the detonation of a nuclear reactor) without any real risks (Méndez et al., 2004). Despite the positive aspects and the high potential for the educational context, for a productive operation, the aspect of data protection has to be considered (Pirner, 2018).

In the last decade, conversational agents evolved significantly due to technological advances (Brown et al., 2020; Russell & Norvig, 2016). A conversational agent is software that communicates with the user either text-based or speech-based (Gnewuch et al., 2017; McTear et al., 2016). In educational contexts, there is also the more specific term pedagogical (conversational) agent (PCA). PCAs can be used to support and improve the learning process in VWs. They can provide scalable individual support, e.g., for organizational or content-specific questions and problems (Khosrawi-Rad et al., 2022). Learners often differ in their characteristics, cognitive performance, knowledge level, and motivation (Hobert & von Wolff, 2019; Schlimbach et al., 2022). A person-centered focus of a PCA can lead to an increased learning outcome (Khosrawi-Rad et al., 2022).

Ethics in the context of AI, and in particular the protection of the privacy of users of PCAs, has attracted increasing interest in recent years. This is particularly the case in Europe, where the introduction of the General Data Protection Regulation (GDPR) has led to the regulation of privacy in technology-based systems and services. The GDPR represents a milestone in terms of personal data protection and thus helps to raise awareness and promote ethical considerations in the context of AI. Four main aspects have to be considered in terms of GDPR: lawful basis & transparency, data security, accountability & governance, and privacy rights (European Union, 2020). It is necessary to note that ethical and privacy challenges have relevance concerning the use of PCAs. This is because sensitive information is often stored in this context or vulnerable groups, such as in the health and education sectors, are affected (Følstad et al., 2021). E.g., quizzes can lead to sensitive information about the users’ skill level. Adding personality to the PCA can lead to friendship-like relationships where users are more likely to share personal information (Strohmann, 2021). Furthermore, when PCAs ask sensitive questions, users are likely to share confidential information, leading to an increased risk of data breaches (Belen-Saglam et al., 2022; Ho et al., 2018).

3 Methodology

To reach our research aim we conduct an SLR following Webster & Watson (2002) and Page et al. (2021). We searched the databases Scopus, AIS eLibrary, ACM Digital Library, IEEE Xplore, ERIC, and Taylor & Francis. These cover the relevant subject areas of economics, information systems, pedagogy, and education. This selection is also supported by literature (Levy & Ellis, 2006). We included journal articles, conference papers, and book chapters. The search was conducted in December 2022. The search term was developed iteratively and exploratively. It consists of synonyms for PCA, VW, and learning. These synonyms are linked with an OR operator, the three different aspects with an AND operator. The search term was targeted at title, abstract, and, if applicable, keywords. The final search term we used was:

(“conversational agent” OR “collaborative agent” OR “virtual assistant” OR “virtual companion” OR “interactive agent” OR “pedagogical agent” OR “pedagogical conversational agent”) AND (“virtual world” OR “digital world” OR “online world” OR “virtual environment” OR “digital environment” OR “learning environment” OR “metaverse” OR “visualization”) AND (“learning” OR “education” OR “e-learning” OR “instruction” OR “immersive learning” OR “intelligent tutoring systems”)

We defined inclusion and exclusion criteria for the title, abstract and full-text screening. We included English-language results only and there had to be a reference to PCAs, virtual worlds, and learning in higher or further education. Articles related to minors as well as duplicates were excluded. We also excluded learners with special needs since we targeted for generalizable results. Other SLRs found were searched for research areas but not included in the analysis itself.

The search resulted in 668 articles in total with 66 duplicates being removed in the first step. Title and abstract screening resulted in 105 contributions, and the full-text screening in 45 articles meeting the predefined criteria. The following figure reveals the screening process in the form of a PRISMA statement as proposed by Page et al. (2021). The numbers behind the database designations represent the respective number of hits.

Figure 1: PRISMA Statement

For the detailed analysis of the contributions, a coding system was set up using Microsoft Excel software. The creation of the coding guide is based on Mayring (2015) and is two-stage. First, six main categories were derived iteratively and exploratory from the abstracts in the context of the Digital Networked Infrastructure for Education In the second step, these main areas were commonly defined in the team. The sub-categories were added exploratively during the full-text coding and iteratively added and defined in the code book. The analysis was performed from mid-December 2022 to early January 2023. Subsequently the results were abstracted.

4 Results

The increasing number of publications per year is revealed in the following figure. The trend line shows a rise in publications per year since 1998 when the topic first came up. We conclude that the topic has gained relevance up until today.

Figure 2: Analyzed Publications per year

The first article included in our analysis was published in 1998 (Rickel & Johnson, 1998). Many articles published in the following years refer to the PCA named Steve described there. This is one of the first human-like PCAs to live with students in a learning environment. It assists the learner in performing physical procedural tasks and can be classified as a tutor. Other contributions consider Steve as a template for their PCA development (Marin et al., 2004) and are guided by its architecture as well as its capabilities (Barange et al., 2017).

Furthermore, we exploratively identified the following categories following our research target:

(1) PCA embodiment and character: When a PCA is integrated into a VW the question arises of how its avatar should look like, move, and behave. Therefore, the analysis of the visual appearance and behavior aims at identifying different design aspects of PCAs in VWs. We identify and report the influence on the learner and the learning outcome.

(2) PCA adaptation and role: We target at identifying the link between emotional adaptation and the PCA’s role as well as different options for implementation. This is of interest for the research question, since PCAs in VWs offer additional design options when adapting to the user, e.g., in terms of mimics. We identify different aspects, detecting the learners’ emotions and the PCA reacting emotionally consistently.

(3) Application of gamification: Gamification refers to the application of game mechanics in non-game contexts to encourage positive behavior like learning (Zichermann & Cunningham, 2011). The use of games in education promotes interactivity, and engagement, and increases motivation (Manesh & Schaefer, 2010). VWs are often perceived as game-like environments (e.g., Gao et al., 2021) and PCAs can add gamification elements (Vijayakumar et al., 2019). Therefore, we examine the use of gamification of PCAs in VWs over time.

(4) Communication technologies: The metaverse trend leads to emerging technologies being implemented into VWs affecting the PCAs verbal and non-verbal reaction. In addition to the standard communication methods (acoustic, visual, and text-based), haptic communication and motion capturing were identified. With more communication technologies offered in parallel, the solution becomes more immersive and inclusive (Zhang et al., 2022).

(5) Data protection and privacy: The protection of private information is important, especially when the artifact is meant for a productive environment at a later stage. PCAs could receive private information and learning analytics in VWs could collect sensitive data. Therefore, the current data protection situation needs to be examined for the prototypes described in the contributions.

(6) Design Science Research application: Research following the Design Science Research (DSR) paradigm makes sure the design knowledge is both, relevant and rigorously derived. Generalizable design knowledge gives answers to design questions one has to ask when implementing artifacts. We scan articles for DSR applications and identify common kernel theories to support future developments.

The resulting coding system is previewed below. It consists of main categories with their corresponding sub-categories, in case available:

  • PCA embodiment and character: animal, human, male, female, diverse, personality

  • PCA adaptation and role: adaptation to learner, mentor, tutor, troublemaker

  • Application of gamification

  • Communication technologies: visual, audio, text-based, haptic, motion

  • Data protection and privacy

  • DSR application and kernel theories: DSR application, kernel theory name and category

The detailed results of this coding system are presented below.

(1) PCA embodiment and character

The following table reveals the results on the different types of embodiments and characteristics covered in the analyzed articles. The characteristics of this main category are divided into human and animal design. These are extended by the assignment of gender (male, female or diverse) and personality. In total, the designated characteristics were described in 36 contributions.

Publications

animal

human

male

female

diverse

personality

(Liew et al., 2022)

x

x

x

(Sloan et al., 2022)

x

x

x

(Petersen et al., 2021)

x

x

x

(Laeeq & Memon, 2021)

x

(Grivokostopoulou et al., 2020)

x

x

(Soliman & Guetl, 2020)

x

x

(Christopoulos et al., 2019)

x

x

x

x

x

(Maryadi et al., 2018)

x

x

x

(Bendou et al., 2018)

x

x

x

(Grivokostopoulou et al., 2018)

x

(Barange et al., 2017)

x

x

(Nakhal et al., 2017)

x

(Bian et al., 2016)

x

x

x

(Liew et al., 2016)

x

x

(Mohanty, 2016)

x

(Hassani et al., 2016)

x

(Liew et al., 2015)

x

x

(Terzidou & Tsiatsos, 2014)

x

(Leung et al., 2013)

x

(Soliman, 2013)

x

x

(Soliman & Guetl, 2012)

x

x

x

(Domagk, 2010)

x

x

(Mehlmann et al., 2010)

x

x

x

(Veletsianos et al., 2010)

x

x

x

x

(Jerjir & Neji, 2009)

x

(Bouhadada & Laskri, 2008)

x

(Harbouche & Djoudi, 2007)

x

(Botsios et al., 2006)

x

(Buche et al., 2005)

x

(Pan et al., 2005)

x

(Marin et al., 2004)

x

(Buche et al., 2004)

(Johnson, 2003)

x

(Atkinson, 2002)

(Lester et al., 1999)

x

(Rickel & Johnson, 1998)

Sum

2

354

9

11

1

11

Table 1: PCA embodiment and character


There is a clear domination of human-like PCAs (35 out of 36 articles). In four articles the PCA is male, and in six articles female. In five articles the prototype offers the option to manually configure the gender. The only article covering gender diversity is from Christopoulos et al. (2019).

The human appearance of the PCA was chosen because it takes over a natural person’s function (Marin et al., 2004). This realism positively influences the learner's immersion and increases the associated learning efficiency (Méndez et al., 2004). In addition, the human form of representation is a prerequisite for the use of human mimics and a human-like personality (Lester et al., 1999). Personality models found are Eysenck’s traits (Liew et al., 2016) and the five factors (Bian et al., 2016).

Two articles include animal avatars for PCA (Christopoulos et al., 2019; Mehlmann et al., 2010). The first article uses a monkey as a troublemaker. However, the monkey is of no interest to the students due to its limited abilities and distracting nature (Christopoulos et al., 2019). In the second article, a hamster is used for culture neutrality while gender is selectable (Mehlmann et al., 2010).

Complementing the human and animal appearance, eleven of the 36 contributions refer to a human-like personality of the PCA. The PCA's personality is intended to enhance learning by also addressing the social aspects. In addition, the PCA's human-like behavior is targeted at extending the time students spend in the VW for learning because it is perceived as more fun (Lester et al., 1999; Marin et al., 2004). The personality of a PCA can be implemented by certain human behaviors, interactions, or life stories. The design depends on the application and the subject area of the PCA (Mohanty, 2016).

(2) PCA adaptation and role

The dominating role of the PCA found (37 of 45) is the tutor role, providing content and asking and answering questions. More advanced topics were considered over time. E.g., the PCA's response to the learner's feelings and the introduction of the mentor role to support emotionally. In 2008, the first paper addressed the PCA's perception of the user's feelings (Bouhadada & Laskri, 2008). The following year, the PCA was introduced as an emotional mentor (Jerjir & Neji, 2009) and continuously developed (e.g., Bian et al., 2016; Grivokostopoulou et al., 2020; Mehlmann et al., 2010). In general, the PCA's reaction to emotions and its role as a mentor can have a significant positive effect on learning (Jerjir & Neji, 2009). 13 articles contain PCAs in a mentor role, whereas five of them (38%) adapt to the learners’ emotions or express emotions themselves (e.g., Mohanty, 2016; Ranjbartabar et al., 2018; Xie et al., 2021). In contrast, from 37 tutor PCAs without an additional mentor role, only three (1%) adapt to learners’ emotions (e.g., Bendou et al., 2018; Liew et al., 2015). We conclude that the importance of adaptation to emotions is dependent on the role the PCA takes. It is most important for the mentor role.

In addition to the roles found in the SLR by Khosrawi-Rad et al. (2022), we identified the role of a troublemaker who e.g., gives wrong answers (e.g., Bouhadada & Laskri, 2008; Buche et al., 2004).

Early adaptive PCAs react based on learners’ interaction with the system in the past (Bouhadada & Laskri, 2008). Another option found is to ask the student about his current emotion (Ranjbartabar et al., 2018). But also the expression of human-like emotions via the PCA’s mimics is found (Bian et al., 2016).

(3) Application of Gamification

Gamification can also create an engaging and interactive learning environment enriched with a PCA (Guo & Goh, 2016). It is used in education to make learning processes more effective or make students spend more time learning (Guo & Goh, 2016). Within the study of the selected articles, gamification was used as a type of VW in 11 articles. Although the first article included in this SLR is from 1998, the first publication also covering gamification was published in 2011. In the following years there is a slight increase in publications. This is represented as slightly rising trend line in the following figure. It must be monitored in future research if this increase of gamification application becomes a real trend.

Figure 3: Application of Gamification per year

(4) Communication technologies

We analyzed the means of communication with the learner. Visual or non-verbal communication was described in 32 articles (e.g., Grivokostopoulou et al., 2020; Petersen et al., 2021; Sloan et al., 2022), verbal or audio communication in 27 articles (e.g., Laeeq & Memon, 2021; Liew et al., 2016), and text-based in 26 articles (e.g., Alves et al., 2008; Harbouche & Djoudi, 2007; Moses, 2019). Many PCAs are capable of multiple communication channels (e.g., Liew et al., 2022; Mehlmann et al., 2010; Soliman & Guetl, 2020). Two more advanced technologies were found in one article, namely haptic communication, and motion capturing (Hassani et al., 2016). Haptic communication refers to the transmission of information using tactile perception. It allows users to interact with a digital system through vibrations, oscillations, or other mechanical stimuli. This form of communication plays an important role in human interaction and is closely related to emotions and social behaviors (Hassani et al., 2016; Norman, 2018). Motion capturing is the sensing of body gestures that can either be mirrored to the avatar or analyzed for accuracy (Hassani et al., 2016; Ke et al., 2016; Sun, 2016). The single article using haptic communication and motion capturing explains the influence on learning progress when learning a foreign language. The design of the VW imitates real-world scenarios to offer a natural learning experience. The learner explores the environment by role-playing with the PCA in natural language. The PCA described can perceive haptic and motion input and provide physical output to the learner. The exact form of communication is not described in detail, since the article focuses on technical implementation (Hassani et al., 2016).

(5) Data protection and privacy

The only study addressing a GDPR-relevant aspect is Tran et al. (2022), a Thai-German collaboration. It explores not only the importance of protecting faculty confidential data but also the need to protect conversations between faculty and PCA from third parties. The system focuses on the PCA and text-based chat as the main components. These require an effective privacy function. The platform integrates several privacy measures in the VW, including preventing other learners from accessing private information, interrupting conversations between PCAs and other learners, and refusing to share information. However, the study only examines learners' experiences with the user interface and the general concept of privacy measures implemented. The functionality and effectiveness of the privacy measures in the system are not evaluated. Hence, not all GDPR-relevant aspects are covered like accountability and governance or the lawful basis and transparency.

(6) Design Science Research Application

None of the coded articles mentioned the application of the DSR paradigm following Hevner (2007). Many prototypes developed lack theoretical grounding because only 12 articles mentioned one or more theories as a basement for their development (e.g., Liew et al., 2022; Petersen et al., 2021; Xie et al., 2021). Social agency theory is the most common theory with three articles (Domagk, 2010; Liew et al., 2015; Petersen et al., 2021). According to that theory, social cues can increase the feeling of social presence and consequently address the social aspects of learning (Mayer, 2014; Stahl, 2004). Most common are learning theories (five theories), e.g., cognitive load theory (Mohanty, 2016) or activity learning theory (Soliman & Guetl, 2020) and human-computer-interaction theories (four articles) like computers-are-social-actors (Liew et al., 2022) or theory of adaptive hypermedia systems (Alves et al., 2008). Less common are communication theories with three theories in one article (Barange et al., 2017) and two different personality models, namely the five-factor model and Eysenck’s trait model (Bian et al., 2016; Liew & Tan, 2016).

5 Discussion and research gaps

The following section is structured in the same way as the results before to demonstrate the link between them. We discuss the results and derive future research streams.

(1) PCA embodiment and character: The general aim of adding an embodied PCA is to increase learning engagement and efficiency (Mayer, 2014; Soliman & Guetl, 2020). A human-like design in terms of optical appearance and personality stimulates social feelings and supports the social component of learning (Mayer, 2014; Stahl, 2004). This principle is also transferable to the interaction between PCA and the learner. The learner has the feeling of applying the conditions and rules for a human-human conversation. This human behavior toward a machine is also backed by the Computers-are-social-actors theory (CASA) mentioned by Liew et al. (2022). This leads to higher engagement and learning performance (Grivokostopoulou et al., 2018; Lester et al., 1999). Additionally, human representation is a prerequisite for natural interaction on the part of the PCA. An animated face provides facial expressions that support realistic visual communication. Other body parts serve to realize physical behaviors and non-acoustic interactions (Nakhal et al., 2017). As a result, the learner perceives the virtual environment as more real and can more easily develop a relationship with the PCA's personality. The feeling of loneliness is reduced (Mohanty, 2016). Animal representations, on the other hand, are often designed to be cute and appropriate for children and therefore rare in higher and further education. The learner is more likely to overlook e.g., technical shortcomings of the VW (Bredeweg et al., 2010; Mehlmann et al., 2010). The advantage of cultural neutrality is underrepresented. Diederich et al. (2022) conclude the design of a consistent character is not a prerequisite. Nevertheless, Lin, the designer of Apple’s Siri, argues that a PCA always has a character, either properly or randomly designed (Lin, 2018). Future studies should consider more precise frameworks for the selection of the presentation form and develop scientifically validated criteria. Aspects concerning personality should be included in that framework as well to prevent a random choice.

(2) PCA adaptation and role: Theoretical design concepts to gather the learners’ emotions, as well as the PCA’s role as a mentor, are still rare. Often, only the need to respond to the learner's emotions and the related improvement in the learning outcome is described. The topic of emotion recognition has been addressed in recent articles, but not elaborated upon. Mohanty (2016) may serve as a starting point. The recognition of emotions is supposed to be done via affective signals. To do so, vocal inflection, prosodic qualities of speech, facial expressions, and motor and physiological states of the learner are detected by the PCA. A response of the PCA to a negative emotion could be a verbally expressed question, e.g., "Can I help you?" in combination with a gesture (Soliman & Guetl, 2013). To further develop the role of a mentor, further research should focus on the acquisition, processing, and interpretation of emotions. Based on these results, a concept for appropriate responses of the PCA should be developed. An anthropomorphic PCA design could support to establish long-term friendship-like relationships with the learner (Strohmann, 2021). In that case, the PCA would take the role of a peer.

(3) Application of Gamification: The use of game-typical elements has been increasingly applied in the field of PCAs in VWs in recent years. E.g., gamification has been used to help engineering students get hands-on training on craft production. Students were asked to create toy cars according to customer requirements. The learning environment is enhanced by gamification elements such as scoring, game levels, and rankings. Additionally, tutorial levels are employed to learn the game and become familiar with the game mechanics (Sloan et al., 2022). Motivation is increased by adding gamification. Since VWs are often customizable the full potential of gamification can be exploited in combination with AI (Sloan et al., 2022). A framework for implementing gamified elements into the PCA’s dialogues could structure research activities and help practitioners.

(4) Communication technologies: We found that more advanced communication technologies are rarely researched in combination with PCAs in VWs. This finding is in line with previous results in educational VW research (Rinn et al., 2023). We conclude that VWs are mostly researched solely or with only one additional technology. However, the combination of technologies supports the practical development of a metaverse. Another advantage of implementing additional communication technologies is that it allows users to interact with digital systems when other sensory channels, such as vision or hearing, are impaired or unavailable (Norman, 2018). This fact supports the inclusion of learners with impediments. More advanced communication technologies for enhancing interaction between people and technologies should be implemented and studied. Especially in combination with each other and in combination with simulations of real-life scenarios that profit from the risk-freedom (e.g., in medical or police training) (e.g., Moskaliuk et al., 2013) and scalability (e.g., engineering) (e.g., Pletz & Zinn, 2020) of a VW. There is a great yet unexploited potential.

(5) Data protection and data privacy: Although the issue of privacy is growing in importance and the implications of misuse are enormous, there is still a lack of research (De Guzman et al., 2020; Lebeck et al., 2018; Ruth et al., 2019). There is a need to support further research in this area to ensure that the development and application of PCAs are done per ethical and moral principles (Følstad et al., 2021). The protection of personal data will also have an impact on the learner's conversations with the PCA. The learner will feel more confident in dialoguing with the PCA and will find it easier to share information. Similarly, the issue of privacy in VWs must be considered. In VWs, there are numerous risks regarding privacy, e.g., digital vandalism and invasion of personal space (Ruth et al., 2019). One reason for the still rarely addressed privacy in the use of PCAs, cited by De Guzman et al. (2020), is that most work on VWs in the last two decades has focused on providing the necessary technology. Thus, there is a gap in research regarding privacy. As technology matures, privacy must now receive increased attention. Taking the categorization of Venable et al. (2016), so-called naturalistic evaluation settings are those very close to a productive environment. For productive usage in Europe, GDPR must be followed. Therefore, research that includes data protection and privacy is necessary to fill the gap between theory and practice.

(6) DSR Application: None of the articles followed the Design Science Research paradigm. Thus, there is no rigorously derived design knowledge to build upon. Many contributions lack a decent theoretical grounding. This is in line with another VW SLR (Rinn et al., 2023). The frequent use of the social agency theory in that context is also in line with another SLR’s result (Martha & Santoso, 2019). A first step in research would be to derive meta-requirements from theories, e.g., the social agency theory and others, or expert interviews.

6 Conclusion

This research aimed to conduct a systematic literature review of the state of research on PCAs in VWs to identify implications for research and practice. Following the approaches of Webster & Watson (2002) and Page et al. (2021), 45 relevant articles were identified and coded. An exploratory approach was used to screen and code the articles found. In Chapter 4 (Results), the following research foci were considered: (1) PCA embodiment and character, (2) PCA adaptation and role, (3) application of gamification, (4) Communication technologies, (5) Data protection and data privacy, and (6) DSR application. The forms of PCAs’ embodiment are mainly anthropomorphic, although there are also advantages of non-human avatars like cultural neutrality. Evaluations of human against non-human PCAs are missing. Gender diversity has only started to reach research in PCA design. The reactions of PCAs to the feelings of learners are seen more often as technology evolves. With this adaptivity becoming possible, the role of an emotionally supporting mentor arose. An approach for further research is offered by Mohanty (2016) and Soliman & Guetl (2013). The use of gamification has gained importance, due to its capability to increase motivation and learning outcomes. A framework for researchers and practitioners could be supportive. More advanced communication technologies like haptic communication in VWs are rarely used so far. However, it supports the inclusion of students with impediments and paves the way for the metaverse becoming reality. Data protection is a necessity in future research work to bring the solutions developed into practice. Since the learner exchanges personal information with the PCA, this information must be made inaccessible to the public, and GDPR rules must be followed. We found that many prototypes lack a decent theoretical grounding and none of the articles followed the DSR approach. This fact leads to a lack of reusable and abstracted design knowledge in the area under consideration. In sum, despite the increasing number of publications and the research history dating back to 1998, the state of research is still immature.

This paper is subject to certain limitations. The selection and analysis process is based on subjective decisions by the authors. Our measures to reduce subjectivity as much as possible were a peer-review process, an iteratively updated and communicated coding scheme, and clearly formulated inclusion and exclusion criteria. Furthermore, the exclusion of articles targeted at learners with impediments could have caused the result of identifying a lack of advanced communication technology.

References

Allouch, M.; Azaria, A.; Azoulay, R.: Conversational Agents: Goals, Technologies, Vision and Challenges. In: Sensors, 21(24), 2021, Article 24. https://doi.org/10.3390/s21248448 (last check 2023-09-18)

Alves, P.; Amaral, L.; Pires, J.: Case-based reasoning approach to Adaptive Web-based Educational Systems. In: 2008 Eighth IEEE International Conference on Advanced Learning Technologies, 2008, pp. 260–261. https://doi.org/10.1109/ICALT.2008.197 (last check 2023-09-18)

Atif, A.; Jha, M.; Richards, D.; Bilgin, A. A.: Artificial Intelligence (AI)-enabled remote learning and teaching using Pedagogical Conversational Agents and Learning Analytics. In: Intelligent Systems and Learning Data Analytics in Online Education, 2021, pp. 3–29. https://doi.org/10.1016/B978-0-12-823410-5.00013-9 (last check 2023-09-18)

Atkinson, R. K.: Optimizing learning from examples using animated pedagogical agents. In: Journal of Educational Psychology, 94(2), 2002, pp. 416-426. https://doi.org/10.1037/0022-0663.94.2.416 (last check 2023-09-18)

Barange, M.; Saunier, J.; Pauchet, A.: Pedagogical Agents as Team Members: Impact of Proactive and Pedagogical Behavior on the User. In: Proceedings of the 16th Conference on Autonomous Agents and MultiAgent Systems, 2017, pp. 791–800. https://dl.acm.org/doi/10.5555/3091125.3091238 (last check 2023-09-18)

Belen-Saglam, R.; Nurse, J. R. C.; Hodges, D.: An Investigation Into the Sensitivity of Personal Information and Implications for Disclosure: A UK Perspective. In: Frontiers in Computer Science, 4, 2022, 908245. https://doi.org/10.3389/fcomp.2022.908245 (last check 2023-09-18)

Bendou, A.; Abrache, M.-A.; Cherkaoui, C.: Contribution of pedagogical agents to motivate learners in online learning environments: The case of the PAOLE agent. In: SCAMS 2017: Innovations in Smart Cities and Applications, 37, 2018, pp. 344–356. https://doi.org/10.1007/978-3-319-74500-8_32 (last check 2023-09-18)

Bian, Y.; Yang, C.; Guan, D.; Xiao, S.; Gao, F.; Shen, C.; Meng, X.: Effects of Pedagogical Agent’s Personality and Emotional Feedback Strategy on Chinese Students’ Learning Experiences and Performance: A Study Based on Virtual Tai Chi Training Studio. In: Proceedings of the 2016 CHI Conference on Human Factors in Computing Systems, 2016, pp. 433–444. https://doi.org/10.1145/2858036.2858351 (last check 2023-09-18)

Botsios, S.; Mitropoulou, V.; Georgiou, D.; Panapakidis, I.: Design of virtual co-learner for asynchronous collaborative e-learning. In: Proceedings - Sixth International Conference on Advanced Learning Technologies, ICALT 2006, pp. 406 – 407. https://doi.ieeecomputersociety.org/10.1109/ICALT.2006.131 (last check 2023-09-18)

Bouhadada, T.; Laskri, M.-T.: An interactive web-based environment using pedagogical agents. In: Journal of Computer Information Systems, 48(4), 2008, pp. 39-48.

Bredeweg, B.; Liem, J.; Linnebank, F.; Bühling, R.; Wißner, M.; del Río, J. G.; Salles, P.; Beek, W.; Gómez Pérez, A.: DynaLearn: Architecture and Approach for Investigating Conceptual System Knowledge Acquisition. In: Aleven, V.; Kay, J.; Mostow, J. (Eds.): Intelligent Tutoring Systems, LNCS 6095. Springer, Berlin, Heidelberg, 2010, pp. 272–274. https://doi.org/10.1007/978-3-642-13437-1_42 (last check 2023-09-18)

Brown, T. B.; Mann, B.; Ryder, N.; Subbiah, M.; Kaplan, J.; Dhariwal, P.; Neelakantan, A.; Shyam, P.; Sastry, G.; Askell, A.: Language models are few-shot learners. In: Advances in Neural Information Processing Systems, 33, 2020, pp. 1877–1901. https://proceedings.neurips.cc/paper_files/paper/2020/file/1457c0d6bfcb4967418bfb8ac142f64a-Paper.pdf (last check 2023-09-18)

Buche, C.; Le Gal, C.; Querrec, R.: Intelligent tutoring system for procedural and collaborative training. In: 8th IFIP World Conference on Computers in Education, WCCE 2005. https://www.scopus.com/inward/record.uri?eid=2-s2.0-84908374043&partnerID=40&md5=5674d064a5ec6a3bcd686c0a52aa5045 (last check 2023-09-18)

Buche, C.; Querrec, R.; de Loor, P.; Chevaillier, P.: MASCARET: A Pedagogical Multi-Agent System for Virtual Environments for Training. In: International Journal of Distance Education Technologies (IJDET), 2(4), Article 4, 2004, pp. 41-61. https://doi.org/10.4018/jdet.2004100103 (last check 2023-09-19)

Christopoulos, A.; Conrad, M.; Shukla, M.: What Does the Pedagogical Agent Say? 10th International Conference on Information, Intelligence, Systems and Applications, IISA 2019. https://doi.org/10.1109/IISA.2019.8900767 (last check 2023-09-19)

Clutterbuck, P.; Heales, J.; Wijesooriya, C.: Forms of Formative Assessment in Virtual Learning Environments. AMCIS 2015 Proceedings, 2015. https://aisel.aisnet.org/amcis2015/ISEdu/GeneralPresentations/31 (last check 2023-09-19)

Dalgarno, B.; Lee, M. J. W.: What Are the Learning Affordances of 3-D Virtual Environments? In: British Journal of Educational Technology, 41(1), 2010, pp. 10–32. https://doi.org/10.1111/j.1467-8535.2009.01038.x (last check 2023-09-19)

De Guzman, J. A.; Thilakarathna, K.; Seneviratne, A.: Security and Privacy Approaches in Mixed Reality: A Literature Survey. In: ACM Computing Surveys, 52(6), 2020, Article 6, pp. 1-37. https://doi.org/10.1145/3359626 (last check 2023-09-19)

Diederich, S.; Brendel, A. B.; Morana, S.; Kolbe, L.: On the Design of and Interaction with Conversational Agents: An Organizing and Assessing Review of Human-Computer Interaction Research. In: Journal of the Association for Information Systems, 23(1), 2022, pp. 96–138. Scopus. https://doi.org/10.17705/1jais.00724 (last check 2023-09-19)

Dionisio, J. D.; Burns, W.; Gilbert, R.: 3D Virtual Worlds and the Metaverse: Current Status and Future Possibilities. In: ACM Computing Surveys Volume 45(3), Article No. 34, pp. 1–38. https://doi.org/10.1145/2480741.2480751 (last check 2023-09-19)

Domagk, S.: Do pedagogical agents facilitate learner motivation and learning outcomes?: The role of the appeal of agent’s appearance and voice. In: Journal of Media Psychology, 22(2), 2010, Article 2. https://doi.org/10.1027/1864-1105/a000011 (last check 2023-09-19)

Edirisingha, P.; Nie, M.; Pluciennik, M.; Young, R.: Socialisation for Learning at a Distance in a 3-D Multi-User Virtual Environment. In: British Journal of Educational Technology, 40(3), 2009, pp. 458–479. https://doi.org/10.1111/j.1467-8535.2009.00962.x (last check 2023-09-19)

European Union: GDPR compliance checklist. GDPR.Eu., 2020. https://gdpr.eu/checklist/ (last check 2023-09-19)

Feidakis, M.; Kasnesis, P.; Giatraki, E.; Giannousis, C.; Patrikakis, C.; Monachelis, P.: Building pedagogical conversational agents, affectively correct. In: Proceedings of the 11th International Conference on Computer Supported Education - Volume 1: CSEDU, 2019, pp. 100-107. https://doi.org/10.5220/0007771001000107 (last check 2023-09-19)

Følstad, A.; Araujo, T.; Law, E. L.-C.; Brandtzaeg, P. B.; Papadopoulos, S.; Reis, L.; Baez, M.; Laban, G.; McAllister, P.; Ischen, C.; Wald, R.; Catania, F.; Meyer von Wolff, R.; Hobert, S.; Luger, E.: Future directions for chatbot research: An interdisciplinary research agenda. In: Computing, 103(12), 2021, Article 12, pp. pages 2915–2942. https://doi.org/10.1007/s00607-021-01016-7 (last check 2023-09-19)

Gao, L.; Wan, B.; Liu, G.; Xie, G.; Huang, J.; Meng, G.: Investigating the Effectiveness of Virtual Reality for Culture Learning. In: International Journal of Human-Computer Interaction, 37(18), 2021, pp. 1771–1781. https://doi.org/10.1080/10447318.2021.1913858 (last check 2023-09-19)

Girvan, C.: What is a virtual world? Definition and classification. In: Educational Technology Research and Development, 66(5), 2018, pp. 1087–1100. https://doi.org/10.1007/s11423-018-9577-y (last check 2023-09-19)

Gnewuch, U.; Morana, S.; Maedche, A.: Towards Designing Cooperative and Social Conversational Agents for Customer Service. Proceedings of the 38th International Conference on Information Systems. Proceedings of the 8th International Conference on Information Systems (ICIS), 2017. https://aisel.aisnet.org/icis2017/HCI/Presentations/1 , https://aisel.aisnet.org/cgi/viewcontent.cgi?article=1312&context=icis2017 (last check 2023-09-19)

Grivokostopoulou, F.; Kovas, K.; Perikos, I.: The effectiveness of embodied pedagogical agents and their impact on students learning in virtual worlds. In: Applied Sciences (Switzerland), 10(5), 2020, Article 5, 1739 . https://doi.org/10.3390/app10051739 (last check 2023-09-19)

Grivokostopoulou, F.; Paraskevas, M.; Perikos, I.; Nikolic, S.; Kovas, K.; Hatzilygeroudis, I.: Examining the Impact of Pedagogical Agents on Students Learning Experience in Virtual Worlds. 2018 IEEE International Conference on Teaching, Assessment, and Learning for Engineering (TALE), 2018, pp. 602–607. https://doi.org/10.1109/TALE.2018.8615421 (last check 2023-09-19)

Grogorick, L.; Robra-Bissantz, S.: Digitales Lernen und Lehren: Führt Corona zu einer zeitgemäßen Bildung? In: HMD Praxis der Wirtschaftsinformatik, 58(6), 2021, Article 6, pp. 1296–1312. https://doi.org/10.1365/s40702-021-00806-z (last check 2023-09-19)

Guo, Y. R.; Goh, D. H.-L.: Evaluation of affective embodied agents in an information literacy game. In: Computers & Education, 103, 2016, pp. 59–75. https://doi.org/10.1016/j.compedu.2016.09.013 (last check 2023-09-19)

Harbouche, K.; Djoudi, M.: Agent-based virtual assistant in an interactive learning environment. In: Information Technology Journal, 6(8), 2007, Article 8, pp. 1199-1207. https://doi.org/10.3923/itj.2007.1199.1207 (last check 2023-09-19)

Hassani, K.; Nahvi, A.; Ahmadi, A.: Design and implementation of an intelligent virtual environment for improving speaking and listening skills. In: Interactive Learning Environments, 24(1), 2016, Article 1, pp. 252-271. https://doi.org/10.1080/10494820.2013.846265 (last check 2023-09-19)

Hevner, A.: A Three Cycle View of Design Science Research. In: Scandinavian Journal of Information Systems, 19(2), 2007, pp. 87–92. https://aisel.aisnet.org/sjis/vol19/iss2/4 (last check 2023-09-19)

Ho, A.; Hancock, J.; Miner, A. S.: Psychological, Relational, and Emotional Effects of Self-Disclosure After Conversations With a Chatbot. In: The Journal of Communication, Vol., Issue 4, August 2018, pp. 712–733. https://doi.org/10.1093/joc/jqy026 (last check 2023-09-19)

Hobert, S.; von Wolff, R. M.: Say Hello to Your New Automated Tutor – A Structured Literature Review on Pedagogical Conversational Agents. 14th International Conference on Wirtschaftsinformatik, Siegen, 2019.

Jerjir, W.; Neji, M.: Use of a conversational emotional agent in E-learning environment. IADIS International Conference on Cognition and Exploratory Learning in Digital Age, CELDA 2009, pp. 118 – 124. https://www.scopus.com/inward/record.uri?eid=2-s2.0-84882972880&partnerID=40&md5=e6366d3fac37118364b14ea3f278752a (last check 2023-09-19)

Johnson, W. L.: Interaction tactics for socially intelligent pedagogical agents. IUI '03: Proceedings of the 8th international conference on Intelligent user interfaces, January 2003, pp. 251–253. https://doi.org/10.1145/604045.604090 (last check 2023-09-19)

Ke, F.; Lee, S.; Xu, X.: Teaching training in a mixed-reality integrated learning environment. In: Computers in Human Behavior, 62, 2016, pp. 212–220. https://doi.org/10.1016/j.chb.2016.03.094 (last check 2023-09-19)

Khosrawi-Rad, B.; Rinn, H.; Schlimbach, R.; Gebbing, P.; Yang, X.; Lattemann, C.; Markgraf, D.; Robra-Bissantz, S.: Conversational Agents in Education – A Systematic Literature Review. ECIS 2022 Research Papers, 2022. https://aisel.aisnet.org/ecis2022_rp/18 (last check 2023-09-19)

Laeeq, K.; Memon, Z. A.: Scavenge: An intelligent multi-agent based voice-enabled virtual assistant for LMS. In: Interactive Learning Environments, 29(6), 2021, Article 6, pp. 954-972. https://doi.org/10.1080/10494820.2019.1614634 (last check 2023-09-19)

Lebeck, K.; Ruth, K.; Kohno, T.; Roesner, F.: Towards Security and Privacy for Multi-user Augmented Reality: Foundations with End Users. 2018 IEEE Symposium on Security and Privacy (SP), 2018, pp. 392–408. https://doi.org/10.1109/SP.2018.00051 (last check 2023-09-19)

Lecon, C.; Koot, C.: Virtuelle 3D-Räume und Lehrvideos als E-Learning-Angebote: Praktische Erfahrungen an der Hochschule Aalen. In: HMD Praxis der Wirtschaftsinformatik, 52(1), 2015, pp. 108–119. https://doi.org/10.1365/s40702-014-0110-4 (last check 2023-09-19)

Lester, J. C.; Zettlemoyer, L. S.; Gregoire, J. P.; Bares, W. H.: Explanatory lifelike avatars: Performing user-centered tasks in 3D learning environments. Proceedings of the International Conference on Autonomous Agents, 1999, pp. 24 – 31. https://www.scopus.com/inward/record.uri?eid=2-s2.0-0032659278&partnerID=40&md5=7af110828df90de0d5fb3eb9cf41a60b (last check 2023-09-19)

Leung, S.; Virwaney, S.; Lin, F.; Armstrong, A. J.; Dubbelboer, A.: TSI-enhanced pedagogical agents to engage learners in virtual worlds. In: International Journal of Distance Education Technologies, 11(1), 2013, Article 1, pp. 1-13. https://doi.org/10.4018/jdet.2013010101 (last check 2023-09-19)

Levy, Y.; Ellis, T. J.: A Systems Approach to Conduct an Effective Literature Review in Support of Information Systems Research. In: Informing Science: The International Journal of an Emerging Transdiscipline, 9, 2006, pp. 181–212. https://doi.org/10.28945/479 (last check 2023-09-19)

Liew, T. W.; Mat Zin, N. A.; Sahari, N.; Tan, S.-M.: The effects of a pedagogical agent’s smiling expression on the learner’s emotions and motivation in a virtual learning environment. In: International Review of Research in Open and Distance Learning, 17(5), 2016, Article 5, pp. 248-266. https://doi.org/10.19173/irrodl.v17i5.2350 (last check 2023-09-19)

Liew, T. W.; Tan, S.-M.: Virtual agents with personality: Adaptation of learner-agent personality in a virtual learning environment. 2016 Eleventh International Conference on Digital Information Management (ICDIM), 2016, pp. 157–162. https://doi.org/10.1109/ICDIM.2016.7829758 (last check 2023-09-19)

Liew, T. W.; Tan, S.-M.; Kew, S. N.: Can an angry pedagogical agent enhance mental effort and learning performance in a multimedia learning environment? In: Information and Learning Sciences, Vol. 123 No. 9/10, 2022, pp. 555-576. https://doi.org/10.1108/ILS-09-2021-0079 (last check 2023-09-19)

Liew, T. W.; Zin, N. A. M.; Sahari, N.; Tan, S.-M.: The effects of Pedagogical agent’s visual realism on learner’s cognitive and socio-emotive outcomes in virtual learning environment. Proceedings of the 26th International Business Information Management Association Conference - Innovation Management and Sustainable Economic Competitive Advantage: From Regional Development to Global Growth, IBIMA 2015, pp. 1098 – 11052015. https://www.scopus.com/inward/record.uri?eid=2-s2.0-84976391684&partnerID=40&md5=449fa39ddbd9360a041510d6549bcfd6 (last check 2023-09-19)

Lin, M.: How to Write Personalities for the AI Around Us. In: The Paris Review. 2018, May 2. https://www.theparisreview.org/blog/2018/05/02/how-to-write-personalities-for-the-ai-around-us/ (last check 2023-09-19)

Luebcke, M.; Bosse, E.; Book, A.; Wannemacher, K.: Zukunftskonzepte in Sicht? Auswirkungen der Corona-Pandemie auf die strategische Hochschulentwicklung. HFD-Arbeitspapier 63, 2022. https://hochschulforumdigitalisierung.de/sites/default/files/dateien/HFD_AP_63_Zukunftskonzepte_in_Sicht_Corona_HIS-HE.pdf (last check 2023-09-19)

Manesh, H. F.; Schaefer, D.: AC 2010-24: A Virtual Factory Approach For Design And Implementation Of Agile Manufacturing Systems. 2010 ASEE Annual Conference and Exposition, 2010, pp. 15–111. https://purehost.bath.ac.uk/ws/portalfiles/portal/127114500/24_A_VIRTUAL_FACTORY_APPROACH_FOR_DESIGN_AN.pdf (last check 2023-09-19)

Marin, B.-F.; Hunger, A.; Werner, S.; Meila, S.; Schuetz, C.: A generic framework for an interface tutor agent within a virtual collaborative learning environment. IEEE International Conference on Advanced Learning Technologies, 2004. Proceedings, 2004, pp. 31–35. https://doi.org/10.1109/ICALT.2004.1357369 (last check 2023-09-19)

Martha, A. S. D.; Santoso, H. B.: The design and impact of the pedagogical agent: A systematic literature review. In: Journal of Educators Online, 16(1), 2019, Article 1. https://doi.org/10.9743/jeo.2019.16.1.8 (last check 2023-09-19)

Maryadi, J. A.; Santoso, H.; Isa, Y. K.: Development of Personalized Pedagogical Agent for Student-Centered e- Learning Environment. 2017 7th World Engineering Education Forum (WEEF), 2018, pp. 309–314. https://doi.org/10.1109/WEEF.2017.8467028 (last check 2023-09-19)

Mayer, R. E.: Principles Based on Social Cues in Multimedia Learning: Personalization, Voice, Image, and Embodiment Principles. In: Mayer, R. E. (Ed.): The Cambridge Handbook of Multimedia Learning. 2nd ed., Cambridge University Press, 2014, pp. 345–368. https://doi.org/10.1017/CBO9781139547369.017 (last check 2023-09-19)

Mayring, P.: Qualitative Inhaltsanalyse: Grundlagen und Techniken. 12., überarbeitete Auflage, Beltz, Weinheim, 2015.

McTear, M.; Callejas, Z.; Griol, D.: The Conversational Interface: Talking to Smart Devices. Springer International Publishing, 2016. https://doi.org/10.1007/978-3-319-32967-3 (last check 2023-09-19)

Mehlmann, G.; Häring, M.; Bühling, R.; Wißner, M.; André, E.: Multiple agent roles in an adaptive virtual classroom environment. IVA 2010: Intelligent Virtual Agents. LNAI Vol. 6356, 2010, p. 250-256. https://doi.org/10.1007/978-3-642-15892-6_26 (last check 2023-09-19)

Méndez, G.; Herrero, P.; De Antonio, A.: Intelligent virtual environments for training in nuclear power plants. ICEIS 2004 - Proceedings of the Sixth International Conference on Enterprise Information Systems, 2004, pp. 204–209. https://www.scopus.com/inward/record.uri?eid=2-s2.0-8444231666&partnerID=40&md5=d0553cd36d90b0de824890e87a7cb83d (last check 2023-09-19)

Mohanty, A.: Affective Pedagogical Agent in E-Learning Environment: A Reflective Analysis. In: Creative Education, 07(04), 2016, Article 04. https://doi.org/10.4236/ce.2016.74061 (last check 2023-09-19)

Moses, K. R.: The effects of a mobile learning environment tutoring system on student achievement in a circuits analysis course. ASEE Annual Conference and Exposition, Conference Proceedings, 2019. https://www.scopus.com/inward/record.uri?eid=2-s2.0-85078798767&partnerID=40&md5=1b990aae2058bb2faede9a6f1d37a7a3 (last check 2023-09-19)

Moskaliuk, J.; Bertram, J.; Cress, U.: Impact of Virtual Training Environments on the Acquisition and Transfer of Knowledge. In: Cyberpsychology, Behavior and Social Networking, 16(3), 2013. https://doi.org/10.1089/cyber.2012.0416 (last check 2023-09-19)

Nakhal, B.; Nakhal, B.; Querrec, R.: Cognitive embodied conversational agents in virtual learning environment. 2017 29th International Conference on Microelectronics (ICM), 2017, pp. 1–4. https://doi.org/10.1109/ICM.2017.8268858 (last check 2023-09-19)

Norman, K. L. (Ed.): The Wiley handbook of human computer interaction set. First edition, John Wiley & Sons, New York, 2018.

Page, M. J.; McKenzie, J. E.; Bossuyt, P. M.; Boutron, I.; Hoffmann, T. C.; Mulrow, C. D.; Shamseer, L.; Tetzlaff, J. M.; Akl, E. A.; Brennan, S. E.; Chou, R.; Glanville, J.; Grimshaw, J. M.; Hróbjartsson, A.; Lalu, M. M.; Li, T.; Loder, E. W.; Mayo-Wilson, E.; McDonald, S.; … Moher, D.: The PRISMA 2020 statement: An updated guideline for reporting systematic reviews. BMJ, 2021, 372, n71. https://doi.org/10.1136/bmj.n71 (last check 2023-09-19)

Pan, Z.; Zhu, J.; Zhang, M.; Hu, W.: Collaborative virtual learning environment using synthetic characters. ICWL 2005: Advances in Web-Based Learning – ICWL 2005, pp. 364–374. https://doi.org/10.1007/11528043_38 (last check 2023-09-19)

Pannicke, D.; Zarnekow, R.: Virtual Worlds. In: Business & Information Systems Engineering, 1(2), 2009, pp. 185–188. https://doi.org/10.1007/s12599-008-0016-1 (last check 2023-09-19)

Perez, J. E.; Dinawanao, D. D.; Tabanao, E. S.: JEPPY: An interactive pedagogical agent to aid novice programmers in correcting syntax errors. In: International Journal of Advanced Computer Science and Applications(IJACSA), Volume 11(2), 2020. https://doi.org/10.14569/ijacsa.2020.0110207 https://doi.org/10.1007/s12599-008-0016-1 (last check 2023-09-19)

Petersen, G. B.; Mottelson, A.; Makransky, G.: Pedagogical agents in educational vr: An in the wild study. CHI '21: Proceedings of the 2021 CHI Conference on Human Factors in Computing Systems. May 2021, Article No.: 482, pp. 1–12. https://doi.org/10.1145/3411764.3445760 (last check 2023-09-19)

Pirner, H. J.: Virtuelle und mögliche Welten in Physik und Philosophie. Springer, Berlin, Heidelberg, 2018.

Pletz, C.; Zinn, B.: Evaluation of an Immersive Virtual Learning Environment for Operator Training in Mechanical and Plant Engineering Using Video Analysis. In: British Journal of Educational Technology, 51(6), 2020, pp. 2159–2179. https://doi.org/10.1111/bjet.13024 (last check 2023-09-19)

Prattico, F. G.; Shabkhoslati, J. A.; Shaghaghi, N.; Lamberti, F.: Bot Undercover: On the Use of Conversational Agents to Stimulate Teacher-Students Interaction in Remote Learning. 2022 IEEE Conference on Virtual Reality and 3D User Interfaces Abstracts and Workshops (VRW), 2022, pp. 277–282. https://doi.org/10.1109/VRW55335.2022.00063 (last check 2023-09-19)

Ranjbartabar, H.; Richards, D.; Makhija, A.; Jacobson, M. J.: Students’ responses to a humanlike approach to elicit emotion in an educational virtual world. AIED 2018: Artificial Intelligence in Education, 2018. LNAI Vol. 10948, 2018, pp. 291–295. https://doi.org/10.1007/978-3-319-93846-2_54 (last check 2023-09-19)

Rickel, J.; Johnson, W. L.: STEVE: A pedagogical agent for virtual reality. Proceedings of the International Conference on Autonomous Agents, 1998, pp. 332 - 333. https://www.scopus.com/inward/record.uri?eid=2-s2.0-0031704843&partnerID=40&md5=ee39db13485400a3933463f74233ba66 (last check 2023-09-19)

Rinn, H.; Khosrawi-Rad, B.; Grogorick, L.; Robra-Bissantz, S.; Markgraf, D.: Virtual Worlds in education – a systematic literature review. ECIS 2023 Research Papers. 277, 2023. https://aisel.aisnet.org/ecis2023_rp/277/ (last check 2023-09-19)

Riva, G.; Mantovani, F.; Capideville, C. S.; Preziosa, A.; Morganti, F.; Villani, D.; Gaggioli, A.; Botella, C.; Alcañiz, M.: Affective Interactions Using Virtual Reality: The Link between Presence and Emotions. In: CyberPsychology & Behavior, 10(1), 2007, pp. 45–56. https://doi.org/10.1089/cpb.2006.9993 (last check 2023-09-19)

Russell, S. J.; Norvig, P.: Artificial intelligence: A modern approach. Pearson Education Limited, Boston, 2016.

Ruth, K.; Kohno, T.; Roesner, F.: Secure Multi-User Content Sharing for Augmented Reality Applications. Proceedings of the 28th USENIX Security Symposium, 2019, pp. 141 – 158. https://dl.acm.org/doi/10.5555/3361338.3361349 (last check 2023-09-19)

Schlimbach, R.; Rinn, H.; Markgraf, D.; Robra-Bissantz, S.: A Literature Review on Pedagogical Conversational Agent Adaptation. PACIS 2022 Proceedings, 20. https://aisel.aisnet.org/pacis2022/20 (last check 2023-09-19)

Short, J.; Williams, E.; Christie, B.: The social psychology of telecommunications. Wiley, London u.a., 1976.

Sloan, H. A.; Zhao, R.; Aqlan, F.; Yang, H.; Zhu, R.: Adaptive Virtual Assistant for Virtual Reality-based Remote Learning. 129th ASEE Annual Conference and Exposition: Excellence Through Diversity, ASEE 2022. https://www.scopus.com/inward/record.uri?eid=2-s2.0-85138240577&partnerID=40&md5=1e2823b84fe1597a348631bd0992bf79 (last check 2023-09-19)

Soliman, M.: Supporting collaborative learning in virtual worlds by intelligent pedagogical agents: Approach and perspectives. CEUR Workshop Proceedings, Volume 1009, 2013, pp. 73 – 76. https://www.scopus.com/inward/record.uri?eid=2-s2.0-84924953709&partnerID=40&md5=f398c3c69ea92b03a3e56527946289ad (last check 2023-09-19)

Soliman, M.; Guetl, C.: Implementing Intelligent Pedagogical Agents in virtual worlds: Tutoring natural science experiments in OpenWonderland. 2013 IEEE Global Engineering Education Conference (EDUCON), 2013, pp. 782–789. https://doi.org/10.1109/EduCon.2013.6530196 (last check 2023-09-19)

Soliman, M.; Guetl, C.: Simulating Interactive Learning Scenarios with Intelligent Pedagogical Agents in a Virtual World through BDI-Based Agents. In: International Journal of Emerging Technologies in Learning, 3(2), 2020, Article 2. https://doi.org/10.3991/ijep.v3i2.2456 (last check 2023-09-19)

Soliman, M.; Guetl, C.: Experiences with BDI-based design and implementation of Intelligent Pedagogical Agents. 2012 15th International Conference on Interactive Collaborative Learning, ICL 2012. https://doi.org/10.1109/ICL.2012.6402046 (last check 2023-09-19)

Stahl, G.: Building Collaborative Knowing. In: Strijbos, J.-W.; Kirschner, P. A.; Martens, R. L. (Eds.): What We Know About CSCL: And Implementing It In Higher Education. Computer-Supported Collaborative Learning Series, Vol 3. Springer, Dordrecht Netherlands, 2004, pp. 53–85. https://doi.org/10.1007/1-4020-7921-4_3 (last check 2023-09-19)

Strohmann, T.: From Assistance to Companionship-Designing Virtual Companions. TU Braunschweig, 2021. https://nbn-resolving.org/urn:nbn:de:gbv:084-2021012213188 (last check 2023-09-19)

Sun, H.-M.: The Assessment of Learning Performance Using Dynamic Time Warping Algorithm for the Virtual Reality of Full-Body Motion Sensing Control. AMCIS 2016 Proceedings, 2016. https://aisel.aisnet.org/amcis2016/HCI/Presentations/2 (last check 2023-09-19)

Terzidou, T.; Tsiatsos, T.: The impact of pedagogical agents in 3D collaborative serious games. 2014 IEEE Global Engineering Education Conference (EDUCON), 2014, pp. 1–8. https://doi.org/10.1109/EDUCON.2014.7130487 (last check 2023-09-19)

Tran, L. A.; Hensen, B.; Klamma, R.; Chantaraskul, S.: Privacy and Security in Mixed Reality Learning Environments by Input and User/Bot Interaction Protection. 2022 4th Asia Pacific Information Technology Conference, 2022, pp. 63–71. https://doi.org/10.1145/3512353.3512363 (last check 2023-09-19)

Veletsianos, G.; Heller, R.; Overmyer, S.; Procter, M.: Conversational Agents in Virtual Worlds: Bridging Disciplines. In: British Journal of Educational Technology, 41(1), 2010, pp. 123–140. https://doi.org/10.1111/j.1467-8535.2009.01027.x (last check 2023-09-19)

Venable, J.; Pries-Heje, J.; Baskerville, R.: FEDS: A Framework for Evaluation in Design Science Research. In: European Journal of Information Systems, 25(1), 2016, pp. 77–89. https://doi.org/10.1057/ejis.2014.36 (last check 2023-09-19)

Vijayakumar, B.; Höhn, S.; Schommer, C.: Quizbot: Exploring Formative Feedback with Conversational Interfaces. TEA 2018: Technology Enhanced Assessment, 2019, pp. 102–120. https://doi.org/10.1007/978-3-030-25264-9_8 (last check 2023-09-19)

Webster, J.; Watson, R. T.: Analyzing the past to prepare for the future: Writing a literature review. MIS Quarterly, 26(2), 2002, xiii–xxiii. https://web.njit.edu/~egan/Writing_A_Literature_Review.pdf (last check 2023-09-19)

Xie, T.; Liu, R.; Chen, Y.; Liu, G.: MOCA: A Motivational Online Conversational Agent for Improving Student Engagement in Collaborative Learning. In: IEEE Transactions on Learning Technologies, 14(5), 2021, Article 5. https://doi.org/10.1109/TLT.2021.3129800 (last check 2023-09-19)

Zhang, X.; Chen, Y.; Hu, L.; Wang, Y.: The metaverse in education: Definition, framework, features, potential applications, challenges, and future research topics. In: Frontiers in Psychology, 13, 2022, 1016300. https://doi.org/10.3389/fpsyg.2022.1016300 (last check 2023-09-19)

Zichermann, G.; Cunningham, C.: Gamification by design: Implementing game mechanics in web and mobile apps. First edition. O’Reilly, Sebastopol, 2011.

Fulltext