Open access peer-reviewed chapter

Learning by Augmented Reality: Cluster Analysis Approach

Written By

Helena Thuneberg and Hannu S. Salmi

Submitted: 30 October 2019 Reviewed: 17 January 2020 Published: 14 February 2020

DOI: 10.5772/intechopen.91252

From the Edited Volume

Mixed Reality and Three-Dimensional Computer Graphics

Edited by Branislav Sobota and Dragan Cvetković

Chapter metrics overview

774 Chapter Downloads

View Full Metrics

Abstract

Because the use of augmented reality (AR) is increasing, it is important to study its possibilities within both formal and informal learning contexts. We clustered 146 sixth graders using AR at a science center based on their reasoning, motivation, and science learning results using the self-organizing maps method (SOM) to identify AR-using subgroups. The aim was to consider reasons why the AR method could be of more beneficial for some students than others. The clustering results complemented earlier findings on AR gains in learning, as an unexpected response to intervention was discovered using this nonlinear analysis. The previous results had indicated that after the AR experience, science test results generally improved and particularly among students with the lowest achievement. The SOM-clustering results showed a majority group of boys, especially those interested in science learning both at school and at the science center using AR. Despite low school achievement, their high motivation led to good science learning results. The prior results, according to which girls closed the science knowledge gap between boys after using AR, became more relative, as two girl-dominated subgroups were identified. The reasons for the results were considered on the basis of motivation, multimedia learning theory, and concept formation theories.

Keywords

  • science learning
  • augmented reality
  • informal learning environment
  • SOM-clustering
  • self-determination theory

1. Introduction

Augmented reality (AR) technology offers possibilities to demonstrate complex phenomena in a novel way. At its best, the novelty of AR makes it an effective servant [1], but on the other hand, it sometimes has been shown to increase cognitive load due to bad practical usability and also because the tasks used are too complicated [2]. The AR advantages can be theoretically understood through multimedia learning theory, which explains how blending virtual contents into the real world can support brain functioning in cognition and learning [3]. The theory stresses the use of pictures in learning instead of just words [4]. Afandi et al. [5] elaborate on the theoretical points further as applied to AR by replacing pictures with real objects and words with symbols and virtual text. From the sociological perspective, the AR method can likely enhance the fulfillment of the essential idea of big principles and ideas of science education [6] and advance understanding about science even for people who otherwise would remain outsiders. AR can be viewed as a great example of tools which, for their part, pave the way for attaining the twenty-first-century competences [7, 8].

In the Finnish national core curriculum [9], the twenty-first-century competences are called transversal competences, which include seven areas. The area with which the connection with AR is most direct is the information and communication technology (ICT) competence. It relates to understanding the principles and essential concepts of ICT and involves creative manipulation of ICT applications and through it communicating thoughts and ideas. In addition to being as an essential skill itself, it is asserted to support the thinking and learning-to-learn competence and to be a sub-skill of the multiliteracy competence.

Augmented reality as a support method for learning has previously mainly been studied in a classroom context [10], although positive results have also been reported in informal learning environments [11]. Most of the previous studies have been qualitative, but based on a meta-analysis of 87 articles [3] and in another 64 analyses [12], a medium effect of AR on learning has been identified, usually in cross-sectional designs. The goal of these variable-oriented studies has been to show general tendencies, usability, advantages, and disadvantages of AR [13], and the compared variables have been knowledge tests, school achievement, motivation, collaboration, and other variables related in learning [14].

The most important article relating to the present book article is “Making invisible observable, learning abstract phenomena in an abstract way” [15]. In that study AR was applied in a quasi-experimental pre- and posttest design in an informal learning environment, i.e., in the science center. As expected based on the research literature, positive learning results were obtained, although without a controlled design, using test and control group interpretation of the results must be cautious. The effect found between the pre- and posttest in knowledge gain was of medium size (partial η 2 = .10), which the result was further analyzed using a structural equation path-model controlling motivational and cognitive variables. Pupils’ prior interest in science and readiness to take responsibility for setting their own goals have previously been found to enhance learning in an informal learning environment [16].

Our study showed two routes which seemed to enhance the post-knowledge scores. The stronger one was going via preknowledge and the other less effective through attitudes and motivation. Knowledge before the exhibition had a direct medium prediction effect on the post-results, but a positive attitude towards science center education had a direct effect, as well. School achievement, gender and autonomy experience, positive attitude, and situation motivation towards the science center education all predicted indirectly some of the knowledge results after the intervention. Based on the results, the AR technology experience was shown to be beneficial, particularly for the lowest-achieving group. Also, girls took advantage of AR and had as high knowledge scores as boys in the posttest.

Now, in the present book chapter, the aim is to complement and cross-validate our previously reported results by using methodological triangulation by a person-centered approach elaborated from the Finnish version [17]. The aim is to elaborate the general tendency found, the general rule, that the low in-school achieving students and girls would specially benefit from the use of AR. In order to identify the deviation from the general tendency, the possible subgroups, and the potentially interesting nonlinear connections, the students are clustered based on the results of the learning, cognitive, and motivational test results.

The research questions are:

  1. What kind of subgroups and results complementing the previous study can be identified by clustering the AR-using students based on cognitive reasoning, motivation, science interest, and knowledge learning test results?

  2. How are boys and girls and students achieving differently in the school environment represented in the subgroups?

Advertisement

2. Method

2.1 Participants

The participating 146 pupils were 11–13 years old, and 51% (n = 75) of them were girls. They were from seven schools from the Helsinki Metropolitan Area in Finland.

2.2 Context

The pupils visited a typical science center exhibition, which included five AR technology-supported exhibits. They were (1) the Doppler phenomenon, (2) Boltzmann’s molecule movement, (3) the Young experiment, (4) the airplane mini wing exhibit, and (5) rolling double cone.

The context of the study was formed as an open learning environment consisting of AR equipment (Figure 1), hands-on exhibit (Figure 2), experimenting with small-scale real objects (Figure 3), and testing AR demonstrations (Figure 4).

Figure 1.

AR equipment showing the functions of the airplane wing with air flow.

Figure 2.

Pupils testing the real hands-on wind tunnel.

Figure 3.

Pupils building and testing a small-scale airplane.

Figure 4.

Testing AR plane in informal settings.

The photos above are showing just one case related to flying. Also all the four other topics were taught based on the same pedagogical principle: the mixed reality as an open learning environment was formed by bridging the gap between virtual AR technology, real hands-on objects, and interactive learning by science center exhibition objects.

2.3 Instruments

  1. Deci-Ryan motivation. A self-determination theory (SDT)-based SRQ-A questionnaire was used to examine relatively stable academic motivation (32 test items, Likert scale 1–4, α = .92). The SRQ-A test includes a formula [18] based on which the relative autonomy index (RAI) was calculated. It describes the overall autonomy level experienced by the pupil. It was only applied as a pretest (Table 1).

  2. Situation motivation test. This provides information about how attractive pupils found the exhibition (14 items, Likert scale 1–5, α = .91). It was applied only as a posttest.

  3. Learning context. School vs. augmented reality in a science center. Context-specific interest was measured in the school context vs. the informal science center context by applying the semantic differential method [19] (14 pairs of adjective alternatives, Likert scale 1–5, pretest α = .81, posttest α = .88).

  4. Raven test. The Raven standard progressive matrices [20] were used to test cognitive visual reasoning. The test contains 60 items divided into 5 sets (A–E). Each of these groups contains 12 tasks (α = .79, 60 items).

  5. The knowledge tests. These consisted of 31 items related to the content areas of the school curriculum of the science subjects, and these contents were combined with the AR solutions in the science exhibition. The questions were piloted 2 months before the actual preknowledge test. The post-knowledge tests were conducted 1 week after the science exhibition visit. In the test the pupils were asked to assess whether they thought the knowledge statements presented were correct or incorrect or whether they were uncertain about them (pretest, α = .72; posttest, α = .77, 31 items).

Table 1.

Design of the study.

The background variables were gender and school achievement, for which we used four school grades (physics, chemistry, mathematics, and mother tongue). The students were grouped into three groups based on achievement (1 lowest quartile, 2 + 3 quartiles, 4 highest quartile).

2.4 Statistical analysis method

The pupils were clustered on the basis of their scores by applying the self-organizing maps method (SOM) [21], a neural network model [22] which is based on unsupervised learning of fuzzy logic. Compared, for example, to K-means clustering, the advantage is that within the SOM cluster, the nearer one pupil ends up to another, the closer the likeness between them is. In the K-means cluster, the neighborhood does not count, and the pupils are merely listed in the cluster, and cluster membership is the information obtained [23, 24, 25].

The SOM method has been widely applied internationally, especially in biotechnology, economy, and technical industries [26]. In social sciences the applications are rare, although it has been shown to have promising possibilities in educational and learning research [27, 28], in the area of psychology, for example, relating in early language learning [29] and in sociological research [30].

Using the SOM method, the goal was to identify subgroups particularly benefitting or non-benefitting from AR. The data of the cluster were transferred to SPPS 25. The statistical significance of the difference between the theoretically expected and observed number of students in each cluster was tested using the chi-square test, and the adjusted residuals (criterion: absolute value ≥2) were used to pinpoint the over- or underrepresentation in each cross-tabulated cell. The differences between the clusters (dummy variables: each cluster vs. all others) were compared using one-way analysis of variance. The change between the pre- and posttests results was analyzed using the general linear modeling method (GLM repeated measures) and its effect size by the partial η2-coefficient (interpretation: >.01 small; >.06 middle; >.14 large).

Advertisement

3. Results

Using the SOM method, five clusters were obtained. When the clusters were cross-tabulated against gender and school achievement groups, the result was that boys and girls were not represented equally as expected in the clusters (χ2 = 18.63, p < .001) and that was also true with the achievement groups (χ2 = 25.38, p < .001). The statistical descriptives are presented in Table 2 and the 95% confidence plots of the knowledge test results (correct, incorrect, uncertain) in the two time points by cluster in Figure 5.

Table 2.

The statistical descriptives.

Figure 5.

Knowledge test T0 (pre-test) and T1 (post-test), correct, incorrect and uncertain answers.

In order to illuminate how the science knowledge test results looked like before and after the science center visit intervention, and the change, we present the 95% confidence plots of the knowledge test results. They are divided into correct, incorrect, uncertain answers in the two time points by cluster in Figure 5.

3.1 Cluster 1 (n = 26; 18%): motivated, low school achievers, boy majority

Significantly more boys (adjusted residual = 3.2) and lowest in-school achievers (adjusted residual = 2.2) than expected. When dummy variable cluster 1 was compared to all the others, in cluster 1, cognitive reasoning was lower; situation motivation and interest in science both in the school and in the exhibition were higher. In the pretest there were more incorrect answers. The correct answers increased (η2 = .43) and incorrect ones decreased (η2 = .44) after the science exhibition and AR-assisted method.

3.2 Cluster 2 (n = 29; 20%): high achievers

Cluster 2 was not gendered; there were an equal number of boys and girls. However, there was a strong representation of in-school highly achieving students (adjusted residual = 3.8). In comparison, in this cluster the pupils had the highest cognitive reasoning scores, higher situation motivation, and interest in science learning at school than the others. They had more pre- and post-knowledge correct answers and fewer incorrect answers at both time points. The correct answers increased significantly (η2 = .16), and the uncertain answers decreased (η2 = .26).

3.3 Cluster 3 (n = 32; 22%): motivated but non-learners, girl majority

In cluster 3, the different school achievers were equally represented, but gender played a role: girls were significantly more represented than boys (adjusted residual = 2.6). In the dummy comparison, students in this cluster had a higher autonomy experience and situation motivation than others. It was notable that in the post-knowledge test after the exhibition, their incorrect answers were found to even increase (η2 = .24) and were the highest scores of all clusters but uncertainty decreased (η2 = .26).

3.4 Cluster 4 (n = 35; 24%): non-motivated by exhibition but learning

In this cluster, the background variables made no difference: there were an equal number of boys and girls and different type of school achievers. The dummy comparison revealed that they had the lowest autonomy experience (RAI) and situation motivation. They were less interested in science learning in school and especially in the exhibition than others. In the preknowledge test, they had more incorrect but fewer uncertain answers than others. After the exhibition the correct answers increased (η2 = .39), incorrect (η2 = .23), and uncertain ones (η2 = .18) decreased.

3.5 Cluster 5 (n = 24; 16%): non-motivated, girl majority

In this cluster there was an overrepresentation of girls (adjusted residual = 2.1), a little less so than in cluster 3. In the dummy comparison cluster 5 versus others, these students were found to have a lower autonomy experience, lower situation motivation, and interest in science learning. In both time points, they had fewer correct and incorrect answers in the knowledge tests than others. However, the most striking difference was that both in the pre- and post-situation, they had more uncertain answers than others. In this cluster the knowledge test results did not change significantly from the pretest to the posttest.

Advertisement

4. Discussion

Previous studies [14] have shown that AR usually enhances learning in an effective way, despite some results that show that the effect seems to fade in the long run [11]. Similar results were found in our earlier study [15]: in general AR improved learning results, and this was supported by interest and situation motivation, especially among boys. In a girls’ group, in turn, experienced autonomy was an important explainer of science learning results. Importantly, the lowest school achievement group especially was found to gain from the use of AR technology. By clustering the same data, we could detect deviations from these general tendencies, i.e., relating to the role of reasoning, school achievement, motivation, and science interest in knowledge learning.

4.1 Low in-school achieving pupils can also have high learning results when they act in an informal learning environment

The cluster analysis revealed that good school achievement is not the only factor leading to motivation in science and to good learning results. Although cluster 2 with an equal number of boys and girls was formed, in which everything (reasoning, school grades, interest in science at school, motivation, and knowledge results) was optimal, we also found that prior school achievement and cognitive reasoning were not totally deterministic factors, and one of the most encouraging result of the clustering study was that a deviant group (cluster 1) from the general rule could be identified. In this cluster, boys were the majority, who, in spite of low school achievement, were especially interested in science learning both at school and at the science center using AR. This led to good science learning results subsequent to the exhibition. Even though they had more incorrect knowledge answers in the beginning than the others, their interest clearly supported learning, as correct answers increased after the AR experience. This result deviates from most meta-results obtained from informal learning contexts [31, 32].

It seems that the idea of using AR-supported learning was successful in its goal to introduce abstract phenomena in a concrete way. Learning by doing and personal experimentation made a crucial link between theory and practice possible, and deduction and induction were combined in a pedagogically effective way. That the pupils were interested showed up both in that they found the science-centered environment attractive (situation motivation) and in that they were deeply engaged in the theme contents (intrinsic motivation) as they learned the scientific knowledge.

4.2 Experienced lack of choice, low autonomy, and low motivation may unexpectedly lead to high results in tests—but at high costs

The somewhat puzzling and unexpected finding relates to the role of autonomy and situation motivation in learning. The general rule, which shows that a low autonomy experience and situation motivation usually lead to less learning and worse learning outcomes, did not materialize in the fourth cluster. In that group the students learned, although they were less autonomous than all the others, less motivated by the AR-assisted learning situation, and in general less interested in science learning overall. The number of correct knowledge answers increased, while incorrect and uncertain answers decreased. This result opens up an interesting theoretical point.

According to the SDT theory [33], nonautonomous motivation is based on the avoidance of sanctions, on hope of rewards, or on experienced pressure. It has been found that the learning results of externally motivated and, thus, less autonomy experienced students might remain more superficial and short-term than those of their more intrinsically motivated classmates. Previous research further indicates that if a student acts because she or he feels anxiety and pressure, psychological energy is consumed for defense of self, and less energy remains for learning new things [34, 35].

Our earlier path-model results, according to which the girls closed the science knowledge gap between boys after using AR, became more relative, as two girl-dominated subgroups were identified.

4.3 Experienced autonomy and motivation usually—but not always—correlate with learning

In cluster 3, with the girl majority, the pupils experienced more autonomy than others and were also motivated by the AR experience, but in both pre- and post-situation had incorrect conceptualizations—they even increased after the science center visit—in contrast with the boy-majority group just described. When, on the other hand, the low rate of uncertainty of knowing found already in the pretest further (unrealistically) decreased after the science center visit, one might wonder what the reason was: why did the experienced autonomy and being attracted by AR use in the exhibition not lead to self-correction of the wrong ideas and learning? Theoretically, AR usually seems to be a practical tool to support the Kolb learning cycle, which starts by being exposed to a concrete experience, following by reflective observation and further transferring to abstract conceptualization and finally leading to active experimentation [36].

Perhaps the phase of reflective observation remained superficial, and/or the abstract conceptualization phase failed [36]. In the research on learning concepts [37, 38], it has been observed that if one builds concepts on incomplete information and only partially, these misconceptions are later very hard to change—most probably even in interesting contexts such as in the AR-connected science exhibition. The big challenge for science teaching is, thus, to identify possible misconceptions and partially formed concepts and to make a necessary return to the earliest phase of the conceptualization process.

4.4 Low autonomy, no interest in AR, much confusion showing as uncertainty, and lowest learning results—as expected, but how to intervene?

In cluster 5, the pupils, with a girl majority, were highly uncertain both before and after the AR experience. While the students in this group were less autonomous and motivated by the exhibition situation, their lowest knowledge results were only as one could expect. Theoretically [36], interpreting the result of this cluster, these pupils (i.e., especially because there were girls in this group) have not been successful in creating meaning from their AR- and science-centered learning experience, and therefore, the whole experiential learning cycle process has been interrupted. The worst conclusion is this failure may be only one in a series of previous failures.

Advertisement

5. Concluding remarks

These results are of interest especially because they add information about different types of pupils who use AR for learning. Some of them clearly somewhat unexpectedly seem to take advantage of the use of AR as a pedagogical tool more than many of the others, even though the preconditions of low school achievement and reasoning skills would have predicted less optimistic AR-learning gains. On the other hand, the results also illuminate situations in which pedagogical intervention would be advisable: an essential notion was that unrealistically, high expectations might arise for AR usage based on superficial observation about the seemingly motivated pupils. In those cases, pupils might be autonomously and eagerly engaging in the task, but in reality, it remains unnoticed that they do not necessarily have enough guidance to make correct conclusions based on their AR experiences.

The most vulnerable group of pupils from the perspective of the big principles and ideas of science education [6] was, however, those on whom the AR experience showed to have no or little effect. Despite the fact that they were fulfilling the expectation based on low motivation and interest proposed by the multimedia learning theory [3, 5], one could have hoped that AR as a novel method would have been more successful. The result is most worrying: what could be done differently, if the novelty effect, a new method to change abstract concepts to more concrete ones, and a fresh, untraditional learning environment were not working? At least we could design the AR-learning situation even more carefully [39].

Perhaps one way would be to assure that AR technology really is as easy as possible to use and that there is enough guidance at the start and support available during the whole process. Simultaneously, it should be assured that the goals are realistic and simple enough. In addition to that, Cheng and Tsai [2] suggest care should be taken that the numerous possibilities of AR do not become too overwhelming and lead to cognitive overload, as short-term memory resources are limited.

Most of the research around mixed reality has focused on technical and practical issues or an evaluation of usability. Educational research on learning aspects has already produced some useful meta-articles on the strengths and weaknesses related to augmented reality [14, 40]. Digitalization has doubtless changed our everyday life—also related to learning. However, the research-based evidence, especially related to the latest, brand new technologies also tend to give false promises or create ambiguous future visions [41] (Säntti & Saari, 2017). Accurate results are needed not only for more meaningful learning but also to create cost-effective solutions and to avoid wrong, often expensive investments.

This study related to learning outcomes has produced some new evidence based on cluster analysis supplementing the earlier findings. Making an invisible phenomenon observable is clearly the strongest input of AR—especially when it offers an opportunity to learn an abstract and difficult topic in a concrete, observable way. Mixed reality combines visible elements with an already existing realistic environment and makes it more understandable. Augmented reality is applicable and works best when teaching real and restricted learning contents, and thus, it is really a challenging superficial “phenomenon-based education.”

Although one has to keep in mind that the process is not straightforward, there are many intervening factors relating to motivation and factors of self; encouraging possibilities emerge through the AR method. One of the most promising results is that this type of intervention and learning method really can support low-achiever students to close the gap on other students. However, it also provides opportunities and challenges for high-achieving students. It also seems to give valuable opportunities for bridging the gap between formal education and informal learning.

References

  1. 1. Zhang J, Sung Y-T, Hou H-T, Chang K-E. The development and evaluation of an augmented reality-based armillary sphere for astronomical observation instruction. Computers & Education. 2014;73:178-188
  2. 2. Cheng K-H, Tsai C-C. Affordances of augmented reality in science learning: Suggestions for future research. Journal of Science Education and Technology. 2013;22(4):449-462
  3. 3. Santos MEC, Chen A, Taketomi T, Yamamoto G, Miyazaki J, Kato H. Augmented reality learning experiences: Survey of prototype design and evaluation. IEEE Transactions on Learning Technologies. 2014;7(1):38-56
  4. 4. Akçayır M, Akçayır G. Advantages and challenges associated with augmented reality for education: A systematic review of the literature. Educational Research Review. 2017;20:1-11
  5. 5. Afandi B, Kustiawan I, Herman N. Exploration of the augmented reality model in learning. Jornal of Physics Conference Series. 2019;1375:012082. DOI: 10.1088/1742-6596/1375/1/012082
  6. 6. Harlen W. In: Harlen W, Bell D, Devés R, Dyasi H, de la Garza DF, Léna P, Millar R, Reiss M, Rowell P, Yu W, editors. Principles and Big Ideas of Science Education. Association for Science Education. Gosport, Hants: Ashford Colour Press Ltd., 2010. Available from: www.ase.org.uk/bigideas. ISBN 978 0 86357 4 313
  7. 7. Deakin R, Stringer C, Ren K. Learning to learn. In: International Perspectives from Theory and Practice. London: Routledge; 2014; 354 p. DOI: 10.4324/9780203078044
  8. 8. Voogt J, Pareja Roblin N. A comparative analysis of international frameworks for 21st century competences: Implications for national curriculum policies. Journal of Curriculum Studies. 2014;44(3):299-321. Available from: https://pdfs.semanticscholar.org/831e/f07db8a589b91a508e0118f6f3c2a1f18c19.pdf
  9. 9. Finnish National Board of Education. FNCC: Finnish National Core Curriculum. Helsinki: Opetushallitus; 2019
  10. 10. Salmi H, Kaasinen A, Kallunki V. Towards an open learning environment via augmented reality (AR): Visualising the invisible in science centres and schools for teacher education. Procedia: Social and Behavioral Sciences. 2012;45:284-295. DOI: 10.1016/j.sbspro.2012.06.565
  11. 11. Sommerauer P, Müller O. Augmented reality in informal learning environments: A field experiment in a mathematics exhibition. Computer Education. 2014;79:59-68. Available from: https://core.ac.uk/download/pdf/143481015.pdf
  12. 12. Garzón J, Acevedo J. Meta-analysis of the impact of augmented reality on students’ learning gains. Educational Research Review. 2019;27:244-260. DOI: 10.1016/j.edurev.2019.04.001
  13. 13. Yilmaz Z, Batdi V. A meta-analytic and thematic comparative analysis of the integration of augmented reality into education. Education in Science. 2016;41(188):273-289. DOI: 10.15390/EB.2016.6707
  14. 14. Bacca J, Baldris S, Fabregat R, Graf S, Kinshuk K. Augmented reality trends in education: A systematic review of research and applications. Education Technology & Society. 2014;17(4):133-149
  15. 15. Salmi H, Thuneberg H, Vainikainen M. Making the invisible observable by augmented reality in informal science education context. International Journal of Science Education. 2017;7(3):253-268. DOI: 10.1080/21548455.2016.1254358
  16. 16. Renninger K. Individual interest and its implications for understanding intrinsic motivation. In: Sansone C, Harakiewicz J, editors. Intrinsic Motivation: Controversies and New Directions. San Diego, CA: Academic Press. pp. 373-404
  17. 17. Thuneberg H, Salmi H. Näkymätön havaittavaksi—klusterianalyysi abstraktin ilmiön oppimisesta konkreettisesti lisäketodellisuuden (augmented reality) avulla. Psykologia. 2018;53(2-3):203-217. With English Summary
  18. 18. Ryan R, Connell J. Perceived locus of causality and internalisation: Examining reasons for acting in two domains. Journal of Personality and Social Psychology. 1989;57:749-761
  19. 19. Osgood CE. Semantic differential technique in the comparative study of cultures. American Anthropologist. 1964;66(3):171-200
  20. 20. Raven J, Raven JC, Court J. Manual for Raven’s Progressive Matrices and Vocabulary Scales. Oxford: OPP; 2003
  21. 21. Kohonen T. Self-Organizing Maps. New York: Springer; 2001
  22. 22. Kohonen T. The self-organizing map (SOM). 2005. Available from: www.cis.hut.fi/projects/somtoolbox/theory/somalgorithm.shtml [Accessed: 02 June 2017]
  23. 23. Kohonen T. Personal Consultancy. Espoo: Technical University; 2006
  24. 24. Kaski S. Data exploration using self-organizing maps. In: Acta Polytechnica Scandinavica, Mathematics, Computing and Management in Engineering Serie. Espoo: The Finnish Academy of Technology; 1997. p. 82
  25. 25. Oja E, Mannila H. From data to knowledge, chapter 7. Self-Organizing Map. Available from: http://www.cis.hut.fi/Opinnot/T61.2010/Luennot/JohdantoWhite.pdf
  26. 26. Laboratory of computer and information science—Bibliography. Bibliography of SOM-Papers. 2017. Available from: http://www.cis.hut.fi/research/refs/ [Accessed: 02 June 2017]
  27. 27. Thuneberg H, Hotulainen R. Contributions of data mining for psycho-educational research: What self-organizing maps tell us about the well-being of gifted learners. High Ability Studies. 2006;17(1):87-100
  28. 28. Thuneberg H. Is a majority enough? Psychological wellbeing and its relation to academic and prosocial motivation, self-regulation and achievement at school. In: Research Report 281. Helsinki: Department of Applied Sciences of Education, Faculty of Behavioural Sciences, Helsinki University Press; 2007
  29. 29. Mayor J, Plunkett K. A neuro-computational account of taxonomic responding and fast mapping in early word learning. Psychological Review. 2010;117(1):1-31. DOI: 10.1037/a00181300
  30. 30. Carboni O, Russu P. Assessing regional wellbeing in Italy: An application of Malmquist–DEA and self-organizing map neural clustering. Social Indicators Research. 2015;122(3):677-700
  31. 31. Rennie L. Learning science outside of school. In: Lederman N, Abell S, editors. Handbook of Research on Science Education. Vol. II. London: Routledge; 2014. pp. 120-144
  32. 32. Tan LWH, Subramanian R. Science and the student entrepreneur. Science. 2002;298(5598):1556. DOI: 10.1126/science.1074497
  33. 33. Ryan R, Deci E, Grolnick W. Autonomy, relatedness, and the self: Their relation to development and psychopathology. In: Cicchetti D, Cohen D, editors. Developmental Psychopathology, Vol. 1, Theory and Methods. New York: John Wiley & Sons, Inc.; 1995. pp. 618-655
  34. 34. Reeve J. Self-determination theory applied to educational settings. In: Deci E, Ryan R, editors. Handbook of Self-Determination. Rochester, NY: The University of Rochester Press; 2002
  35. 35. Ryan R, Deci E. Self-determination theory and the facilation of intrinsic motivation, social development, and well-being. American Psychologist. 2000;55(1):68-78
  36. 36. Kolb D. Experiential Learning: Experience as a Source of Learning and Development. Prentice Hall: Englewood Cliffd; 1984
  37. 37. Klausmeier H, Hooper F. Conceptual development and instruction. In: Kerlinger F, Carroll B, editors. Review of Research in Education, Vol. 2. New York: F. E. Peacock; 1974
  38. 38. Klausmeier H. Concept learning and concept teaching. Educational Psychologist. 1992;27:267-286
  39. 39. Bressler D, Bodzin A. A mixed methods assessment of students’ flow experiences during a mobile augmented reality science game. Journal of Computer Assisted Learning. 2013;29(6):505-517
  40. 40. Radu J. Augmented reality in education: A meta-review and cross-media analysis. Personal and Ubiquitous Computing. 2014;18(6):1533-1543
  41. 41. Player-Koro C. The contemporary faith in educational technology—A critical perspective. Tidskrift för Professions Studier. 2016;23(2):98-106

Written By

Helena Thuneberg and Hannu S. Salmi

Submitted: 30 October 2019 Reviewed: 17 January 2020 Published: 14 February 2020