H809: Week 7 roundup

Ok, I think I've always been about a week behind with the posts but it also looks like people on the course are trying to play catch up too, and I've been pretty busy with PhD work, so I am probably a bit more behind than usual. And yeah, I haven't caught up on the reading for weeks 8 and 9 either...

But anyway. Week 7 has been interesting, but before I go on to that I wanted to post a couple of interesting links that have popped up on the forums since last week. The first is to a blog post called "How Online Communities and Flawed Reasoning Sound a Death Knell for Qualitative Methods". The second is related to last weeks discussions on audiences, and is a link to a New Scientist article on how the media can distort research findings. There was a little more talk about audiences and ethics as well, with it being pointed out that often a researchers write for themselves in order to clarify and work through ideas (i.e. you are your own audience) and that the notion of "informed consent" can be a tricky one when dealing with minors and those whose first language isn't English.

As for week 7 though, the main theme (and for the rest of this block) is learning theories. The discussions in the forums and on the blogs definitely suggest there is a fair amount of confusion going on here in terms of just what constitutes of learning theory and which ones go under what headings. One of the tutors posted a link to a summary of learning theories by Helen Beetham that fits in closest to my own thinking, which I hope helps clarify some of the confusion.

As for the readings, there were two papers this week. The first was by Conole et al. (2004) called ‘Mapping pedagogy and tools for effective learning design’. The paper attempted to provide e-learning practitioners with a framework to relate learning theory to practice. At least some of the debate in the forums related to how the criteria used to classify different learning theories (individual - social, reflection - non-reflection, information - experience) could be applied differently, and so perhaps the framework proposed would be better for enabling practitioners to see how their perceptions of different learning activities vary from each other. For a brief summary and interesting reflection on the paper see Juliette's post on Learning Theories (Part 2), where she also raises the question of just what is a learning theory exactly. Part of the weeks activities included trying to put the previous blocks (weeks 1 to 5) readings into the summary headings provided by Conole and colleagues such as behaviourism, constructivist. systems theory etc. Sonja had a go on her blog at Mapping papers onto theories. She also considered her own teaching in terms of learning theories.

The second paper by Jones and Preece (2006) is called ‘Online communities for teachers and lifelong learners: a framework for comparing similarities and identifying differences in communities of practice and communities of interest’. I think one of the most interesting points made in connection to this paper within the forums was about how the researchers developed a framework based on theory to inform their research but it still isn't clear from the paper alone how they came up with the factors included in the model. In relation to using theory to inform practice, I'd like to think these factors have come up as significant in previous research., especially as a lot of them (e.g. common ground, trust) are familiar from when I studied Human Computer Interaction at Bath. However, without having a copy of the previous publications referred to in front of me, it's difficult to know for sure. For an example of how the framework Jones and Preece present could prove useful for other research purposes, check out JM's post here. Juliette has also posted her reflections on the paper in Learning Theories (Part 3), including a consideration of the difference between theories and frameworks, echoing some of the discussions occurring in the forums.

Finally, all this talk about learning theories has gotten me thinking about how they relate to game-based learning. If I am going to use the categories used by Helen Beetham above, then I need to start with behaviourism. At the most basic level, I reckon that you could safely use a behaviourist perspective to discuss how players learn game controls - it's a simple case of pairing the right buttons (stimulus) with the right actions occurring in the game (response). As you move further into the game though, the constructivist learning principles start to come through - you are an active participant in this process, you have to try things out and regulate your performance while the game attempts to scaffold your activities by starting the game out easy and then making it progressively more difficult. If you are playing with other people, co-located or otherwise, social constructivism kicks in as your peers help you out, and/or you start engaging in collaborative activities. Finally, maybe you now start to see yourself as a "gamer", so apart from playing the game, you start to engage in other activities around it - talking about it with friends and online, reading magazines/blogs, contributing to walkthroughs etc essentially participating in a community of practice - or what James Paul Gee is talking about when he talks about "semiotic domains" and "affinity groups" of players.

For a really interesting take on how video games embody different learning theories see Ian Bogost's "Persuasive games" chapter 8. He mentions the three perspectives I used in the previous paragraph but what I find most interesting is how he explains the media effects argument as a behaviourist perspective. The idea is that violence in game-play will be reinforced and thus more likely to occur in real life, implying a direct transfer between the two environments. I doubt that the real story is as simplistic as this - otherwise I really would have beaten up an awful lot of people up by now, and probably stolen a couple of cars - but I guess you could argue that this is essentially what simulations are trying to achieve: a realistic a mapping as possible between the virtual and the real so that behaviour learnt within the simulation will directly transfer to real world situations. And I could see how that could be useful for certain kinds of training, but I always thought this was a situated learning approach, where you are essentially simulating how you would behave in a community of practice. Now I'm thinking,that you would still be doing that but through a process of reinforcement... But if I don't agree with the media effect argument, how can I defend using this same approach for educational purposes? And is this really how we learn from video games? I do know I am interested in games based learning, not simulation based learning or even serious games (which often seem quite similar to simulations), as I think they can provide with a very different sort of learning experience but I need to do a bit more reading and thinking before I can verbalise that.... Hmm, now I'm confused. But it's late and I think that's enough for today so maybe I'll come back to it later.

H809: Week 6 update

I had thought about combining this post with a week 7 entry, as it is a little overdue, but the forums have been a bit quiet so I thought I'd focus on week 6 and wait a little longer to give people a chance to discuss the relevant activities.

The theme of week 6 was audiences and ethics, and while there was no set reading to discuss, students were asked to listen to a podcast - which anyone can listen to from here (thanks to Juliette for posting the link). The podcast was discussion between James Aczel, Eileen Scanlon, Cindy Kerawalla, and Chris Jones about the impact of different audiences on the process of research and how it is reported. Discussions in the forums highlighted the importance of pitching proposals to funders in such a way as to justify the research planned (including a consideration of any ethical issues), the need to be cautious of distorting the findings by oversimplifying the message (e.g. when reporting to a non-technical audience), and how there can often be a tension between what the funders and the researchers want. The latter point is especially true of dissemination activities, as funders will often want publicity straight away, while researchers will tend to want to mull things over a bit and consider the implications. If anyone is interested, this link was posted in the forum cafe to a Guardian discussing the government's interest in "evidence based research". Another point that came up, was how it is common to disseminate the same research findings to different audiences. This reminded of conversations I had when working as a research assistant on the Racing Academy project, where we talked about dissemination in terms of both academic audiences and practitioners, because we also wanted the findings to be useful to teachers who wanted to use game-based learning in practice. In general, the discussions within H809 seemed to suggest that thinking about your target audience should happen quite early on in the research process, because it helps you address the issue who is likely to benefit from your research. This doesn't mean that you should tell funders or other audiences what they expect, but by considering what they might find most useful from the start, you won't have carried out a piece of research that no one wants to hear about! Meanwhile, Juliette and Sonja have both used their blogs to consider how the issues of audiences affect their own research.

In terms of ethics, a lot of the forum discussions focused on the ethics of carrying out research online. Part of this was about the "racial ravine" e.g. only 5% of Internet users are African-American and so a researcher has a duty to note that results may be influenced by inequalities in power relations (be they due to race, class, gender, sexuality etc) or cultural issues. Other issues raised were how to go about getting informed consent from participants (see Juliette's post on ethics for some examples of consent forms and information sheets) and how you can know whether someone online is who they say they are. Linked to the latter point was a suggestion that the Exploring online research methods website might be a little out of date, as there is little consideration of Web 2.0 technologies in terms of ethics. An article was also linked to about the failure of Captcha systems (which I seem to have to deal with everytime I buy gig tickets or post a blog comment) to distinguish between computers and humans. Students have also begun to think about how to address ethics in their own research by posting case studies to the wiki (which you can access here if you are logged into the course website) including JM who has posted her case study online. Finally, there was also some talk about the difficulty of maintaining the anonymity of participants. Changing someone's name is not always enough, as they can be identified by other information. For example, it was pointed out in the forums that while Hiltz and Meinke (1989) did not refer to participants by their real names, they did make a potential breach of privacy by informing us that not only did the Upsala college's ice hockey team take part in the project but also hat some of them failed to show up on-line on a regular basis. It is worth noting however, that even if care is taken to anonymise identifiable information about participants, they may still find it somewhat uncomfortable to read about how their behaviour is interpreted by the researcher(s). One way to avoid this is to make sure your participants get to read your interpretations before you publish them, but this also runs the risk of them withdrawing their consent during the final stages of your research...

As usual, I've been trying to think about my own take on the topics being addressed in H809. In terms of audiences, I think I'm probably focusing on an academic audience at the moment as I'm not looking at anything that directly relates to educational practice just yet. However, studying games and learning means there are a variety of academic audiences I can address as I seem to be some sort of psychology, computer science, education type crossroads which I can also talk about in terms of HCI (Human Computer Interaction) user experience evaluation. I think this will be especially obvious when it comes to writing up my findings, and is something I have already become aware by submitting papers to different types of conferences. In terms of ethics, I don't think I'm going to have any major problems as it looks like I'm going to be using adults (keep in mind that when children are being used in research projects, there will be even more ethical issues to consider and processes to complete such as a Criminal Records Bureau check), and won't be asking them to do anything that could cause them serious harm. That said, if I do end up using these gaming vests, there may be some potential for physical injury that I will need to take into account and justify my reasons for wanting to look into. I should also say that even though I didn't need to get ethical approval for the studies I carried out last year during my masters, filling in the OU ethics proforma was still quite a useful exercise as if helped set out what I intended to and made me think about all sorts of issues that need to be considered if you want to carry out an ethically sound piece of research that your particpants won't regret taking part in.

H809: End of block 1

This is just a quick post to wrap up the last of block 1 so we can all start afresh for the next part of the course.

I can imagine that everyone has been very busy getting the first assignment in (due today) so things have been a little quieter. In week four, there was some discussion about referencing tools and bibliographic software. It's something I have to keep reminding myself to do - keep track of what I'm reading and where to find it - but I have to admit I don't always stay on top of. But, once you get to grips with the tool you are using, it's one of those things that will actually save you time in the long run and well worth it. The main tools that have come up in the discussions include Refworks, Endnote and Zotero (which is the one I actually use). I did have a go at Endnote but Zotero just seems easier - I love the fact I can add references just straight from my browser, though you do need to be using Firefox to do so). Plus, if you use it in combination with something like Dropbox (suggested in one of the forums) you don't have to worry about only having access to it on one PC. Oh, and Zotero is also free, unlike the other two. In general, while using any of this kind of software does have a bit of a learning curve, the advantages far outweigh the disadvantages since they allow you to keep a record of what you've been reading, attach notes about this, create bibliographies in specific styles and avoid having to repeatedly search for the same document. Another link posted on the forum is to a review paper on blended learning, which shows how powerful things like using the keyword function can be (see appendix 1).

The last paper to be read in Block one was "Learning by Collaborating: Convergent Conceptual Change" by Jeremy Roschelle (1992). Unfortunately there wasn't a whole lot of discussion going on about this one, but it is rather heavy going and in combination with the upcoming TMA1, I suspect people had less time to get into it. Mike Protts did post his own reflections on the paper though, and relates them to "extreme programming". One of my supervisors gave me the paper to read last year, and I remember thinking at the time that it was an incredibly detailed account of a single case. While this obviously imposes limit on the generalisabilty of the claims made, the claims are often supported by referencing other studies, and the paper does provide a really interesting account of the processes that occur when trying to come to a shared understanding about scientific concepts - which are notoriously difficult to get right (see this link from the forums about how it can all go very wrong). I liked how the author discussed the findings in terms of theories of learning including constructivism and situated action. If pairs are learning through convergent conceptual change then it illustrates that collaborative learning can occur without the need for asymmetrical pairs (Vygotsky) and/or without cognitive conflict (Piaget) in order for the participants to achieve mutual understanding. By referring to situated action as well, there is a further emphasis on the context within which the interactions take place, because the environment is seen as an integral part of our cognitive processes. The reference also reminded of when I did my Human Communication and Computing MSc at the University of Bath, where we did an awful lot of talking about how technology can be used to support the process of achieving common ground during collaborative activities.

How does this relate to my current research? I'm not really sure it does to be honest, as even though I may be using a case-study approach I'm not sure I want one this detailed! While learning through collaborating is something I definitely want to keep in mind, I'm not focusing on formal learning of scientific concepts and I'm not sure I'd be comfortable enough to use a discourse analytic approach (in the form of conversational analysis) to analyse co-located game play interactions. But I guess it's an option! At the very least, it's given me something to think about in terms of methods and theories that concern collaborative learning.

So that's it for block one. I hope everyone got their TMAs in ok and that you're all looking forward to block two. It starts this week with a focus on audiences (something Sonja Tack has already been thinking about) and ethics.

User-generated content

So, what is user generated content then? I've been thinking about this sort of thing for a while now I think I first mentioned it when I was writing about Spore. In relation to games, it means you not only get to play them but you get to have some input into the game, by designing your own levels, for instance. This is beyond being able to customise your avatar in an RPG, as it influences the gameplay itself. The concept is quite similar to modding, which has been around for ages, with whole communities built around it e.g. for Counter-Strike (which is itself a mod of Half -Life). But though modding tools are sometimes made available for certain games, the process was usually quite technical. There has been a more recent move though, towards encouraging this sort of user-generated content by making it easier to do, with games like Little Big Planet (LBP) allowing players to design, build and share their own levels. The video below is an example of a player created LBP level, based on Takeshi's Castle:



The reason I'm interested in all this, is because I think it says a lot about different player motivations. There seems to be a certain type of player who is not content with the experience of playing but wants to create as well. Things is, I'm just not sure I'm one of them. And as much as stuff like Sporn and my mate creating a phallic shaped rocket ship in Little Big Planet can amuse me, it's just not what I want to be spending my time doing. Don't get me wrong, I know people can come up with some pretty impressive creations (as the video above illustrates) and I actually really enjoy games like SimCity where you get to build your own city. I'm just not that fussed about being able to design the landscape I'm going to build the city on. In Spore, I felt like I had to push myself through the creature design stages in order to get to the good bit (and I was so relieved when I realised I could just use the games own designs and other peoples for stuff like planes and buildings in the later stages). In Little Big Planet, I watched my sister sit through boring tutorials to get to grips with the level editor controls so she could start producing her own - as an artist I think this really appealed to her, though I have a suspicion she was more interested in creating a novel visual experience, rather than in thinking about it in terms of 'good' game design. It's all really fascinating from a research perspective - I can ask what drives these players to create, something Bartle's 4 types of gamer categories do not account for (I guess it would need some sort of creator/designer category), or I could ask what sort of other skills they develop while they are creating whatever they are creating. But on a personal level, I think just want to play already!

This also relates to how games can be used within education. Teachers can get their students to play games (be they designed to be explicitly educational or not) and try an integrate this into some part of the curriculum or they could get them to build their own games. This isn't that new an approach, Llyod Rieber and colleagues carried out Project KidDesigner back in the late 90s, and you can probably trace it's constructivist roots back to Seymour Papert and LOGO in the 70s. The basic idea is that kids will learn more effectively and acquire a wider range of skills if they are actively constructing something. And with the development of free software tools such as GameMaker, that make designing your own game a relatively simple matter, its become a lot more common than it used to be. If anyone is interested in this sort of thing, Jake Habgood carried out some relatively recent research that looked at the kinds of games children made in after school clubs, while his website contains a whole host of information about the resources out there that teachers and children can use.

I'm doubt a specific approach is better than another, as usual it will depend on the context and how well integrated the approach and context are (if anyone from H809 is reading this post, what I just said definitely relates to the Laurillard (1994) paper from Week 3!). I do find it interesting though that in terms of learning theories you can label this approach as constructivist, while you could talk about massively multi-player online games tends under some sort of communities of practice heading. Plus, it's made me think about what I want from my gaming experiences - and it seems that I don't want to actively engage in an online community, I just want to get on with some actual game play when the mood strikes. But is something I want because it requires less effort? What does that mean for the learning that results from the experience? Is it somehow shallower or less likely to transfer? Maybe I'm just impatient, but I have to admit I don't want to design parts of a game myself as it feels like a lot of work (and even though I am studying games, I still see playing them as a break from 'proper' work). And also, if I've just spent x amount of money on a game, I definitely want to be rewarded by an experience that has been designed for me to play. But that's just me, and I'm beginning to realise that there is a whole range of reasons why people play, and create, games. If we're ever going to be able to truly tap into the educational potential, of using games, I think we're going to have to recognise that and understand these motivations a whole lot better than we do now.

H809: Week Three reflections

I had been meaning to get this post out earlier but have been busy this week trying to submit a conference paper. But it's all in now, so will have to wait and see how it goes.

Students were asked to use academic search engines such as Google Scholar and ISI Web of Science (which you need to access through the OU library page, under databases but remember to sign in first) to find papers and evaluate their impact by checking how many times the papers had been cited. It seems that while this turned out to be a rather time consuming task and that not everyone got the same results, most people concluded that the last two readings didn't seem to have a huge impact and some students started to question whether number of citations was the only way to measure impact - surely having to read them for the course means they have an impact, despite not adding to how many times they have been cited?

There were two readings for this week; the first of which was "How can learning technologies improve learning?" (Laurillard, 1994). The main point that came out of the discussions about this was how important it was to consider the relationship between the context in which learning takes place and the outcomes which result from this learning. It isn't enough to simply ask whether technology x improves learning, but under what conditions does technology x improve learning, something H809 tutor Rhona highlights in her post and links to how to approach TMA1. JM has also posted on how the paper relates to the use of wikis. Another issue that came out of the forums is that technology can sometimes be an obstacle to learning, as students could end up spending too much time getting to grips with the software and not enough on the content they are supposed to be learning. This is actually quite relevant to my topic of research, because there does seem to be a distinction between learning how to play a game i.e. in terms of controls, and other skills that develop as a result of continued play e.g. problem solving, decisions making etc. Another interesting point raised about the paper was how the arguments within it are still valid today with respect to newer technologies (e.g. Web 2.0, virtual worlds), with a link being posted to a New Scientist article about the impact of podcast lectures.

Less was said about the second paper "Knowledge, society and perspectives on learning technology" by Oliver and colleagues (2007). I suspect part of the reason for this is that it continued the epistemological debate over positivism and other social perspectives, and also because we are getting closer to the first assignment deadline. Juliette Culver has posted quite a nice summary of both the papers, and her thoughts on them - from this and the forums it seems students appreciated how the paper outlined different perspectives and gave actual examples of how these would influence research in practice. There was also the suggestion that while quantitative approaches might be good for examining whether an effect takes place, qualitative approaches are probably more useful for explaining why the effect occurs (or not). The discussions on frameworks also link to the final activities for this week concerning the podcast about the impact of ICTs in education (you will need to be signed in to access this link). The podcast seemed to get people thinking about how important it is to consider philosophical perspectives, in addition to the other questions suggested in Week 1, when reading about research, as the approach adopted is quite likely to affect the methods and conclusions of the paper.

I think that covers the main events of the last week or so. If anyone has anything to add though, do please let me know. I'd also be happy to receive any feedback about how useful (or not!) these posts are, what I should be including in them, and about the timing of them.

H809: Thoughts on week two

Technically, I guess H809 is in week three, but it seems to make sense to post about the previous works activities (some of which are carrying on) rather than on trying to provide some sort of 'this just happened' account. I thought it would also be worth sharing some wikipedia links that came up in the forums for anyone who was having trouble with the stats reported in last weeks paper - the first concerns F-ratios, and the second ANOVAs. It might also be useful to look at the course wiki (sign in required) to see how some of the students have used it to integrate their different accounts of how technology has been used in education over the years. This activity will help prove useful further on in the course as we start to consider how to contextualise educational research. A link that might be useful for finding relevant articles was also posted in the cafe for Journals in the field of technology enhanced learning.

Week two's reading was ‘Using computer-based text analysis to integrate qualitative and quantitative methods in research on collaborative learning’ (Wegerif & Mercer, 1997). Juliette has a nice summary and some reflections on it here. Some interesting things that have come out of the forum discussions so far include the distinction between quantitative and qualitative methods in terms of their level of abstraction, the strengths and weaknesses of different methods of both collection and analyses e.g. the fact that textual analysis of speech will miss out on non-verbal communication and about how adequate a control group comparison was (not very, it would seem in this case). On a personal level, I think I enjoyed reading this paper more than last week's one, and I especially liked the introduction section for providing a kind of pros and cons to quantitative and qualitative research. The promised solution to the divide between the two sounded promising but as the students discussions have indicated there are some issues about the control group used (where they subject to the same analyses or not) and about whether the computer-based textual analyses carried out really does address all the issues it set out to do.

I think the most interesting aspect of this paper is that it has got everyone talking about quantitative and qualitative methods, with students considering issues such as how different is positivism to evidence-based practice? The debate over quantitative vs. qualitative is a long one and unfortunately not an easy one to jump into. When I was doing the MRes last year, I found it helpful to think about how these approaches differ on an epistemological basis. Essentially, positivists view research as a way to uncover what is already there while constructivists argue that reality is socially constructed, and so "research findings are created rather than discovered" (Badley, 2002). One of this weeks references, Richard Pring's article "The false dualism of educational research" (the link is accessible only if you're signed into OU StudentHome), provides another interesting insight into the debate. The paper provides a really useful outline of the quantitative and qualitative approaches, especially in terms of their philosophical basis, but ultimately argues that this does not have to be an either/or issue. Instead, the author concludes that "the qualitative investigation can clear the ground for the quantitative--and the quantitative be suggestive of differences to be explored in a more interpretive mode" (p. 259; Pring, 2000). This doesn't mean that a researcher should always use both, but that she or he needs to consider methods in terms of what is most appropriate to address the research questions. There is a lot to get your head around in Pring paper, but it is well worth a read as it provides a really interesting account of the debate, and an alternative option. In addition, it was suggested in the forums that next weeks reading by Oliver et al. (2007) also helps to clarify some of these perspectives (specifically positivism and constructivism), though I haven't read this yet.

The reason all this is important from a research perspective is that no matter what area it is you are focusing on, once you've figured out a research question/problem, you're going to have to think about methods. And when you think about methods, you have to be able to defend the choices you make and this means being able to talk about what you rejected and why as well. At the moment it looks like I'm going to be adopting a case-study based approach because I'm not looking to prove a hypothesis, but to explore certain processes, and because I want an in depth account of these process. So I have to sacrifice breadth for depth in terms of my results. It looks then like I will be taking a more qualitative approach since I will be using observation and interviews. However, I have also been thinking about getting some more "objective" data, such as physiological measures e.g. galvanic skin responses. The idea here is to gather a variety of measures to explore an phenomenon in depth, which may eventually lead to a framework of some sort, which could then be tested for it's generalisability. As for whether I think reality is socially constructed or not? I think I've tried to avoid answering that in the past but I guess I do agree, up to a point. I'm going to go with Pring on this one, and say I think I agree that our interpretations of reality are constrained by it's own features, so we can still say that some constructions are more likely than others. Otherwise, a lot of research might seem somewhat futile and I'd be out of a job!

H809: Week one roundup and reading reflections

Well it's been just over a week and things have definitely got going with H809. Students have been busy introducing themselves, and it seems there is quite a range of people on the course, with a variety of backgrounds and expertise (as was last year's group). There's also been a certain amount of becoming familiar with the VLE, I know I'm still getting used to the forums but I am starting to feel less confused about where everything is, and less overwhelmed by the number of posts! There are even a few blogs popping up - I've listed the public ones under H809 on the left hand side of this page, though there are also a couple that are just open to OU users. Not much is happening on these just yet but there have been a few posts e.g. Juliette Culver introducing her research background and her thoughts on educational research, and Mike Protts reflecting on the first course reading. Hopefully, we'll see a few more starting up and some further discussion as the course progresses. It does seem that some people are further ahead than others in their work, such as H809-jm thinking about a for technologies in education, but it is worth pointing out that one of the advantages of doing an online course is that you can go through the materials at your own pace so it's best not to use other people's progress as a marker for your own. Btw, in case anyone missed it, a glossary for key terms has been set up within the course wiki (if you are signed into the OU website, you can access this here).

In terms of the first paper,"Teaching sociology in a virtual classroom" (Hiltz & Meinke, 1989), most of the tutor groups have been getting on with the activities and sharing their thoughts and opinions about it. I think one of the first things that people noticed about the paper was the date that it was written - I mean we're talking pre-internet (something I have real trouble imagining as I've never had to do any academic work without it) so it's important to try and put this in context as there wouldn't have been much CMC related literature around at the time. However, the novelty value of the Virtual Classroom (VC) didn't really seem to be something the researchers considered but it is something I really should think about in relation to my own research, especially when dealing with novel game-play interaction techniques.

Some of the other things that seemed to come up in forum conversations more than once were the fact the study tried to cover an awful lot of ground, the colleges that took part in the study were very different (as were the modes of delivery) and that the institutions attitude towards having to use the virtual classroom was not always favourable. The latter point was quite interesting to me, as it reminded me of my work at the University of Bath where I was a research assistant on the Racing Academy project and one of the things we had to evaluate was the organisational impact of implementing the use of the game within different HE and FE institutions. We ended up using Activity Theory (I think this is coming up later on in H809 anyway) as a way of describing all the factors that seemed to have an impact, and I'm sure we would have missed some of the most interesting findings if we hadn't tried to take organisational issues into account. In the forum discussions, it was pointed out that while Hiltz & Meinke (1989) mention the fact that there was resistance to the use of the Virtual Classroom, we have no idea how the students were affected by this, or even why it occurred in the first place. I guess that to me at least, these seem like questions worth asking. It was also good to see how everyone is starting to consider the methods being used, and coming to terms with the distinction between quantitative and qualitative methods, something that I think the next reading will place more emphasis on.

My own research is beginning to take shape at the moment, and there are certain key words circling round my head as I try and formulate my research question. One of these terms is engagement, and I couldn't help pay attention when Hiltz and Meinke began to talk about interest and involvement. You see one of the key reasons for the academic interest in digital games is that they are seen to be engaging so researchers want to know how we can harness this motivational power (p. 4; Kirremuir & McFarlane, 2004). As such, I was especially interested in Hypothesis 2.4 which suggested the VC would be superior to traditional teaching in terms of "Increased level of interest in the subject matter, which may continue beyond the course" (p. 436; Hiltz & Menke, 1989). How were they going to evaluate this? Turns out through self-report questionnaires, and I'm not sure they even did ask about "beyond the course". So, the measure of interest was actually how interested the students thought they were, with no recognition of the possibility that the novelty of the VC might be a contributing factor. I guess I was hoping for something a bit more objective, though I'm not sure what exactly. In terms of methods, I know I won't be using some sort of pre-post test experimental design either as I will be focusing on much more informal learning. Still need to think about how I'm going to assess this though...

Going back to the paper, I think (and this is something else that kind of came up in the forums) the references to procrastination and self-discipline are a little bit worrying as they seemed to come across like students were being blamed for not being interested enough in the first place. If the VC is supposed to raise interest in the course, but not all students feel the same way, then surely it's not doing it's job (in this respect at least)? Big surprise, but the students who participated the most in the VC were the ones with the highest levels of reported interested i.e. the students who described the experience as "fun" (p. 440) were probably already highly motivated to begin with. The authors even go on to conclude that students who have problems with motivation, verbal skills, and/or access to computers are more likely to drop out of an online course - which suggests to me that the VC really doesn't increase "level of interest in the subject matter". I have a suspicion as well that when it comes to games, a similar thing is going on. I mean, it seems likely that the people who would get the most out of game-based learning are the ones who are already motivated to play games which seems quite obvious now that I've written it down...

Hiltz and Meinke also tie motivation to the concept of cognitive maturity - the authors claim that students who have attained a specific "level of cognitive maturity or writing skill" are actually predisposed "to active and highly readable engagement with ideas and new skills" (p. 434). I guess this is an attempt to explain why the VC does not appeal to everyone, which is fine, except that there is no consideration for how the situation might be improved, apart from cutting out the VC entirely from the academically weakest course. The notion of cognitive maturity reminded me a little of some reading I did last year on approaches to learning (see here for brief introduction) where much research has focused on how to promote deeper approaches to learning within education. So maybe that's why I was expecting something about how to improve the situation, rather than the conclusion that the VC is just not suitable for less academically able students. As for my own project (and for where I'm going with the link to games-playing) I think this has reinforced my thinking in terms of how important it is to take student characteristics (or game player expectations and long term motivations) into account if we are ever going to come up with a clear understanding of how motivation, involvement and learning interrelate.