|Australasian Journal of Educational Technology
2006, 22(4), 531-547.
The affordances of online learning technologies have enabled more widespread development of learning environments that facilitate the exploration and solving of complex and realistic problems. In this paper, we describe the design of a real world geography problem, embedded within a web environment that is facilitated by an onsite excursion for data collection. The learning environment has been designed to deliberately address known problems associated with the problem solving approach, specifically in regard to three issues, and uses scaffolding prompts and supports embedded within the environment to facilitate student learning. The paper describes the theoretical foundations for the approach, the design of the learning task, and specific scaffolding approaches used in the environment.
Virtually everyone, in their everyday and professional lives, regularly solves problems ... Unfortunately, students are rarely, if ever, required to solve meaningful problems as part of their curricula. The few problems that students do encounter are normally well-structured (story) problems, which are inconsistent with the nature of the problems they will need to learn to solve in their everyday lives. (p. 63)Others have argued that most set problems lack the complexity required to help students learn to use the knowledge they have acquired in appropriate and adaptive ways (e.g. Cognition and Technology Group at Vanderbilt, 1993). In dealing with simple, or well-structured problems, Collins (1988) has argued that students often invoke 'suboptimal schemes' for remembering information solely to pass tests, rather than to address the genuine demands of a real problem. 'For example, arithmetic students might conclude that any word problems including the word left (How many did she have left?) are subtraction problems ... such knowledge is less likely to be stored in a form that is useable when applied to novel situations' (pp. 2-3). In these contexts, knowledge itself is seen by learners as the final product of education rather than a tool to be used dynamically to solve problems (Cole, 1990).
Sternberg, Wagner and Okagaki (1993) analysed the differences between the kinds of problems learners face in academic situations and practical, real world applications. For example, academic problems tend to be: formulated by others, well-defined, complete in the information they provide, characterised by having only one correct answer, characterised by having only one method of obtaining the correct answer, disembedded from ordinary experience, and of little or no intrinsic interest. In direct contrast to the academic approach, practical problems tend to be characterised by: the key roles of problem recognition and definition, the ill-defined nature of the problem, substantial information seeking, multiple correct solutions, multiple methods of obtaining solutions, the availability of relevant prior experience, and often highly motivating and emotionally involving contingencies (Sternberg et al., 1993, p. 206).
The affordances of online learning technologies have enabled more widespread development of learning environments that facilitate complex problem solving of practical and realistic problems. Moreover, the visual and audio facilities of the web can more fully be utilised to 'set the scene' for the problem, so that learners can be engaged in a problem that is effectively described and appropriately resourced. In this paper, we describe the design of a complex problem embedded within a web environment and facilitated by an onsite excursion for data collection. The learning environment has been designed to deliberately address known problems associated with the approach, specifically in regard to three problem solving strategies, and uses scaffolding prompts and supports embedded within the environment to facilitate student learning.
A previous study by the first author (reported in depth in Brickell, Harper & Ferry, 2002) into student perceptions of the problem solving process and the strategies used in developing solutions to the problem, revealed several weaknesses that students exhibit in this process. The study introduced four conceptual frameworks (Critical Thinking, Six Thinking Hats, Concept Mapping, Venn Diagrams) for students to use during the problem solving process. The problem context focussed on ill-structured problems presented in a virtual setting on a CD, Exploring the Nardoo (1996). Students assumed the role of environmental consultants who were required to prepare a comprehensive report on environmental problems associated with a fictitious river, within an historical context.
The four frameworks were introduced to participants as a scaffolding mechanism to assist in assessing the credibility of evidence collected to support a solution to the problem; to think strategically; and to make judgments and decisions regarding the effectiveness of proposed solutions. Evaluation of framework use provided some insights into the effectiveness of these strategies in supporting the development of solutions to the problems under investigation and demonstrated that participants using the Six Thinking Hats and Critical Thinking frameworks provided clearer representations of, and better argued solutions to, the problem under investigation.
Throughout the course of this study it became evident that many of the participants from each of the framework groups focused their search and analysis strategies on a preconceived 'solution' to the problem and concentrated their efforts towards this goal. Actions taken by many participants resembled a trial and error approach that lacked any obvious focus towards a particular theory or hypothesis and spent more time accessing resources that had little or no bearing on the specific problem. Figure 1 presents a summary of the problem solving strategies that students would be expected to use in solving the Nardoo problem. The shaded area highlight those aspects of the process that the study confirmed were inadequate or weak, specifically:
Figure 1: Weaknesses in problem solving strategies
The results showed that while some aspects of a problem solving approach were enhanced, there were some shortcomings in that many students would approach the problem as they might for well-structured problems, expecting that there was a single answer, or single best approach. Consequently, they were frequently unable to allow for alternative strategies, and were too quick to select and commit to a problem solving strategy without exploring all the options. For example, when being briefed on the problem by the Water Resources Manager, they did not take care to listen to the full description of the task to ensure that they were fully in command of the requirements of the job. Even though the description of the task was given via audio rather than a written document, many students did not take notes or write anything down, but simply moved forward to explore the rest of the environment. Similarly, in the checking phase of the task, many students did not explore alternative solutions, but were more inclined to justify their initial response rather than check carefully to ensure that there was no better solution.
As a result of the findings of this study (see Brickell, et al., 2002 for a more in depth discussion of results) further work has focussed on a design for a scaffolding system to support learners in such environments. It is proposed that in so doing, it may be more appropriate to design structures that:
The Geography Challenge provides a geographic, information rich setting in which students are engaged in investigations that reflect the everyday management of environmental issues that impact on one area of Sydney Olympic Park: the Narawang Wetland. The major objective of this online environment is to address the requirements of the Year 10 Geography syllabus by heightening student awareness of the need to manage the resources of the Narawang Wetland wisely and sustainably through good management practices. The educational approach taken is based on a general constructivist model of learning that challenges students with investigations that are student centred and set within an authentic context. This model of learner engagement views learning as an active and interpretive process that specifically addresses the New South Wales Geography syllabus outcomes:
The study of Geography develops a wide range of skills such as gathering, organising and evaluating geographical information from a variety of sources, including fieldwork ... The ecological dimension requires students to identify and analyse the ways humans interact with environments and in so doing develops students' skills in evaluating arguments and problem-solving. (NSW Geography Stage 4/5 syllabus, 2002, p.8)In the scenario presented in the challenge, students are approached by the management of the park to investigate a series of problems associated with pests in the park, the impact of human activity on the parklands, and water management. An engaging animated scenario is presented of annoying mosquitoes biting nearby residents, smelly ponds that deter picnickers and nocturnal rats enjoying the remains of food scraps left by park visitors (Figure 2). The problem is presented in the form of a letter to geography consultants (the students) who are invited to advise the park management on strategies to restore an ecological balance to the area.
In order to complete their assignment, students research the problem, explore and propose a solution, and write their report and recommendations to the park. This process might take several weeks, and the data collection phase is conducted in an onsite visit to the park (i.e., the excursion) mid way through the research.
Development of the model for the Geography Challenge has been guided by situated learning theory of knowledge acquisition where the problem context and tasks require thinking strategies that are appropriate in 'real life' situations and the learning develops as a function of the activity, context and culture in which they occur (Lave & Wenger, 1991; Brown Collins & Duguid, 1989; Herrington & Oliver, 2000). Essential elements of this approach to learning emphasise the enhancement of 'higher order' thinking skills through engagement with complex and ill-defined authentic tasks. The growth and application of knowledge to everyday problems requires the consideration of context in which the problem arises since a suitable response takes much of the meaning from the situation being confronted (Choi & Hannafin, 1995, p. 54).
|Figure 2: Scenes from |
the introduction to the
Within this online environment the non-linear nature of the information structures and the variety of media formats requires the learner to make decisions about where to find supporting information, what kind of information should be selected to support the task, how much information is needed to justify an argument and what strategy approach is best suited for the problem under investigation. It becomes apparent then that knowledge of one's metacognitive processes, through independent decision making and regulation of learning processes, is necessary for a learner to successfully manage the learning environment. This may require additional support to assist the learner in this process.
It has been argued in relation to learner scaffolding, that learners seek new information in ways that depend on, and are limited by, their current mental model and learning goals (Barker et al, 1998; Jonassen, 1997). From observation and interaction with the dynamics of the problem space, learners develop an internal representation of objects, events and relationships among them. As a learner engages with the problem solving task, mental representations are created or enhanced and knowledge transfer, if any, that emerges is driven by the representation formed in the mind of the learner. The nature and quality of the actions that then take place in further development of a problem solution will depend upon the richness of the mental representations that the learner has formed. For learners to be successful when developing solutions to complex, ill-structured problems they must engage in strategic thinking (Larkin, 1989) which includes use of procedural steps, having strategies for identifying and meeting sub-goals, and using metacognitive strategies for directing, monitoring and evaluating individual learning. Several studies have demonstrated (Lajoie et al, 2001; Suthers, 1998) that learners need to be supported in acquiring these skills.
Traditionally teachers have been the facilitators of learning for their students. Whether this learning has taken place through teacher centred or student centred approaches, the teacher's role has been one of initiating the learning sequence and scaffolding its development through various mechanisms of support. Scaffolding is generally regarded as support for learners while they are engaged in activities just beyond their capabilities (Guzdial, 1994; Hannafin et al, 2001; Vygotsky, 1978). It may range from assisting learners with completion of an entire task to providing occasional support. As the learners' capabilities improve, the teacher gradually reduces the support until the learner becomes self sufficient with the assigned problem. However, the process of continually monitoring the progress of all students becomes increasingly difficult if a more student centred approach is adopted through engagement with complex tasks that involve an inquiry based approach to learning.
In the Geography Challenge scaffolding is provided through supportive teacher facilitation and also in the use of cognitive tools to promote learning. This support provides the bridge across the 'zone of proximal development' (Vygotsky, 1978) - the gap between what the student currently knows and the knowledge needed to accomplish the task. Brush and Saye (2002) provide a differentiation between the two types of support in conceptualising the differences as 'soft scaffolds' - specific support provided by a teacher or peer group member; and 'hard scaffolds' - embedded support within the online environment. The construction of understanding through direct human interaction or through use of the online tools provide a means of prompting students in reflecting on and reviewing their 'theories and actions' (Land & Hannafin, 1997) and work towards providing a bridge between the learners existing cognitive processes and the additional cognitive demands required in understanding the interactions and interrelationships of the problem space.
In the Geography Challenge, online tools have been embedded in the learning environment, specifically: Your Notes, RAP, Resources and Help. Such tools may serve as 'metacognitive coaches' providing hints, 'hard' scaffolds and models to assist the learner to develop skills that facilitate better transfer across domains. The result is a complex interaction between prior knowledge, perceptions of events, intents, actions, observations and reflections that lead to further development of on going theories and actions for both the individual and the collaborating members of the investigative group.
Depending on the degree and type of scaffolding required within this online learning environment, the learners may use the support system to assist with the planning process or as part of their ongoing development of higher order thinking skills. Recent work (McGuinness, 2005; Kuhn & Udell, 2003; White & Frederikson, 2000) has demonstrated that using aids to induce reflection and other 'higher order' skills promotes clearer understanding when developing interpretations and conclusions based on the evidence collected.
|Engagement phase||Steps in problem solving|
process of Challenge
Context and background development at school or home
Understanding the problem
Deciding on data required
On site activities and data entry at computer 'Pod' in the wetland. Secondary data research through GIS interaction.
Analysis, reasoning and argumentation, development of artefact at school or home.
Reporting your research
In the Geography Challenge, once students have accepted the offer to act as consultants to Sydney Olympic Park, they choose to investigate one of three themes (Pests, Water, Human Interaction) and work through three phases of engagement: a pre-visit phase; a fieldwork phase and a post-visit phase. Each phase of the investigation is linked to steps in the problem solving process and each step has a range of supporting tasks and activities to support the development of understanding and help develop a broader picture of the complexity of the management issues (Table 1).
By placing learners in the role of professionals who are actually confronted by such problems, they are challenged to develop the knowledge base and strategies that are normally required to resolve the issues.
The tasks and activities associated with each step of the process have been designed to cultivate awareness of the issues, provide the opportunity to retrieve relevant information related to the theme under investigation, promote development of metacognitive skills and facilitate the evolution of reasoning expertise for real world problems. Hints, suggestions and clues are used within each step to refine their knowledge and provide direction for focusing their specific line of inquiry.
process from model
|Research Action Plan|
|Integration into steps|
in Geography Challenge
|Clarifying the problem||
||Step 1: Understand the problem|
Step 2: Asking questions
||Step 3: Deciding on the data required|
Step 4: Identifying techniques
Step 5: Collecting data
|Data analysis||Step 6: Analysing data|
|Checking ideas||Step 7: Drawing conclusions|
|Developing argument||Step 8: Reporting your research|
This integration resulted in the implementation of a sequential series of numerical steps to guide students through their investigations (Table 2). The 'Steps' were then used as the primary navigation system for the Geography Challenge that allows the users to move through the process at their own pace and revisit them as required.
To support the investigation of the themes within the Challenge a series of cognitive tools (Jonassen, 1997; Lajoie, 1993) have been incorporated through a secondary navigational system (Figure 3) of hyperlinks.
Figure 3: Navigational elements
These links provide access to:
Figure 4: Scaffolding questions in Help
|I found it easy to access and use the web links||6||4||0||0|
|I found the interface (menus, headings, navigation bars) easy to use||3||6||1||0|
|I found it easy to access and play the sound files||2||6||2||0|
|I found it easy to access linked documents||3||3||1||0|
|The amount of screen explanation was adequate for performing the task||0||6||3||0|
|Terminology was clear and precise||1||7||1||0|
|The online materials are useful - it is easy to understand the relationship between the learning tasks.||1||8||0||0|
Following usability testing, students were interviewed (and audio taped) in groups on specific aspects of the design. Students valued the overall appearance of the website, e.g., "It was very informative, easy to read and well set out", and some commented on the authentic nature of Challenge: "It's pretty helpful that this is for real - you had to do it for real", and "Instead of having straight out questions, you learn a lot more." In general the students felt they understood the overall problem they were addressing, although some confusion was evident in their early exploration of the environment, with some students reporting difficulty in "try[ing to] work out what to do ... to try and work out where we had to go and stuff", which is in keeping with the complex nature of the task. However, all were confident that with practice they would feel more capable.
Overall, such evaluation revealed few fundamental or practical problems with the design, and suggested improvements have been incorporated to improve the usability of the Challenge and increase its appeal to the target group. Two schools from the Sydney region are currently undertaking full testing of the beta version, including fieldwork and data entry at Sydney Olympic Park.
Similarly, the aim of the Geography Challenge is to support students to become more expert like as geographers. It has been designed to reflect a research action plan (required by the NSW Geography syllabus) representing the stages an expert geographer would follow in solving a complex problem involving interaction between humans and the environment. While evaluation has been conducted in the form of project conceptualisation review, needs assessment and formative evaluation during development (including usability studies, expert review and pilot implementation studies) (Reeves & Hedberg, 2003), it is most likely that only an extensive impact evaluation after full implementation will reveal whether the aims of the project have been realised.
The Geography Challenge has used recent theory and research on problem solving and scaffolding to provide a basis for the design of a complex and realistic task, and to guide the development of scaffolding mechanisms within the environment itself. As such, the design was informed by previous extensive research on a similar learning environment. The scaffolding has been designed to provide metacognitive support for the refining of the process, clarifying the problem and checking of ideas. Further evaluation and research will inform the design of the both the current and future projects featuring cognitive tools in authentic learning environments.
Brickell, G. & Herrington, J. (2004). Learner challenges and situated learning: Engaging students at Sydney Olympic Park. In R. Atkinson, C. McBeath, D. Jonas-Dwyer & R. Phillips (Eds), Beyond the comfort zone: Proceedings of the 21st ASCILITE Conference (pp. 150-158). Perth, 5-8 December. http://www.ascilite.org.au/conferences/perth04/procs/brickell.html
Brickell, G. J., Ferry, B. & Harper, B. (2002). Developing informal reasoning skills in ill-structured environments: A case study into problem-solving strategies. In A. Williamson, C. Gunn, A. Young & T. Clear (Eds), Winds of change in a sea of learning: Proceedings of the 19th Annual ASCILITE conference (pp. 65-73). Auckland, NZ: UNITEC Institute of Technology. http://www.ascilite.org.au/conferences/auckland02/proceedings/papers/094.pdf
Brown, J. S., Collins, A. & Duguid, P. (1989). Situated cognition and the culture of learning. Educational Researcher, 18(1), 32-42.
Brush, T. A. & Saye, J. W. (2002). A summary of research exploring hard and soft scaffolding for teachers and students using a multimedia supported learning environment. The Journal of Interactive Online Learning, 1(2), http://www.ncolr.org/jiol/issues/2002/fall/toc.asp
Choi, J. & Hannafin, M. (1995). Situated cognition & learning environments: Roles, structures & implications for design. Educational Technology Research & Development, 43(2), 53-69.
Cognition and Technology Group at Vanderbilt (1993). Toward integrated curricula: Possibilities from anchored instruction. In M. Rabinowitz (Ed), Cognitive science foundations of instruction (pp. 33-55). Hillsdale, NJ: Lawrence Erlbaum Associates.
Cole, N. (1990). Conceptions of educational achievement. Educational Researcher, 19(3), 2-7.
Collins, A. (1988). Cognitive apprenticeship and instructional technology (Technical Report No. 6899): BBN Labs Inc., Cambridge, MA.
Guzdial, M. (1994). Software-realized scaffolding to facilitate programming for science learning. Interactive Learning Environments, 4(1), 1-44.
Hannafin, M.J., Hannafin, K.M., McCarthy, J.E. & Radtke, P. (2001). Scaffolding performance in EPSSs: Bridging theory and practice. In C. Montgomerie & J. Viteli (Eds), Proceedings of EdMedia World Conference on Educational Multimedia, Hypermedia & Telecommunications 2001 (pp. 658-661). Tampere, Finland: AACE.
Herrington, J. & Oliver, R. (2000). An instructional design framework for authentic learning environments. Educational Technology Research & Development, 48(3), 23-48.
Hmelo-Silver, C.E. (2004). Problem-based learning: What and how do students learn? Educational Psychology Review, 16(3), 235-266.
Hollingworth, R. W. & McLoughlin, C. (2001). Developing science students' metacognitive problem solving skills online. Australian Journal of Educational Technology, 17(1), 50-63. http://www.ascilite.org.au/ajet/ajet17/hollingworth.html
Interactive Multimedia Learning Laboratory (1996). Exploring the Nardoo. [Computer Software]. Belconnen, Australia. Interactive Multimedia Pty Ltd. http://www.emlab.uow.edu.au/Nardoo/nardoo.htm
Jonassen, D. H. (1997). Instructional design models for well-structured and ill-structured problem-solving learning outcomes. Educational Technology Research & Development, 45(1), 65-94.
Jonassen, D. H. (2000). Towards a design theory of problem solving. Educational Technology Research & Development, 48(1), 63-85.
Jonassen, D. H. (2006). On the role of concepts in learning and instructional design. Educational Technology Research and Development, 54(2), 177-196.
Kuhn, D. & Udell, W. (2003). The development of argument skills. Child Development, 74(5), 1245-1260.
Lajoie, S. P., Lavigne, N. C., Guerra, C. & Munsie, S. D. (2001). Constructing knowledge in the context of BioWorld. Instructional Science, 29(2), 155-186.
Lajoie, S. P. (1993). Computer environments as cognitive tools for enhancing learning. In S. P. Lajoie & S. J. Derry (Eds), Computers as cognitive tools (pp. 261-288). Hillsdale, NJ: Lawrence Erlbaum.
Land, S. M. & Hannafin. M. J. (1997) Patterns of understanding with open-ended learning environments: A qualitative study. Educational Technology Research & Development, 44(3), 37-53.
Larkin, J. H. (1989). What kind of knowledge transfers? In L.B. Resnick (Ed), Knowing, Learning and Instruction: Essays in Honor of Robert Glaser, 283-306. Hillsdale, NJ: Lawrence Erlbaum Associates.
Lave, J. & Wenger, E. (1991). Situated learning: Legitimate peripheral participation. Massachusetts: Cambridge University Press.
McGuinness, C. (2005). Teaching thinking: Theory and practice. British Journal of Educational Psychology, 11(3), 107-127.
Reeves, T.C. & Hedberg, J.G. (2003). Interactive learning systems evaluation. Englewood Cliffs, NJ: Educational Technology Publications.
Suthers, D. (1998). Representations for scaffolding collaborative inquiry on ill-structured problems. Paper presented at American Educational Research Association. San Diego, CA. [verified 21 Oct 2006] http://lilt.ics.hawaii.edu/lilt/papers/1998/Suthers-aera98.pdf
Sternberg, R.J., Wagner, R.K., & Okagaki, L. (1993). Practical intelligence: The nature and role of tacit knowledge in work and at school. In J.M. Puckett & H.W. Reese (Eds), Mechanisms of everyday cognition (pp. 205-227). Hillsdale, NJ: Lawrence Erlbaum Associates.
Vygotsky, L. (1978). Mind in society: The development of higher psychological processes. Cambridge: Harvard University Press.
White, B. & Frederikson, J. (2000). Metacognitive facilitation: An approach to making scientific inquiry accessible to all. In J. Minstrell & E. V. Zee (Eds), Inquiry into inquiry learning and teaching in science (pp.283-315). Washington, DC. AAAS. [verified 21 Oct 2006] http://thinkertools.soe.berkeley.edu/Pages/paper.html
|Authors: Dr Gwyn Brickell and Associate Professor Jan Herrington|
Research Centre for Interactive Learning Environments
Faculty of Education, University of Wollongong, NSW 2522, Australia
Email: firstname.lastname@example.org, Jan_Herrington@uow.edu.au
Please cite as: Brickell, G. and Herrington, J. (2006). Scaffolding learners in authentic, problem based e-learning environments: The Geography Challenge. Australasian Journal of Educational Technology, 22(4), 531-547. http://www.ascilite.org.au/ajet/ajet22/brickell.html