Open educational practice beyond the institution?

The following is a continuation of prior ponderings about about open educational practice (OEP) and open educational resources (OER) in the context of a potential institutional grant application. It’s an attempt to make sense of some of the relevant literature I’ve read and figure out how that might influence the nascent project. In particular, it suggests that some of the OER/OEP literature is limited due to its focus on: OER; the individual; the institution; and, on searching as the means of discovery.

It leads to a nascent idea of a project to address these perceived limitations.  i.e. it’s a project that is not limited to one institution; it’s not focused on the individual actor, but on the connections between them; and, it’s aiming to explore if and with what impacts the OER/OEP can be embedded into existing networks.

Defining some terms – OER and OEP

The OECD (2007) defines OER as

digitised materials offered freely and openly for educators, students, and self-learners to use and reuse for teaching, learning and research (p. 10)

The focus on open resources is perhaps most widely represented in the concern over the cost of textbooks for University students. A problem for which open textbooks are seen as the solution.

This is problematic and is explored more in the next section.

One reaction to these problems has been interest in Open Educational Practices (OEP). OPAL (2011, p. 12) define OEP

as practices which support the (re)use and production of OER through institutional policies, promote innovative pedagogical models, and respect and empower learners as co-producers on their lifelong learning path. OEP address the whole OER governance community: policy makers, managers/ administrators of organisations, educational professionals and learners.

The Capetown Open Education Declaration offers

open education is not limited to just open educational resources. It also draws upon open technologies that facilitate collaborative, flexible learning and the open sharing of teaching practices that empower educators to benefit from the best ideas of their colleagues. It may also grow to include new approaches to assessment, accreditation and collaborative learning

Bossu, Brown and Bull (2014, p. 5) offer this observation on the relationship between OER and OEP

OER movement has evolved from being mainly focused on increasing access to digital educational resources, to being focused on supporting educational practices and promoting quality and innovation in teaching and learning through Open Educational Practices

Beetham et. al. (2012) suggest that OEP encompasses the following

  • Production, management, use and reuse of open educational resources;
  • Developing and applying open/public pedagogies in teaching practice;
  • Open learning and gaining access to open learning opportunities;
  • Practising open scholarship to encompass open access publication, open science and open research;
  • Open sharing of teaching ideas and know-how; and,
  • Using open technologies.

Limitations of the literature and practice

There’s a fairly large and growing literature around OER and more interestingly OEP. What follows are some initial observations drawn from dipping my toe into that literature.

The resource focus

While Bossu et al (2014) suggest that the OER movement has evolved to focus on OEPs it’s hard to kill off the textbook idea. Adam Croom analysed the abstracts from all the OpenEd conferences since 2012 looking for use of the words “OER” and “textbook”. Abstracts with “textbook” rose from under 10% to over 30% from 2012 through 2015.

The reasons behind this are likely to be many and complex. However, an obvious driver is the cost of textbooks. Even Kanye West is concerned about the cost of textbooks

This resource focus is also illustrated by the on-going fetish for providing repositories that will hold all of the open content (textbooks) and make it easy for people to find and re-use that content. Even Amazon is getting into the OER repository “business”.

Mike Caufield outlines two reasons why the repository approach “has been a disaster”

  1. “assumes that learning objects are immutable single things, and that the evolution of the object once it leaves the repository is not interesting to us”; and,
  2. “it centalizes resources, and therefore makes the existing ecosystem more fragile”.

He also offers this lesson

products need a marketplace but living things need an ecosystem. Amazon gives us yet another market.

Mike also describes what he sees as a solution in the idea of connected copies.

Bossu et al (2014) concluded that

OEP have potential to lead to more open pedagogical practices and innovative cultures. In other words, a narrow focus on OER per se may not be enough for educational institutions to fundamentally embrace and establish effective open pedagogical practices (p. 16)

It’s just not textbooks where the “product” (resource) focus is evident when it comes to open in education. MOOCs are perhaps the most visible “open” practice from Universities. The “course” (open or not) is yet another product for the institution to market.

The individual focus

A lot of the OER/OEP work has been focused on individuals. Why are they adopting OEP? What are the challenges they face?  It is work that identifies “a need for systematic staff development within institutions, which could address these very practical needs” (Stagg, 2014, p. 155) and other support mechanisms such as (Stagg, 2014, p. 161)

  • an understanding of how to search for, evaluate, and select openly-licenced content for a specific learning context;
  • a working knowledge of Creative Commons and Free Cultural Licences, as well as Public Domain, including knowledge of licence compatibility, and the inherent obligations that each type of licence carries;
  • a working knowledge of the local institutional policies and priorities;
  • the ability to integrate the newly-created OER into the curriculum; and
  • a supporting mechanism (such as a repository) to store the newly created OER, and allow for global discoverability

If OEP requires an ecosystem, then the ecosystem has to involve more than an individual. It’s more than just me using OER in my course(s). Sustainable and effective OEP would appear to require that there be multiple people involved. My OEP relies on the presence of others engaged in OEP.

A major challenge here is that University teaching and the systems that support it are not well known for supporting the sharing of teaching practice. For example, the limited visibility and sharing of resources between courses within the same program.

The institutional  focus

This is a problem that has become another focus within the OER/OEP literature. Some examples include

the absence of mediating artefacts or a supportive institutional environment can inhibit a practitioner’s ability to engage fulsomely with OEP (Stagg, 2014, p. 161)

As Smith and Wang (2007) point out, for an OER initiative to be sustainable in the long term it needs to create value for the host institution. (Bossu et al., 2014, p. 21)

Stagg (2014) uses the Capability Maturity Model (CMM) as inspiration to develop a continuum of OEP. The CMM and this work is based on the assumption that (Stagg, 2014)

An effective organisation seeks to understand repeatable conditions and processes which support projects, and then extend an understanding of the processes to optimise them within an organisational context. There is a realisation that a systematic, defined approach is required, especially when diffusing a new organisation-wide idea. The maturity of process is “the extent to which a specific process is explicitly defined, managed, measured, controlled and effective” (Paulk et al., 1993, p. 21).

A similar evidence-based model could be developed that would provide guidance to open practitioners in a systematic manner, repeatable across contexts (p. 156)

This is not to suggest that there isn’t value in institutions addressing the barriers that prevent adoption of OER/OEP. But the point is that the ecosystem in which OEP occurs involves more than the individual institutions. Beetham et al (2012) argue that the “greatest potential benefits are communal rather than tied to the competitive advantage of individuals or institutions”. The on-going neo-liberal/techno-rationalist trend in the management of universities brings with it a strong focus on institutional advantage, distinction, and efficiency. A focus/mindset that will find it difficult to recognise, let alone value and act for communal benefits. Arguably, this techno-rational mindset is the reason why MOOCs and the most prevalent university engagement in “open”. MOOCs are seen to support institutional distinction and advantage.

The techno-rational mindset is also not likely to deal well with the complexity inherent in an ecosystem. Beetham et al (2012) argue

One effect of openness is to uncouple people in time and space, making connection easier, but complex negotiation of needs, understandings and perceptions more difficult. This is true for learners and teachers, for institutions and (potential) students, for researchers and stakeholders in their research.

Searching and making connections

Masterman and Wild (2013) make a common point that

Searching for potentially suitable resources is arguably the most time-consuming aspect of OER use

Masterman and Wild (2013) identify that “the quantity of items returned by a search for OER remains problematic”. They describe Google searches returning “unmanageable quantity of hits”, but at the same time hiding resources that may reside in “OER collections which are concealed behind registration pages”. OER collections also suffer due to their much “smaller quantity and scope” that reduces the likelihood of successful searches. Mike Caufield has a related, but slightly different take on this problem. There just isn’t enough good quality stuff out there.

 

Hence the focus has been on institutions providing better repositories and on helping more people develop more OERs. But is that enough?

What about better connecting OERs into the existing ecosystems of learners and teachers?  If you are teaching (or learning about) X, then there is probably an ecosystem where you and others that teach (or learn about) X “live” (at least occasionally). Would it be easier to find OERs associated with X, if the OERs were connected into that ecosystem?

For example, If you’re a teacher educator in Queensland focused on the digital technologies subject in the new Australian Curriculum, then chances are that your “ecosystem” includes: the QSITE mailing list; the Australian Curriculum website; and, Scootle. If that ecosystem included links etc. to relevant OERs, then you’d probably be more likely to stumble across them and perhaps interact with them?

The Australian Curriculum website currently supports this type of connection by providing direct links to Scootle resources (where available) from content descriptions (e.g. ACTDIK001). This allows school teachers who are tasked with help students demonstrate understanding against this content description to quickly see relevant resources.

At least two interesting questions arise

  1. Has this integration of resources into the ecosystem of teachers helped address the search problem?
  2. Is it possible and beneficial to connect into this ecosystem OERs that are designed to help pre-service (and perhaps in-service) teachers learn about how to teach?

What might be interesting to do?

Let’s start with some assumptions and a question.

OER are living objects that reside within an open ecosystem. OEP is about living within an open ecosystem. The learning and teaching context within Universities tends not to embody these views. How might/can a group of initial teacher educators use these assumptions to engage in OEP?

Context

At the moment, teacher educators from three separate Australian Universities have expressed interest. I believe all are involved in some way with the teaching of courses intended to help prepare pre-service teachers engage with the Technologies learning area.

This includes two “groups” of teacher educators who are from the same institution, who are teaching somewhat related courses, but that are in different programs with different focii. It also includes teacher educators teaching essentially the same course, but at fairly different institutions. Includes courses that have been run for a number of years, and at least one course that has to be designed and taught for the first time by the end of 2016.

The Technologies learning area includes the digital technologies subject. Due to this and their personal backgrounds, each of the teacher educators have some level familiarity with digital technologies. They are all (at least at some level) familiar with the “practitioner ecosystem” (i.e. QSITE, Australian Curriculum website, and Scootle) used by both pre-service and in-service teachers.

Project aim

Encourage the sustainable engagement with OEP amongst teacher educators by exploring and opening up existing practices of the group. Using an approach that rejects some of the standard assumptions around of OER/OEP. i.e. it’s not limited to within one institution; it’s not focused on the individual actor, but the connections between them; and, it’s aiming to explore if and with what impacts the OER/OEP can be embedded into existing networks.

Project activities

An initial set of activities might include:

  1. Map and analyse
    1. Personal beliefs and capabilities to engage in OEP.
    2. institutional beliefs and capabilities to engage in OEP.
    3. the ecosystem in which each operates.
  2. Identify and implement barriers and opportunities to open up individual ecosystems
    What exactly gets done depends on the findings of step 1, but possible examples include:

    1. Sharing existing content via github or similar;
    2. Broaden single course social bookmarking across institutions; and
    3. Exploring how to embed OER/OEP into existing teacher ecosystem..
  3. Analyse, evaluate, and reflect on the experience.

 

References

Beetham, H., Falconer, I., McGill, L., & Littlejohn, A. (2012). Open Practices: a briefing paper. Retrieved from https://oersynth.pbworks.com/w/file/58444186/Open Practices briefing paper.pdf

Bossu, C., Brown, M., & Bull, D. (2014). Adoption, use and management of open educational resources to enhance teaching and learning in Australia. Office of Learning and Teaching. Sydney, Australia.

Masterman, L., & Wild, J. (2013). Reflections on the evolving landscape of OER use. In OER 13: Creating a Virtuous Circle (pp. 1–8). Retrieved from https://www.academia.edu/3361645/Reflections_on_the_evolving_landscape_of_OER_use

OECD. (2007). Giving Knowledge for Free. doi:10.1787/9789264032125-en

OPAL. (2011). Beyond OER: Shifting Focus to Open Educational Practices. Open Education Quality Initiative. Retrieved from https://oerknowledgecloud.org/sites/oerknowledgecloud.org/files/OPAL2011.pdf

Stagg, A. (2014). OER adoption: a continuum for practice. Universities and Knowledge Society Journal, 11(3), 151 – 164. doi:10.7238/rusc.v11i3.2102

Can video be emedded in ePub exported from #moodle book?

Last year my institution installed the Lucimoo epub export tool for the Moodle Book module. I did some of the testing of it. I’m particularly interested (but not overly) in its ability to export a book resource as an ePub file (see I’m innovative, I support the kiddies and their fancy new mobile devices). While the export basically works, the testing identified a number of problems. I’ve fixed most of those (mainly tidying up my hand-crafted HTML and that produced by a few tools I use).

The one remaining problem is

The videos don’t show

The following is an exploration of if and how this problem can be fixed. I haven’t solved the problem. I am no expert. Feel free to point out flaws and recommend improvements.

In summary

  • It is possible to use the epub export tool to produce ePub files that contain videos that will play in some ePub readers on computers.
  • These ePub files don’t appear to work on mobile devices but this needs to be confirmed.
  • For this to work you need to get direct access to the video file and for that file to be in a format that is linked by the HTML 5 video tag and the device/reader being used.
  • To do this on Vimeo, you need a Pro account.

In my context, if I had access to a Vimeo Pro account I could in theory convert most of my “video embeds” over to using the Video tag and help enhance the experience of the ePub user. They would be able to play the video in iBooks on a computer, but not the phone. However, at least on the phone they would see some evidence of a video being present, rather than an empty space.

Beyond the cost of the Vimeo Pro account, that would also require converting all the embedded videos. There’s enough to be annoying.

Initial explanation of the problem

I assumed that the problem was due to my use of Vimeo to host most of my videos. In particular, that ePub readers (iBooks is what I test with) didn’t like the default Vimeo embed HTML.  Possibly because the ePub reader doesn’t have sufficient smarts to parse and do something with the iframe etc.

It can work

This 2010 blog post provides proof that you can play video within an ePub file on a computer (MacOSX/iBooks) and a mobile (iOS/iBooks). Some level of proof given in the image below. If I hit the play button, the video plays quite nicely thank you.

ePub file playing video

Let’s try this with vimeo

Woo hoo! Sadly my quick initial skim (late last week) thought I’d found the solution. The “video” tag. Use that and all is good. (I was missing a few things because I only skimmed the article last week).

First question, can you use the HTML 5 video tag?

An answer to this question on Stack Overflow suggests that it is indeed possible and it provides an example.

In essence, you can find a direct link to an mp4 version of your Vimeo movie and use that with the video tag.

First problem with vimeo and the video tag

As pointed out by one of the comments on the answer to the Stack Overflow question, you have to have a pro Vimeo account to find the direct link to an mp4 version of your Vimeo movie.

A Vimeo pro account costs $USD219 a year.  A little beyond the price I’m prepared to change. Wonder if there’s an institutional solution?

Second problem with vimeo and the video tag

The price is a bit of a bugger, but let’s test this with the Moodle Book module and the Lucimoo epub tool.

So I create a Moodle Book resource that contains three pages (chapters in Moodle Book speak) each of which embeds a video via different means:

  1. the video tag to embed the video from the original tutorial, to demonstrate it working;
  2. use the standard vimeo player to embed one of my videos; and,
  3. the video tag to embed the “direct vimeo video” from the answer to the Stack Overflow question.

Success, it works as expected when viewed on iBooks on the Mac. In addition, when viewing the Book via Moodle all the videos are playable.

The video tag embed from the original tutorial works and I can play the video of the kittens playing.

Video tag embed working

As expected the standard Vimeo player embed did not work. Just an empty page. No indication that there was meant to be a video embedded.

Vimeo embed not working
And very interestingly the embed of a Vimeo video using the video tag did work.

Vimeo embed working (video tag)
But not on the phone

The problem is that it doesn’t work on the phone.

The first page from the original tutorial will display a “play” button indicating that a video is there. But nothing happens when the button is pressed.
IMG_4052

 

The standard Vimeo embed doesn’t work, as expected. But the use of the video tag to embed a Vimeo video shows a “play” button crossed out. Indicating some major problem.

IMG_4053

It works if you embed the video in the ePub file

The ePub file from the original tutorial actually embeds the video file in the ePub file.  It’s local. That’s why it works on the mobile phone.

For this to work with the Book export tool the videos would all have to be local to the book etc. Not likely to happen anytime soon.

Other readers

The original tutorial post is titled “HTML5 Video Works on iBooks on iPad!!”. In addition, I’ve only tested this in iBooks, not other readers. The comments include mention that this approach is not “standard” and that the video playing will not work when viewing the ePub using “Adobe Digital Editions”.

Something that I can confirm. I can view the textual content, but not the video.

Not surprisingly it will work using the Firefox EPUBReader extension.

 

Sentiment analysis of student blog posts

In June last year I started an exploration into the value of sentiment analysis of student blog posts. This morning I’ve actually gotten it to work. There may be some value, but further exploration is required. Here’s the visible representation of what I’ve done.

The following is a screen shot of the modified “know thy student” kludge I’ve implemented for my course. The window shows some details for an individual student from second semester last year (I’ve blurred out identifying elements). The current focus is on the blog posts the student has written.
Sentiment analysis of blog posts

Each row in the above corresponds to an individual blog post. It used to show how long ago the post was written, the post’s title, and provide a link to the blog post. The modified version has the background colour for the cell modified to represent the sentiment of the blog post content. A red background indicates a negative post, a green background indicates a positive post, and a yellow background indicates somewhere in the middle.

The number between 0 and 1 shown next to the post title is the result provided by the Indico sentiment analysis function. The method use to perform the sentiment analysis.

Does this help?

Does this provide any help? Can it be useful?

An initial quick skim of posts from different students seemed to indicate mostly all green. Was the sentiment analysis revealing anything useful? Was it working?

In the following I examine what is revealed by the sentiment analysis by paying close attention to an individual student, the one shown in the image above.

Red blog post – reveal target for intervention?

The “red” blog post from the image above included words like “epic fail”. It tells the story of how the student had problems getting the new software for the course working. It shows as the third post the student made in the semester. The start of this course can be frustrating for students due to technical problems. This particular student didn’t report any of these problems on the course discussion forums.

Given that the course is totally online and there are ~100 students in this offering, there’s little chance for me to have known about these problems otherwise. Had the sentiment analysis been in place during the offering and if it was represented effectively, I might have been able to respond and that response might have been helpful.

Yellow blog post – a problem to address?

The yellow post above is a reflection on the students experience on Professional Experience, in a school, in front of a classroom, actually teaching. It is a reflection on how the student went through an emotional roller coaster on prac (not unusual), how her mentor really helped (also not unusual, but a little less so), but also how the various exemptions she received contributed to her problems.

Very positive blog posts – loved resources?

A number of the posts from this student are as positive as they can get – 1.0. Interestingly, almost all of them are descriptions of useful resources and include phrases like

what a wonderful learning tool …lovely resource…wonderful resource for teachers

What’s next?

Appears that the following are required/might be useful

  1. Explore different representations and analysis
    So far I’ve only looked at the student by student representation. Another forms of analysis/representation would seem potentially useful. Are there differences/patterns across semester, between students that are the same/different on certain characteristics, between different offerings of the course etc.

    How can and should this representation be made visible to the students?

  2. Set this in place for Semester 1.
    In a couple of weeks the 300+ student version of this course runs. Having the sentiment analysis working live during that semester could be useful.
  3. Explore useful affordances.
    One of the points of the PIRAC framework is that this form of learning analytics is only as useful as the affordances for action that it supports. What functionality can be added to this to help me and the students take action in response?

Reflection

I’ve been thinking about doing this for quite some time. But the business of academic life has contributed to a delay.  Getting this to work actually only required three hours of free time. But perhaps more importantly, it required the breathing space to get it done. That said, I still did the work on a Sunday morning and probably would not have had the time to do it within traditional work time.

 

Minimalism, constructivism and use of Moodle or any other e-learning tool

Ben-Ari (1999) reports an experiment where 10 members of a University department were asked to verbalise their understandings as they completed tasks in Word. The aim was to explore their conceptual understanding of Word and its link with their use of Word. Ben-Ari (1999) writes

Considering the high quality of the subjects, the most surprising result was the low level of use of this very sophisticated software tool.

Another surprising result was

the degree of anthropomorphic volition attributed to the software….”You see that’s what I mean, it behaves strangely

Given the widespread recognition of the limited use of institutional e-learning information systems (e.g. Moodle), I wonder what a similar experiment focused on teacher and student conceptual understanding would reveal?

I’m willing to bet there might be some significant similarities. Especially given my finding last year that branding the LMS can hurt “learning”.

I wonder if this offers some explanation about why a tool like Moodle – designed from a socio-constructivist perspective – is rarely used that way?

I wonder what, if anything, could be fruitfully done to confirm and fix this?

I wonder if there’s any correlation between this and the nature of the type of training provided to teachers and learners? Most of what training I’ve seen seems to rely on what Ben-Ari labels as minimalism

a method for designing manuals for software documentation and for using these manuals in training users of the software. A minimalist manual is short, stresses active learning and considers errors to be opportunities for learning rather than mistakes to be corrected….its insistence that conceptual material not be included in training, or at least that it be deferred until the student is more experienced.

References

Ben-Ari, M. (1999). Bricolage Forever! In Eleventh Workshop on the Psychology of Programming Interest Group (pp. 53–57). Leeds, UK. Retrieved from http://www.ppig.org/papers/11th- benari.pdf

Exploring the relationship between learning design and OEP

Another year and another institutional grant opportunity around openness. This year the focus is on Open Educational Practice and is

designed to raise awareness and understanding of open educational practice (OEP) across USQ and to provide the opportunity for USQ academics to experiment with OEP in courses and programs.

What follows are some early ramblings that have arisen from discussions with various folk about whether or not we might submit an application.

What is Open Educational Practice (OEP)?

I think getting common agreement on an answer to this question will be a major challenge, and not just for us.  Stagg (2014, p. 154) writes

There is evidence to also suggest that OEP is, after ten years, neither widespread, nor well-known (Conole, 2013; Conrad et al., 2013

Wikipedia, amongst much else, offers this on OEP

Open educational practices (OEP) are teaching techniques that draw upon open technologies and high-quality open educational resources (OER) in order to facilitate collaborative and flexible learning.[1][2] They may involve students participating in online, peer production communities [3] within activities intended to support learning [4] or more broadly, any context where access to educational opportunity through freely available online content and services is the norm.[1] Such activities may include (but are not limited to [1]), the creation, use and repurposing of open educational resources and their adaptation to the contextual setting.[4][5][6] OEP can also include the open sharing of teaching practices[1] and aim “to raise the quality of education and training and innovate educational practices on an institutional, professional and individual level”.[7]

What might we do

Initial interest is focused on actually trying to share and re-use open content between different contexts.  Not just making content open (OERs), or using open content (OERs) to produce our own teaching materials, but exploring how, if, and what happens when you try to set up an OEP ecosystem between educators (what about learners? hopefully they’d be included) in different contexts.

So far we’ve identified three possible “contexts” in which we might be able to explore

  1. Between similar courses within a single institution
    One likely participant teaches a course to pre-service teachers based on the Technologies learning area. Another colleague and I have been tasked with developing a course for another program to help pre-service teachers learn about both the Arts and Technologies learning areas. Can we engage in a bit of OEP between these two courses? Not to mention the two cohorts of learners in each course.
  2. Between similar courses between institutions.
    There are other Universities that teach similar courses. Can we engage in a bit of OEP between these courses between universities? Not to mention the different cohorts of learners?
  3. Between universities and teachers.
    In-service teachers may benefit from what’s done in these courses. In-service teachers could definitely help improve what’s done in these courses. Can we engage in a bit of OEP between teacher educators, pre-service teachers, and in-service teachers.

#3 might be a step too far in a year long project, but…

Learning design

When this rough idea was circulated one of those included mentioned some commonality with some earlier work on “Implementing effective learning designs”.

I’ve always been a bit of a learning design skeptic, but off I went to explore this idea. Cameron (2008) was amongst the first papers I came across. The research questions in Cameron (2008, p. 45) certainly resonate with my early thinking about this project (in the following, I’ve replaced “learning designs” with “open educational practices”

What open educational practices can be readily adopted by particular disciplines as templates for best practice?
What pedagogical issues emerge from the implementation of open educational practices in particular contexts?
How can identified barriers to academics’ adoption, adaptation and reuse of open educational practices be overcome?
How can the adoption of effective open educational practices be facilitated by the use of supports and scaffolds, such as, a learning activity planning tool?

The last one is a bit of a stretch, but these still appear to be in the same ballpark.

Learning designs are descriptions of learning and teaching processes that are known to be effective. By abstracting what is known to work into a learning design it is hoped that these designs can be communicated and shared between teaching staff, especially staff who do not have expertise in designing learning. It is hoped that learning designs can act as a pedagogical framework that will help teachers create enhanced learning. This is done by customising the generic learning design in ways appropriate to the context.

If this description is somewhat appropriate, then learning designs are about producing abstractions of good practice and then encouraging others to customise those abstractions to their context. I wonder about the level of tacit knowledge involved in creating those abstractions and the gulf it produces between the creators and users of learning designs.

OEP versus Learning design

As mentioned above the notion of OEP is very much up in the air.  The understanding I’m using here is that OEP is about making the practices I use, and subsequently the artefacts I produce, in my teaching open for others to see, consider, reuse, and re-purpose. Unlike learning designs, it won’t be going through much of a process of abstraction.

What is being shared will still be very contextual. It will be bundled up with the assumptions that I and my environment bring to my teaching. Assumptions that will range from the administrative, technological, pedagogical, etc.

This will make it very difficult for other people to understand what I’ve shared, let alone understand why it is the shape it is, let alone reuse what is shared in their context. This could perhaps all fail.

However, if someone takes the time to engage with that contextual baggage, perhaps they may learn a different way of thinking about a problem. Or better yet, by engaging with my practice they might pass on to me a different way of thinking about a problem.

By sharing the very different models we bring to the act of teaching (and learning) we have to revisit and perhaps remodel our conceptions of teaching. i.e. to learn.

I’m not sure that the use of learning designs require the same level of learning. Since its an abstraction with context removed, does this makes it easier to reuse a learning design than to engage in OEP? Does this also mean that you a likely to learn less by reusing a learning design?

If the contextual difference between those engaging in OEP is too much, does this decrease the likelihood of OEP being adopted and having an impact?

What if you were sharing heavily contextual OEPs within fairly similar contexts, would this impact adoption and impact?

What are the contextual factors that influence adoption and impact?

Design funnels and complexity

Just before I started writing this I read this blog post from Dave Snowden summarising some thinking about Complexity Theory and design thinking. The post suggests that design thinking (emphasis added)

is appropriate in the complicated domain of Cynefin and to some extent as a complex to complicated transition method. But it falls down in the complex domain. A parallel point is that it originates in, and is appropriate for, product creation but starts to have problems in a service environment. The points are linked because service is nearly always complex, product complicated

The post gives an overview of some difficult territory which I need to read and ponder more. But what strikes me is that it can be argued that teaching is a service, not a product. Thus design thinking, if you accept Snowden’s argument, is probably not appropriate for teaching.

Also, at some level the production of learning designs follows a logic similar to design thinking. It aims to understand the complexity of teaching and reduce it to a complicated collection of learning designs that can be reused.

OEP (using the definition above) is about opening up the complexity of teaching so that you can see what others are doing and more easily question, share, and repurpose what they do in your context. i.e. learn.

The problem is that the modern neo-liberal university doesn’t really want to accept and work with complexity. That’s too uncertain and impossible to manage. It wants/needs to reduce complexity to obviousness or complication (using words from the Cynefin framework). Preferably complication because that’s the realm of the expert.

References

Cameron, L. (2008). Implementing effective Learning Designs : An overview of an ALTC Competitive Grants Program project. In L. Cameron & J. Dalziel (Eds.), 3rd International LAMS & Learnign Design Conference (pp. 43–49). Sydney. Retrieved from http://lams2008sydney.lamsfoundation.org/pdfs/04b.pdf

Stagg, A. (2014). OER adoption: a continuum for practice. Universities and Knowledge Society Journal, 11(3), 151 – 164. doi:10.7238/rusc.v11i3.2102

Extending a little thought experiment

David Wiley has posed a little thought experiment that encourages reflection around levels of automation and “personalisation” within a University course. Judging by my Twitter stream it appears to have arisen out of a session or happening from the ELI conference. The experiment describes a particular teacher purpose, outlines four options for fulfilling that purpose, and offers a standard against which to consider those options.

It’s a thought experiment that connects to a practice of mine and the growing status quo around higher education (at least in Australia). It’s also generated some interesting responses.

I’d like to extend that experiment in order to

  1. Reflect on some of the practices I have engaged in.
  2. Highlight some limitations with the current practice of e-learning in Australian higher education.
  3. Point out a potential problem with one perceived future for e-learning (replace the teacher with technology).

First, it would be useful to read Wiley’s original (and short) thought experiment and the responses.

Types of extensions

There are a range of ways in which the original thought experiment could be extended or modified. I’ll be looking at the following variations

  1. Modify the teacher’s purpose. (The support extension)
    In Wiley’s experiment the teacher is seeking to acknowledge success (score 80% or higher on an exam). Does a change in purpose impact your thinking?
  2. Clarify the context. (The inappropriate massification extension)
    Does the nature and complexity of the educational context matter? Does it change your thoughts?
  3. Add or modify an option. (The personalisation extension)
    Wiley gives four options ranging on a scale from manual/bespoke/human to entirely automated. Some of the comments on Wiley’s post offer additional options that vary the relationship between what is automated and what is manual/human. Generally increasing the complexity of the automation to increase it’s level of “personalisation”. At what level does automation of personalisation become a problem? Why?
  4. Question the standard
    The standard Wiley sets is that the students “receive a message ‘from their teacher’ and that students will interpret the messages as such”. In a world of increasingly digitally mediated experiences, does such a standard make sense?
  5. Change the standard each practice is being measured against. (The “connection not the message” extension).

The support extension

In Wiley’s experiment the purpose is stated as the faculty member deciding

that each time a student scores 80% or higher on an exam, she’ll send them an email congratulating them and encouraging them to keep up the good work

What if the purpose was to

Identify all those students who have not submitted an assignment by the due date and don’t already have an extension. Send each of those students an email asking if there’s a problem that she can help with.

This is the purpose for  which I’ve recently developed and used an option similar to Wiley’s option #3.

Changing the purpose doesn’t appear to really change my thoughts about each of the options, if I use the standard from Wiley’s thought experiment

to ensure that students are actually receiving a message “from their teacher” and that students will interpret the messages as such.

With an option #3 like approach, it’s possible that students may not interpret the message as being “from their teacher”/personal. But it’s not sufficient for me to stop (more below)

But it does rule out an automation option suggested by @KateMfD

Email is bad enough, but faux email? Why not make them badges and be done?

A non-submission badge strikes me as problematic.

The inappropriate, massification extension

Does the context within which the course is taught have any impact on your thinking?

The context in which I adopted option #3 was a course with 300+ students. About 160 of those students are online students. That is, they never aren’t expected to attend a campus and the geographic location of most means that they it would be impossible for them to do so. I’m directly responsible for about 220 of those students and responsible for the course overall. There are 2 other staff responsible for two different campus cohorts.

The course is 100% assignment based. All assignments are submitted via a version of the Moodle assignment submission activity that has been modified somewhat by my institution. For the assignment described in this post only 193 of 318 enrolled students had submitted assignments by the due date. Another 78 students had received extensions meaning that 47 students hadn’t submitted by the due date.

The tool being used to manage this process does not provide any method to identify the 47 that haven’t submitted AND don’t have extensions. Someone manually needs to step through the 125 students who haven’t submitted and exclude those that have extensions.

Having done that the teacher is then expected to personally contact 47 different students? Many of whom the teacher will never meet face-to-face? Many of whom chose the online study option due to how well asynchronous learning fits their busy life and part-time study? Even though attempting to personally contact these 47 students is going to consume a significant amount of time?

Another problem is that the system provided by the institution doesn’t provide any other choice than to adopt Wiley’s option #1 (send them each an email). Not only does the system NOT support the easy identification of non-submit, no extension students. It provides no support for sending a bulk email to each student within that category (or any other category).

In order to choose Wiley’s other options a teacher would have to engage in a bit of bricolage just like I did. Which tends not to happen. As an example consider that my course is a 3rd year course. The 300+ students in my course have been studying for at least 3 years in an online mode. Many of them for longer than that because they are studying part-time. They will typically have studied around 16 courses before starting my course. With that in mind here’s what one student wrote in response to me adoption option #3

Thank you for contacting me in regards to the submission. You’re the first staff member to ever do that so I appreciate this a lot.

Does a teaching context that has seen significant massification unaccompanied by appropriate changes in support for both students and teachers make any difference in your thoughts? If the manual options are seen to take time away from supporting other (or all) students? What if the inappropriate massification of higher education means that the teacher doesn’t (and can’t) know enough personal information about (most of the) individual students to craft a meaningful, personal email message?

The personalisation extension

Wiley’s options and some of the responses tend to vary based on the amount of personalisation, and how much of the personalisation is done by a human or is automated.

A human manually checking the gradebook and writing an individual email to each student seems to strike some as more appropriate (more human?). Manually sending an email from a range of pre-written versions also may be ok. But beyond that and people appear to start to stuggle.

What about the option suggested by James DiGioai

scripting the criterion matching step, which informs the teacher which students are above 80%, and pushes her to write bespoke messages for each matching student. She automates the tedious part of the task and let the teacher do the emotional work of connecting with and support her students.

Is it the type of work that is automated that is important?

What about the apparently holy grail of many to automate the teacher out of the learning experience? Are we fearful that technology will replace teachers? Can technology replace teachers?

Or is it the case that technology can and should

replace many of the routine administrative tasks typically handled by teachers, like taking attendance, entering marks into a grading book

Bringing us back to the question of where do you draw this line?

Question the standard

Wiley’s standard is

our faculty member wants to ensure that students are actually receiving a message “from their teacher” and that students will interpret the messages as such.

The assumption being that there is significant value to the student in the teacher sending and being seen to send a message written specifically for the student. A value evident in some of the responses to Wiley’s post.

In this “digital era” does such a standard/value continue to make sense? @KateMfD suggests that in some cases it may not, but in Wiley’s original case it does

But an email of encouragement strikes me as a different kind of thing. It’s intended either to be a personal message, or to masquerade as one. Political campaigning, marketing, all the discourses that structure our lives, and that we justly dismiss as inauthentic, reach for us with the mimicry of personal communication. “Dear Kate” doesn’t make it so.

Is the “is there a problem? can I help?” message that I use in my context one that can be automated? After all, the purpose of the message is that I don’t know enough about the student’s reason for not submitting to personalise the message.

What if the massification of higher education means that the teacher doesn’t (and can’t) know enough about (most of) the students to craft a personal message? Alright to automate?

I have some anecdotal evidence to support this. I have been using options at or around Wiley’s 3rd option for years. An “email merge” facility was a feature we added to a system I designed in the early 2000s. It was one of the most used features, including use by teachers who were using a different system entirely. This facility mirrored the functionality of a “mail merge” facility where you could insert macros in a message that would be replace with information personal to each individual.

One example of how I used was a simple “how’s it going” message that I would send out a key points of the semester. One response I received from a student (which I’m sure I’ve saved somewhere, but can’t find) was along the lines of “I know this is being sent out as a global email, but it still provides a sense of interaction”.

Suggesting that at least for that student there was still value in the message, even though they knew I didn’t hand craft it.

The “connection not the message” extension

Which brings me to my last point. The standard for Wiley’s thought experiment is based on the value of the message being and being seen to be a personal message to the student. That’s not the standard or the value that I see for my practices.

For what it’s worth I think that the “7 Principles of Good Practice for Undergraduate Education” from Chickering and Gamson (1997) are an ok framework for thinking about learning and teaching. The first of their 7 principles is

  1. Encourages Contact Between Students and Faculty
    Frequent student-faculty contact in and out of classes is the most important factor in student motivation and involvement. Faculty concern helps students get through rough times and keep on working

The standard I use is whether or not the practices I use encourage contact between my students and I. Does it create a connection?

Whether or not the students see the message I sent as being personally written for them is not important. It’s about whether or not it encourages them to respond and helps a connection form between us.

In the case of the not submitted, no extension students I’m hoping they’ll respond, explain the reason they haven’t submitted, and provide an opportunity for me to learn a little more about the problems they are having.

While I haven’t done the analysis, anecdotally I know that each time I send out this email I get responses from multiple students. Most, but not all, respond.

For me, this standard is more important than the standard in Wiley’s thought experiment. It’s also a standard that my personal experience suggests that moving further up Wiley’s options is okay.

It’s also a standard which argues against the complete automation of the personalisation process. The reasons why students haven’t submitted their assignment and the interventions that may be needed and appropriate tend to represent the full richness and variety of the human condition. The type of richness and variety for which an automated system can’t (currently?) handle well.