University data isn’t that “big”, what are the implications?

Learning analytics is being enabled/driven/sparked by the concept of “big data”, but for a while I’ve wondered just how big is the data being gathered by Universities. Preparations for a workshop earlier in the week provided an opportunity to find out.

Big data

The most recent spark for this query was Clow (2013) who gave the example of the Large Hadron Collider at CERN producing 23 petabytes of data in 2011. Some other examples found via Google included

For a sense of scale, if you had 1 petabyte of MP3 music, you’d still be listening to that music after 2000 years of continuous play.

University “big” data?

In comparison lets assume you have the following for a single Australian University

  1. All the database tables and files uploaded to an LMS for the years 2004 through 2009.
  2. All the database tables and files uploaded to another LMS for the years 2009 to now.
  3. All the student demographic and age data for the same institution since around 2001.

How big is that “big” data?

I’ve been reliably informed that it is 665 gigabytes in size.

i.e. 0.000634193 petabytes.

Kind of not in the same league.

Questions

I wonder how this impacts the use of big data techniques to analyse university e-learning? How “big” does big data need to be to be useful?

The above is the combined data for the majority of online courses for a university since 2005 or so. What does that say about how “big” the data for an individual course is? Do big data techniques and assumptions break down at this size?

References

Clow, D. (2013). An overview of learning analytics. Teaching in Higher Education, (August), 1–13. doi:10.1080/13562517.2013.827653

One thought on “University data isn’t that “big”, what are the implications?

  1. Pingback: University data isn't that "big", wha...

Leave a Reply

Please log in using one of these methods to post your comment:

WordPress.com Logo

You are commenting using your WordPress.com account. Log Out /  Change )

Google photo

You are commenting using your Google account. Log Out /  Change )

Twitter picture

You are commenting using your Twitter account. Log Out /  Change )

Facebook photo

You are commenting using your Facebook account. Log Out /  Change )

Connecting to %s