Thursday, 28 November 2013

Grey literature, green open access: the BLDS Digital Library

By Rachel Playforth

Not all research is carried out within universities, or published in peer-reviewed journals.  ‘Grey literature’ (for example reports and working papers) is produced in large quantities throughout the world by independent research institutes, think tanks, charities, international organisations and government agencies (as well as by universities).

Although the lack of both peer review and formal publication standards must be taken into account when evaluating this kind of literature, it can be an important source of original research and up to date information.

Grey literature is increasingly available online, but there are still problems with finding and using it, including missing identifying/contextualising information such as dates, unclear copyright status, and lack of a stable URL or permanent online location. Research published in the global South can already be hard to find as it rarely appears in Northern bibliographic indexes, so Southern grey literature is at a double disadvantage.

As part of our work to raise the profile of Southern-published research and make it more accessible to a global audience, the British Library for Development Studies has been building digital collections by digitising ‘grey’ material in our physical holdings.

We initially focused on series papers from research institutes and university departments in Africa and Asia which had little existing online presence. The first step was to negotiate with the copyright holders to license their material under Creative Commons Attribution Non-Commercial No Derivatives (By-NC-ND). This is a license that combines liberal reproduction terms with some restrictions on types of reuse.

Once agreements with copyright holders had been signed, we scanned our print copies of their publications, using optical character recognition (OCR) to make the text fully searchable. These digital versions were then uploaded as PDFs (with full metadata) to a newly created Digital Library on our DSpace repository platform.

Digital repositories have been developed primarily as a way to store and make accessible pre-publication versions of peer reviewed articles (known as ‘green’ open access or self-archiving). However, our experience at BLDS shows that they can also be an effective way of archiving and disseminating previously offline, dispersed or hidden grey literature outputs.

Since our first partnership agreement with the University of Nairobi in 2010, we have added a total of 2220 documents to the Digital Library. These documents originate from 15 different organisations based in Ethiopia, Ghana, India, Kenya, Pakistan, South Africa, Tanzania, Uganda, Zambia and Zimbabwe. There are around 4000 downloads from the collection every month, and around 2000 abstract views (over 60% from the global South). The more Digital Library papers are accessed, the higher they are ranked in Google Scholar search results, and vice versa - a virtuous circle of discoverability.

The next phase of digital collection building involves inviting Southern partner organisations to contribute content directly to the Digital Library, with BLDS providing capacity support for local digitisation where needed. If you would like to know more about this project, please contact Rachel Playforth.

We are currently surveying users about our website, BLDS Digital Library and catalogue.  The information that we collect in this way will assist us in developing our work so that we can continue to offer you an excellent service.

Rachel Playforth is Repository Coordinator for the British Library for Development Studies at IDS.  

Friday, 8 November 2013

Looking for a tool to analyse and 'compare' policies? Check our our lessons from conducting a QDA

By Elise Wach

As part of our team efforts to maintain a reflective practice and share learning to others, one of our latest ‘Practice Papers in Brief’ provides some insights from conducting a Qualitative Document Analysis (QDA) on policy documents for the rural water sector.

The QDA was undertaken as part of the Triple-S (Sustainable Services at Scale) initiative, for which the Impact and Learning Team (ILT) at IDS facilitates learning. 

Qualitative Document Analysis (QDA) is a research method for systematically analysing the contents of written documents.  The approach is used in political science research to facilitate impartial and consistent analysis of written policies. 

Given that Triple-S is aiming to change policies and practices in the rural water sector, the initiative decided to undertake a QDA on policy documents at the international level in order to understand trends and progress in the sector and also to engage development partners in identifying possible changes to policies and practices to move the sector closer to achieving ‘sustainable services at scale.’  Later, we decided to expand this to ‘practice’ documents as well. 

Consistent with Triple S’s ‘theory of change’, generating discussion on these issues and catalysing change was just as much of a priority as generating reliable evidence about policy trends.

In the paper, we discuss the strengths and weaknesses of the methodology, and provide some pointers that might be helpful if it is a tool you might consider using.

Overall, we found that the QDA exercise provided useful information about trends and gaps in the rural water sector, helped to refine the Triple-S engagement strategy, and served as a useful platform for engagement with partner organisations.

Some of our lessons related to issues of defining our 'themes' and scoring, inclusion criteria for documents, unclear or zero scoring, and the relationships between the research team and the organisations included in the review.

Next week, Triple-S will be kicking off another QDA for the Ghana Workstream, to analyse government rural water policies, and will incorporate many of the lessons that we’ve learned on QDA so far.  We’ll also be conducting another round of QDA at the international level next year to analyse the ways in which the rural water sector policies have shifted over the course of the Triple-S project, and to understand what to focus on moving forward.

Elise Wach is Monitoring, Evaluation and Learning Adviser with the Impact and Learning Team at the Institute of Development Studies. 

Other blogs by Elise on Impact and Learning: 

Wednesday, 30 October 2013

The revolution will not be in open data

By Duncan Edwards

I’ve had a lingering feeling of unease that things were not quite right in the world of open development and ICT4D (Information and communication technology for development), so at September’s Open Knowledge Conference in Geneva I took advantage of the presence of some of the world’s top practitioners in these two areas to explore the question:

How does “openness” really effect change within development? 


Inspiration for the session came from a number of conversations I’ve had over the last few years.

My co-conspirator/co-organiser of the OKCon side event “Reality check: Ethics and Risk in Open Development,” Linda Raftree, had also been feeling uncomfortable with the framing of many open development projects, assumptions being made about how “openness + ICTs = development outcomes,” and a concern that risks and privacy were not being adequately considered.

We had been wondering whether the claims made by Open Development enthusiasts were substantiated by any demonstrable impact. For some reason, as soon as you introduce the words “open data” and “ICT,” good practice in development gets thrown out the window in the excitement to reach “the solution”.

A common narrative in many “open” development projects goes along the lines of “provide access to data/information –> some magic occurs –> we see positive change.” In essence, because of the newness of this field, we only know what we think happens, we don’t know what really happens because there is a paucity of documentation and evidence.

It’s problematic that we often use the terms data, information, and knowledge interchangeably, because:
  • Data is NOT knowledge 
  • Data is NOT information 
  • Information is NOT knowledge. 
Knowledge is what you know.

It’s the result of information you’ve consumed, your education, your culture, beliefs, religion, experience – it’s intertwined with the society within which you live.

Understanding and thinking through how we get from the “openness” of data, to how this affects how and what people think, and consequently how they might act, is critical in whether “open” actually has any additional impact.

Can applying a Theory of Change help us answer this question?


At Wednesday’s session, panellist Matthew Smith from the International Development Research Centre (IDRC) talked about the commonalities across various open initiatives. Matthew argued that a larger Theory of Change (ToC) around how ‘open’ leads to change on a number of levels could allow practitioners to draw out common points. The basic theory we see in open initiatives is “put information out, get a feedback loop going, see change happen.” But open development can be sliced in many ways, and we tend to work in silos when talking about openness. We have open educational resources, open data, open government, open science, etc. We apply ideas and theories of openness in a number of domains but we are not learning across these domains.

We explored the theories of change underpinning two active programmes that incorporate a certain amount of “openness” in their logic.

Simon Colmer from the Knowledge Services department at the Institute of Development Studies outlined their theory of change of how research evidence can help support decision-making in development policy-making and practice. While Erik Nijland from HIVOS presented elements of the theory of change that underpins the Making All Voices Count programme, which looks to increase the links between citizens and governments to improve public services and deepen democracy.

Both of these ToCs assume that because data/information is accessible, people will use it within their decision-making processes. They also both assume that intermediaries play a critical role in analysis, translation, interpretation, and contextualisation of data and information to ensure that decision makers (whether citizens, policy actors, or development practitioners) are able to make use of it. Although access is theoretically open, in practice even mediated access is not equal – so how might this play out in respect to marginalised communities and individuals?

What neither ToC really does is unpack who these intermediaries are. What are their politics? What are their drivers for mediating data and information? What is the effect of this? A common assumption is that intermediaries are somehow neutral and unbiased – does this assumption really hold true? 

What many open data initiatives do not consider is what happens after people are able to access and internalise open data and information. How do people act once they know something?

As Vanessa Herringshaw from the Transparency and Accountability Initiative said in the Raising the Bar for ambition and quality in OGP session, “We know what transparency should look like but things are a lot less clear on the accountability end of things”.

There are a lot of unanswered questions. Do citizens have the agency to take action? Who holds power? What kind of action is appropriate or desirable? Who is listening? And if they are listening, do they care?

Linda finished up the panel by raising some questions around the assumptions that people make decisions based on information rather than on emotion, and that there is a homogeneous “public” or “community” that is waiting for data/information upon which to base their opinions and actions.

So as a final thought, here’s my (perhaps clumsy) 2013 update on Gil Scott Heron’s 1970 song “The Revolution will not be televised”:

“The revolution will NOT be in Open data,
It will NOT be in hackathons, data dives, and mobile apps,
It will NOT be broadcast on Facebook, Twitter, and YouTube,
It will NOT be live-streamed, podcast, and available on catch-up
The revolution will not be televised”

Heron’s point, which holds true today, was that “the revolution” or change, starts in the head. We need to think carefully about how we get far beyond access to data.

This blog was originally published as an Open Knowledge Foundation blog. Duncan Edwards is ICT Innovations Manager at the Institute of Development Studies. Follow Duncan on Twitter. 


Other blogs by Duncan on Impact and Learning: 

Friday, 25 October 2013

Open Access futures?


by Rachel Playforth

"First they ignore you, then they laugh at you, then they fight you, then you win."

I’ve heard this Gandhi quote applied to open access advocacy before, and the Open Access Futures conference I attended yesterday was an interesting indicator of where we are in that process.

Is it a good sign that the open access community feels able to argue endlessly about ‘Green’ or ‘Gold’ and the fine detail of Creative Commons licenses? Have we won the war and all that remains is to quibble over the spoils? Or have the commercial journal publishers turned out to be the real winners, yet again, while we fight each other over the correct pronunciation/transcription of ‘CC By’?

By making themselves major players in the open access market and (to be fair, often constructively) engaging in the debate, publishers have cleverly deflected attention from the unpalatable fact which accelerated the OA issue into public consciousness in the first place: their grossly inflated profit margins (close to 40% in some cases[1]) and the resulting ‘serials crisis’ that threatened the ability of libraries to perform their core function of providing information.

These profit margins have not decreased, as far as I can tell, but we seem to have tacitly agreed to stop mentioning them while publishers convince us that they care about open access.

In fact, so powerful is the publishing lobby that a huge part of the open access discussion now centres around protecting these very profits (embargo periods, a free APC market, etc). Should we accept this and work to find pragmatic solutions in what we’re told is a ‘transition’ period – or is it really just a transition from one source of income for publishers to another? Has the radical potential of open access been squandered? What would real disruptive change look like?

The conference did offer some hope that change on a grander scale is happening, mainly through the passion and energy of young academics who take the DIY approach - with a sensibility borrowed from hacker culture and open source technology. They are creating new platforms for scholarship that don’t just fill a gap for researchers priced out of the commercial OA market, but take disciplines in new directions and question the whole process of academic publishing. See eLife, Alluvium, the Open Library of Humanities.
Is grey literature the next frontier for Open Access?
Image is CC0 licensed

Other areas are also opening up outside academic institutions, with charities, independent institutes,
government agencies and NGOs not only benefiting from open access content, but creating their own. In most cases there is nothing to stop these organisations from making their publications freely available, and indeed many have been doing so through websites and self-publishing for years, but by adopting the norms and principles of open access we can share our content so much more effectively. Free from the stranglehold of commercial publishers, I believe that grey literature of all kinds is the next big unexplored area for open access.

A recent Thesis Whisperer blog post explored the frustrations of a researcher on the distance we still have to go, but by developing our institutional repository and working with international partners on exposing their own grey literature through open access, IDS is heading in the right direction.


[1] Of goats and headaches’, The Economist, 26 May 2011 http://www.economist.com/node/18744177/ 


Other blogs by Rachel on Impact and Learning:

Wednesday, 23 October 2013

Digital repositories – reaching the parts other websites cannot reach

By James Georgalakis

If you write a blog about what’s trending on Twitter or the latest website design fad you normally get some good engagement. If you write about Open Access to research you can normally get a debate going.

But when you start writing, or talking for that matter, about institutional repositories people’s eyes tend to glaze over. This is unfortunate because a key, perhaps essential, element of an innovative digital communications strategy that promotes Open Access to research is the use of a repository. Perhaps it is the name that puts people off or they simply assume this is the sole preserve of librarians.

Whatever the blockage is we need to get over it and fast.

Many research funders have long expected to see repositories host outputs they have funded. Universities have long been fully equipped in this area but many members of the development research community from think tanks to NGOs are simply publishing their outputs onto a traditional website.

This week, which is also Open Access Week 2013, IDS announced that it is in the process of digitising and publishing onto OpenDocs, its open access repository, its entire back catalogue of almost 2,000 research reports, working papers, practice papers, and other IDS Series Titles.

I will attempt to explain why I believe digital repositories are essential if you are serious about open access publishing and research uptake.

What is a digital repository, anyway?


Repositories are built on software that is international and interoperable, facilitating data exchange and re-use. In other words, they are highly compatible with other systems! The full text of each archived document is rapidly indexed by search engines and securely stored for the long term. In this way a repository like OpenDocs hugely increases the discoverability of IDS and our partners’ research through search engines such as Google scholar. This means more citations and hopefully more uptake and influence.

At IDS we have a good publications search area on our website which is one of our most popular pages. What you may not notice is that most of the documents you download are actually hosted on our repository. This is because OpenDocs adds value, securing additional hits from searches made from outside the IDS site as well as those done within the site. We also provide the links to all our partners’ and projects’ websites so that the research outputs they appear host all get downloaded directly from OpenDocs, which is crucial for our monitoring systems.

Many institutions use repositories to profile special collections or archives. This can result in large numbers of downloads where there are topical themes or big name academics involved. Perhaps not surprisingly, the very early days of IDS’ repository were marked with the launch of a Robert Chambers archive. Many repositories have built in analytics so that you can view downloads of specific publications or whole collections. Again, due to the wider reach of repositories, this gives you a far fuller picture of usage than the google analytics reports you may have been producing on your own website’s page views and downloads.

Of course repositories vary hugely and some can do quite different things to others. IDS uses a software package called DSpace which represents a different approach to digital collections management compared with other popular systems like Fedora.

IDS’ repository actually hosts two completely distinct collections:
  1. One is rather obviously the IDS Research Community  collection
  2. the other is the BLDS Digital Library of over 2,000 full-text publications from research organisations in Africa and Asia. 
Presently OpenDocs is mainly populated with text-only material but over time it may include datasets and multimedia content as well.

Warning: Digital repositories do not automatically meet all open access mandates


Open Access literature is digital, online, free of charge, and free of most copyright and licensing restrictions. Clearly repositories, with their ability to make research more widely available should form a crucial part of any open access strategy.

However, just because publications and other outputs are freely downloadable from repositories it does not mean they are free of all licensing restrictions. This means they may not meet the open access requirements of some funders. Every effort is now being made at IDS to ensure material in OpenDocs has a Creative Commons Attribution license.

So, if you are amongst those whose research and knowledge is not supported with a digital repository, you need to ask some hard questions. Does your institutional website offer the same benefits and if not what are you going to do about it? Failure to invest in this technology and promote its use across your networks may be undermining your potential reach.
Find out more about IDS' approach to open access publishing.
  
James Georgalakis is Head of Communications at the Institute of Development Studies. Follow James on Twitter. 


Previous blogs by James on Impact and Learning: