Showing posts with label Research2policy context. Show all posts
Showing posts with label Research2policy context. Show all posts

Monday, 25 February 2013

Research does not automatically generate knowledge - rethinking product and process

By Catherine Fisher

The overwhelming conclusion I have drawn from my involvement as a contributor to the IDS Bulletin, New Roles for Communication in Development?, is the need for research communication to place a greater focus on process rather than product. I draw this insight from both the process (what I've learned from being involved) and the product itself (what I've learned from some of the great articles in the Bulletin). I'm not arguing that there is no role for product, far from it, but that there is value in re-examining the relationship between the two.
Product v Process? Baking Czech bread
Image credit: Chmee2 (Own work) CC-BY 3.0


Overall I would argue that articles in the Bulletin collectively encouraged us to challenge our assumptions around three related areas:
  • What is research? 
  • What is knowledge?
  • How does change happen?  

And to explore  links between these areas: how does research generate knowledge, whose knowledge produces the research, how does research or even knowledge lead to change?  All speak to a greater focus on process. I explore a couple of examples below.

Research changes those involved 

Patta Scott Villier's article, This research does not influence policy, explores how participation in a research process brought change for both the researchers and the ‘researchees’,  even if the resulting output didn't shape high level policy processes  So the process generated more change than the product. But maybe the product (or its story as described in Patta's article) will inspire someone somewhere else to undergo a similar process, that might itself generate change...

Research doesn’t necessarily build knowledge

In our article, Kirsty, Louise and I explore the factors that shape whether actors engage with research and are willing and able to draw on research.  In doing so, we challenge ideas that research, even if it is shared at the right time and packaged in the right way, will somehow automatically generate “knowledge” in target audiences.  Research does not automatically generate knowledge. This happens through a process of sense-making in which the “knower” is an active participant not a passive recipient, who may deliberately or inadvertently choose to reject the intended message of the product. As Penelope Beynon’s et al's article illustrated, even carefully constructed outputs such as a policy brief, often seen as the silver bullet of research communication, can lead to the creation of different knowledge than was intended.

Growing importance of “process architects”

One implication of this greater focus on process is a greater role for intermediaries, knowledge brokers or innovation brokers within the broad spectrum of research communication. The focus on process over product helps us to see a greater role for these actors which is not just about turning research outputs into attractive products but about seeing research  and research-based products as part of the processes of knowledge creation and change, and supporting the design of these processes. These processes will often draw on products from multiple sources, current or historical, local or from far away. Often these processes themselves produce products which then go on to inform other processes. This speaks to some of the points I make in the Introduction, Is Development Research Communication Coming of Age? (PDF).  

The value and opportunity for exposing the process behind the product

One final reflection is that I doubt anyone will learn as much from the papers that appear in the journal  as I have learned from writing them. The process of writing a paper with a colleague forced us both to reexamine our assumptions and beliefs. An early version of our paper included a box outlining the differences in position about research and knowledge, and how it contributes to change that attempted to share some of the discussions we had  Yet journal articles require a compelling single narrative, an authoritative position and do not allow for divergence and discussion. They also have a strict word count. So this was dropped. While journal articles play an important role in communicating ideas and indeed validating the rigour of those ideas, particularly those from more formal research processes, perhaps there is also space – particularly in the social sciences for us to be more open in our workings, less authoritative in our positions. New media such as blogs like this, or even tweets enable “work in progress/emerging thinking” type products to be shared more widely that can  trigger thinking and knowledge generation processes for others. 

I hope that both this blog series and the Bulletin itself has prompted you to think and re-examine your ideas as it has done for me.

Catherine Fisher contributed to the Introduction in the IDS Bulletin, entitled Is Development Research Coming of Age? (PDF) and to the Bulletin article entitled Stimulating Demand for Research Evidence: what role for capacity building?. Catherine is International Capacity Building Co-ordinator at Amnesty International. She was formally Capacity Support Coordinator with the Impact and Learning Team at IDS.   

More blogs on the IDS Bulletin New Roles for Communication in Development?

Monday, 10 December 2012

Forget asking if policymakers understand evidence – do we understand policy?

By Emilie Wilson

I am setting aside my role as editor for this blog for a minute to share some reflections on a recent workshop I attended. It was called Beyond Communication: exploring approaches to research uptake; and was organised by the UK Collaborative on Development Sciences (UKCDS) and UK Department for International Development (DFID).

Is “Research uptake” more jargon, or a different way of understanding communication? 

The first time I came across the expression “research uptake” was in 2010, when the new UK coalition government was voted in, and a marketing and communication “freeze” across all UK departments was implemented.

I was new to my Communications job at the time, and would have been inclined to agree with my colleague Jeff Knezovich’s observation that “The term was specifically designed to obfuscate its purpose—ironic, given that the whole point was to help clarify and communicate research findings. This obfuscation was a result of a change of government in the UK, and a “communications” witch-hunt from the Conservative-led coalition, branding such activities as “wasteful Labour spending” in a time of austerity”

However, a quick Google search reveals that “research uptake” was around pre-2010 and a number of different sectors have used the term when grappling with the issue ‘how on earth do you get people to do something with the research?’.  In health, for example in this paper “Fostering implementation of health services research findings into practice: a consolidated framework for advancing implementation science"; or in political economy, for example The Politics of Trade (these examples were thrown up by the ‘quick Google search’ so I’m not holding them up as exemplary merely indicative).

At the workshop, Kirsty Newman – Research Uptake Manager at DFID (and contributor to this blog) – described Research Uptake as “allowing us to take a holistic view” of this issue – here is a reproduction of the sketch I drew in my note-book to capture her description:



The assumption being that previously communicating research findings had focussed on ‘dissemination’ or ‘diffusion’ – i.e. supply; and that research uptake was shifting the focus to ‘demand’ – either ‘what do they want’ or ‘can we persuade them to want what we have’ Or more eloquently described by Jeff as “stimulating an enabling environment among end users of research to commission and find appropriate information to support their own policy processes”. Most people who work in marketing and communications will already be pretty familiar with the focus on stimulating demand, and I’m sure would be only too pleased share their wealth of research on this area!

Evidence-based policy – one way to reduce poverty 

It seems we are still living in an Age of Reason (at least in the northern hemisphere), believing strongly that research validated by expert peers and based on tried and tested methodological approaches has something to offer to people in power. The offer is that research can demonstrate what works or doesn’t work, and it is not supposed to be tainted by money, politics or tribal affiliation – it’s a global public good, a credible source of authority. The assumption is that decisions based on this objective knowledge source will be of the greatest possible benefit, and not privilege a minority or prop up a flawed system.

So, should the ‘demand’ box in my diagram be renamed “creating demand” – i.e. the process is still supply-driven. Evidence (derived from research) – like vitamins, for example – is good for you (and your policymaking) and we need to develop increasingly sophisticated ways for people to engage with it. But do we know much about the demand other than through dialogue which merely engages our ‘end users’ with our research products and processes? Evidence literacy has been used as a term to describe the ability of policymakers and practitioners to understand and apply research evidence, but have we stopped to ask ourselves about our own literacy?

The Kirsty Newman policymaking quiz (PowerPoint)

Kirsty Newman did just that during the workshop, when she put the shoe on the other foot, and asked those present at the workshop some simple questions mostly about the UK policy environment. Such as – what are the three principle functions of the UK parliament? How would you define a “civil servant”? (this was a multiple choice one). I’m ashamed to say that, even with a degree which includes a minor in politics, I only got 4/7 questions correct. And most people present scored less! 

It may have been that people in the room would have been more familiar with other policy environments (and not specifically the UK's), but Kirsty's quiz did well to make the point: do you know the language of the people you are trying to communicate with?

Which is why I think we should consider sticking with the term “communication”, describing a two-way process (from the Latin verb to share) rather than “uptake”, implying a one-way process.

Emilie Wilson is Communications Officer at the Institute of Development Studies, and editor of the Impact and Learning blog. 

Thursday, 4 October 2012

Information ecosystems of policy actors - new Working Paper

By Simon Batchelor

In this blog, I have previously discussed some longer term research we are conducting around how policymakers understand, access and use information. For example, Early headlines from research on policymakers and ICTS: persistent and curious enquirers (with smartphones) or Digital information on the move: the rise of the Tablet.

I'm pleased to now be able to share with you a new working paper, entitled Information Ecosystems of Policy Actors - Reviewing the Landscape, which presents interim findings and analysis so far.

The full data set will include respondents from Ethiopia, Ghana, India, Nepal, Kenya and Bangladesh. The interim findings report on face-to-face structured interviews with 368 policy actors in the first 4 countries – Ethiopia, Ghana, Nepal and India.

Why did we conduct this research?
Well, information ecosystems are changing the world over. This is true for policy actors in every country in the world. Even those actors in countries with poor connectivity are experiencing dramatic changes in the way they, as decision-makers, access technology and use it. In the working paper, we use the term 'policy actors' to encompass all those involved in significant decision-making – including those linking policy and practice, and those engaged with civil society and private sector policies as well as government.

So what have we found? Standing at 80 pages, the working paper is not a light read! However, it does is confirm with evidence what many of us knew intuitively. That is, 'policy actors' as part of society's elite do have access to the latest information technology. This includes ipads, tablets PCs, and smartphones. I think we were a little surprised at first, but the sample of policy actors as a whole have a very similar profile of technology access to the average UK or USA household.

This was important to us. Here at IDS, we are working on various knowledge-based and knowledge mobilisation programmes. Our study was intended to provide a current view of how policy actors engaged with information systems, and where knowledge intermediaries (people and organisations who mediate between researchers and decision-makers) could best add value.

Implications for knowledge intermediary
Early adopters of the newer forms of ICT are changing their behaviour and searching for information in new ways. Knowledge intermediaries need to adapt their mechanisms and pathways to ensure they contend for these emerging patterns of behaviour. About 40 per cent of policy actors are already using smartphones, so the development of mobile apps which assist research communications would seem appropriate.

Indeed, looking to the future, there were in general positive attitudes towards new ICT services, reinforced by positive social referents. With very few limiting control factors, there is a positive intention to use new ICT services such a social media, video online, instant messaging, smartphone apps. Given their hard-ware, it is likely that policy actors will be increasingly using the new ICT services in the coming year. See the graphic below:
Graph from IDS Working Paper: Information Ecosystems of Policy Actors - Reviewing the Landscape 
There is often an assumption in knowledge intermediary work that senior policy actors may not be searching for information directly themselves, and that they are simply 'presented' with information. While this may remain the case in the poorer and/or more formally organised countries, it is less so in the mid-range countries. The implication is that where connectivity is improving, policy actors will look for information themselves. They will spend a significant amount of time looking for information, and they will be 'persistent and curious'.

An implication of this is to work on ensuring visibility when it comes to Internet search engines like Google. Where knowledge intermediaries intend to use the internet to communicate and disseminate summaries of research and evidence, it is important to ensure that they can be seen through these search engines, especially Google. While ranking across all search engines is important, the data confirms the current dominance of Google. In terms of existing websites that specialise in development information there was a reasonable awareness across the respondents. There is room for improvement.

Finally the findings also offer an insight into 'traditional media' (radio, TV and print). Policy actors do engage with the traditional media and while we have seen that they currently have very negative perceptions of the media‟s performance, nevertheless a significant proportion of them are engaging with the media day by day. There is therefore a role for the knowledge intermediary to assist the 'translation' of research and evidence into the media.

These are only the headlines – have a look at the working paper. We invite further feedback to this working paper and comments that might be assist and direct us in the full analysis.

Wednesday, 18 July 2012

Do policymakers in the South text more than talk?

By Simon Batchelor

In a news story today on the BBC website, the headline reads “Texting overtakes talking in UK, says Ofcom study”.  The article states that “While 58% of people communicated via texts on a daily basis in 2011, only 47% made a daily mobile call, [according to the UK's] communications industry regulator [Ofcom].”

As readers of this blog will know, we have been conducting our own study in 6 countries on the information ecosystem* of policy actors.  You can find our previous blogs, here and here.

While we asked participants in the study about what ICT technology they owned, how frequently they used the Internet, how they searched for information, and so on, we did not ask them specifically about their preferred form of mobile phone use (texting or talking).  However, the Ofcom report which prompted the BBC news story, focuses on much more than texting – in fact, it covers very similar set of questions to our own study (indeed we used the Pew US studies to help shape our own study).

For example, UK Ofcom report states that “39% of (UK) adults now own a smartphone, a 12% increase on 2010.”  How does this compare with policy actors in the South? The graph below shows that of our sample of 100 actors in each country, a similar proportion have at least one smartphone. In fact some people have more than one, since cross network calls are often expensive enough that it makes it worth carrying two phones to keep call costs down.  This is particularly true of say Ghana, where several respondents had 2 or 3 smartphones.


The UK report also states that “Tablet ownership is also on the rise, with 11% owning such a device, up from 2% last year.”  Interestingly as this blog showed, Tablet ownership among policy actors is at an equivalent level – currently at about 15% (from the updated data set). We concluded in that blog that this ownership of technology suggests that information intermediaries seeking to get evidence in front of policy actors in order to inform their decisions, should indeed be using these channels.

The Ofcom report also offers detail on internet behaviour of UK households – contrasting the behaviour of 16 to 24 year olds with others. Of course, in our study we didn’t have many 16–24 year olds as we were interviewing those in leadership and management positions.  However we did note that the younger respondents tended to do more with their smartphones and tablets than older respondents – with the exception of where older respondents let their children play with their phones. Where this occurred, the older respondents themselves had as good a knowledge of the more tricky smartphone activities such as downloading an app, or uploading a video, as the younger respondents. 

And finally the Ofcom report states that “Two thirds of internet users have accessed Facebook.”.  From our preliminary data almost 70% of our respondents have accessed internet communities. Keeping in mind that actually there are alternative social networks to Facebook on the world scene (hard to believe!), this again shows an equivalent figure. What is much more surprising from our data is that nearly 60% of those who have smartphones have accessed social networks from their phones. Unfortunately, the Ofcom report doesn’t say how people access their social network. 

Conclusion?  As we have previously noted in our work, the respondents to our survey show that technology use among policy actors in the South pretty much mirrors the average household in USA (Pew Internet and American Life Project research). With this Ofcom report on UK behaviour, we can see that our research findings also appear to mirror technology use in the UK.   

If this is so, (and this is where I am speculating) then perhaps it is reasonable to assume that the details of how people surf might also be true?  For instance, Ofcom report that “With two-thirds of internet users on Facebook, it generates almost a quarter of all referred traffic to YouTube (23.7%), in contrast to Google’s 32.3%. Facebook also refers traffic to other popular websites: BBC (11.2%), eBay (6.7%), Twitter (3.8%), and Wikipedia (3.6%).”  If policy actors are members of social networking sites, then perhaps Facebook is driving them to sites as much as their own searching of Google. If this is the case, then it becomes all the more important that social networks are used by knowledge intermediaries to bring evidence to the attention of policy actors.

Tuesday, 3 July 2012

When policy actors engage with the internet, what do they actually do?

By Simon Batchelor

Ever wondered what those serious men and women who describe themselves as involved in policymaking actually use the internet for?

From our study of 360 policy actors across 4 countries, Ehtiopia, Nepal, India and Ghana, the graph below shows the percentage of the whole sample undertaking certain actions on the internet.


Graph from IDS Impact and Learning team study on information behaviours of policy actors in Ethiopia, Ghana, India and Nepal




Unsurprisingly, almost all policy actors engage with the internet for emails. As you can see from the graph, over 80% download official forms, obtain information from public authorities’ websites and read or download newspapers or online news. A majority undertake the remaining options Instant Messaging, internet communities, video and audio podcasts, uploading self-created content and seeking health-related information. Just under half have telephoned over the internet.

Yet, when you compare these responses, coming from a wide variety of actors in the global South, some of whom have quite poor connectivity, to that pioneer of internet engagement, the USA, you find that their internet use is almost same as that of the average American household! According to recent Pew Research Center on households in the USA, 92% read email, or use a search engine, 76% read online news and 65% use social networking. Only 24% of USA households have used Voice of Internet (PDF link) – so in this case the policy actors are ahead in their use than the average US household.

Are differences still about connectivity?

There are of course differences across the countries not captured by the above graph. We would expect the use of the internet to relate to the connectivity of the country, and to some extent this is what we see in our findings. According to the 2011 ICT Development Index (IDI) (PDF), undertaken by the International Telecommunication Union, Ethiopia ranks 150th, Nepal 134th, Ghana 120th and India 116th - out of a total of 154 countries covered by the index. (We also speculated that connectivity in the South of India was better than the North, and divided our sample accordingly.)

In the graph above we see that telephoning over internet (VOIP), which demands good connectivity, follows our understanding of the connectivity of the countries surveyed. Ethiopia with its poor connectivity makes telephoning a difficult option even for those on the best connectivity the country can provide. Whereas in South India it has now become common across most respondents to use the internet for telephoning (80%).

Data around obtaining information from public authorities’ websites also follows levels of connectivity at the country level, with the exception of Ethiopia. The unusual high use seems to be explained from other data as being about ‘formality’ and need to know official government positions.

However, not all behaviours are best explained by connectivity. When we consider instant messaging and uploading video – which other data suggests are emergent behaviours more dependent on early adoption  – there is no significant difference between countries. Whereas for the use of emails, while there is some difference between countries, the overwhelming uptake makes such differences of no practical meaning.

Finally just considering early adopters; unsurprisingly early adopters have a higher use on Telephoning over the Internet, video calls (via webcam), entertainment, videos or audio podcasts and ‘uploading self-created content to be shared’. We didn’t dare ask these senior policy actors what entertainment they were accessing!

So why should we be interested in this? 

We often talk as though policy actors are a unique species, that because they are such important people, they behave in a unique way. To me the data suggests they are human as the rest of us when it comes to communication and information-seeking behaviours. They use the internet in much the same way as the average UK and USA household uses it. And there is a spread of use, in the same way we see a spread of use among US households. Some have invested in new technologies (see my earlier post on the adoption of Tablet PCs) and some of them are early adopters, just as some households are early adopters. Policy actors seem to demonstrate a spread of human interest in the new communication tools in much the same way as a population with wealth and access might show.

When I first came to IDS I wondered whether ‘policy actors’ in countries of poor connectivity would ever push the Facebook button on a webpage or use instant chat for a helpdesk. I thought that perhaps some of our efforts using the latest communications technologies were a little too North-centric, and that policy actors in the South might be left cold.

However, our research suggests otherwise. My scepticism has been duly quashed.

Thursday, 17 May 2012

Reflections on the K* summit: beyond K-Star-wars?

By Catherine Fisher

It was only a matter of time before someone made the KStarWars joke at the K* Conference that took place at the end of April in Canada. I’m only sorry it wasn’t me!

However, the K* Conference was notable not for its battles, but for the sense of commonality that emerged among the participants and for the momentum for future action it generated. 


The K* summit aimed to connect practitioners working across the knowledge-policy-practice interfaces to advance K* theory and practice. Its aim was to span the different sectors and contexts and different terms under which this kind of work is undertaken, for example Knowledge Mobilisation (KMb), Knowledge Sharing (KS), Knowledge Transfer and Translation (KTT).  Hence K*:  an umbrella term that attempts to bypass terminology discussions. 

This blog post provides links to some of the great reporting from the event, acknowledges some of the critiques that the event raised and points to the next steps for K*.    
The opening presentation highlighted how K* is about supporting processes of exchange and engagement between knowledge-policy-practice interfaces not the achievement of particular outcomes. It was great to hear this point made by John Lavis, who has something of a guru status in K* in health. Other important points were about learning about context and what that means, not just saying its important!
Another great metaphor courtesy of Charles Dhewa. The importance of multiple knowledges, knowledge hierarchies and the role of K* actors in helping to facilitate interactions between those knowledges was a recurring theme. E.g. see video by Laurens Klerxx talking about multiple knowledges and innovation brokers. 
As David Phipps explains in this video, participants from Canada, Ghana and Argentina were able to find considerable commonalities in their work with communities. This transnational comparison may be familiar to those of us who work in international development but it was a first for many of the Canadian participants who are doing really interesting work, for example, in government ministries or communities. I think this points to a strength of the K* movement in connecting people that might not otherwise talk.
The conference illustrated the range and scope of K* work. For example, Jacquie Brown, National Implementation Research Network who works helping communities to implement science, has learnt how this piece fits within the broader scope of K*.  For me, this seeing how different kinds of K* roles are played and how they intersect is important.  

In this video, I share some of my reflections at the time: brokering in the Canadian context including an  examples of brokering at the point of research commissioning:  power dynamics in brokering; and the way that informing role of knowledge brokering is getting a “bum rap” compared to more relational knowledge brokering work. I also get distracted by bangs, crashes and the emergence of breakfast!  

Critiques and the importance of engaging with them

The conference has generated some robust critiques. For example, Enrique Mendizabal sparked a discussion on his blog, On Think Tanks with a range of critiques including whether knowledge brokers are required, how knowledge is shared, and a critique of elitist professionalisation of this field. Scroll to the bottom of his blog post to read the responses, including mine. Meanwhile, Jap Pels argued that the nature of the debate at K* was pretty basic knowledge-sharing stuff.

I think both of these critiques raise interesting points but I think they constitute arguments For K*, not against it. K* recognises that the knowledge work is changing and proliferating, that there is considerable experience and understanding that is not shared across the different spaces in which the role is played. It aims to bring together bodies of expertise (for example that which Jaap Pels points to) to raise the game of all practitioners. It will hopefully provide spaces for debates and engagement with the kinds of critiques that Enrique raises.   

So what next for K*?


The conference generated a range of areas for further collaborative action, and plans for taking the K* initiative goes from here. 

Areas for further collaborative action included:
  • Understanding impact: a group agreed to share the tools data collection tools they are already using, I’ll be participating in this group, building on work of Knowledge Brokers Forum
  • K* in developing countries: a predominantly African group explored the particular dimensions of K* work in their contexts generating a number of action points
A group of participants gathered on Saturday to work out what next for K* as a whole. Consolidation of the K* Green Paper is considered an important next step – co-organiser  Louise Shaxson will be leading this work. There are ideas of developing a more formalised network, which will be led by UNU-INWEH in the first instance.   

UNU, who have led this process so far, remain committed and aim to get the support of the UNU governance. The World Bank has already provided financial support. Support from such international bodies is important as it will embed the international nature of this initiative, it is not without its risks!    


So to borrow again from StarWars, the force is, for now, with K*.  The scale and ambition of the initiative together with some indications of funding and high profile support suggest it has a future. However it faces both practical and fundamental challenges.

Practical challenges include maintaining ownership and momentum on behalf of the largely volunteer force taking it forward for now, identifying its niche and building connections around such a fragmented field of practice.

More fundamental challenges lie in ensuring that it really can generate value that will improve knowledge-policy-practice interfaces, rather than providing a talking shop for elitist actors.   




Catherine Fisher is a member of the K* Conference International Advisory Committee.

Thursday, 3 May 2012

More on Change: systems, principles, and learning

By Elise Wach

I am back to talk about change following on from my previous postings (Change is hard and Change is hard but not impossible) on how you change a sector, Here are some reflections from the latest IRC Triple-S learning retreat.

IRC is attempting to change the way water is provided in rural communities by:
  1. changing the way things work at the level of rural communities so that water is available to everyone indefinitely, and
  2. changing the water sector to enable this to happen. 
I think it is easy to get lost in the frameworks and theories that attempt to explain how to achieve these changes. For example, there are a number of different frameworks proposed for influencing policy and measuring that influence (for example Crewe and Young 2002, Court and Young 2003, Steven 2007, Gladwell 2000, etc.). These provide useful insights as to what might make a difference, but at the end of the day we need to remember that these are complex and unique systems that we are trying to change: so there is no ‘best practice’! 

Danny Burns’ seminar at IDS yesterday on "How Change Happens" helped remind me that while it is not necessarily labelled as such, Triple-S is essentially using a Systemic Action Research (PDF) approach: their larger (systems) view of the water sector and iterative learning processes enable them to recognise and respond to opportunities for change.

Image from: http://www.rallytorestoresanity.com 
In attempting to influence policy, for example, Triple-S is not just looking at written policy documents (although this is one piece of Triple-S work).  But they recognise that policy change results from and is indicated by changes in discourse, perceptions, agendas, networks, political contexts, and institutions.  And that a multitude of stakeholders are involved in those changes, including journalists, NGO workers, researchers, finance ministers, and even people who post on Twitter. They recognise that certain events (such as a change in government) can greatly accelerate or completely block policy changes. 

And that the right evidence and information at the right time delivered to the right people could make a difference.  So the Triple-S approach is built on the assumption that changing policy doesn’t entail following a formula but instead recognising and responding to opportunities and trigger points.

At the rural community level, Triple-S is trying to ensure that the rural water sector takes into account a variety of factors in order to ensure that water services are provided to everyone indefinitely.  So this means looking at life-cycle costs, mechanisms for transparency and accountability, possible alternative service providers, accounting for the multiple uses of water, etc. etc.  

But does viewing these issues with a systemic lens mean that we become paralysed by the complexity?  Danny Burns pointed out yesterday that the key is to focus on action rather than on consensus.  To focus on the actions that different actors can take that can change the system.  Or as Bob Williams explains in his the Ottawa Charter approach (doc), it will be a ‘strategically selected jigsaw of people and organisations doing what they are most effective at’ that will create lasting change, rather than Triple-S trying to change the sector on its own.

Triple-S isn’t trying to get consensus around a specific approach to achieving sustainable rural water supply, but is instead trying to get everyone on board with basic set of principles for sustainable services and providing a range of resources and tools and building capacities (look out for new trainings in the near future) to put those principles in action. They are leveraging existing institutions and structures, and working closely with individuals and organisations to facilitate ownership.

But getting people to wrap their heads around the concept of changing their principles is a big obstacle.  People want tools and approaches that they can go put into action, and while Triple-S is providing a range of these, success starts with viewing rural water supply completely differently: it isn’t ‘the Service Delivery Approach’ but ‘a Service Delivery Approach’. 

Another obstacle Triple-S is facing relates to the way in which evidence is perceived.  So there are people who say, ‘this is all fine and good in theory, but is it really possible? Can we really achieve both sustainability and scale? Where is the evidence?’  Evidence is a strong word.  Today, it usually refers to a call for a ‘rigorous’ approach like a randomised control trial.  But if you want to find out if services are provided forever, then how long do you have to wait for the RCT results?  And here is where I cannot resist but refer to the brilliant example of the limitations of RCTs – would you doubt that a parachute would make jumping out of a plane safer just because an RCT has not proven it?  I think this highlights the need for the development community to reflect on what we consider to be evidence.     

But I don’t think that these obstacles are insurmountable, especially given that Triple-S’ approach enables it to recognise and respond to opportunities and challenges while remaining focused.  One of the Triple-S pillars is for the rest of the rural water sector to have ‘a strong learning and adaptive capacity’.  I see this as pre-requisite for success in the other two pillars, and in the rural water sector in general.  But achieving this is....well, complex.

Thursday, 26 April 2012

Policy influence or evidence-informed policy: what is the difference?

By Catherine Fisher

“We all want a culture of evidence informed policy making, don’t we?” asked Dr Ruth Nyokabi Musila from African Institute for Development Policy (AFIDEP) at the opening of her presentation at the International Conference on Evidence Informed Policy.

It was a commitment to this ideal that had united over 50 researchers from 4 continents, brought togther in Ile Ife, Nigeria, earlier this year. I was attending under the auspices of the IDS Mobilising Knowledge for Development Programme (MK4D) and had been invited to present and chair a session.

Policy influence is not the same as evidence informed policy
 
Throughout the conference I was struck by a blurring between the (admittedly closely related) concepts of research having policy influence and evidence informed policy. The difference seems pretty obvious to me but I sometimes struggle to explain it.  

Let me try this…  
  • Effective research communication (which aims to influence policy) is indicated by change in policy/process/discourse based on the research findings you are communicating.

  • Effective evidence informed policy is demonstrated by a culture (systems, processes, attitudes and behaviours) that mean that people in decision making processes regularly engage with research from a wide range of sources when formulating, implementing, reviewing policy.

And to illustrate this difference, here are two examples from the conference:

Image: http://profile.ak.fbcdn.net/

Firstly, Kakaire Ayub Kirunda, shares his learning on how to influence policy. He observed that  “while members of parliament might be an ultimate target, they hardly have time and it is their clerks and assistants who do the lion's share of their research..."

He adds that, in a conversation with Ugandan MP, Honurable Obua Denis Hamson, who also chairs the Science and Technology Committee of Parliament, about how he would want researchers to approach him with evidence, the MP suggests “Probably the easiest way is to first give me a brief summary of your research findings. We can start from there.”


Ah yes, the ubiquitous policy brief. IDS' Impact and Learning Team recently conducted some research around the effectiveness of these as a communication tool, but that is for another blog.

By contrast, an example of supporting evidence informed policy was brilliantly illustrated by Jorge Barreto. He described the creation of an “Evidence Centre” in PiriPiri, a town in a poor region of Brazil. The Centre promoted the use of health evidence locally to improve municipal decision-making process.

Over a beer the night before, Jorge had told me that infant mortality rates in Piripiri were far lower than in other similar towns, his colleague added “20 babies survive a year because of these local policies”.  

Jorge’s presentation concluded that “current efforts to improve local government’s capacity to use research evidence to define problems, find tested interventions, assessing the quality of global and local evidence and translating evidence to key stakeholders are worth continuing. This is our little contribution towards addressing the knowledge to action gap.” Not so little for those children who survive and their families.


I feel it is worth maintaining the distinction between policy influence and evidence informed policy as the activities you undertake to influence policy with research will be different to those you might undertake if you wish to bring about a culture of evidence informed policy.

Such as...Research communication versus knowledge brokering


Two areas of activity which seek to either influence policy and/or support evidence informed policy are research communication (sometimes referred to as research uptake) and knowledge brokering (sometimes referred to as knowledge mobilisation). These distinct activities also often get confused (see my earlier post Buzzing about brokers).

Working closely with IDS Knowledge Services, engaged in knowledge brokering activities, and the IDS Communications Team, focused on supporting IDS research, this is something we decided to explore in more depth at an Impact and Learning team ‘learning lab’, a reflective practice tool we’ve been using to create a space for shared learning.

Here are some notes from the lab, which focused on "desired outcomes": 

"Research Communication and Knowledge Brokering get confused because while they start from different places (one piece of evidence versus many pieces of evidence) they use similar methods and communication tools (e.g. policy briefs). However, they can be untangled again when you look at the outcomes they are trying to achieve:
  • Desired outcomes of ‘Research Communicators’ relate to a change in a specific/thematic policy or practice i.e. you know RC activities have succeeded if a specific policy decision is made
  • Desired outcome of ‘Knowledge Brokers’ relate to a change in the information-seeking and decision making behaviour of policy/practice actors i.e. you know KB activities have succeeded if decision makers consider a diverse range of evidence to inform their decisions

Importantly, power matters: in Research Communication, the relationship between the researcher (or research institution) and decision maker makes a difference to whether the decision maker gets to hear about a specific piece of evidence (e.g. informal encounters, ‘Beer Buddies’) whereas knowledge brokers, such as the IDS Knowledge Services, can work to equalise that power imbalance for less powerful researchers (or research institutions). For example, the British Library of Development Studies' work around improving access to research published in the global South”

I will explore how ‘politics’ comes to play on these two strands of research uptake activity in my next blog. Meanwhile, you can follow me on Twitter @CatherineF_IDS; I'm currently at the K* Conference in Hamilton, Canada.

Monday, 16 April 2012

Digital information on the move: the rise of the Tablet

By Simon Batchelor

Here in the UK the ‘new’ devices of smartphones, tablet pcs and ipads are very evident. Just take a train, and you will see at least half the people on it are staring at a screen.  While we may think they are working on their emails, some of them are just playing games or watching films – nevertheless digital information on the move is becoming even easier.

So is this change in device use becoming common in the countries where we work?


Our recent study (yet to be officially launched and published), suggests that for the policy environment these devices are changing access to information.  When asking 368 policy actors in six countries (Bangladesh, Ethiopia, Ghana, India, Kenya, Nepal) what devices they have access to we get the responses as shown in the figure below.

Emerging findings from Impact and Learning Team (IDS) research, full report will be available on www.ids.ac.uk


The figure illustrates that 90% of respondents have a computer desktop either at home or the office, 88% have a laptop for use in either the office or home.  However what becomes interesting is their growing use of Tablet computers.  Tablet use among policy makers in the South is at 12%. 


So how does this compare with the UK scene?  While we don’t have the UK figures (and if anyone has please add as a comment), the Pew internet survey for the USA (June 2011) suggests that use of Tablets across the USA has risen to 8% over the last 12 months.  This means average use among policy actors in the South is slightly higher at 12%.  Perhaps interestingly but unsurprisingly, desktop and laptop use among policy actors is considerably higher than the USA general public average which stands at 58% and 52% respectively.  

Indeed in September 2011, India's Economic Times carried a story announcing that the computer allowance for MPs had been raised from Rs 150,000 to Rs 200,000.  The extra Rs50,000 was specifically to obtain a tablet device such as an ipad or Samsung Galaxy powered by Android. “Owning a tablet is mandatory for all MPs, officials said.”  The article states that “over 125 members from the total 245 have already bought the tablets”.

And how about Smartphones?  The graph shows that 40% of respondents had smartphones. Of these 8% had iphones, 12% Blackberries and 31% were ‘other’ smartphones – where smartphone meant they got their email over the phone and could surf the internet.

What does this increased use of mobile technology mean for Knowledge Intermediaries?  

The information ecosystem is changing.  Policy actors do indeed have access to the latest technology, and the proportion of early adopters among the policy actor subset is approximately the same as the averages of the general public in the USA.  While much intermediary work is digital, the debate continues as to whether it is the best pathway for getting research in front of the key people.

Our forthcoming report explores the behaviour of policy actors, but in terms of potential digital access, the data confirms that, increasingly, policy actors have access to this medium, and we should not miss the opportunity to develop "apps" which engages with these early adopters. A real-time example of the potential in this is the IDS Knowledge Services Open API. It allows developers to create apps for Android-driven Tablets and smartphones which could tap into the BRIDGE and Eldis research databases containing over 32, 000 summaries and documents.

Monday, 30 January 2012

Change is hard but not impossible with a little help from ELFs (part 2)

Guest post: We welcome back Elise Wach, Evaluation Consultant at the Institute of Development Studies (IDS)

To follow on from my post last week on how change is hard to achieve, even when you know an approach isn't working, here's an update on the Learning Retreat that the Impact and Learning Team facilitated for the IRC (International Water and Sanitation Centre) Triple-S Initiative. 

We kicked off the 2-day retreat by hearing reports back on the variety of learning streams that had taken place so far and assessing progress.  This led into discussions about the approach of the initiative as well as the approach of the evaluation and learning.  Were course corrections needed in order to achieve the desired outcomes of the initiative?  Were adjustments to the evaluation and learning methodologies needed in order to better capture initiative progress?

In terms of the approach of the initiative, one of the primary concerns was related to external communication - getting the right information out to the right people in a timely manner.  IRC’s key staff immediately made commitments to improve this:
  1. Set up an organisational blog to get discussions started and put information out on the web (see Emilie Wilson’s entry about the merits of blogging).  
  2. Post more information and resources on the website, even if not yet polished.  A key phrase throughout the retreat was to ‘not let the perfect be the enemy of the perfectly good’.  Resources and information may take the form of videos, slide decks, and less formal reports.
  3. Improve the layout of the website to make it more user-friendly, and the search engine tags to make it easier to find.
Other commitments were also made to improve the approach of the initiative, including a re-visit to the Theory of Change.  This will surely be discussed in detail at the next Learning Retreat which will go into more depth into the data and its synthesis and also include the advisory group for the initiative (scheduled for the end of April).

See more at http://www.waterservicesthatlast.org  

In terms of the evaluation and learning approaches, a few changes will be made to the timing and scope of data collection and analysis.  For example, given the disconnect between policy and practice discussed in last week’s entry, it was decided that in addition to analysing the policy documents of key agencies and organisations in the water sector, IRC and ILT will also analyse documents that might indicate that shifts in policies are being reflected in practice, such as calls for proposals and project reports.  That information will of course be posted on the Triple-S website in an effort to give these agencies a little extra nudge towards sustainable services that last.  



It was also determined that impact weighting for different outcomes and milestones might prove useful, along the lines of DFID’s revised approach to logframes (PDF) (though Triple-S is looking to move away from a linear/tabular format and towards more mind mapping and video).  

What was interesting to me about the retreat was the fact that none of the data discussed revealed anything incredibly new or surprising to the Triple-S team.  But for some reason, getting a group of people in a room together and setting aside time to specifically discuss progress and obstacles can be extremely effective for getting decisions made…especially if External Learning Facilitators (endearingly referred to as ELFs) are there to help the process along.

IRC has committed to starting their blog in the next week and will soon be posting more resources on their website, including the full report from the Learning Retreat (which will cover much more than I’m able to include here). As for making it easier to find the Triple-S website, you can try to Google it for yourself, but I think they’re still working on this one (unfortunately there’s a clothing company that goes by the same name!), so just in case, the "Water Services that Last" website is here.

Friday, 16 December 2011

How can we make research communications stickier?

Guest Post: 
James Georgalakis, Communications Manager at the Institute of Development Studies (IDS)

James looks back on 2011 and reflects on the most-viewed news stories about IDS research, featured on the IDS website. Here are his thoughts on what made them popular:


Image from: http://serenelyfull.blogspot.com
Which were the "stickiest" stories on the Institute of Development Studies’ (IDS) website in 2011? Is the use of SEO (search engine optimisation) techniques cheating? And do we improve research impact by dropping in the names of royals and celebrities? Just some of the questions I try and answer in this end of year blog.

News or blogs on development research are highly unlikely to compete with viral YouTube sensations involving celebrities or pets that reach millions in hours. But a quick scan through the top ten most viewed news stories from the IDS web site from 2011 still tells us a lot about what it is that makes some research communication super sticky.

In fact, some IDS news stories were so sticky they came top of the 2011 list even though they were not even posted in 2011. For example, a story about Ian Scoones’ book on Zimbabwe’s land reform, posted in November 2010, came in at number one followed closely by Andy Sumner’s New Bottom Billion, also a 2010 story.What did these stories have that others did not? Well of course exciting, original research helps!

Both of these examples tick that box. Scoones’ revelation that Zimbabwe’s land reforms were not so bad after all quickly ignited a lively media debate that has just run and run. It was still running a year on with this BBC Radio 4 documentary looking closely at his claims. Sumner’s startling findings on the changing nature of poverty also ignited debate in the media and academia and stoked up the blogosphere. This is why web traffic just keeps on finding its way back to the original web stories.

However, not all of our top ten scorers from this year were about original research with counterintuitive findings.

Consider our official number one story from 2011 (the most page views of all the stories actually posted in that year). It is news of a special conference celebrating the work and ideas of IDS Research Associate, Robert Chambers, with links to all the related materials.

This is not hard news and it is not particularly surprising or controversial. Instead, what we have here is the awesome stickiness of a big, well stellar, name in the development research community. How often is Chambers’ name googled? How big are the networks of people who have shared the link with one another and will have flocked to access this content? How quickly did news of his conference spread across the blogosphere with links back to the original content?

Robert Chambers was not the only big name to make the IDS top ten. At number two we have Kate Middleton and Prince William who, according to the IDS headline from last April, ‘got engaged in Africa’s land grab hotspot’.

Yes that’s right! We took the convergence of a royal wedding, the happy couple’s obscure connection with land grabs and a recent IDS hosted academic conference on land grabbing to produce something really sticky. Just think how many royal wedding fans inadvertently became informed on the land grab issue. Such are the rewards of working in research communications.

To be fair to the Future Agricultures Consortium, who organised the International Conference on Global Land Grabbing, this is a pretty sticky topic even without royal endorsement. It features in no less than three of our top ten spots from 2011.


The tactic of using highly topical and sticky words or names in your headline is known as search engine optimisation (SEO) or cheating, and it works. When used well, SEO means that big search engines like Google, Yahoo! and Bing will list the relevant link(s) to your website in their first page, increasing the likelihood of people clicking on your links.

Of course topicality is itself one of the greatest assets of all. Just take the Arab uprisings or the Horn of Africa crisis which both, perhaps not surprisingly, made our top ten.

However, as any newspaper sub-editor will tell you: if all else fails you just need a great headline.

What else can explain a story about a podcast from an IDS Sussex Development Lecture coming in at number eight? Don’t get me wrong it was a really great (and packed out) lecture but a story about a podcast!

It was titled: ‘Decline of the NGO Empire – where next for international development organisations?’ Pretty good huh? Yes, it was one of mine. Also very nice, (and not one of mine) and slipping in at number ten is: ‘Taking the scare out of scarcity - how faulty economic models keep the poor poor’. See what we did there?

Now I know the whole subject of web traffic drivers and SEO is way more complicated than this.

Our study of the IDS top ten has severe limitations. Clearly content published early in the year has an advantage over the stories that came after and some of our high scorers were boosted by extended periods on the IDS home page. Plus it is about push as well as pull and for that we have to start thinking about the role of social media, where content is positioned on the site and a multitude of other factors.

This is another blog for another day, but my point is this: if you want lots of people to find the story about your research irresistible consider this 2011 IDS top ten. Methodologically sound and original research is great, but a crowd pulling name, timeliness, a big surprise and a great title all help a lot too.

If you want to know more about this stickiness business I suggest you read Made to Stick: Why Some Ideas Survive and Others Die, by Chip and Dan Heath which should be a compulsory text for all those working in research communications.

Happy holidays!
James Georgalakis, Communications Manager, IDS

And here is that 2011 IDS website news stories top 10 in full (listed by order of unique page views to date):

1. Revolutions in development reflecting forwards from the work of Robert Chambers
2. Prince William and Kate Middleton engaged in Africa’s land grab hotspot
3. Bellagio Initiative starts an IDS led global debate exploring the future of philanthropy and international development
4. Debating the global land grab
5. How a citizen led approach can transform aid to governance
6. The East African food crisis beyond drought and food aid
7. Experts warn of new scramble for Africa at an international conference on land grabbing
8. Decline of the ngo empire – where next for international development organisations?
9. The people revolt why we got it wrong for the Arab world
10. Taking the scare out of scarcity - how faulty economic models keep the poor poor

Friday, 14 October 2011

Early headlines from research on policy makers and ICTs: "persistent and curious enquirers" (with smartphones)

By Simon Batchelor

Just to keep you up to date on the country studies that I mentioned in my first blog….(in which I spoke about research we were conducting on policy makers and their use of ICTs).... a lot of data is in. Some countries found it easier to get interviews with senior policy makers than others, so some countries have still to deliver their full quota.

However we have now begun analysis and we begin to find some interesting headlines. As I write, my colleagues Jon Gregson and Manu Tyagi are presenting some headlines back to a portion of the intermediary sector in India and Nepal, and Chris Barnett presented last week in Ghana.  I would like to acknowledge the work of our partners ODC Inc in Nepal, and Delink Services  in Ghana.

So what are some of those headlines?

We will upload the slideshare soon, but in brief here are some of the things that attracted my attention:-

Policy actors have access to ICT, and a considerable number of them have smartphones, and to my mind more importantly, know how to use them!

Image from: http://bestsmartphone2011.info/

Of course they almost all have access to computers and the internet, and cellphones.  But Ghana 52%, Nepal 49% and North India 35% of the samples have smartphones.  In Ghana 25% had more than one smartphone!  And of those that have a smartphone, almost all in Ghana and Nepal have explored sending emails, surfing in the internet on the phone, recording a video and instant messaging.  Only in North India did it seem that there were a significant portion of people who had a smartphone and yet did not explore these ‘features’ (about 50%).

What does this mean to us in the intermediary sector? It suggests that if you are developing an app to push research into the policy environment, then the baseline of smartphone use is there.

Policy actors are surfing the internet themselves – the idea that policy makers wait for an assistant to brief them seems to be diminishing.  

In all three countries, the majority of policy makers agreed with statements surrounding their own use of ICT and surfing the internet.  They described themselves as ‘a "persistent and curious" enquirer’ and noted that they ‘often "discover" other relevant information when searching’ (Phrases used by the PEW Internet studies in USA).  They also agreed to a lesser extent with ‘I tend to get my briefings face to face officially, in meetings’.  In Ghana, where there was a significant portion of private sector executives, there were a significant number who actually disagreed with the idea that they got their information from ‘official briefings’.

What does this mean to us in the intermediary sector? It suggests that policy actors are looking for information themselves, and, I presume, therefore need to find it easily, in an accessible form, and I guess, quickly.  

Yes, I know that searching for information online is evolving, and that social networks now tend to push information within the network.  This changes the way those of us who are well connected get our information.  We did investigate whether the policy actors are connected to social media networks and to some extent looked at their searching behaviours, but we are not there yet in the analysis to be able to comment on it.  Watch this space.

Policy actors do have an appetite for research – or at least they say they do 

There was a consistent strong agreement with the need for facts and figures, and that these need to be up to date.  We explored what information they were actually looking for and we looked at whether they trust the sources and channels for the information.  Again, these details will come out as the analysis proceeds.  However there was an interesting difference between the three countries.  In India there is a strong trust for ‘local research’ (as opposed to international research), however in Ghana  and Nepal they rate international research much higher than local research.
 
What does this mean to us in the intermediary sector ? In our MK4D programme, we are working on the idea that local intermediaries understand the context of research and policy in their location, and therefore have a strong ground with which to communicate research to policy makers. However, we also work with the idea of ‘co-construction’ working alongside and with our colleagues in the South.   If ‘local research’ is trusted less by policy actors, then that would seem to endorse the approach of co-construction – where local and international bodies work together to provide quality insights.   It also suggests that our programme to support the exposure of research published in the South onto the global internet is heading in the right direction.

Anyway, those are some insights from the first week of analysis.  More to come.

Friday, 7 October 2011

Getting serious about the evidence in policy making

By Nick Perkins
 
See www.impactevaluation2011.org
Earlier this year, the International Initiative for Impact Evaluation - better known as 3ie - convened a conference in Mexico called
Mind the Gap: From Evidence to Policy Impact.

I liked the idea of dedicating 3 days, dozens of presentations and hundreds of blog posts to that little ‘leap of faith’ which characterises so many theories of change about what research can do for development.


The problem that we are faced with is that the normative idea about how policy should be made – based on objective evidence – is seldom the reality that we are faced with - i.e. policy through political expediency. Political expediency is understood to be a range of contextual influences on the decision-making process. When described this way, there is something inevitable about it.

Current thinking is that this expediency can be addressed through mediation of research knowledge. This has given rise to the research mediation sector- institutions and individuals within institutions who seek to frame research in a way that it is accessible and relevant to people working in key policy spheres.

What this reveals is a kind of contradiction at the heart of the development knowledge sector. While we call for evidence-based policy making, there is also increasing investment in the complex process that shapes decision making. A way through this may have been revealed through a closer look at what research mediation actually entails.

A couple years ago, IDS held a series of ‘influencing seminars’ which revealed how different disciplinary communities nuanced their approaches to policy influence depending on how they understood change happened. None of them declared disdain for value of quality evidence. Instead they all expressed differing views of what constitutes ‘quality’ evidence and how to gain traction with those who might need it.

What emerged was a framework of four different ways of building an effective relationship between research and quality policy making.

The first is about generating as many policy options as possible. This emphasises the use of repositories to allow users to sift through the options for themselves.

The second is evidence-based and prioritises the familiar idea that the quality of the research evidence is what will best inform the quality of the decision. Systematic reviews are seen as crucial in the research mediation process here.

Third is the value-led idea of policy-making. There are many examples of this leading to bad science, but it is by far the most common type of public policy making. Networks and epistemic communities are critical to the mediation process in this case.

Finally we have the relational model of influence, which maintains that no amount of research will influence a policymaker if there is not a relationship which reflects equity and a balance of power -where a researcher or a mediator are themselves subject to some influence.

Clearly though, none of these frames are mutually exclusive. Perhaps the point is that we can support the complex reality of policy influence which draws on these without losing sight of the where we ultimately need to get to. In fact using a little political expediency ourselves can go a long way to cross what is too often seen as a small gap.

Thursday, 8 September 2011

Consuming knowledge or constructing it: a response

By Catherine Fisher

In my colleague Sunder’s blog earlier this week entitled Consuming knowledge or constructing it: evidence from the field , he described the resistance that some of the civil servants that he had met in India felt towards engaging with research knowledge. 

Reading the post, I felt that the reasons given by the civil servants he met for not wanting to engage with research knowledge are extremely valid and justified, based on their understanding of research and  “research uptake” or “evidence based policy” agendas.  
The  reasons given for not engaging with research  reveal a set of assumptions about the nature of research knowledge and knowledge more broadly that stem from modernist ideas about knowledge that are explored in the paper  that my colleague Emilie discussed in the first of this series of blogs.

Entitled Changing conceptions of intermediaries: challenging the modernist view of knowledge, communication and social change, one section of the paper explores four key modernist assumptions about knowledge which it goes onto critique:  that there exists an objective reality, that the scientific method of enquiry is neutral, that knowledge can be stored, managed and transferred, and that communication is a linear process.   These seemed to chime with me when I thought about the assumptions that seemed to inform the responses of the civil servants Sunder interviewed.   While these ideas have been widely critiqued, lots of the assumptions remain, both for people involved in the world of research uptake, and on Sunder’s evidence,  in the minds of the people whom they are trying to influence.  

I think the civil servants seemed to be rejecting a set of assumptions about research and its role in decision making, which I paraphrase as:

1. Research knowledge is the only knowledge that is important

This idea has been championed since the enlightenment and contains ideas about how legitimate knowledge is produced: it privileges knowledge produced through certain scientific processes and marginalises other sources of knowledge eg that generated through experience, or from less powerful actors.  While the underlying tenets have merit and underpin movements such as “evidence based policy”,  few proponents of greater use of evidence in decision making would argue that decisions should be solely based on research based evidence with no regard of other kinds of knowledge or social, economic or political contexts.   However maybe this is what is conveyed!

2.  Research provides a pre-determined right answer
There are very few policy contexts in which there is a clear cut right answer, particularly in relation to social, economic and political issues, and so social science research is very rarely going to be able to provide a right answer.  As intermediaries, we are concerned with engagement with a multiple range of sources from which an answer can be constructed.  And again I doubt many people involved in research uptake would see that one piece of research will provide a policy answer

However, as Carol Weiss in the introduction to Fred Carden’s recent book “Knowledge to Policy: Making the most of Development Research  observes, for many policy makers in developing countries, their experience of research is that which accompanies policy prescriptions handed out by funding institutions, thus the idea that research promotes a correct one-size fits all approach could well have been reinforced by this experience.


3. Knowledge can be communicated in a linear way and consumed passively

Personally, I believe that knowledge can only be constructed in someone’s head, knowledge requires a “knower” and is the sense someone make of information when they analyse and understand it according to their previous experience, belief systems and even what mood they are in today.  Thus I would argue with the title of the post but its been pointed out that my position may be a little extreme and not necessarily shared by many in the industry in which I work!  However I think that everyone who works in the knowledge industry needs to dispel the myth that knowledge can be transferred or passively consumed in ways that bear no reference to the consumer – people have knowledge and this shapes how they interpret new knowledge (research knowledge or otherwise)  and what they do as a result. 

So I would conclude that resistance to use of evidence in decision making is entirely reasonable if you have a modernist understanding of research knowledge.  Or indeed if you have been subject to such ideas from others/ believe that the person you are talking to shares those ideas!  

For me 2 areas emerge:

To what extent are the people who promote research uptake/evidence based policy etc propagating ideas about research and its role in change that are not useful?   Do those of us involved in promoting greater use of research in decision making need to be clearer with ourselves how we see the role of research vis a vis other knowledge and in the context of political realities and consider what messages we are sending. 

I am increasingly thinking it would be valuable if people generally (including me) were more aware of their own decision making processes - a kind of meta-cognition that allows them to be more aware of the how they process information and ideas, accepting, rejecting and interpreting  and applying them in line with their previous experiences, knowledge and beliefs.  In keeping line with the work of IDS colleagues in the Participation Power and Social Change Team, I suspect that this can be encouraged through greater reflective practice .   Another angle on this issue is idea of “evidence literacy” I am working with INASP to explore this through its PERii: Evidence-Informed Policy Making programme and will be posting updates to this blog. Watch this space.