Testing tells you whether your choice of framing—the emphasis you put on particular concepts—is likely to affect the change you were hoping for.
While working on the Framing Equality Toolkit with ILGA-Europe and LGBTI campaigners from across Europe over the past few years, we found that doing any kind of testing was really rare.
Campaign messages are often developed under huge pressure, in a small team, and sent straight out into the world. These messages are based on assumptions rather than evidence of how an audience will react and they are therefore likely to be hit-or-miss.
When messages miss, they can leave a lasting negative impression on how people think about your issue. This can set you back in time and resources, and make it harder to realise your vision.
And when you do test, it can be a useful learning experience for both the short- and longer-term about how people understand your issue and what kind of framing works.
Our aim, then, is to make testing common practice on any budget.
The guide focuses on three methodologies: surveys, focus groups and interviews, and follows the steps illustrated in the example above.
- Know what you are looking for: form the right research questions and hypotheses before you begin.
- Choose your methodology: decide whether focus groups, interviews or surveys are the best match for your research question.
- Prepare your messages to test: follow some basic principles to get your messages ready to test and compare.
- Find the right sample: find out about different types of samples and how you can recruit them.
- Look for what works: know how to make sense of your results.
You don’t need any expertise to understand this guide.
We hope that this guide will help you work with researchers or agencies to test your messages; or even to have a go at trialling some low-cost methodologies yourself.
Using testing to improve campaigns: an example
Using the process in this guide, we worked closely with an LGBTI organisation in Slovenia called Legebitra. Together we organised some low cost focus groups to test their messages about LGBTI discrimination, and we used the results to develop the final campaign. Testing helped Legebitra to find effective and humorous ways of appealing to shared identities and emphasising the common ground between LGBTI people and non-LGBTI people.
This campaign is already proving successful in Slovenia, with the film getting 50,000 views in the first few days of its release.
If you want to talk about testing, please get in touch!