Don't hurl misleading statistics about...

Posted by Debra Allcock

chief Executive, DSC

Thu 25th, Jul

Recent reports from the Fundraising Regulator have misused numbers to paint a picture of the sector that is bleaker than the reality.

 “Politicians use statistics like drunks use a lamppost, for support rather than illumination.” I have a degree in psychology and got part way through a physics degree (which involves quite a bit of higher maths). These two disciplines are very strict about data – how you gather it, analyse it and report it – because it is so easy to manipulate and misrepresent to promote a particular agenda.

Some years ago a company that was tendering for some work for the Directory of Social Change did some analysis of our customer base. According to its research, 80 per cent of our customers had given a particular, very worrying response. It turned out that the sample size was 10 out of a customer base of more than 15,000, a number that is not only statistically invalid, but also factually useless! If I hadn’t understood enough about statistics to ask about sample size we might have made a catastrophically bad decision.

Reporting data and statistics properly really matters. Which is why I worry about the way the Fundraising Regulator has presented statistics about complaints in its recent reports and commentary. There are two core issues that would have had my stats tutor chucking chalk. First, the use of technical statistical terms without context. For example, the regulator refers to “significant numbers” filing complaints without clarifying what “significant” means. It refers to “high numbers of complaints received” without giving a comparator.

Second, its use of percentages masks underlying numbers that matter. For example, it says that complaints to the regulator increased by 18 per cent in the period between September and March 2017/18, compared with the same period in 2016/17. This statistic is probably right, but because we don’t know what the actual number of complaints was for that period we can’t compare. It does tell us that it received an additional 367 complaints for 2017/18, which brings the total number for the whole year to 1,080.

Statistics on the number of asks to the public are incredibly hard to come by, but based on approximately £10bn of voluntary donations it is not unreasonable to assume there are millions of fundraising contacts each year. I don’t wish to diminish its significance, but 1,080 complaints is small compared with the millions of interactions that could lead to a complaint. So in that context it’s hard to argue that 1,080 is significant.

The regulator says it investigated 55 complaints and in 81 per cent of those cases the complaints were upheld. Again, 81 per cent sounds a huge proportion, but amounts in fact to only 44 complaints. So the way these figures are presented gives the false impression that lots of charities are irresponsible fundraisers.

We all want fundraising in our sector to be of the highest standard, but I don’t think it helps to have uncontextualised statistics and technical terms hurled about as if by a metaphorical drunk trying to find something to lean on to support himself. We need data soberly presented, without being under the influence of an agenda. That way the whole picture is illuminated and we can make better decisions.

This article first appeared on Third Sector.

Leave a comment

Successful Credit Management During a Pandemic – Part Three

Sun 25th, Oct

Welcome to the 3rd of our series of blogs to help you improve your ‘Order to Cash’ process in a practical way and reduce the negative effects of the pandemic on businesses.

Race to Net Zero Blog

Thu 15th, Oct

Guest blog by CGI’s Pulina Abeywickrama, SME Senior Consultant | Agile Project Manager

Successful Credit Management During a Pandemic – Part Two

Tue 13th, Oct

Welcome to the 2nd of our series of blogs to help you improve your ‘Order to Cash’ process in a practical way and reduce the negative effects of the pandemic on businesses.

Why now is the right time to take IoT seriously

Mon 27th, Jul

Guest blog by Alan Nunn – Communications Subject Matter Expert at CGI

How IoT can create a sustainable future for water

Mon 27th, Jul

Guest blog by Graham Hainsworth – Director Consulting in CGI’s Water Sector Business

Happy 9th Birthday 6th Door Ltd

Tue 19th, May

As I’m leaning on the stand-up desk in my makeshift home office, that over the weeks has been turned into a video and podcast recording studio

How to take back control of your water costs

Fri 13th, Mar

While most businesses already have a comprehensive strategy in place for their electricity and gas consumption, water management is often overlooked.

How to choose an energy consultancy

Fri 13th, Mar

Most business owners recognise the advantages of shopping around for the best energy deal, but without the time, resource and expertise to find the best tariff, it can be an almost impossible task.

Business energy: Don’t get caught out by rollover rates

Fri 13th, Mar

As a busy business owner, you may feel there are not enough hours in the day to secure your next energy contract. You know you’ll get around to it, but when you’ll get around to it is another matter.

Business water matters – Top 3 water saving tips

Fri 13th, Mar

Water is often referred to as ‘the forgotten utility’. While many large businesses are clearly focussed on their comprehensive energy strategies, it seems many are yet to implement a strategy around managing their water usage.