Don't hurl misleading statistics about...

Posted by Debra Allcock

chief Executive, DSC

Thu 25th, Jul

Recent reports from the Fundraising Regulator have misused numbers to paint a picture of the sector that is bleaker than the reality.

 “Politicians use statistics like drunks use a lamppost, for support rather than illumination.” I have a degree in psychology and got part way through a physics degree (which involves quite a bit of higher maths). These two disciplines are very strict about data – how you gather it, analyse it and report it – because it is so easy to manipulate and misrepresent to promote a particular agenda.

Some years ago a company that was tendering for some work for the Directory of Social Change did some analysis of our customer base. According to its research, 80 per cent of our customers had given a particular, very worrying response. It turned out that the sample size was 10 out of a customer base of more than 15,000, a number that is not only statistically invalid, but also factually useless! If I hadn’t understood enough about statistics to ask about sample size we might have made a catastrophically bad decision.

Reporting data and statistics properly really matters. Which is why I worry about the way the Fundraising Regulator has presented statistics about complaints in its recent reports and commentary. There are two core issues that would have had my stats tutor chucking chalk. First, the use of technical statistical terms without context. For example, the regulator refers to “significant numbers” filing complaints without clarifying what “significant” means. It refers to “high numbers of complaints received” without giving a comparator.

Second, its use of percentages masks underlying numbers that matter. For example, it says that complaints to the regulator increased by 18 per cent in the period between September and March 2017/18, compared with the same period in 2016/17. This statistic is probably right, but because we don’t know what the actual number of complaints was for that period we can’t compare. It does tell us that it received an additional 367 complaints for 2017/18, which brings the total number for the whole year to 1,080.

Statistics on the number of asks to the public are incredibly hard to come by, but based on approximately £10bn of voluntary donations it is not unreasonable to assume there are millions of fundraising contacts each year. I don’t wish to diminish its significance, but 1,080 complaints is small compared with the millions of interactions that could lead to a complaint. So in that context it’s hard to argue that 1,080 is significant.

The regulator says it investigated 55 complaints and in 81 per cent of those cases the complaints were upheld. Again, 81 per cent sounds a huge proportion, but amounts in fact to only 44 complaints. So the way these figures are presented gives the false impression that lots of charities are irresponsible fundraisers.

We all want fundraising in our sector to be of the highest standard, but I don’t think it helps to have uncontextualised statistics and technical terms hurled about as if by a metaphorical drunk trying to find something to lean on to support himself. We need data soberly presented, without being under the influence of an agenda. That way the whole picture is illuminated and we can make better decisions.

This article first appeared on Third Sector.

Leave a comment

Happy 9th Birthday 6th Door Ltd

Tue 19th, May

As I’m leaning on the stand-up desk in my makeshift home office, that over the weeks has been turned into a video and podcast recording studio

How to take back control of your water costs

Fri 13th, Mar

While most businesses already have a comprehensive strategy in place for their electricity and gas consumption, water management is often overlooked.

How to choose an energy consultancy

Fri 13th, Mar

Most business owners recognise the advantages of shopping around for the best energy deal, but without the time, resource and expertise to find the best tariff, it can be an almost impossible task.

Business energy: Don’t get caught out by rollover rates

Fri 13th, Mar

As a busy business owner, you may feel there are not enough hours in the day to secure your next energy contract. You know you’ll get around to it, but when you’ll get around to it is another matter.

Business water matters – Top 3 water saving tips

Fri 13th, Mar

Water is often referred to as ‘the forgotten utility’. While many large businesses are clearly focussed on their comprehensive energy strategies, it seems many are yet to implement a strategy around managing their water usage.

Know where your cloud data is stored or risk a GDPR fine

Thu 27th, Feb

For businesses who have chosen cloud-based data hosting services there’s a temptation to relax and think “great, we’re paying someone else to take care of our data, we don’t need to worry about it any more.”

Transparency plans could slow down region’s business growth

Thu 27th, Feb

Efforts by regional start-up initiatives that have led to Merseyside outperforming the rest of the UK when it comes to business growth could be hampered by new government proposals, a leading legal expert has claimed.

Backup or risk losing your business

Thu 13th, Feb

Maintaining a robust backup is hard work, it’s important to not only build the correct solution for your business and trust your IT support provider to look after it, but to also maintain a sense of urgency as a business owner to...

Information Destruction and Compliant Data Handling in the Education Sector

Thu 13th, Feb

Identity theft costs the UK economy £5.4 billion and a recent BSIA report showed 169,592 cases of identity fraud, representing an increase of 49% over the previous year.

Give Your Business Utilities a Refresh for 2020

Mon 20th, Jan

January is a time for reflection for most people and this includes business owners, with the new year bringing with it an opportunity to take stock of performance during the past 12 months, create goals for the year ahead, and ensure...