How Does Your Nonprofit Use Data To Improve Results? | Beth’s Blog

How Does Your Nonprofit Use Data To Improve Results?

Measurement

Today,  NTEN’s Amy Sample Ward shared this fabulous video on Facebook.   It is from the recent workshop that NTEN and NPower in Charlotte, NC to help participants understand the power of data to drive decision-making for nonprofits.    It’s a topic that NTEN’s executive director, Holly Ross, has covered with this must-read post: “Four Ways Nonprofits Can Increase Their Impact With Data.”

NTEN is also doing this flash poll to learn how nonprofits make sense of their own data.  I’d love to see a survey of nonprofit measurement practice that quantifies this.   I’d be curious to see a benchmarking study on nonprofits on this topic that looks at how nonprofits apply measurement techniques and tools to improve their programs and demonstrate impact, including social media measurement.

Measuring Networked Nonprofits: Using Data for Social Change is the topic of the book  I’m co-authoring with KD Paine.   It is a look at measurement and learning practices when social media is in the mix.  One of the chapters is on organizational culture – what’s in the DNA of  a “data-driven” nonprofit and what are the incremental steps for change?

As part of my work as Visiting Scholar at the David and Lucile Packard Foundation,  I’m facilitating peer exchange groups on measuring the networked nonprofit with 60 grantees.   These sessions have become rich focus groups for the book writing.     I did an assessment of  participants current level of social media practice using my Crawl Walk Run Fly framework to better understand measurement practices.

Here’s a summary:

There was a range of practice for using data and measurement to improve social media and demonstrate impact:

Crawl

Does not know where to start.  Does data collection  from time-to-time, but not formal reporting.  Does not have a dashboard or simple collection method.  Often overwhelmed.  Does a lot of  ”drive by” analysis, but no monthly review of trends.   Does not have a reflection process for analyzing success or failure to take into next use or campaign.

Walk
Regularly collects data but in a bunch of different spreadsheets and collected by different people.  Data is focused on the metrics that are specific to social media channel and uses it to improve for content, messaging, and engagement on specific channels.    Social media data is not linked to higher level organizational results or mission-driven goals.    Discussions on how to improve results are occasionally part of staff meetings and rarely reports are shared with or requested by board.

Run
Has a system and dashboard for collecting measurement data that is shared with different departments.    Has different views or level of detail for senior leaders,  implementors, and different departments.    Holds weekly campaign check-ins to evaluate what’s working and what’s not across communications channels, as well as, any specific social media feedback received that would help shape our future campaigns or social media use.   Monitors feedback from target audience in real time but balances with trend or survey data.     Documents quantitative results against goals and value when asked by senior leadership.   Works with measurement consultants or specialists to improve skills and capacity.

Fly
In addition to weekly check-ins, the dashboard includes  key performance metrics related to goals as well as more detailed metrics.   Has shared organizational dashboard across departments and process for analyzing, discussing, and applying results.   Presents a regular report to senior leadership which details high level successes, challenges, and recommendations for moving forward.   Presents a report with quantitative analysis that demonstrates value.   Staff performance reviews incorporate how well the organization is doing on KPIs.  Works with measurement consultants or specialists to improve skills and capacity or to commission independent study.

Participants identified two key areas of  ”Measurement Stress” – one was cultural and the other technical or systems-related.

Organizational Culture

  • Finding the time to devote to measurement.
  • Articulating measurable goals
  • Overwhelmed by data collection process

Technical or Systems Challenges

  • Getting accurate data and the right information
  • A streamlined and well designed dashboard
  • Better data analysis, linking it to decisions
  • Conversion, as measured in dollars and cents, as a means to evaluate and justify the time spent on social media.
  • How to measure behavioral change
  • Picking the right measurement tool for the job and how to use it
  • How to apply data to improve on social media: What does it mean?

Where is your nonprofit when it comes to social media measurement practice?  Are you crawl, walk, run, or fly?   What does that look like?    How is your nonprofit using data and measurement to make effective decisions about networked approaches and social media?

Please share your stories in the comments below – you might be featured in the book!

 

9 Responses

  1. Annaliese says:

    Thank you for posting about this, Beth! And stay tuned: NTEN will be conducting some big-picture and deeper dive research projects around how organizations are working with their data (coming in 2012) . . .

  2. jenny says:

    i’m definitely in the crawl stage at our nonprofit. We just jumped on the bandwagon of doing social media when I arrived, but I’ve been so busy trying to get a grasp of the print end of communications, that I haven’t been able to do social media properly. It’s been frustrating and a difficult learning process of figuring things out…albeit slowly…and learning about analytics and measurement and setting objectives—it’s a completely foreign world to me as someone who comes to the job with a journalist’s background.

  3. Beth, absolutely fantastic post. Whether a non-profit is in the crawl or fly stage there is a great software solution out there to retrieve, measure and evaluate the performance outcomes and impact of non-profits. If you go to http://www.newdea.com you will see the many solutions they have for the philanthropic community. In fact, I highly recommend you get a hold of them for the research you are doing for your book. The folks at Newdea have been at this awhile working with high net worth donors, foundations, corporations, financial institutions and non-profits and they have obtained a plethora of information and knowledge over the last several years.. He’s the other great thing about Newdea…it’s affordable for any size non-profit. So there is absolutely no excuse from the technology standpoint of not measuring results.

    Really cool stuff.

  4. Mazarine says:

    Measuring data that we’re getting from ever increasingly complex online engagement measurement programs is a huge challenge.

    It’s NOT just about the bottom line, though of course we end up there.

    Since I installed the Ghostery plugin for Firefox, I’ve found a WHOLE BUNCH of ways that websites are tracking user activity. It’s incredible how much we are being tracked. But we can block this tracking, and we can look at what successful websites are doing and emulate them. And a lot of these tools are free, or have a free trial. I wrote a post about this here: http://www.treyzsocialmedia.com/watch-watched-realtime-tracking-tools-website/

    Your findings from this can help inform how you redesign your nonprofit website, get more donations, and help your visitors find the information they were looking for more quickly.

    Peace,

    Mazarine

  5. Bob Filbin says:

    Hi, Beth,

    Right now at dosomething.org, we are walking, but quickly accelerating towards running and flying. As Do Something’s newly hired Data Analyst, I am working to make sure that our departmental and overall organizational goals are aligned, and that social media data are seamlessly integrated into achieving our organizational metrics.

    A big part of what I will be doing here is making sure that every person on staff has access to the data they need in order to create actionable changes in the way they do their work. Ideally, each person will receive the data they need automatically and on a regular basis. I hope to have automatic dashboards set up for each department in the next couple of months, and then we’ll really be flying. =)

    Bob Filbin
    Data Analyst
    DoSomething.org

  6. [...] approach your classification can start to emanate a enlightenment of dimensions and training is to always be piloting with tiny projects.    Setting adult a exam of hashtag giving is an example.  You’d exam opposite calls to [...]

  7. David Comer says:

    subscribe to your blogs

  8. [...] http://www.bethkanter.org/org-use-data/ Share this:TwitterFacebookLike this:Like Loading… Leave a comment | [...]

Leave a Reply