Taking Note: A Progress Report on NEA Outcomes Measurement

January 4, 2013

By Rich Heeman, Program Analyst with the NEA Office of Research & Analysis

As we welcome the new year, the Office of Research and Analysis (ORA) would like to take a moment to reflect on progress made toward two of the goals and outcomes emphasized in the NEA’s strategic plan.

One goal is “to engage the public with diverse and excellent art,” a key outcome of which is that “Americans throughout the nation experience art.” Regarding this deliverable, the NEA has embarked on a two-phase pilot study of how we might effectively report, for a cohort of grantees that mount live exhibits or performances, the percentage of audience members who demonstrate that they were “affected” by these events. As part of the first phase of this study, the consultant Wolf Brown produced an extensive review of published works that examine measurements of “affect,” especially regarding arts participation.

This review was completed in October 2011, and has proved foundational for the NEA’s attempts to realize a long-term strategy for measuring audience affect in a pragmatic, cost-effective way. A report from the review is available here on the NEA website.

In addition to measuring audience affect, we are also working to acquire a more in-depth understanding of where NEA-funded arts events occur, and who benefits from them.

In 2010, the NEA committed to a significant upgrade of its processes and technology for collecting location-specific project information from NEA grantees. This investment is now starting to pay off. Because we require grantees to report street-level addresses for the venues where their NEA-sponsored arts activities have taken place, we are in a position to understand the agency’s full impact in ways that previously were unimaginable. For example, the following graphic of project activity locations (for the NEA’s fiscal year 2010 grants) depicts the geographic reach of NEA grantees:

Another major goal of the Arts Endowment—one that supports and reinforces all of the agency’s other activities, in fact—is “to enable the NEA mission through organizational excellence” so that, among other outcomes, the “NEA is an efficient and vigilant steward of public funds.” The following bullets cover two initiatives underway that will help us meet this objective:

  • The NEA recently conducted its first survey of grant applicants. The survey revealed a broadly positive response to the periodic public webinars the agency hosts on grant application guidelines. A majority of survey respondents who had viewed a webinar said it helped them better prepare their applications. Consequently, the NEA is expanding its webinar efforts. If you are interested in applying for an NEA grant, we hope that you’ll join us for a webinar that suits your schedule between January 10 and February 12, 2013. To participate, please go here.
  • In early 2013, we expect to launch an advanced search page for grants awarded by the NEA. This new search feature will allow applicants, grantees, researchers, and other interested members of the public to more easily access grant records and obtain additional information that was previously unavailable through the NEA’s website. The search page will also provide an option for downloading data tables, allowing stakeholders to conduct their own analyses of the agency’s grant-making activities.

These projects, along with other ORA efforts to advance the collection, analysis, and distribution of arts-related data, have sparked an increased appetite for information across the agency. Over the past six months alone, ORA worked with discipline staff on program-specific analyses; provided agency-wide guidance on analytic tools; and presented data to our state and regional partners.

As we continue to improve our internal data-sharing and collaboration, we are also working to make the agency more transparent. This February, the NEA will have a home on the performance.gov website. From this portal, the public will be able to link to our strategic plan, budget submissions, and annual performance reports. Throughout 2013, we plan to share additional information on agency metrics, results from data visualization projects, and, with luck, some success stories on our uses of measurement.

Tags: , , ,

2 Responses to “Taking Note: A Progress Report on NEA Outcomes Measurement”

  1. Teri Alea says:

    I love the image of the geographic reach of NEA grantees. What do the lines represent?
    We are using Google Map to locate all venues in Tennessee that sell TACA (the Tennessee Association of Craft Artists) members craft work. We will continue to develop the map by adding TACA artist studios that are open to the public, and also locations where annual events led by or in which TACA artists or chapters participate in. The result will be a visual of the effect TACA has throughout Tennessee.

    • Teri– That map depicts the geographic distribution of NEA-supported project activities. All grants awarded within a state are plotted near the center of the state. (Though it’s difficult to see on this scale, the central point is marked with the state abbreviation ["MT", for example].) The lines then connect this central point to the various locations where project activities occurred. (Project activity locations are identified by light blue circles on the map.) I was trying to highlight the fact that NEA funded projects often have a regional or national impact. — Rich Heeman

Leave a Reply

Please read our complete comment policy

We will not post comments that:

1. Contain vulgar language, personal attacks of any kind, or are offensive
2. Promote services or products (non-commercial links that are relevant to the blog post or comment are acceptable)
3. Are far off-topic
4. Make unsupported accusations
5. Are simply links to other sites, blogs, editorials, etc.