How do you measure the value of a university? For most of the twentieth century, the answer was relatively straightforward: count publications, track citations, rank research outputs, and monitor graduate employment rates. These metrics shaped funding decisions, institutional reputations, and academic careers. But they told only part of the story — and increasingly, that incomplete picture is being challenged.
A growing movement within Australian higher education is asking a more expansive question: what is a university’s impact on the community it serves? And crucially, how do we measure it in ways that are credible, meaningful, and actionable?
Why Traditional Metrics Fall Short
Traditional academic metrics were designed to measure academic activity, not community benefit. A journal article published in a prestigious international journal scores well on conventional measures — but if it addresses a problem irrelevant to local communities, or if its findings are never translated into practice, its real-world impact may be negligible.
Conversely, a researcher who spends years building a relationship with a regional council, helping them redesign social services based on community-led data, may produce few publications but generate enormous value. Under traditional metrics, this work is largely invisible. Under impact-oriented frameworks, it becomes central.
Emerging Approaches to Impact Measurement
Several frameworks have emerged in recent years to help universities better capture community impact. The UK’s Research Excellence Framework (REF) introduced impact case studies as a formal component of research assessment — requiring universities to demonstrate the real-world difference their research has made. Australia has observed this experiment closely, with discussions ongoing about whether similar approaches should be adopted here.
Domestically, the Engagement and Impact Assessment (EIA), piloted by the Australian Research Council, represents a significant step in this direction. The EIA asks institutions to demonstrate how their research has influenced policy, practice, or community outcomes — shifting the conversation from outputs to outcomes. Early results have been promising, revealing a depth of community-facing research that had previously been undervalued and underreported.
Beyond formal government assessments, many universities are developing their own internal frameworks. These often draw on social return on investment (SROI) methodologies, logic models, and developmental evaluation approaches — tools borrowed from the community sector and adapted for the university context. Some institutions are partnering directly with community organisations to co-develop impact measurement frameworks, ensuring the metrics used actually reflect what communities value rather than what is easiest for universities to count.
The Challenge of Attribution
One of the thorniest problems in community impact measurement is attribution. If a university researchers contributes to a policy change that improves health outcomes for a regional community, how much of that improvement can be attributed to the research? Policy change is usually the result of many factors — advocacy, political will, economic conditions, community organising — and isolating the contribution of any single actor is genuinely difficult.
Most sophisticated impact frameworks have moved away from seeking strict causal attribution toward a contribution approach. Rather than asking “did this research cause this outcome?”, they ask “what was this research’s contribution to this outcome?” This is a more honest framing that acknowledges complexity while still holding research accountable for its real-world relevance.
Building a Culture of Impact
Ultimately, measurement frameworks are only as useful as the culture that surrounds them. If impact assessment is experienced by academics as a compliance burden — another administrative hoop to jump through — it will generate data without changing behaviour. The universities making the most progress are those that have embedded impact thinking into how they hire, promote, fund, and celebrate researchers.
This means recognising community partnerships in promotion criteria. It means creating seed funding for community-engaged research that isn’t tied to traditional grant structures. It means training researchers in co-design and participatory methodologies. And it means telling stories — publicly and proudly — about the difference university research is making in Australian communities.
The shift from measuring activity to measuring impact is not just a technical change. It is a cultural one — a statement about what universities are for, and who they serve.