|
HOME
ABOUT THE CENTER
HISTORY OF THE
CENTER
AREAS OF RESEARCH
PUBLICATIONS
CENTER MEMBERS
WHAT'S NEW
RELATED LINKS
CONTACT US
 |
|
Recently several articles (Arnold, 2004; Molas-Gallart and Davies, 2006)
have appeared arguing for a several changes in the kinds of S&T
evaluations that are being made. Among other suggestions, the following
seem to be of special merit: (1) a more macro and systemic focus; (2)
concentrating on the processes of innovation; (3) using theory to guide
the S&T evaluation; and (4) identifying blockages and obstacles or what
Arnold (2004) labels failures. One of the great advantages of
concentrating on innovation processes is that it helps identify the causal
chain connecting policy intervention and outcome including eventual
societal impact, a problem that Molas-Gallart and Davies (2006) identify
in the medium and long-term evaluations that are more typical. To this
list of desiderata, we would add the perspective of the policy maker who
wants to know what policy reformulations should be made to correct
the blockages and obstacles.
Given these observations, the Center for
Innovation has developed the following kinds of theories and frameworks
for evaluation of innovation and knowledge production:
Ř
A three level framework, micro, meso, and macro, for
evaluation of technological sectors with three sets of indicators at each
level for identifying blockages and obstacles.
Ř
A balanced score performance management system for research
organizations.
Ř
A four-fold theory of attributes associated with portfolio
choices in different kinds of and research project profiles.
Current Research
Projects include:
-
Study of technical progress in scientific and technological
research in Sandia National Laboratories
-
Study of STAR performance system in NOAA
Recent Research Reports
include:
-
Managing and Measuring Technical Innovation in Research Organizations:
The development of Alternative Measures of Technical Progress (with
Jordan, Mote, and Hepler) 2004 Report for Sandia National
Laboratories
-
Perceptions of
the ORA Research Environment and Areas to Investigate for Improvement:
A preliminary report on the results of the research environment survey
(Hage, Mote and Kurashina) 2005 Report for STAR
Relevant Publications
include:
-
Jordan, G., J. Hage
and J. Mote. 2008. A Theories-Based
Systemic Framework for Evaluating Diverse Portfolios of Scientific Work
Part One: Micro and Meso Indicators.
In C.L.S. Coryn and Michael Scriven (Eds.), Reforming the Evaluation
of Research. New Directions for Evaluation, 118, 7-24.
-
Jordan, G., J. Hage
and J. Mote. 2007. A
Theories-Based Systemic Framework for Evaluating Diverse Portfolios
of Scientific Work Part Two: Macro Indicators and Policy
Interventions. Science and Public Policy
34(10): 731-741.
-
Mote, J., G. Jordan
and J. Hage. 2007. Measuring Radical Innovation in Real
Time. International Journal of Technology, Policy and Management,
7 (4): 355-377.
Recent Conference
Papers include:
-
Mote, Jonathan, Gretchen Jordan, and Jerald Hage. 2006. "New Directions
in the Use of Network Analysis in R&D Evaluation." Presented at the
Atlanta Conference on Science and Technology Policy, Atlanta, GA, May
18-19.
-
Hage, Jerald, Jonathan Mote, and Gretchen Jordan. 2006. "Macro Dynamic
Evaluation Models for the Formation of National Scientific and
Technological Policies." Presented at the Atlanta Conference on Science
and Technology Policy, Atlanta, GA, May 18-19.
-
Jordan, Gretchen. 2006. "A Strategic Balanced Scorecard for Publicly
Funded Science and Technology Programs." Presented at the Atlanta
Conference on Science and Technology Policy, Atlanta, GA, May 18-19.
-
Jordan, Gretchen. 2006. "Dilemmas in Managing Small and Large Research
Projects for Radical innovation: Presented at the Research Profiles
Approach." Presented at the 2006 Annual Meeting of the American
Association for the Advancement of Science, St. Louis, MO, February 17.
-
Jordan, Gretchen. 2006. "A Theory-based Framework for Evaluating
Diverse Protfolios of Scientific Work." Presented at New Frontiers of
Evaluation. Vienna, Austria April 24-25.
-
Mote, Jonathan E. 2006. “Measuring Radical Innovation in Real-time.”
Presented at the 2006 Annual Meeting of the American Association for the
Advancement of Science, St. Louis, MO, February 17.
|
