Theories and Research on Evaluation of Science and Technology

HOME

ABOUT THE CENTER

HISTORY OF THE CENTER

AREAS OF RESEARCH

PUBLICATIONS

CENTER MEMBERS

WHAT'S NEW

RELATED LINKS

CONTACT US

 

          Recently several articles (Arnold, 2004; Molas-Gallart and Davies, 2006) have appeared arguing for a several changes in the kinds of S&T evaluations that are being made.  Among other suggestions, the following seem to be of special merit:  (1) a more macro and systemic focus; (2) concentrating on the processes of innovation; (3) using theory to guide the S&T evaluation; and (4) identifying blockages and obstacles or what Arnold (2004) labels failures.  One of the great advantages of concentrating on innovation processes is that it helps identify the causal chain connecting policy intervention and outcome including eventual societal impact, a problem that Molas-Gallart and Davies (2006) identify in the medium and long-term evaluations that are more typical. To this list of desiderata, we would add the perspective of the policy maker who wants to know what policy reformulations should be made to correct the blockages and obstacles.

            Given these observations, the Center for Innovation has developed the following kinds of theories and frameworks for evaluation of innovation and knowledge production:

Ř      A three level framework, micro, meso, and macro, for evaluation of technological sectors with three sets of indicators at each level for identifying blockages and obstacles.

Ř      A balanced score performance management system for research organizations.

Ř      A four-fold theory of attributes associated with portfolio choices in different kinds of and research project profiles.

Current Research Projects include:

  1. Study of technical progress in scientific and technological research in Sandia National Laboratories

  2. Study of STAR performance system in NOAA

Recent Research Reports include:

  1. Managing and Measuring Technical Innovation in Research Organizations: The development of Alternative Measures of Technical Progress  (with Jordan, Mote, and Hepler) 2004  Report for Sandia National Laboratories

  2. Perceptions of the ORA Research Environment and Areas to Investigate for Improvement: A preliminary report on the results of the research environment survey (Hage, Mote and Kurashina) 2005 Report for STAR

Recent Conference Papers include:

  1. Mote, Jonathan, Gretchen Jordan, and Jerald Hage. 2006. "New Directions in the Use of Network Analysis in R&D Evaluation." Presented at the Atlanta Conference on Science and Technology Policy, Atlanta, GA, May 18-19.

  2. Hage, Jerald, Jonathan Mote, and Gretchen Jordan. 2006. "Macro Dynamic Evaluation Models for the Formation of National Scientific and Technological Policies." Presented at the Atlanta Conference on Science and Technology Policy, Atlanta, GA, May 18-19.

  3. Jordan, Gretchen. 2006. "A Strategic Balanced Scorecard for Publicly Funded Science and Technology Programs." Presented at the Atlanta Conference on Science and Technology Policy, Atlanta, GA, May 18-19.

  4. Jordan, Gretchen. 2006. "Dilemmas in Managing Small and Large Research Projects for Radical innovation: Presented at the Research Profiles Approach." Presented at the 2006 Annual Meeting of the American Association for the Advancement of Science, St. Louis, MO, February 17.

  5. Jordan, Gretchen. 2006. "A Theory-based Framework for Evaluating Diverse Protfolios of Scientific Work." Presented at New Frontiers of Evaluation. Vienna, Austria April 24-25.

  6. Mote, Jonathan E. 2006. “Measuring Radical Innovation in Real-time.” Presented at the 2006 Annual Meeting of the American Association for the Advancement of Science, St. Louis, MO, February 17.


University of Maryland UMD Home Department of Sociology Directories Search Calendar
Maintained by Center for Innovation
Direct questions and comments to webmaster