Hardback
Handbook on the Theory and Practice of Program Evaluation
As this volume demonstrates, a wide variety of methodologies exist to evaluate particularly the objectives and outcomes of research and development programs. These include surveys, statistical and econometric estimations, patent analyses, bibliometrics, scientometrics, network analyses, case studies, and historical tracings. Contributors divide these and other methods and applications into four categories – economic, non-economic, hybrid and data-driven – in order to discuss the many factors that affect the utility of each technique and how that impacts the technological, economic and societal forecasts of the programs in question.
More Information
Critical Acclaim
Contributors
Contents
More Information
There has been a dramatic increase in expenditures on public goods over the past thirty years, particularly in the area of research and development. As governments explore the many opportunities for growth in this area, they – and the general public – are becoming increasingly concerned with the transparency, accountability and performance of public programs. This pioneering Handbook offers a collection of critical essays on the theory and practice of program evaluation, written by some of the most well-known experts in the field.
As this volume demonstrates, a wide variety of methodologies exists to evaluate particularly the objectives and outcomes of research and development programs. These include surveys, statistical and econometric estimations, patent analyses, bibliometrics, scientometrics, network analyses, case studies, and historical tracings. Contributors divide these and other methods and applications into four categories – economic, non-economic, hybrid and data-driven – in order to discuss the many factors that affect the utility of each technique and how that impacts the technological, economic and societal forecasts of the programs in question.
Scholars, practitioners and students with an interest in economics and innovation will all find this Handbook an invaluable resource.
As this volume demonstrates, a wide variety of methodologies exists to evaluate particularly the objectives and outcomes of research and development programs. These include surveys, statistical and econometric estimations, patent analyses, bibliometrics, scientometrics, network analyses, case studies, and historical tracings. Contributors divide these and other methods and applications into four categories – economic, non-economic, hybrid and data-driven – in order to discuss the many factors that affect the utility of each technique and how that impacts the technological, economic and societal forecasts of the programs in question.
Scholars, practitioners and students with an interest in economics and innovation will all find this Handbook an invaluable resource.
Critical Acclaim
‘The economic crisis has simultaneously placed a strong emphasis on the role of R&D as an engine of economic growth and a demand that limited public resources are demonstrated to have had the maximum possible impact. Rigorous evaluation is the key to meeting these needs. This Handbook brings together highly experienced leaders in the field to provide a comprehensive and well-organised state-of-the-art overview of the range of methods available. It will prove invaluable to experienced practitioners, students in the field and more widely to those who want to increase their understanding of the complex and pervasive ways in which technological advance contributes to economic and social progress.’
– Luke Georghiou, University of Manchester, UK
‘Theoretical and empirical research on program evaluation has advanced rapidly in scope and quality. A concomitant trend is increasing pressure on policymakers to show that programs are “effective”. Now is the time for a comprehensive status report on state-of-the-art research and methods by leading scholars in a variety of disciplines on program evaluation. This outstanding collection of contributions will serve as a valuable reference tool for academics, policymakers, and practitioners for many years to come.’
– Donald S. Siegel, University at Albany, SUNY, US
– Luke Georghiou, University of Manchester, UK
‘Theoretical and empirical research on program evaluation has advanced rapidly in scope and quality. A concomitant trend is increasing pressure on policymakers to show that programs are “effective”. Now is the time for a comprehensive status report on state-of-the-art research and methods by leading scholars in a variety of disciplines on program evaluation. This outstanding collection of contributions will serve as a valuable reference tool for academics, policymakers, and practitioners for many years to come.’
– Donald S. Siegel, University at Albany, SUNY, US
Contributors
Contributors: S. Arvanitis, B. Bozeman, S. Casault, S.E. Casey, I. Feller, M.P. Gallaher, D.O. Gray, A.J. Groen, D. Hicks, J.E. Jankowski, G.B. Jordan, G. Kingsley, A.N. Link, J.D. Linton, R.J. Loomis, J. Melkers, A.C. O’Connor, D. Rivers, R. Ruegg, J.T. Scott, P. Thomas, N.S. Vonortas
Contents
Contents:
1. Introduction to the Handbook
Albert N. Link and Nicholas S. Vonortas
PART I: ECONOMIC METHODS AND APPLICATIONS
2. The Theory and Practice of Public-Sector R&D Economic Impact Analysis
Albert N. Link and John T. Scott
3. Micro-Econometric Approaches to the Evaluation of Technology-Oriented Public Programmes: A Non-Technical Review of the State of the Art
Spyros Arvanitis
4. Selection of a Portfolio of R&D Projects
Sébastien Casault, Aard J. Groen and Jonathan D. Linton
PART II: NON-ECONOMIC METHODS AND APPLICATIONS
5. Peer Review and Expert Panels as Techniques for Evaluating the Quality of Academic Research
Irwin Feller
6. Logic Modeling: A Tool for Designing Program Evaluations
Gretchen B. Jordan
7. Research Value Mapping and Evaluation: Theory and Application
Barry Bozeman and Gordon Kingsley
PART III: HYBRID METHODS AND APPLICATIONS
8. Social Network Methodology
Nicholas S. Vonortas
9. Estimating Avoided Environmental Emissions and Environmental Health Benefits
Alan C. O’Connor, Michael P. Gallaher, Ross J. Loomis and Sara E. Casey
10. Evaluating Cooperative Research Centers: A Strategy for Assessing Proximal and Distal Outcomes and Associated Economic Impacts
Drew Rivers and Denis O. Gray
PART IV: DATA-DRIVEN APPLICATIONS
11. Bibliometrics as a Tool for Research Evaluation
Diana Hicks and Julia Melkers
12. Patent Analysis
Rosalie Ruegg and Patrick Thomas
13. Measuring Innovation with Official Statistics
John E. Jankowski
Index
1. Introduction to the Handbook
Albert N. Link and Nicholas S. Vonortas
PART I: ECONOMIC METHODS AND APPLICATIONS
2. The Theory and Practice of Public-Sector R&D Economic Impact Analysis
Albert N. Link and John T. Scott
3. Micro-Econometric Approaches to the Evaluation of Technology-Oriented Public Programmes: A Non-Technical Review of the State of the Art
Spyros Arvanitis
4. Selection of a Portfolio of R&D Projects
Sébastien Casault, Aard J. Groen and Jonathan D. Linton
PART II: NON-ECONOMIC METHODS AND APPLICATIONS
5. Peer Review and Expert Panels as Techniques for Evaluating the Quality of Academic Research
Irwin Feller
6. Logic Modeling: A Tool for Designing Program Evaluations
Gretchen B. Jordan
7. Research Value Mapping and Evaluation: Theory and Application
Barry Bozeman and Gordon Kingsley
PART III: HYBRID METHODS AND APPLICATIONS
8. Social Network Methodology
Nicholas S. Vonortas
9. Estimating Avoided Environmental Emissions and Environmental Health Benefits
Alan C. O’Connor, Michael P. Gallaher, Ross J. Loomis and Sara E. Casey
10. Evaluating Cooperative Research Centers: A Strategy for Assessing Proximal and Distal Outcomes and Associated Economic Impacts
Drew Rivers and Denis O. Gray
PART IV: DATA-DRIVEN APPLICATIONS
11. Bibliometrics as a Tool for Research Evaluation
Diana Hicks and Julia Melkers
12. Patent Analysis
Rosalie Ruegg and Patrick Thomas
13. Measuring Innovation with Official Statistics
John E. Jankowski
Index
