Robert Murphy
Senior Research Social Scientist
Bob's research focuses on the design of experimental and quasi-experimental evaluations of educational programs and technologies. Bob's research interests also extend to the design of theory-driven instrumentation to assess program implementation and instructional practice and the analytical models used to examine the linkages between program implementation, practice and outcomes. Bob also has considerable experience in the management of large scale evaluations in educational settings.
Recently Bob has played key technical and project management roles on two large-scale random assignment control studies funded by the U.S. Department of Education, one examining the effectiveness of instructional software to support reading and math skills and another examining the effectiveness of different early elementary mathematics curricula: the Evaluation of the Effectiveness of Educational Technology Interventions (EETI) studies a variety of instructional software products and involves the participation of 33 school districts, 144 schools, 440 classroom teachers and 12,000 students over a four year time period; and the Evaluation of Mathematics Curricula (EMC), a four year study assessing the relative impact of four different math curricula in grades 1 and 2 and involves 12 school districts, 108 schools, 600 classroom teachers and 6,000 students. In addition to his project management responsibilities, Dr. Murphy's technical responsibilities on the EETI study include the development of the conceptual framework for the study, the design and piloting of classroom observation and teacher interview protocols, the design of a protocol to monitor vendor training of teachers, the design and implementation of training sessions for field staff on use of the field instrumentation, and the design of the analytical models used to assess the impact of conditions and practices on product effectiveness. On the EMC study, Dr. Murphy is overseeing SRI's contributions to the development of a classroom observation protocol, teacher survey, and the implementation of an assessment of teacher knowledge for teaching math.
In addition, Bob is also currently co-leading a 3-year study for the Bill and Melinda Gates Foundation that involves the systematic assessment of the quality of teacher assignments and student work in 24 high schools supported by the Foundation. In 2000, Bob was a task leader on a Department of Education task order A Review of the Evidence on the Effectiveness of Discrete Educational Technology and produced a research synthesis of the extant evaluation literature (1993-2000) on the effectiveness of educational software supporting skill development in language arts and mathematics. As part of this same task order, Bob and SRI colleagues developed a Web-based consumer guide to help district and school practitioners evaluate the validity of research-based claims of program effectiveness made by the producers and distributors of educational software.
Prior to joining SRI, Dr. Murphy was a Research Graduate Fellow at the Institute for Policy Research at Northwestern University where he worked with Dr. Thomas Cook on a randomized field trial of Dr. James Comer's School Development Program in Chicago.
Education
- Ph.D., Human Development and Social Policy, Northwestern University, 2002
- Program in Public Sector Analysis, University of Dublin - Trinity College, 1994
- M.S., Mechanical Engineering, Rensselaer Polytechnic Institute, 1987
- B.S., Mechanical Engineering, University of Massachusetts, 1984
Professional Experience
- Research Social Scientist, SRI International, Menlo Park, CA (2000-present)
- Research Graduate Fellow, Institute for Policy Research, Northwestern University, Evanston, IL (1994-2000)
- Rotary Ambassadorial Scholar, University of Dublin - Trinity College, Dublin, Ireland (1993-1994)
- Research Engineer, United Technologies Research Center, East Hartford, CT (1984-1994)
Research Areas at CTL
Past Projects at CTL
- Evaluation of Math Curricula (Leader) ended 2008
- Evaluation of the Bill & Melinda Gates Foundation's National High School Program ended 2006
- Evaluation of the Effectiveness of Educational Technology Interventions (EETI) (Leader) ended 2007
- Evaluation of the GLOBE Program ended 2006
- Principled Assessment Designs for Inquiry (PADI) ended 2008
- Teacher Assignment/Student Work Project (Leader) ended 2007
Publications
-
Means, B., Toyama,Y., Murphy. R., Bakia, M., and Jones, K. (2009). Evaluation of Evidence-based Practices in Online Learning: A Meta-analysis and Review of Online-learning Studies. Washington, D.C.: U.S. Department of Education.
Read more
-
Dynarski, M., Agodini,R., Heavisude, S., Novak, T., Carey, N., Campuzano, L., Means, B., Murphy, R., Penuel, W., Javitz, H., Emery, D., & Sussex, W. (2007). Effectiveness of reading and mathematics software products: Findings from the first student cohort. Report to Congress. NCEE 2007-4006. Washington, D.C.: U.S. Department of Education.
Read more
-
Means, B., Murphy, R., Shear, L., Gorges, T., Hu, P., & Sussex, W. (2006). Implementing Reading and Mathematics Software. Menlo Park, CA: SRI International.
Read more
-
Means, B., Murphy, R., Javitz, H., Haertel, G., & Toyama, Y. (2004). Design Considerations for Evaluating the Effectiveness of Technology-Related Teacher Professional Development. Menlo Park, CA: SRI International.
Read more
-
Mitchell, K. J., Murphy, R. F., Bacevich, A. E., Garet, M. S., Fouts, J. T., Baker, D. B., Gratama, C. A., & Hafter, A. (2004). Measuring the Quality of Teacher Assignments and Student Work in High School English and Mathematics.
Read more
-
Mitchell, K. J., Murphy, R. F., Hafter, A., & Shkolnik, J. (2004). Exploring Assignments, Student Work, and Teacher Feedback in Reforming Schools: 2002-03 Data from Washington State.
Read more
-
Mitchell, K. J., Murphy, R. F., Jolliffe, D., Leinwand, S., & Hafter, A. (2004). Teacher Assignments and Student Work as Measures of Opportunity to Learn.
Read more
-
Mitchell, K., Murphy, R., Hafter, A., & Shkolnik, J. (2004). Exploring assignments, student work, and teacher feedback in reforming schools: 2002-03 Data from Washington State. Washington, DC: American Institutes for Research and SRI International.
Read more
-
Mitchell, K., Murphy, R., Hafter, A., & Shkolnik, J. (2004). Technical Appendix: Exploring assignments, student work, and teacher feedback in reforming schools: 2002-03 data from Washington State. Washington, DC: American Institutes for Research and SRI International.
Read more
-
Mislevy, R., et al. (2002). Design patterns for assessing science inquiry (PADI technical report 1). Menlo Park, CA: SRI International.
Read more
-
Penuel, W.R., Kim, D., Michalchik, V., Lewis, S., Means, B., Murphy, R., Korbak, C., Whaley, A., & Allen, J.E. (2002). Using technology to enhance connections between home and school: A research synthesis. Prepared for the Planning and Evaluation Services, U.S. Department of Education. Menlo Park, CA: SRI International.
Read more
-
Means, B., Penuel, W. R., Crawford, V. M., Korbak, C., Lewis, A., Murphy, R. F., Shear, L., Villavicencio, C., Vinson, E. Y., & Yarnall, L. (2001). GLOBE Year 6 evaluation: Explaining variation in implementation. Menlo Park, CA: SRI International.
Read more
-
Murphy, R., Penuel, W., Means, B., Korbak, C., Whaley, A. (2001). E-DESK: A Review of Recent Evidence on the Effectiveness of Discrete Educational Software. Menlo Park, CA: SRI International.
Read more
-
Cook, T. D., Hunt, H. D., & Murphy, R. F. (2000). Comer's School Development Program in Chicago: A theory-based evaluation. American Educational Research Journal, 37(2), 535-597.
Read more
-
Cook, T. D., & Murphy, R. F. (1999). How inner-city children see their family, school, peers and neighborhood: Developmental changes during the transition to adolescence. (Working Paper). Evanston, IL: Institute for Policy Research, Northwestern University.
Read more
-
Cook, T. D., Hunt, H. D. & Murphy, R. F. (1998). Designing a Useful Evaluation of the Comer School Development Program. Paper presented at the 1998 Annual Meeting of the American Evaluation Association, Chicago, November 4-7.
Read more

