Rochester Grantmakers Forum
A professional association of foundations, corporations, government representatives, philanthropic organizations and individuals;
 
the Forum serves as a catalyst and resource for effective philanthropy.

Home
About
Who we are
What we are
What we do
Membership
How we can help you
How to join 
List of Members
Events
Publications
For Funders
WILLpower
Funders Alliance
REP
Job Openings
Links
Contact Us

Directory of Evaluators Serving Upstate New York

Introduction 

Grantmakers and grantseekers throughout our region have expressed a growing need for assistance with evaluation.  Their evaluation needs vary:

bullet

Some seek evaluators who can design and carry out evaluation projects with minimal assistance from the organization or program being evaluated. 

bullet

Others seek evaluators who can work in a highly collaborative way with staff and volunteers both in the design and implementation phases of an evaluation. 

bullet

Others prefer to have staff and volunteers receive training so the organization can carry out evaluations internally in the future.

During 1998 and 1999 Rochester Grantmakers Forum and participants in the Rochester Effectiveness Partnership (REP), under the leadership of REP’s evaluation partner Dr. Anita Baker, carried out a project to define and respond to these needs.  This Directory of Evaluators is the result.  It has been updated for the 2002 Guide to Grantmakers in the Rochester Area.

Fifteen individuals and organizations provided information regarding their services for inclusion in this Directory of Evaluators.  Their presence here in no way represents an endorsement by the Rochester Grantmakers Forum or the Rochester Effectiveness Partnership of their credentials or the quality of their work.  We encourage those seeking evaluation help to ask thoughtful questions, review samples of previous work by the evaluators, and check a number of references before selecting the best person or organization to meet their needs.

Evaluators who wish to be included in future editions should contact the Rochester Grantmakers Forum at 585-232-2380 or rgf@frontiernet.net.

We have also included an Evaluation Resource List, with information provided by Dr. Michael Quinn Patton (past president of the American Evaluation Association and an internationally recognized evaluation consultant who is based in Minneapolis) and some additional listings provided by Dr. Baker.


anita baker consulting

CONTACT     Anita Baker, Ph.D.                                Phone: 609-397-8722
                        1
01 E. Blair Tr.                                     Fax: 609-397-7907
                        Lambertville, New Jersey 08530             Email: abaker8722@aol.com

DIVERSITY INFORMATION

Woman-owned? Yes
Minority-owned?
No

EVALUATION-RELATED EXPERTISE

Program evaluation Yes

Statistical Analyses Yes

Collaboratives No

Community-based No

Participatory evaluation Yes

Longitudinal Yes

Large-scale, multi-site Yes

 

TOPICAL AREAS OF EXPERTISE
Youth development
Alternative education
Employment (including wage growth/sectoral development)
Fatherhood development

RELATED EDUCATIONAL BACKGROUND OF STAFF
Masters and doctoral degrees

GEOGRAPHIC AREAS SERVED  
Nationally, but mostly in New York City, Rochester NY, New Jersey, and Washington, D.C.

EXPERIENCE
Program Evaluation: 10+ years experience designing, directing, and participating in these evaluations for a variety of clients.
Statistical Analyses:
Have experience with advanced methods such as regression analysis, analysis of variance, HLM, but mostly do basic frequency calculations.
Multi-site Evaluation:
10+ years of experience working on and directing large-scale, multi-site evaluations for federal and state governments and private funders.
Participatory Evaluation:
Have been training groups of non-profits, funders, and evaluators in this approach for 7 years.  I also conduct participatory evaluations with most clients.
Designing Evaluation Tools:
Basic survey, interview, observation protocol development.
Developing Logic Models:
About 4 years experience training non-profit organizations and evaluators in use of logic models for program planning, evaluation, and fund development.
Analyzing Evaluation Information (including software, dedicated hardware, etc.):
Experience, hardware and software to analyze surveys and interviews.  Mostly small databases—N=500 or less.
Teaching Evaluation Skills:
Have conducted training for 12 groups of after-school providers in New York City (as part of a team), serve as lead trainer for REP in Rochester and the lead trainer for the Participatory Evaluation Institute in New York City.

HAS EVALUATION EXPERIENCE WITH:
Nonprofits:
Yes
Funders:
Yes
Government:
Yes
Educational Institutions:
Yes
For-profit Businesses:
Yes

PROGRAMS/ORGANIZATIONS EVALUATED IN RECENT YEARS

·         Atlantic County Children/Family Initiative

·         New Visions Library Project

·         Sanctuary for Families Shelter Program & Legal Services

·         State of New Jersey’s Neighborhood Community Services Project (Department of Education)

·         STRIVE Inc.’s ASAP Employment Program and For Women Only Program

·         Fund for the City’s Networks for Youth Development

·         State of New Jersey’s School-based Youth Services Project (Department of Humanities)

 

PERCENT OF ORGANIZATION’S TIME SPENT ON EVALUATION WORK:  100%

EVALUATION ASSOCIATION MEMBERSHIPS
American Evaluation Association

PRICING
Daily Rate (including fringes, overhead, etc.):
Nonprofits= $550, Others= $650
Discount Available For Nonprofits?
Yes (see above) Is Amount of Discount Negotiable? No

REFERENCES
Nonprofits
JoEllen Lynch, Good Shepherd Services, 718-788-0666
Anita Strauss, New Visions, 212-645-5110
Robert Carmona, STRIVE Inc., 212-360-1100
Beth Krueger, New York State Bar Association, 518-457-5560
Janet Kelly, Partnership for After-school Education, 212-571-2664

Funders
Beth Bruner, Bruner Foundation, 585-381-6368

Kay Reiss, New Jersey Department of Human Services, 609-292-0908

 

Others

Norman Unsworth, Atlantic County Department of Intergenerational Services, 609-445-7700

 


BOWEN’S EVALUATION & CONSULTING SERVICES, INC.

 

CONTACT     Kathryn A. Sielbeck-Bowen, Ph.D.                    Phone: 570-882-9481

                        CEO, Program and Training Evaluator                Fax: 570-882-1341

                        The Enterprise Center                           Email: kathryn.bowen@cyber-quest.com

703 S. Elmer Avenue                             Website: www.BowenEvaluation.com

Sayre, Pennsylvania 18840

 

DIVERSITY INFORMATION

Woman-owned? Yes

Minority-owned? Yes

 

EVALUATION-RELATED EXPERTISE

Program evaluation Yes

Statistical Analyses Yes

Collaboratives Yes

Community-based Yes

Participatory evaluation Yes

Longitudinal Yes

Large-scale, multi-site Yes

Other Theory-based evaluation, utilization-focused evaluation, evaluation of training, concept mapping

 

TOPICAL AREAS OF EXPERTISE

Health

Youth development

Maternal/Child

Child protective services

Nursing

Education

Anti-discrimination

Community health

 

RELATED EDUCATIONAL BACKGROUND OF STAFF

Ph.D. in Program Evaluation & Planning

Evaluator's Institute

1.  Mixed method Evaluations, 1997

2.  How to Develop Program Theory, 1998

3.  Evaluating Community Collaborations and Building their Capacity, 1999

4.  Cluster Evaluation and Other Multiple-Site Strategies, 2000

5.  Evaluating Hard to Reach Populations, 2001

Masters in Community Health and Education

 

GEOGRAPHIC AREAS SERVED 

Pennsylvania and New York (beyond if necessary)

 

EXPERIENCE

Program Evaluation: Teen Pregnancy & Parenting Program Evaluation; High School Science Program Evaluation; Gay, Lesbian, Bisexual Program Evaluation; Youth Development Curriculum Evaluation.

Statistical Analyses: GSEOP Data Analysis—Cornell University.

Community-based Evaluation: Cornell University CPS Training—evaluation of training in community collaboration; evaluation of community-based science center.

Participatory Evaluation: Teen Pregnancy and Parenting Program Evaluation.

Designing Evaluation Tools: Pre/Post Tests, Retro-Post Tests, Satisfaction Surveys.  Questionnaires/ surveys for Ithaca High School (1996) and Tompkins Co. Male Survey (1998).

Developing Logic Models: Tompkins Co. Teen Pregnancy and Parenting Program (1998).

 

 

(Listing continues on next page.)


BOWEN’S EVALUATION & CONSULTING SERVICES, INC. - continued

 

 

Analyzing Evaluation Information (including software, dedicated hardware, etc.): SPSS, GSEOP Data Analysis, Concept Systems Concept Mapping.

Teaching Evaluation Skills: Teaching Assistant (1995-1997), Program Evaluation Planning at Cornell University, Faculty at Cornell University: Graduate Course: 2000 Qualitative Methods PAM 615

Others: Abstinence education for 9-13-year-olds.

Evaluation of the Balanced and Restorative Initiative, multi-site evaluation across the state of

Pennsylvania (National Juvenile Justice Department).

Evaluation of the Cornell Collaboration on Community and Capacity Building Curriculum

Evaluation of the New York State Food Stamp Nutrition Education Program (multi-site)

Qualitative evaluation of the NYS Expanded Food and Nutrition Education Program (multi-site)

Evaluation of the Managing Pressures Before Marriage Program

Evaluation of the Families United to Prevent Teen Pregnancy Program

 

HAS EVALUATION EXPERIENCE WITH:

Nonprofits: Yes

Funders: Yes

Government: No

Educational Institutions: Yes

For-profit Businesses: No

 

PROGRAMS/ORGANIZATIONS EVALUATED IN RECENT YEARS

Tompkins Co. TASA, Teen Pregnancy and Parenting Program

Ithaca High School Science Program

Ithaca Science Center

Gay, Lesbian, Bisexual Program at Cornell University

Cornell Collaboration Training

Advancing Youth Development Training

Immunization Program

Rockland County Life Skills Academy

Integrated County Planning

 

PERCENT OF ORGANIZATION’S TIME SPENT ON EVALUATION WORK:  100%

 

EVALUATION ASSOCIATION MEMBERSHIPS

American Evaluation Association

New York Evaluation Association

 

PRICING

Daily Rate (including fringes, overhead, etc.): $500/day plus travel/lodging expenses

Discount Available For Nonprofits? Yes       Is Amount of Discount Negotiable? Yes

 

REFERENCES

Nonprofits

·         TASA—Teen Pregnancy and Parenting Program, 609 W. Clinton Street, Ithaca, NY 14850

 

Others

·         Jutta Dotterweich, Dr. Frank Barry, Cornell University Collaboration Training, Family Life Development Center, MVR Hall, Ithaca, NY 14853-4401, 607-255-4108 or 607-255-7456

·         Dr. Steve Goggin, Youth Development Curriculum, Cornell University: (Cornell Cooperative Extension, MVR Hall N130, Ithaca, NY 14853-4401, 607-255-2245

·         Lois Houser, Partners of Bradford Co., 409 S. Main Street, Athens, PA 18810, 510-882-8338


Center for Governmental Research (CGR)

 

CONTACT     One South Washington Street                 Fax: 585-325-2612

                        Suite 400                                               Website: www.cgr.org

                        Rochester, New York  14614

 

Donald E. Pryor                                                Phone: 585-327-7067

Human Services Analysis                      Email: dpryor@cgr.org

 

Patricia Malgieri                                    Phone: 585-327-7056

Email: pmalgieri@cgr.org

 

DIVERSITY INFORMATION

Woman-owned? No

Minority-owned? No

 

EVALUATION-RELATED EXPERTISE

Program evaluation Yes

Statistical Analyses Yes

Collaboratives Yes

Community-based No

Participatory evaluation Yes

Longitudinal Yes

Large-scale, multi-site Yes

 

 

TOPICAL AREAS OF EXPERTISE

Human Services Analysis and Evaluations, Integrated Services to Children and families, Education Reform, Census Interpretation and Community Profiles, Management Assistance to Governments, Economic Analysis, Computerized Mapping

 

RELATED EDUCATIONAL BACKGROUND OF STAFF

Advanced training, master’s and doctoral degrees

 

GEOGRAPHIC AREAS SERVED

New York State

 

EXPERIENCE

CGR has extensive experience with program evaluation, collaboratives, statistical analyses, community-based evaluation, organizational evaluation, evaluation of collaboratives, multi-site evaluation, participatory and evaluation throughout New York.  CGR has worked extensively with New York State governmental agencies, numerous county governments and departments, other local governmental bodies, United Ways, nonprofit service-providing agencies, school districts, the faith community, community organizations and foundations locally and around the state.

 

Designing Evaluation Tools: Numerous outcome measures for various organizations and types of services interview protocols, consumer satisfaction and impact surveys, instruments to track Workforce Investment Act progress, numerous instruments appropriate to meet targeted agencies, services and target groups.

Developing Logic Models: As needed.

Analyzing Evaluation Information (including software, dedicated hardware, etc):  Extensive hardware, software and staff capacity to handle small and large databases, for single and multiple sites.

Teaching Evaluation Skills: Through community-based fund for the Public Interest initiative, work with local agencies to develop evaluation and needs assessment capacities in-house.

 

 

 

 

(Listing continues on next page.)


Center for Governmental Research - continued

 

 

HAS EVALUATION EXPERIENCE WITH:

Nonprofits: Yes

Funders: Yes

Government: Yes

Educational Institutions: Yes

For-profit Businesses: Yes

 

PROGRAMS/ORGANIZATIONS EVALUATED IN RECENT YEARS

Numerous governmental departments, early childhood and after-school programs, school-based student support centers, community-reinvestment act (mental health) programs, statewide Coordinated Children’s Services Initiative (CCSI), youth anti-violence initiatives, learn and serve curriculum initiatives at Rochester Institute of Technology, various academic/world of work initiative at Monroe Community College, Northeast Area Development (NEAD), anti-drug initiative, Even Start programs in selected counties, Wilson Commencement Park, numerous community needs assessments, etc.

 

PERCENT OF ORGANIZATION’S TIME SPENT ON EVALUATION WORK:  50%

 

EVALUATION ASSOCIATION MEMBERSHIPS

Various local and national associations

 

PRICING

Daily Rate (including fringes, overhead, etc.): depends on project and the number of staff involved

Discount Available For Nonprofits? Yes, depending on the circumstances

 

REFERENCES

Nonprofits

Ann Howard, RIT Professor in College of Liberal Arts and Community Service Coordinator

Bruce Stanley, Executive VP of United Way of Northeastern New York

Jean Howard, Wilson Commencement Park

Carol Gravetter, United Way of Greater Rochester

 

Funders

Deborah Ellwood, Rochester Area Community Foundation

Dan Ross, Monroe County Department of Social Services

Diane Larter, Monroe County Department of Social Services

Sherm Sacco, Director, Management and Budget, Niagara County

Arthur Johnson, Broome County Mental Health Commissioner

 

Others

Raoul Grassi, President, Greece Teachers Association

Margaret Duff, Director, Livingston County Event Start

 

 

 

CHILDREN’S INSTITUTE, INC.

 

CONTACT     274 N. Goodman Street, Suite D103       Phone: 585-295-1000

Rochester, New York 14607                              Fax: 585-295-1090

Website: www.childrensinstitute.net

 

A. Dirk Hightower, Ph.D.          Email: dhightower@childrensinstitute.net

Executive Director

or

                        Guillermo Montes, Ph.D.            Email: gmontes@childreninstitute.net

                        Director of Research and Evaluation

 

 

DIVERSITY INFORMATION

Woman-owned? No

Minority-owned? No

 

EVALUATION-RELATED EXPERTISE

Program evaluation Yes

Statistical Analyses Yes

Collaboratives Yes

Community-based Yes

Participatory evaluation Yes

Longitudinal Yes

Large-scale, multi-site Yes

 

 

TOPICAL AREAS OF EXPERTISE

Child development

Prevention programs for children

Resilience in youth

Social and emotional assessment

Problem solving

School systems

Measure, test and survey development

School adjustment

Children of Divorce

 

 

RELATED EDUCATIONAL BACKGROUND OF STAFF

Executive Director and Director of Research and Evaluation: post-doctoral training

Other staff: 4 bachelors, 5 masters, and 8 doctoral degrees between them

 

GEOGRAPHIC AREAS SERVED  New York State, Monroe County

 

EXPERIENCE

Program Evaluation: 40+ years, programs in schools and for youth in the community.

Collaboratives: Lead agency for Rochester Early Enhancement Program (REEP) and Rochester Early Childhood Assessment Partnership (RECAP).

Statistical Analyses: Advanced including multiple regression, structural equation modeling, hierarchical linear modeling, logistic probate, simultaneous equations, factor analyses, MANOVA.

Community-based Evaluation: Fathers’ programs in Rochester, Wellness Centers.

Evaluation of Collaboratives: Evaluation of Rochester Early Enhancement Program (REEP).

Multi-site Evaluation: California PIP project – 600+ sites simultaneously; NY PMHP project – 100+ sites simultaneously.

Participatory Evaluation: Evaluation of West-side health Services Early Childhood program.

Designing Evaluation Tools: We have designed assessment and evaluation tools for over 30 years.  Social/emotional adjustment, teacher ratings, parent ratings, child self-ratings, group leader ratings, substance abuse measure, self-control, fathers’ involvement, parent satisfaction, social support, early childhood phone survey, parent assessment of early experiences, observation measures, surveys of all types, interviews.

 

(Listing continues on next page.)


CHILDREN’S INSTITUTE, INC. - continued

 

 

Developing Logic Models: Developed logic model for West-side Health Services Early Childhood program, and for middle school wellness centers.

Analyzing Evaluation Information (including software, dedicated hardware, etc.): More than 40 computers with statistical capability – Pentium IIs, Pentium IIIs, 450-500 MHz; software – SAS, SPSS, LISREL.

Teaching Evaluation Skills: Hightower and Montes have taught evaluation at the university level.  Montes teaches evaluation courses at the University of Rochester.  Our focus on evaluation is to teach others.

 

CHILDREN’S INSTITUTE HAS EVALUATION EXPERIENCE WITH:

Nonprofits: Yes

Funders: Yes

Government: Local, state, USA, international

Educational Institutions: Yes

For-profit Businesses: No

 

PROGRAMS/ORGANIZATIONS EVALUATED IN RECENT YEARS

Children of Divorce Intervention Program

Wellness Centers (CHANGE)

A.C.T. – For the Children

Fathers Matters (RACF)

Primary Mental Health Project (80+ sites)

YWCA Successful Employment for Women

Pre-Kindergarten Classrooms (200+ sites)

REEP – All programs in the collaborative

How Was School Today? (SPCC)

Healthy Moms

Rochester City School District

Lawrence Public Schools

 

PERCENTAGE OF ORGANIZATION’S TIME SPENT ON EVALUATION WORK:  25-50%

 

EVALUATION ASSOCIATION MEMBERSHIPS

American Evaluation Association

American Psychological Association

American Educational Research Association

 

PRICING

Daily Rate (including fringes, overhead, etc.): $75/hr ($600/day)

Discount Available for Non-Profits: Yes (This is the discount rate.  We have not worked with for-profits.)  Is Amount of Discount Negotiable? Yes

 

MISSION AND/OR APPROACH TO EVALUATION

To strengthen children’s social and emotional competence and to prevent adjustment difficulties.  Our sound research and evaluation enable us to develop and promote high-quality early intervention programs, materials, and practices for children, families, schools, and communities.

 

ORGANIZATIONAL STRUCTURE

Staff:

Executive Director (19 years experience)

Research Director (6 years experience)

Evaluation Director (6 years experience)

Research Associates (2 associates, 6 and 4 years experience respectively)

Research Coordinator (21 years experience)

Information Analysts (6 analysts, with an average of 3 years experience)

 

 

 

(Listing continues on next page.)


CHILDREN’S INSTITUTE, INC. - continued

 

 

REFERENCES

Non-profit

Ann Brown, Rochester City School District

Andrew MacGowan, Rochester City School District

Mary Lou Bergeron, Lawrence Public Schools

 

Funders

Diane Larter, Monroe County Department of Social Services

Bonnie Hindman, Rochester Area Community Foundation

Roger Gardner, Daisy Marquis Jones Foundation

Bill McCullough, United Way

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 


HALLEY RESEARCH, LLC

 

 

CONTACT     June P. Mead, Ph.D.                             Phone: 607-772-8036

                        Director of Research and Evaluation      Fax: 607-772-8243 (please call before faxing)

195 S. Washington Street                       Email: jm62@cornell.edu

Binghamton, New York 13903

 

DIVERSITY INFORMATION

Woman-owned? Yes

Minority-owned? No

 

EVALUATION-RELATED EXPERTISE

Program evaluation Yes

Statistical Analyses Yes

Collaboratives Yes

Community-based Yes

Participatory evaluation Yes

Longitudinal Yes

Large-scale, multi-site Yes

Other Concept mapping, web-based evaluations

 

TOPICAL AREAS OF EXPERTISE

Children, youth, and families at risk

21st Century Community Learning Centers

Community-based programs

Parent/Family Programs

Outcome evaluations

Youth Development

Information technologies

 

 

RELATED EDUCATIONAL BACKGROUND OF STAFF

Director of Research and Evaluation: postdoctoral training, teaches research methods at Syracuse University & Binghamton University

Other staff: 1 bachelor’s, 1 master’s, 1 Ph.D.

 

GEOGRAPHIC AREAS SERVED  New York State and Washington, DC

 

EXPERIENCE

Extensive experience in all facets of research and evaluation from grant and proposal preparation to report writing and workshop training.

Designing Evaluation Tools: Focus groups, interview protocols, educational assessment instruments, web-based evaluation tools (available through Children, Youth and families Educational Research Network (CYFERnet; http://www.cyfernet.org), USDA, Cooperative Extension).

Developing Logic Models: Extensive.  Piloted theory-oriented evaluation approach which preceded United Way of America’s “logic model” approach to evaluation outcomes.

Analyzing Evaluation Information (including software, dedicated hardware, etc.): SPSS, Ethnographer, dedicated Mac and PC-based computers.

Teaching Evaluation Skills: Numerous workshops geared to human service practicioners; adjunct faculty at Syracuse University; teach at Binghamton University School of Continuing Education.

 

HAS EVALUATION EXPERIENCE WITH:

Nonprofits: Yes

Funders: Yes

Government: Yes

Educational Institutions: Yes

For-profit Businesses: Yes

 

 

 

 

(Listing continues on next page.)

HALLEY RESEARCH, LLC - continued

 

 

PROGRAMS/ORGANIZATIONS EVALUATED IN RECENT YEARS

4-H Clubs of New York State

21st Century Community Learning Centers

Grandparenting Program

Southern Tier Electric Learning Community

CDFI Fund, US Department of Treasury

Youth Voices

Teen Assessment Project (TAP) of Broome County

Reducing Risks & Increasing Capacity

 

PERCENT OF ORGANIZATION’S TIME SPENT ON EVALUATION WORK:  100%

 

EVALUATION ASSOCIATION MEMBERSHIPS

AEA

AERA

 

PRICING

Daily Rate (including fringes, overhead, etc.): Negotiable

Discount Available For Nonprofits? Yes       Is Amount of Discount Negotiable? Yes

 

REFERENCES

Available upon request.


Jonathan Klein, MD, MPH

 

CONTACT     Jonathan Klein, MD, MPH             Phone: 585-275-7760

                        University of Rochester                         Fax: 585-242-9733

601 Elmwood Avenue                            Email: jonathan_klein@urmc.rochester.edu

PO Box 690

Rochester, New York 14642

 

DIVERSITY INFORMATION

Woman-owned? No

Minority-owned? No

 

EVALUATION-RELATED EXPERTISE

Program evaluation Yes

Statistical Analyses Yes

Collaboratives Yes

Community-based Yes

Participatory evaluation Yes

Longitudinal Yes

Large-scale, multi-site Yes

 

 

TOPICAL AREAS OF EXPERTISE

Adolescent health services

Prevention of adolescent pregnancy

Youth assets

New York State Act for Youth Center of Excellence

 

RELATED EDUCATIONAL BACKGROUND OF STAFF

Self: Postdoctoral training

Other Staff: 3 master’s, 2 doctoral, 2 postdoctoral

 

GEOGRAPHIC AREAS SERVED  Local, statewide, and nationally

 

EXPERIENCE

Program Evaluation: Teen pregnancy program and coalition evaluation for the Monroe Council on Teen Pregnancy, Evaluation for the Hartford CT Action Plan for Teen Pregnancy Prevention, Youth Development Outcomes for United Way/Youth Bureau.

Collaboratives: See “Program Evaluation

Statistical Analyses: Various scientific studies.

Community-based Evaluation: See “Program Evaluation”

Organizational Evaluation: See “Program Evaluation;” Evaluation of United Way training for agencies.

Evaluation of Collaboratives: See “Program Evaluation”

Multi-site Evaluation: See “Program Evaluation,” also evaluation of school-based health centers, community and regional health centers, and others.

Participatory Evaluation: See “Program Evaluation.”

Designing Evaluation Tools: Extensive work with questionnaires, administrative and records review forms.  Some content analysis and event logs, too.

Developing Logic Models: Training and technical assistance offered.

Analyzing Evaluation Information (including software, dedicated hardware, etc.): Extensive experience in quantitative and qualitative methods.

Teaching Evaluation Skills: We are committed to developing technical capacity in community-based organizations.

Analyzing Evaluation Information (including software, dedicated hardware, etc.): Extensive experience in quantitative and qualitative methods.

Teaching Evaluation Skills: We are committed to developing technical capacity in community-based organizations.

 

(Listing continues on next page.)

Jonathan Klein, MD, MPH - continued

 

 

HAS EVALUATION EXPERIENCE WITH:

Nonprofits: Yes

Funders: Yes

Government: Yes

Educational Institutions: No

For-profit Businesses: No

Others: Health providers/agencies

 

PROGRAMS/ORGANIZATIONS EVALUATED IN RECENT YEARS

MCTP

Connects

In Control

New York State Department of Health

Preventive Services in Health Centers

RAPPM/E

 

PERCENT OF ORGANIZATION’S TIME SPENT ON EVALUATION WORK:  30%

 

EVALUATION ASSOCIATION MEMBERSHIPS

None

 

PRICING

Daily Rate (including fringes, overhead, etc.): Depends on the project

Discount Available For Nonprofits? Yes       Is Amount of Discount Negotiable? Yes

 

MISSION AND/OR APPROACH TO EVALUATION

Public health

Community empowerment

Technical assistance and capacity development

 

REFERENCES

Nonprofits

Kathy McNamara, National Association of Community Health Centers

Kathy Lewis, United Way

Foster Gesten, MD, New York State Office of Managed Care

 

Funders

Kathy Lewis, United Way

Julia Lear, Robert Wood Johnson Making the Grade Program

 

Others

Karen Reixach, Monroe County Department of Social Services


Metis Associates

 

CONTACT     Richard Pargament                                Phone: 212-425-8833

                        90 Broad Street, 12th Floor                     Fax: 212-480-2176

                        New York, New York, 10004                Email: rpargament@metisassoc.com

Website: www.MetisAssoc.com

 

DIVERSITY INFORMATION

Woman-owned? No

Minority-owned? No

 

EVALUATION-RELATED EXPERTISE

Program evaluation Yes

Statistical Analyses Yes

Collaboratives Yes

Community-based Yes

Participatory evaluation Yes

Longitudinal Yes

Large-scale, multi-site Yes

Other formative evaluation, survey research, policy analysis

 

TOPICAL AREAS OF EXPERTISE

Public education; Housing; School-to-work; Foster care; Community-based planning; Juvenile justice;
Community health; Mental health; Teen sexuality; Job development; Welfare reform

 

RELATED EDUCATIONAL BACKGROUND OF STAFF

Dr. Pargament has obtained all of the following: bachelor’s degree, advanced training, master’s degree, doctorial degree, postdoctoral training

Other staff: 15 bachelor’s defgree, 10 advanced training, 40 master’s degree, 25 doctoral degree

 

GEOGRAPHIC AREAS SERVED  Northeast: New York, Maryland, Massachusetts, Rhode Island.  South East: Georgia, North Carolina, South Carolina, Arkansas.  Midwest:  Ohio, Missouri.  Northwest: Washington, Alaska.  Far West: California.

 

EXPERIENCE

Program Evaluation: 20+ years experience in evaluation design and data collection, data analysis, and report writing.  Adept in both formative and summative evaluation techniques, as well as needs assessments.
Collaboratives:  Metis is highly experienced in evaluating (and facilitating) team-building processes and strategic alliances among stakeholders such as community residents, non-profit organizations, government and businesses.

Statistical Analyses: Metis is skilled in statistical analysis procedures that include multiple regression, multivariate analysis, factor analysis, econometric forecasting, and time series analysis.  Metis specializes in presenting complex and detail analyses in ways that are accessible and useful to our clients.

Community-based Evaluation: Metis uses a community-based research approach that involves member in devising and executing evaluation tools such as resident surveys and neighborhood inventories.  For example, neighborhood inventories use standard observation procedures to systematically record the physical condition of the neighborhood.

Organization Evaluation: Metis is experienced in guiding organizations through the process of clarifying their short- and long-term strategic objectives and helping them evaluate the alignment of all aspects of their operations to produce results that matter most.

Evaluation of Collaborative: Metis is adept at examining the process and outcomes of collaborative using such tools as results-based management frameworks, workload planning and standards developments, and communications assessments.

Multi-Site Evaluation: Metis has 20+ years experience in the development and maintenance of large scale, multi-site, multi-year data sets.

 

(Listing continues on next page.)


Metis Associates - continued

 

 

Participatory Evaluation: Metis’ evaluation work is always highly interactive and closely tailored to the specific needs of the client.  Our work emphasizes client involvement because we prefer to work with clients closely and listen to them carefully, making sure we understand their issues, questions, and strategies.

Designing Evaluation Tools: Surveys, neighborhood inventories, structured interview protocols, class room observation protocols, focus group protocols, environmental scans, needs assessments.

Developing Logic Models: Metis has worked with numerous organizations to identify performance indicators and benchmarks including inputs, outputs, and outcomes measures.  Metis works with clients to conduct a ‘theory of change’ evaluation design and analysis plan for comprehensive initiatives.

Analyzing Evaluation Information:  Metis uses a variety of statistical software applications including SPSS and PSTAT, as well as Microsoft Excel and Access.  Metis also has technical expertise in using desktop geographical information software (GIS) packages such as ArcView and MapInfo.  We ensure the accuracy of evaluation data using highly rigorous quality control systems and data confidentiality procedures.

Teaching Evaluation Skills: Self-evaluation is strongly emphasized in Metis’ work with clients, especially community-based organizations.  Metis works with community members in devising and executing evaluation tools in order to expand the capcity of neighborhood stakeholders to carry out reliable research on their own.  In 1998, Metis developed an evaluation user’s guide and training manual entitled, Pathways for Assessing Strategies for Community Partners.

Others: Policy analysis – Metis helps clients assess the effectiveness of existing policies and regulations for the purpose of using findings to inform decisions about policy changes.

 

HAS EVALUATION EXPERIENCE WITH:

Nonprofits: Yes

Funders: Yes

Government: Yes

Educational Institutions: Yes

For-profit Businesses: Yes
Other: Yes

 

PROGRAMS/ORGANIZATIONS EVALUATED IN RECENT YEARS

New York City Summer School Program
Neighborhood Partners Initiative (funded by the Clark Foundation)

 

PERCENT OF ORGANIZATION’S TIME SPENT ON EVALUATION WORK:  50%

 

EVALUATION ASSOCIATION MEMBERSHIPS

American Evaluation Association

American Educational Researchers Association
Association for Public Policy Analysis and Management
National Community Building Network

 

PRICING

Daily Rate (including fringes, overhead, etc.): By staff level
Managing Senior Associate: $1,155                     Research Analyst: $406
Senior Associate: $868                                       Research Assistant: $266

Senior Research Associate: $693                        Data Entry/Clerk: $168

Research Associate: $525

 

Discount Available For Nonprofits? Reduced rates are offered under certain circumstances.  Metis also accepts work on a fixed-priced basis.

(Listing continues on next page.)


Metis Associates – continued

 

 

MISSION AND/OR APPROACH TO EVALUATION

Metis’ mission is to support public and private organizations in achieving results for the children, adults, families, and communities they serve.  All of our interactions with clients, as well as all of our products and services, are driven by this goal of empowering clients.

 

ORGANIZATIONAL STRUCTURE

Staff:

80 in-house, 15+ years of evaluation experience (on average)

 

Current Caseload:

52 clients being served

 

REFERENCES

Nonprofits

Youth Futures Authority, Otis Johnson, 912-356-2208

 

Funders

Edna McConnell Clark Foundation, Susan Notkin, 212-551-9100

Annie E. Casey Foundation, Tony Cipollone, 410-547-6600

 

Others

United Federation of Teachers, Randy Weingarten, 212-598-9215

Wake County Health Department, Gibby Harris, 919-250-4516

 

 


THE OMG CENTER FOR COLLABORATIVE LEARNING

 

CONTACT     Kennard T. Wing/Tom Burns                 Phone: 215-732-2200

                        1528 Walnut Street, Suite 805                 Fax: 215-732-8123

Philadelphia, Pennsylvania 19102            Email: Ken@omgcenter.org

Website: www.omgcenter.org

 

DIVERSITY INFORMATION

Woman-owned? No

Minority-owned? No

 

EVALUATION-RELATED EXPERTISE

Program evaluation Yes

Statistical Analyses Yes

Collaboratives Yes

Community-based Yes

Participatory evaluation Yes

Longitudinal Yes

Large-scale, multi-site Yes

Other Formative Evaluation, Foundation-focused Evaluation

 

TOPICAL AREAS OF EXPERTISE

Community Development

Arts and Culture

Children, Youth and Families

Human Services

Capacity Building/Organizational Issues

 

RELATED EDUCATIONAL BACKGROUNG OF STAFF

Project Director has bachelors, masters, and doctoral degrees along with advanced training

Other staff has 3 bachelors, 8 masters, and 4 doctoral degrees and all of them have advanced training.

 

GEOGRAPHIC AREAS SERVED  National

 

EXPERIENCE

Program Evaluation: Lots of evaluations.  Ours tend to be for funders, have a significant formative component, be collaborative in process, and provide feedback to funders, grantees, and the field as a whole.

Collaboratives: We have evaluated a number of programs supported by funders collaboratives in addition to the evaluation experience under “Evaluation of Collaboratives” below.

Statistical Analyses: Extensive experience with a wide range of methods including hypothesis testing, regression, analysis of variance, G.I.S., and network analysis.  Also other quantitative analysis such as cross-tabulation, descriptive statistics and financial analysis.

Community-based Evaluation: Place-based work is a significant component of our evaluation work, and we seek to involve the community in our evaluation through interviews and focus groups, and sometimes by training and employing them in the evaluation.

Organizational Evaluation: We are experienced in organization assessment as a lead-in to capacity-building and as a baseline in program evaluation where capacity-building is a program goal.

Evaluation Collaboratives: We have evaluated a number of operating support collaboratives in the community development field, as well as learning communities that were part of other program evaluations.

Multi-site Evaluation: We have evaluated a number of national projects, such as the Annie E. Casey Foundation’s Rebuilding Communities Initiation, and the Fannie Mae Sustained Excellence Awards Among Others.  These two were 5 and 10 sites nationwide, respectively.

Participatory Evaluation: This is basic to our philosophy.  We understand that the evaluation will not lead to anything unless the decision-makers learn, and that requires collaboration…hence our name.

 

 

(Listing continues on next page.)


THE OMG CENTER FOR COLLABORATIVE LEARNING - continued

 

 

Designing Evaluation Tools: Routine Development of interview guides, discussion guides for focus groups and surveys.  Have also developed instruments for measuring program outcomes and web-based surveys.

Developing Logic Models: We have developed our own pathway mapping process to help funders and nonprofits think through and articulate what they hope to achieve, how, and why they think it will work.

Analyzing Evaluation Information: We are fairly aggressive information technology users.  We keep up to date on hardware and software releases, are fully networked and have a highspeed, full time internet connection.  We most often use Excel, SPSS, Arcview, Visio, Access, and Word processing.  Yet our greatest strength is our team approach to the analysis of qualitative data.

Teaching Evaluation Skills: This has been an occasional part of evaluations.   We have also been hired to design and run workshops on the subject.  We also run such workshops for our own human service grantees in the Philadelphia area.

 


PHILLIBER RESEARCH ASSOCIATES

 

CONTACT     William or Susan Philliber                       Phone: 845-626-2126

                        16 Main Street                                      Fax: 845-626-3206

Accord, New York 12404                      Email: sphilliber@compuserve.com (Susan)

or         billpra@compuserve.com (William)

Website: philliberresearch.com

DIVERSITY INFORMATION

Woman-owned? Joint partnership - 1 woman, 1 man

Minority-owned? No

 

EVALUATION-RELATED EXPERTISE

Program evaluation Yes

Statistical Analyses Yes

Collaboratives Yes

Community-based Yes

Participatory evaluation Yes

Longitudinal Yes

Large-scale, multi-site Yes

 

 

TOPICAL AREAS OF EXPERTISE

Teen Pregnancy

Youth Development

Schools

Journalism

Job programs

Cultural Programs

Health

Domestic Violence

Homelessness

After-school programs

 

RELATED EDUCATIONAL BACKGROUND OF STAFF

Senior Partner has a doctoral degree

Other staff has 20 bachelor’s degrees, 5 master’s degrees, and 6 doctoral degrees

 

GEOGRAPHIC AREAS SERVED   Nationally

 

EXPERIENCE

Designing Evaluation Tools: Lots—questionnaires, interviews, focus group scripts, coding schemes.

Developing Logic Models: We develop logic models for all our evaluations.

Analyzing Evaluation Information: It is what we do, we use SPSS and manage large data sets.

Teaching Evaluation Skills to Others: Please call Rochester United Way for an example.

 

HAS EVALUATION EXPERIENCE WITH:

Nonprofits: Yes

Funders: Yes

Government: Yes

Educational Institutions: Yes

For-profit Businesses: Yes

 

PERCENT OF ORGANIZATIONS TIME SPENT ON EVALUATION WORK: 99.9%, rest is teaching evaluation and designing programs

 

EVALUATION ASSOCIATION MEMBERSHIP

American Evaluation Association

 

PRICING

Daily Rate (including fringes, overhead, etc.): Varies

Discount Available for Nonprofits? No

 

(Listing continues on next page.)


PHILLIBER RESEARCH ASSOCIATES - continued

 

 

ORGANIZATIONAL STRUCTURE

Staff: Around 50 in-house staff persons with 2 consultants

Current Case Load: More than 200

 

REFERENCES

Nonprofits

Michael Carrera, NYC Children’s Aid Society

 

Funders

United Way of Memphis

Stuart Foundation

Robin Hood Foundation

Mott Foundation

Knight Foundation

CA Wellness Foundation

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 

 


UNIVERSITY OF PITTSBURGH

 

CONTACT     William E. Bickel                                                           Phone: 412-624-7091

University of Pittsburgh                                                 Fax: 412-624-9149

743 Learning Research and Development Center            Email: Bickel@Pitt.edu

3939 O’Hara Street

Pittsburgh, Pennsylvania 15260

 

DIVERSITY INFORMATION

Woman-owned? No

Minority-owned? No

 

EVALUATION-RELATED EXPERIENCE

Program evaluation Yes

Statistical Analyses No

Collaboratives Yes

Community-based No

Participatory evaluation No

Longitudinal Yes

Large-scale, multi-site No

 

 

TOPICAL AREAS OF EXPERTISE 

Education; Organizational Learning; Organizational Capacity Building via Evaluative Processes

 

RELATED EDUCATIONAL BACKGROUND OF STAFF 

Has doctoral degree with 25 years experience in various evaluative and policy settings

Staff has advanced training and doctoral degree

 

GEOGRAPHIC AREAS SERVED  Varies

 

EXPERIENCE

Designing Evaluation Tools: Comprehensive, multi-method designs, surveys, focus groups, observations, interviews

Developing Logic Models: Considerable in private foundation contexts

Analyzing Evaluation Information: Various

 

HAS EVALUATION EXPERIENCE WITH:

Nonprofits: Yes

Funders: Yes

Government: Yes

Educational Institutions: Yes

For-profit Business: No

 

PERCENT OF ORGANIZATION’S TIME SPENT ON EVALUATION WORK:  30-40%

 

EVALUATION ASSOCIATOIN MEMBERSHIPS 

American Evaluation Association, American Educational Research Association

 

PRICING

Daily Rate (including fringes, overhead, etc.): Various - $400-$500

Discount Available for Nonprofits? No               Is this negotiable? Yes

 

ORGANIZATIONAL STRUCTURE

Staff: Various in-house staff with 4-15 years evaluation experience each

Current Case Load: Various

References

Ricardo Millett, Kellogg Foundation (Funder)

Joseph Dominic, Heinz Endowments (Funder)

ROCHESTER RESEARCH GROUP

 

CONTACT     Jocelyn Goldberg-Schaible, President                  Phone: 585-924-3620

                        PO Box 22954                                                  Fax: 585-924-3715

Rochester, New York 14692                              Email: rrg22954@frontiernet.net

 

DIVERSITY INFORMATION

Woman-owned? Yes

Minority-owned? No

 

EVALUATION-RELATED EXPERTISE

Program evaluation Yes

Statistical Analyses Yes

Collaboratives Yes

Community-based Yes

Participatory evaluation Yes

Longitudinal Yes

Large-scale, multi-site Yes

Other Qualitative and quantitative research and evaluation

 

TOPICAL AREAS OF EXPERTISE

Focused on the methodology rather than on any specific topical area

Interested in youth development, education, health, community services, etc.

 

RELATED EDUCATIONAL BACKGROUND OF STAFF

President: BA-Princeton, MBA-Harvard

Staff: 3 bachelor’s, 3 master’s, 1 postdoctoral

 

GEOGRAPHIC AREAS SERVED  Throughout the United States and Canada

 

EXPERIENCE

Our experience with evaluation emerged from our expertise with the process of using market research as the legwork for strategic and tactical planning.  We have been evaluating programs, organizations, products, and services for over seventeen years, throughout the corporate and not-for-profit communities.  Our expertise with statistical analysis is particularly strong—especially in terms of making complex findings easy to understand.

Designing Evaluation Tools: Interview protocols, survey questionnaires, focus group discussion guides.

Analyzing Evaluation Information (including software, dedicated hardware, etc.): Data analysis has been the backbone of our research and evaluation activities for over 17 years.  We operate 6 computers, have university-based mainframe access, partner with a CATI-enabled telephone bank, and have 3 programmers on staff with over 60 years of data processing and analytical experience between them.  Most of our data analysis is run through the latest version of SPSS-X.

Teaching Evaluation Skills: It is important to us that our clients learn not only to use their findings effectively for implementation, planning, and decision-making, but also that they learn research and evaluation skills as well.  When there is a need or desire for our clients to undertake their own evaluations, we are always supportive of fostering independence by teaching them and coaching them along the way.

 

HAS EVALUATION EXPERIENCE WITH:

Nonprofits: Yes

Funders: Yes

Government: Yes (county and city)

Educational Institutions: Yes

For-profit Businesses: Yes

Others: Media                                                                                                                

 

(Listing continues on next page.)


ROCHESTER RESEARCH GROUP - continued

 

 

PROGRAMS/ORGANIZATIONS EVALUATED IN RECENT YEARS

·         Wilson Commencement Park—evaluation of alumni success

·         United Way—evaluated client needs for various programs serving the Overcoming Disabilities and Strengthening Families impact areas (both involving potential employment of difficult-to-employ populations).  Also evaluated Eldersource from the client and caregiver perspectives.

·         Rochester Grantmakers Forum—assisted with Impact Assessment

·         Blue Cross/Blue Shield—evaluated potential opportunity represented by Medic patient database system

·         Provider Resource Network—evaluated PRN’s first two applications, the Homeless Shelter Bed Registry and Eldersource.  [PRN is collaboratively funded by the City; the Country, and the United Way.]

·         The B. Thomas Golisano Foundation—Have provided research and evaluation services for an Aging & Disabilities study with LIFESPAN and the Al Sigl Center, and the Full Circle Careers in Caring collaboration between Lifetime Assistance, Heritage Christian Home, ARC of Monroe, and Continuing Developmental Services.

·         Rochester Museum & Science Center – provided strategic and tactical insight into program planning and evaluation via the feedback of museum members, the community at large, and k-6 educators across Monroe County.

 

PERCENT OF ORGANIZATION’S TIME SPENT ON EVALUATION WORK:  Currently at 40%, but we see that percentage increasing over time

 

PRICING

Daily Rate (including fringes, overhead, etc.): $800/day in-town, $1,000/day out-of-town

Discount Available For Nonprofits? Yes       Is Amount of Discount Negotiable? Yes

 

MISSION AND/OR APPROACH TO EVALUATION

Using market research and evaluation as the legwork for the strategic and tactical planning process

 

ORGANIZATIONAL STRUCTURE

We have a team of 12 very capable people with various skills related to research and evaluation, whom we assemble on an as-needed basis given the requirements of each project.  They are located throughout the US (e.g. Florida, Tennessee, and Massachusetts).  Rochester is the management nucleus of all our activities, even when projects are undertaken elsewhere.

 

REFERENCES

Nonprofit

Jean Howard, Wilson Commencement Park

James Branciforte, Lifetime Assistance, Inc.

Fran Weisberg, LIFESPAN

Kate Bennett, Rochester Museum & Science Center

 

Funders

Carol Gravetter, United Way of Greater Rochester

Ann Costello, B. Thomas Golisano Foundation

Mel Walczek, Monroe County

 

Other

Jane Ellen Bleeg, Jane Ellen: Strategic Results
TISCHLER AND ASSOCIATES

 

CONTACT     Camille Tischler, Evaluator                     Phone: 607-273-2955

                        110 Taylor Place                                   Fax: 607-256-7144

Ithaca, New York 14850                        Email: cmt2@cornell.edu

 

DIVERSITY INFORMATION

Woman-owned? Yes

Minority-owned? No

 

EVALUATION-RELATED EXPERTISE

Program evaluation Yes

Statistical Analyses Yes

Collaboratives Yes

Community-based Yes

Participatory evaluation Yes

Longitudinal No

Large-scale, multi-site No

Other Utilization-focused evaluation, theory-based evaluation

 

TOPICAL AREAS OF EXPERTISE

Organizational development

Conflict resolution

Health

Human services

Nonprofit organizations

Small business

 

RELATED EDUCATIONAL BACKGROUND

Doctoral candidate

 

GEOGRAPHIC AREAS SERVED  East Coast

 

EXPERIENCE

Designing Evaluation Tools: Have designed surveys, measurement tools, interview guides, case study guides, etc.

Developing Logic Models: Used logic models in several recent projects (see “Programs/Organizations Evaluated in Recent Years”).

Analyzing Evaluation Information (including software, dedicated hardware, etc.): Uses SPSS for quantitative data analysis.  Finds software for qualitative analysis (NUDIST, etc.) unsatisfactory for the evaluation work done previously.  Finds that a finer grain analysis than is possible with computer software is needed when the focus is on meaning.

Teaching Evaluation Skills: Has experience teaching individuals and groups to do problem-solving, mediation, how to establish self-directed work teams, etc.  Doesn’t have specific experience teaching evaluation skills.

 

HAS EVALUATION EXPERIENCE WITH:

Nonprofits: Yes

Funders: Yes

Government: No

Educational Institutions: Yes

For-profit Businesses: Yes

 

 

 

 

 

 

(Listing continues on next page.)

TISCHLER AND ASSOCIATES – continued

 

 

PROGRAMS/ORGANIZATIONS EVALUATED IN RECENT YEARS

·         Henry A. Wallace Institute Agricultural Policy Project:  This Kellogg-funded five-year project involves building local capacity and creating dialogue between local agricultural representatives and national policy specialists to develop national policies that are responsive to local agricultural needs.

·         Parenting Skills Workshop Series of Tompkins County Cornell Cooperative Extension: Teaches behavioral strategies to parents at all levels of literacy.

·         Southern Tier Regional Medicaid Special Needs Managed Care Project: Evaluation of four county team process culminating in lessons-learned handbook for the Robert Wood Johnson Foundation.

·         American Educational Research Association Grant Program: Evaluation of progress made on AERA Grant Program’s goals, that is, to promote high quality quantitative educational research.  With Jennifer Greene and Leslie Goodyear.

·         Ithaca Arts Project: Evaluation of the NYS Education Department arts initiative as implemented in the Ithaca City School District.  With Jennifer Greene.

·         North Carolina Natural Resources Leadership Institute, North Carolina State University: Evaluation of the first five years of a multi-state leadership program emphasizing alternative dispute resolution processes as a major strategy for resolving natural resource issues.  One of three principals with Alan Hahn and Jennifer Greene.

 

PERCENT OF ORGANIZATION’S TIME SPENT ON EVALUATION WORK:  70%

 

EVALUATION ASSOCIATION MEMBERSHIPS

American Evaluation Association

 

PRICING

Daily Rate (including fringes, overhead, etc.): $400/day

Discount Available For Nonprofits? Yes       Is Amount of Discount Negotiable? Yes

 

REFERENCES

Nonprofits

Wendy Aquadro, Tompkins County/Cornell Cooperative Extension, 615 Willow Avenue, Ithaca, NY 14850, 607-272-2292

Rosaire Karij, Planned Parenthood of Tompkins County, 314 W. State Street, Ithaca, NY 14850, 607-273-1513 x123

 

Others

Michael Levi, Ph.D., Professor Emeritus, North Carolina State University, 919-851-3933

Jennifer Greene, Ph.D., Cornell University, Department of Policy Analysis and Management, Ithaca, NY 14850, 607-255-2506, jcg8@cornell.edu


TRAINING SYSTEMS INSTITUTE – SYRACUSE UNIVERSITY

 

CONTACT     Philip Doughty, Director             Phone: 315-443-3703

                        330 Huntington Hall                               Fax: 315-443-9218

Syracuse, New York 13244                   Email: pldought@sued.syr.edu

Website: www.idde.syr.edu

 

DIVERSITY INFORMATION

Woman-owned? No

Minority-owned? No

 

EVALUATION-RELATED EXPERTISE

Program evaluation Yes

Statistical Analyses Yes

Collaboratives Yes

Community-based No

Participatory evaluation No

Longitudinal Yes

Large-scale, multi-site Yes

Other Economic analysis of training and larger performance technology interventions

 

TOPICAL AREAS OF EXPERTISE

Educational Technology

 

RELATED EDUCATIONAL BACKGROUND OF STAFF

A mix of faculty, doctoral and master’s students, and professional staff.

Staff: 3 master’s, 7 doctoral

 

GEOGRAPHIC AREAS SERVED  New York State, national government agencies, corporations, school districts, international organizations and agencies.

 

EXPERIENCE

Designing Evaluation Tools: Survey instruments, qualitative interview protocols, cost-effectiveness analysis protocols

Analyzing Evaluation Information (including software, dedicated hardware, etc.): SPSS, multiple programming and data coding methods and analysis tools, access to many support components

Teaching Evaluation Skills: Multiple graduate courses within academic program devoted to evaluation design, methods, and planning.  Multiple workshops, seminars, and presentations devoted to general and specific evaluation tools and applications.

 

HAS EVALUATION EXPERIENCE WITH:

Nonprofits: Yes

Funders: Yes

Government: Local, state, USA, international

Educational Institutions: Yes

For-profit Businesses: Yes

Others: Military

 

PERCENT OF ORGANIZATION’S TIME SPENT ON EVALUATION WORK:  50%, includes front-end analysis

 

EVALUATION ASSOCIATION MEMBERSHIP

American Evaluation Association

American Educational Research Association

 

 

 

 

(Listing continues on next page.)
TRAINING SYSTEMS INSTITUTE – SYRACUSE UNIVERSITY - continued

 

PRICING

Daily Rate (including fringes, overhead, etc.): Varies widely depending upon personnel devoted to a particular project.

Discount Available for Nonprofits? Yes         Is Amount of Discount Negotiable? Yes

 

MISSION AND/OR APPROACH TO EVALUATION

Flexible, responsive, complex when required and desired simple when appropriate.  A heavy emphasis on client involvement in planning, implementation, and reporting

 

ORGANIZATOINAL STRUCTURE

Staff: 7 in-house, consultants vary considerably, including alumni worldwide. Over 15 years experience for all primary project leaders.

Current Case Load: 3 major projects.

 

REFERENCES

Nonprofits

Janice Liddell, CONTACT

 

Funders

Angel Broadnax, US Bureau of the Census

 

Others

Oswego School System


Evaluation RESOURCES

 

 

General Evaluation Books

The following provide good introductions to, and practical guides on, evaluation (books with an “*” are strongly recommended).

 

Assessment and Program Evaluation, An ASHE Reader, Joan S Stark and Alice M. Thomas (Simon & Schuster Custom Publishing, 1995)

 

Community Impact Evaluation, by Nathaniel Lichfield (University College, London Press—UCL Press, 1996)

 

Dissemination Utilization Strategies for Foundations: Adding Value to Grantmaking, Thomas Backer, (Free: Communications Department of the Ewing Marion Kauffman, 4900 Oak, Kansas City, MO 64112-2776)

 

Empowerment Evaluation: Knowledge and Tools for Self-assessment and Accountability, D.M. Fetterman, S. Kaftarian, and A. Wandersman (Sage Publications, 1996)

 

Evaluating Initiatives to Integrate Human Services, Jules M Marquart, Ellen L. Konrad,eds. (Jossey-Bass, Spring 1996)

 

Evaluation, 2nd edition, Carol H. Weiss (Prentice Hall, 1997)

 

Evaluation: A Systematic Approach, 5th edition, Peter Rossi and Howard Freeman (Sage Publications, 1993) (A textbook)

 

Evaluation for the 21st Century: A Handbook, Eleanor Chelimsky and William R. Shadish (Sage Publications, 1997) (A reader)

 

Evaluation Strategies for Communicating and Learning: Enhancing Learning in Organizations, by R. Torres, H. Preskill, and M. Piontek (Sage Publications, 1996)

 

Evaluation With Power: A New Approach to Organizational Effectiveness, Empowerment, and Excellence Gray, Sandra Trice and Associates (Jossey-Bass Publishers, 1997)

 

Evaluator’s Handbook, Joan L. Herman, L.L. Morris, and Carol Taylor Fitz-Gibbon (Sage Publications, 1987) (Very basic)

 

*Handbook of Practical Program Evaluation, Joseph S. Wholey, Harry P. Hatry, and Kathryn E. Newcomer, Editors (Jossey-Bass, 1994) (A reader)

 

Hard-Won Lessons in Program Evaluation. New Directions for Program Evaluation, Michael Scriven (Jossey-Bass, 1993)

 

Healthy People 2000: Midcourse Review and 1995 Revisions, Public Health Service, U.S. Department of Health and Human Services, 1995.

 

Impact Analysis for Program Evaluation,Lawrence Mohr (Sage Publications, 1992)

 

Measuring Program Outcomes: A Practical Approach (United Way of America)

 

Professional Evaluation, E.R. House (Sage Publications, 1993)

 

*Program Evaluation: Alternative Approaches and Practical Guidelines, B.R. Worthen, J.R. Sanders, and J. Fitzpatrick (Addison, Wesley, Longman, 1997) (A textbook)

 

*Program Evaluation: Methods and Case Studies, 5th edition, Emil J. Posavac and Raymond G. Carey (Prentice Hall Humanities/Social Sciences, 1997)

 

The Program Evaluation Standards: How to Assess Evaluations of Educational Programs, 2nd edition, J.R. Sanders (Sage Publications, 1994)

 

Qualitative Evaluation and Research Methods, 2nd edition, Michael Quinn Patton (Sage Publications, 1990)

 

Realistic Evaluation, Ray Pawson and Nick Tilley (Sage Publications, 1997)

 

Thinking About Program Evaluation, R.A. Berk and D.H. Rossi (Sage Publications, 1990)

 

*Utilization-Focused Evaluation: The New Century Text, Michael Quinn Patton (Sage Publications, 1997)

 

W.K. Kellogg Foundation Evaluation Handbook, W.K. Kellogg Foundation (W.K. Kellogg Foundation, P.O. Box 550, Battle Creek, MI 49016, ask for item number 1203).

 

Workbook for Evaluation, Howard E Freeman, Peter H. Rossi and Gary D. Sandefur. (Sage Publications, 1993)

 

 

Evaluation WebSites

The Internet is a great place to get information about evaluation.  The following sites on the Internet offer a range of information and resources for evaluation.  Many have links to other evaluation-related sites.

 

General Sites

 

http://www.eval.org/

The homepage of the American Evaluation Association, an international professional association of evaluators devoted to the application and exploration of program evaluation, personnel evaluation, technology, and many other forms of evaluation.

 

http://www.evaluationcanada.ca/

The homepage of the Canadian Evaluation Association which is dedicated to the advancement of evaluation for its members and the public.

 

http://www.wmich.edu/evalctr/

The Evaluation Center, located at Western Michigan University, is a research and development unit that provides national and international leadership for advancing the theory and practice of evaluation, as applied to education and human services.

 

http://www.unitedway.org/outcomes/

The United Way’s Resource Network on Outcome Measurement: A guide to resources for measuring outcomes for health, human service, youth- and family-serving agencies.  Order their manual, Measuring Program Outcomes: A Practical Approach, here.

 

 

http://www-leland.stanford.edu/~davidf/empowermentevaluation.html

The American Evaluation Association has a Collaborative, Participatory, and Empowerment Evaluation topical interest group that is dedicated to the exploration and refinement of collaborative, participatory, and empowerment approaches to evaluation.

 

http://www.innonet.org/

Innovation Network, Inc., (InnoNet) is an organization dedicated to helping small- to medium-sized nonprofit organizations successfully meet their missions.  The purpose of their site is to provide the tools, instruction, and guidance framework to create detailed program plans, evaluation plans, and fundraising plans.

 

http://hogg1.lac.utexas.edu/Gen/

The Grantmakers Evaluation Network (GEN) is an affinity group of the Council on Foundations.  The purpose of GEN is to promote the development and growth of evaluation in philanthropy.  GEN will seek to leverage, expand, and diversify the sources of philanthropic dollars for evaluation and to build the capacity of members and others in its pursuit.

 

http://www.socio.com

This is Sociometrics’ homepage.  Click on “Program Evaluation” for evaluation resources available from Sociometrics.

 

http://home.wmis.net/~russon/icce/

The International & Cross-Cultural Evaluation Topical Interest Group (I&CCE) is an organization that is affiliated with the American Evaluation Association.  The purpose of the I&CCE is to provide evaluation professionals who are interested in cross-cultural issues with an opportunity to share their experiences with each other.

 

 

Education

 

http://www.ericae.net

The Educational Resources Information Center (ERIC) Clearinghouse on Assessment and Evaluation is a project of the National Library of Education, US Department of Education directed by the Department of Measurement, Statistics, and Evaluation at the University of Maryland in College Park. A site listing many education-related links for assessment and evaluation.

 

Mental Health

 

http://www.vanderbilt.edu/VIPPS/CMHP/

The Center for Mental Health Policy is housed in the Vanderbilt Institute for Public Policy Studies of Vanderbilt University, and focuses on child, adolescent, and family mental health services research.  Their page has links to other mental health related sites.

 

HIV/AIDS

 

http://www.tmg-web.com/edc.htm

The Measurement Group, in collaboration with PROTOTYPES, has been funded by the Health Resources and Services Administration to provide help on evaluation and dissemination activities to 27 national demonstration programs on HIV/AIDS treatment services.  This Evaluation and Dissemination Center is a part of HRSA’s activities to develop innovative models for treating HIV/AIDS.

 

 

 

Rochester Grantmakers Forum
919 Winton Road South, Rochester, NY 14618
ph. 585/232-2380,  fax. 585/232-8413, email. rgf@frontiernet.net
Copyright © 2000 by Rochester Grantmakers Forum. All rights reserved. Policies & Disclaimers.
Revised: 02 Mar 2004 14:02:38