The Manufacturing Advisory Service (MAS) - Impact Analysis Methodology Study

This document describes an evaluation of the Manufacturing Advisory Service (MAS) program, which supports UK small and medium-sized manufacturing enterprises (SMEs) to enhance their economic performance. The evaluation aimed to measure the program's impact on Gross Value Added (GVA) and employment growth using quasi-experimental data-matching methods, including difference-in-difference analysis. The findings suggest that businesses receiving MAS support experienced a significant increase in GVA, with larger grants and repeated interventions correlating with greater economic benefits. However, the study faced methodological challenges such as potential self-selection and advisor-selection biases, and peer reviewers highlighted concerns regarding the validity of the results and data limitations. Recommendations for future evaluations include methodological improvements, annual analysis repetition, and the consideration of randomized controlled trials to address biases. The evaluation also underscores the need for a more robust theory of change and better data sharing practices. Despite the positive impact indicated, the evaluation suggests delaying a full economic evaluation until the long-term benefits can be assessed and calls for further research to improve the understanding of the program's cost-effectiveness. **This summary was written by an AI model and therefore should not be considered a definitive summary of the report. If you are aware of inaccuracies, please email evaluation.registry@cabinetoffice.gov.uk.**

Description

• Lead department: Department for Business, Energy & Industrial Strategy
• Evaluation stage: A complete evaluation report
• Other departments: No other departments listed
• Evaluation types: Value for money evaluation; Impact evaluation
• Impact methods: Quasi-experimental method
• Quasi-experimental methods: Difference-in-difference
• Value for money methods: Other
• Grant information: This intervention is not distributing funding via a grant
• Government Major Project information: This intervention is not a major project
• Policies: No policies provided

Event Dates

• Event Name: Publication of final results
• Event date: February 2016

Evaluation Costs

• Cost: Not provided

Evaluation sharing

• Link(s) to published report(s): Yes
• Links to evaluation plans: No link provided
• Links to published evaluations (DEBUGGING): No final report link found.
• Findings: Not provided
• Permission to share confirmed: Yes