ON-LINE - Evaluation Strategy

Online Information on Employment and Training Opportunities for Disabled People

Project Reference Group Meetings

Evaluation Strategy - Proposal

from the Minutes of the Meeting Tuesday 22th September 1998
St Thomas’s Centre, Ardwick Green North, Manchester

The evaluation of the project will focus on process, activities and results; and, particularly, on the impact on the target groups for each of the activities.

A. Key issues for consideration within evaluation

(Developed after consideration of proposals for evaluation in Project Application Form and responses to initial questionnaires completed by partners.)

1. Implementation of plans, and achievement of results in relation to:

Information Service
- Needs of, and problems faced by disabled people in accessing information on education, training, employment and related subjects (particularly through electronic systems)
- Action to meet these needs and overcome problems within the context of the implementation and development of the On-Line information service
- Results of access to service by disabled people, information specialists and support workers (including difficulties encountered, further action taken, and comparisons with other forms of information provision)
Training of 15 information specialists/support workers (including, as a high priority, disabled people) to use Information Service – effectiveness of training; skills developed and information, acquired or developed; and subsequent use of what they have learnt
Training and support for 100 disabled people so that they can meet their information needs by directly accessing the Information Service. This will include training on using the Internet; and will be provided by the information specialists/support workers who receive the training mentioned immediately above. Support will be provided by Toucan as agreed with each of the organisations involved; and, could include, for example, assistance to develop tutoring skills; and advice on the organisational requirements for enabling people to have direct access to information via computers, or, on equipment which is suitably accessible
Products and Information dissemination - information and training packages and other documents (including the ‘local Web Accessibility Guide’, methods used, and results – including responses from recipients/users

2. Management of the project including the effectiveness of the arrangements for developing a ‘voluntary’ partnership of a wide range of different organisations, and for sharing information and experiences within and outside the partnership. And, the lessons to be learnt for designing and implementing achievable projects – particularly those concerning disabled people, and/or which involve community links.

3. Level of involvement and contribution made by disabled people (with particular reference to women and people from ethnic minorities) in all aspects of the project – for example:

Management
Design and delivery of training
Dissemination of results, and of preparation of material etc for dissemination

4. Impact of the TAD transnational project on the national project or other activities of TOUCAN or any of its ‘On-Line partners’

5. The extent to which the project meets the needs and expectations of TOUCAN and its On-Line partners in relation to:

The continuation and development of services and provision developed within the project (including the Information Service) beyond the life-span of the project
Other related future initiatives – joint or separate.
Application by general information providers in the NW of the approach developed within the project to improving access to information for disabled people.
Acceptance of the principles on which the project is based within future SRB and ESF funding in the NW.

B. Action proposed to be taken

1. Meeting Expectations of Project Partners

Analyse responses from partners to initial questionnaire seeking information about expectations from project
Preparation of note on the implications for the project and the evaluation
Follow-up later as part of preparation of the Interim and Final Evaluation Reports - see 5 below

2. Management of project and results

Develop instruments and/or plans for interviews to gather views and information on the various structures introduced for management and implementation of the project (including Project Reference Group, and User Group), and the opportunities and arrangements for sharing information and experiences. Provide feedback to Project Manager.
Receive information produced from the monitoring system installed by the Project Manager; assess and provide feedback to the Project Manager.

3. Effectiveness of project and ‘User’ satisfaction

Develop instruments and/or plans for interviews to assess the views of participants etc, on needs (subject to the results of the ‘Technology and Application survey’) and expectations in relation to:
(a) Information Service
(b) Training for information specialists/support workers
(c) Dissemination of information
Particular emphasis will be put on identifying the further action taken as a result of participation in the various aspects of the project, and the involvement of, and benefits for disabled people. Material for examples and case studies for inclusion in the final report will also be collected.
Analyse responses, and provide feedback to the Project Manager

4. TAD transnational partnership

Gather information and views from TOUCAN and transnational partners to establish their expectations of - the input to TAD from the On-Line Project, and the impact of TAD on On-Line; and to assess whether those expectations have been met.
Analyse responses, and provide feedback to the Project Manager.

5. Interim and Final Evaluation Reports

Prepare Interim and Final Evaluation reports for 4.12.98 and 3.12.99 respectively, for consideration by the Project Reference Group, and eventual submission to ECOTEC. These reports will cover all of the subject areas mentioned above.

6. Attendance at meetings

Attend Project Reference Group and other meetings in order to pursue any of the above – subject to prior agreement with the Project Manager and availability of funds.

John Clark
9.9.98

Back to the Minutes of the Meeting Tuesday 22th September 1998