SIG Common European Framework (CEFR SIG)
7th CEFR SIG Meeting
Thursday, 24 May, 2018, 14.00 – 17.30h
14:00 Welcome by the SIG coordinator, Neus Figueras
14.15 – 15.15 (15 minute presentations followed by 5 minute questions and discussion)
Voula KANISTRA (Trinity College London/Bremen University).
Exploring the feasibility of using the Item Descriptor Matching (IDM) method to set cut scores on a B2 CEFR level examination.
This paper presents a method to overcome the main challenge associated with setting cut-scores on a B2 CEFR level Reading test, when using the Item Descriptor Matching (IDM) method. Rasch was used to evaluate panellist consistency and item difficulty. The cut-score was calculated through logistic regression. The accuracy and consistency of cut-scores were evaluated and will be reported.
Vincent FOLNY (CIEP)
Concurrent validation CEFR scale (for productive skills)
In 2014, CIEP has developed a study to link the Test de Connaissance du français (TCF) scores to the Canadian Language Benchmarks. This study has been a unique occasion to implement a concurrent validation scale study between CEFR scales and French Canadian Language Benchmarks version (NCLC). Quantitative analysis (Facets analysis, rankings reliability) have been done as well as qualitative analysis of CEFR and NCLC descriptors. Interpretation of results should help to understand better how CEFR is used and its efficiency for identifying levels compare with other scales.
Marita Härmälä ( Finnish Education Evaluation Centre) and Eli MOE (University of Bergen)
Developing language awareness in subject classes.
This presentation reports on an ongoing 4-year ECML project centered on the language of schooling. It builds on the results of the Language Descriptors 2012-2015 project where subject specific CEFR descriptors were developed for young L2 learners in history and mathematics. The aim of the current project is to develop samples of teaching materials including both content and language goals.
15:15 – 15:45 Coffee break
15:45 – 16:25 (15 minute presentations + 5 minute questions and discussion)
Cristina RODRIGUEZ (EOI Santiago de Compostela).
Incorporating mediation descriptors in a C1 speaking test.
Recent Spanish legislation will require EOIs (official public language schools for adults) to include mediation as a part of curriculums and large-stakes language assessments. Current C1 speaking rating scales and tasks were analysed to identify what elements of mediation were already present and determine the changes that need to be made in order to operationalise the new CV mediation descriptors.
Irina PAVLOVSKAYA (University of St. Petersburg) and Olga LANKINA (University of St. Petersburg).
Assessment of Oral Mediation: Holistic and Analytical Marks .
This presentation focuses on the relationship of oral performance criteria such as interaction, discourse management, range, accuracy, and mediation of texts / concepts. It is based on the assessment of students’ group discussions in university CLIL classes (49 performances). There is evidence that holistic marks for mediation correlate with analytical marks. The research is at its early stage.
16:25 – 17:15 Summary Discussion of recent events on the CEFR Companion Volume:
6th CEFR January SIG in Dublin and Council of Europe May Launching Conference in Strasbourg.
17:15 – 17:30 Closing discussion