The issue of didactical suitability in mathematics educational videos: experience of analysis with prospective primary school teachers
←
→
Page content transcription
If your browser does not render page correctly, please read the page content below
The issue of didactical suitability in mathematics educational videos: experience of analysis with prospective primary school teachers La cuestión de la idoneidad de los vídeos educativos de matemáticas: una experiencia de análisis con futuros maestros de educación primaria María BURGOS, PhD. Associate Lecturer. Universidad de Granada (mariaburgos@ugr.es). Pablo BELTRÁN-PELLICER, PhD. Associate Lecturer. Universidad de Zaragoza (pbeltran@unizar.es). Juan D. GODINO, PhD. Professor. Universidad de Granada (jgodino@ugr.es). Abstract: educational intervention with 93 prospective The number of educational videos availa- primary school teachers, focussed on develo- ble on the internet on the most varied topics ping their ability to analyse the educational is rapidly increasing. These include mathe- suitability of videos about proportionality. year 78, n. 275, January-April 2020, 27-49 matics videos that cover virtually any type of Preliminary analysis of the video revealed curriculum content. However, their quality as significant errors and inaccuracies in the de- a learning resource varies greatly. As a result, finitions, propositions, and procedures, as well it is necessary to provide teachers with tools as shortcomings and inaccuracies in the argu- revista española de pedagogía to enable them to analyse the appropriateness ments, and so its level of epistemic suitability of using educational videos, considering the is rated as medium. However, the majority of various aspects involved. This paper describes the prospective teachers rated its degree of the design, implementation and results of an suitability as high in almost all components. This work was carried out in the framework of the EDU2016-74848-P (Spanish state research agency, ERDF) research project and FQM-126 (Regional Government of Andalucia) and S36_17D (Regional Government of Aragón and European Social Fund) groups, Spain. Revision accepted: 2019-11-25. This is the English version of an article originally printed in Spanish in issue 275 of the revista española de pedagogía. For this reason, the abbreviation EV has been added to the page numbers. Please, cite this article as follows: Burgos, M., Beltrán-Pellicer, P., & Godino, J. D. (2020). La cuestión de la idoneidad de los vídeos educativos de matemáticas: una experiencia de análisis con futuros maestros de educación primaria | The issue of didactical suitability in mathematics educational videos: experience of analysis with prospective primary school teachers. Revista Española de Pedagogía, 78 (275), 27-49. doi: https://doi.org/10.22550/REP78-1-2020-07 https://revistadepedagogia.org/ ISSN: 0034-9461 (Print), 2174-0909 (Online) 27 EV
María BURGOS, Pablo BELTRÁN-PELLICER and Juan D. GODINO Students regard studying didactic suitability mentación y resultados de una acción forma- and implementing it through components and tiva con 93 futuros maestros de educación indicators as positive, believing that this acti- primaria, orientada al desarrollo de la com- vity facilitates professional reflection. Howe- petencia de análisis de la idoneidad didáctica ver, mastering this tool requires analysing a de vídeos sobre proporcionalidad. El análisis greater number and variety of videos and fur- a priori del vídeo reveló errores e impreci- ther collective discussion of the results of the siones significativas en las definiciones, pro- analyses performed by the students. posiciones y procedimientos, así como caren- cias o inexactitudes en los argumentos, por Keywords: teachers’ education, onto-semiotic lo que el nivel de idoneidad epistémica se approach, didactical suitability, educational vi- valora como media. Sin embargo, la mayoría deos, proportionality. de los futuros docentes valoraron su grado de idoneidad como alto en casi todos los com- ponentes. Los estudiantes consideran positi- Resumen: vo el estudio de la idoneidad didáctica y su La cantidad de vídeos educativos dispo- implementación a través de componentes e nibles en Internet sobre los más variados te- indicadores, considerando que esta actividad mas está aumentando a un ritmo acelerado. facilita la reflexión profesional. No obstan- Así, nos encontramos vídeos de matemáticas te, el dominio de esta herramienta requiere que cubren prácticamente cualquier tópico incrementar el número y variedad de vídeos curricular, aunque su calidad como recurso para analizar y mayor discusión colectiva de didáctico es muy desigual. En consecuencia, los resultados de los análisis que realizan los year 78, nº 275, January-April 2020, 27-49 es necesario proporcionar a los profesores estudiantes. herramientas que les permitan analizar la pertinencia del uso de estos vídeos, teniendo Descriptores: formación de profesores, enfo- en cuenta los diversos aspectos implicados. que ontosemiótico, idoneidad didáctica, vídeos revista española de pedagogía En este trabajo se describe el diseño, imple- educativos, proporcionalidad. 1. Introduction as flipped learning (Bergmann & Sams, The use of educational videos from 2012), should be the subject of educatio- YouTube and other platforms has increa- nal research as it is not clear how possi- sed dramatically in recent years, offering ble it is to achieve meaningful learning a promising learning resource for students by watching recorded classes. Indeed, and the general public (Azer, AlGrain, several researchers discuss the role that AlKhelaif, & AlEshaiwi, 2013). the use of YouTube and other social media might play in formal education, These educational resources and the analysing how online resources are or- pedagogical models that use them, such ganised and how they can be inserted 28 EV
The issue of didactical suitability in mathematics educational videos: an analysis experiment... as informal tools in specific educational proportionality that are available on the settings (Borba et al., 2016; Dabbagh & internet. Kitsantas, 2012; Duffy, 2008; Portugal, Arruda, & Passos, 2018; Ramírez, 2010). The work is based around the following It is widely regarded as necessary for sections. Section 2 outlines the theoretical the field of educational studies to inves- framework and specific research problem. tigate the adequacy of online educatio- Section 3 describes the design of the tra- nal resources to ensure that technology ining process implemented. Section 4 in- is in accordance with learning objecti- cludes a preliminary analysis of the video ves (Turney, Robinson, Lee, & Soutar, about proportionality, which is used as 2009). an instrument for evaluating the compe- tences achieved by the future teachers. Research in mathematics teaching Section 5 shows in detail the results of regarding the use of educational videos the experiment, analysing qualitatively emphasises the importance of the tea- and quantitatively the reports drawn up chers themselves evaluating and recom- individually by the future teachers. The mending suitable videos for their pupils final section includes a summary of the re- (Beltrán-Pellicer, Giacomone, & Burgos, search and discussion of its implications, 2018; Ruiz-Reyes, Contreras, Arteaga, & and limitations. Oviedo, 2017; Santos, 2018). This is be- cause some of these videos show forma- lly incorrect procedures, not all of them 2. Theoretical framework and re- search problem year 78, nº 275, January-April 2020, 27-49 indicate the educational level for which they are intended, and the meanings they In the field of research into training raise might not be relevant to what is be- mathematics teachers, different theore- ing covered in class. Accordingly, there tical frameworks are used to categorise revista española de pedagogía is a clear need to design and implement and promote different types of professio- training processes that make it possible nal knowledge and competences (Pino-Fan to promote teachers’ professional growth & Godino, 2015). We consider that the and develop their knowledge and compe- didactic–mathematical knowledge and tences (Chapman, 2014; English, 2008; competences (DMKC) model (Godino, Mason, 2016; Ponte & Chapman, 2016; Giacomone, Batanero, & Font, 2017; Breda, Sadler, 2013). Pino-Fan, & Font, 2017), developed wi- thin the framework of the onto-semiotic In view of this issue, the aim of this approach to mathematical knowledge and research is to design, implement, and instruction (OSA) (Godino, Batanero, & evaluate a training activity for future Font, 2007), provides suitable tools for primary school teachers, focussing on approaching our research problem. This developing knowledge and competences, model emphasises the importance of de- relating to the analysis of the epistemic signing and implementing training resour- suitability of educational videos about ces that promote teachers’ competence in 29 EV
María BURGOS, Pablo BELTRÁN-PELLICER and Juan D. GODINO analysing educational suitability. Didacti- interpret, generalise, and justify the solu- cal suitability is understood as the degree tions. Furthermore, the different partial to which an instructional process combi- meaning of the mathematical objects that nes certain characteristics that mean it appear must be connected and defined can be described as appropriate or adequa- (Godino, Font, Wilhelmi, & Lurduy, 2011). te, the main criterion being the fit between the personal meanings students construct Using didactical suitability enables (learning) and the institutional meanings, teachers to reflect systematically on their whether these are intended or actually im- own practice (Aroza, Godino, & Beltrán- plemented (teaching), taking into account Pellicer, 2016; Beltrán-Pellicer, Godino, & the influence of the environment (Godino, Giacomone, 2018; Posadas & Godino, 2017) 2013). This involves coherently and syste- and it can also be applied to analyse par- matically articulating six criteria relating tial aspects of the instructional processes, to the facets that affect a training process such as the use of technological resources. (Godino et al., 2007): epistemic, ecological, Specifically, Beltrán-Pellicer, Giacomone, cognitive, emotional, interactive, and tho- and Burgos (2018), using the theoretical– se relating to media. methodological tools from OSA, analysed the degree of epistemic suitability of a se- We consider that a mathematics trai- lection of the educational videos viewed ning process is more epistemically suita- most frequently by users of YouTube™, ble the better the institutional meanings relating to problems of proportional sha- implemented (or intended) represent a re- ring. On the one hand, they found a wide year 78, nº 275, January-April 2020, 27-49 ference meaning. The reference meaning variety of focuses and methods for solving will relate to the particular educational this type of problem, which can interfere level and should be drawn up, taking into with the teaching and learning process in account the different types of problems the classroom if the teacher does not pre- revista española de pedagogía and contexts for use of the content taught, viously select or record these videos. On as well as the operational and discursive the other hand, the epistemic suitability practices required (Godino, 2013). Conse- of the sample of videos analysed was very quently, it will be necessary to take into diverse, with videos that contained errors account the degree of adequacy of the si- and inaccuracies as well as many of them tuations–problems and it will also be ne- offering an unrepresentative or poorly de- cessary to consider the variety and ade- fined treatment of the mathematical con- quacy of the representations, definitions, tent. Finally, they noted that the videos procedures, and propositions, as well as with the metrics reflecting the greatest po- the arguments supporting them. High sui- pularity were not the most suitable ones. tability from an epistemic perspective re- This work is the main antecedent of the quires the situations–problems proposed present paper. to involve a variety of representations, to offer students a variety of ways of approa- We consider that it would be desirable ching them, and to require students to for teachers to understand the didactic 30 EV
The issue of didactical suitability in mathematics educational videos: an analysis experiment... suitability of the tool and acquire the neces- Furthermore, before carrying out this sary competence to use it to analyse edu- research, and in line with the chosen cational resources critically, particularly in DMKC model, we carried out training the use of videos available online. workshops with the group of students fo- cussing on developing the competence of Furthermore, various pieces of research analysing global meaning (based on iden- show that teachers, both in their initial tra- tifying situations-problems and the opera- ining and in service, show difficulties with tional, discursive, and normative practices teaching concepts relating to proportionali- involved in solving them), and onto-semio- ty (Bartell, Webel, Bowen, & Dyson, 2013; tic analysis of the practices (description Ben-Chaim, Keret, & Ilany, 2012; Berk, of the framework of objects and processes Taber, Gorowara, & Poetzl, 2009; Hilton & involved in the practices) used in the ma- Hilton, 2018). Teacher training must take thematical activity of solving problems in- into account the development of mathema- volving proportionality. tics teaching knowledge and competences relating to this topic by designing and im- The first session comprised a two-hour plementing specific training interventions. workshop where the characteristics of the This is why the trainee teachers were asked theory of didactical suitability were pre- to analyse a video on proportionality. sented, as well as how the different epis- temic, cognitive, affective, interactional, media related, and ecological dimensions 3. Design of the training process of a given study process relate to each year 78, nº 275, January-April 2020, 27-49 The training experience was carried other. The aim was to involve future pri- out during the 2018-2019 academic year mary school teachers in a reflection on the in the framework of the Curriculum need to have a system of specific indicators Design and Development in Primary that make it possible to evaluate teaching revista española de pedagogía Education module with ninety-third year practice systematically. students from the Primary Education de- gree. In the next session, also lasting two hours, the future teachers worked in During their degree studies, future teams to analyse the epistemic suitabi- teachers receive specific training about lity of online educational videos on pro- epistemic (mathematical content), cogni- portionality. The initial group work ena- tive (mathematics learning, errors, and bled the students to compare, discuss, difficulties), instructional, and curricular and improve their proposals for evalua- aspects, so that when carrying out their ting the epistemic suitability of different school placements, they should be able to educational videos relating to proportio- put into practice the knowledge they have nality. acquired to analyse, design, and support teaching-learning according to specific In the third phase, the students indi- content (in our case, proportionality). vidually completed the tasks described in 31 EV
María BURGOS, Pablo BELTRÁN-PELLICER and Juan D. GODINO the following section as a final evaluation In general, the situations-problems pro- instrument, the results of which are analy- posed in the video are presented in context sed in this work. and the mathematical ideas are connected. Various ways of approaching the problems are proposed, but we consider that the sam- 4. Preliminary analysis of the ple of the problems is not sufficiently repre- epistemic suitability of the video sentative or defined. The solution methods In this section we analyse the epistemic proposed are only applied to problems with suitability of the video, that is, the mathe- a missing value, in which the condition matical knowledge brought into play in it. of regularity is assumed in advance, and This analysis will serve as a benchmark problems involving comparing ratios, for for interpreting the students’ answers example, are not considered. The video fea- when they evaluate the suitability of the tures a great variety of linguistic registers educational video. The researchers perfor- and representations: natural registers (oral med the analysis and preliminary evalua- and written), symbolic (numerical and alge- tion independently. They then compared braic), tabular, and graphic ones. them to decide on a common evaluation. Furthermore, we have identified some The educational video analysed1 covers errors and inaccuracies in the presenta- the topic of direct arithmetic proportio- tion of rules (definitions and propositions) nality from the perspective of presenting and arguments: the notions of ratio and proportion (Ben- year 78, nº 275, January-April 2020, 27-49 Chaim, Keret, & Ilany, 2012). The idea is — Error of expression in the handling of that the future teachers will watch the simplifications of fractions. To simplify, video closely and critically assess its de- the numbers that appear in the nume- gree of suitability, in line with the episte- rator and denominator are crossed out, revista española de pedagogía mic suitability components and indicators leaving as superscript the factors that (Godino et al., 2007; Godino, 2013). remain when canceling terms. Graph 1. Screenshot from minute 7. Image text: Quotient Equality Method. M1: shirts (units) M2: fabric (m2) Source: Clasemáticas, 2012. 32 EV
The issue of didactical suitability in mathematics educational videos: an analysis experiment... — Error in the definition of ratio and pro- relationship that doubling one magni- portion. tude corresponds to doubling the other. (1:00) «Ratio, mathematically spea- (4:30) Next, the narrator tells the stu- king, means quotient. The proportion, the dents the question they should ask after ratio, the quotient between these two mag- finding the magnitudes: «Will twice as nitudes is always the same.» many shirts need twice as much cloth?» Here we see incorrect use of the con- (4:43) «If the answer is yes, and in this cepts of ratio and proportion. A ratio is not video it obviously will be, because if not, always a quotient and a ratio is not the we would be looking at another type of same as a proportion, a confusion found proportionality … then we are looking at a with some frequency in teaching practice. problem of direct proportion.» — The doubling rule does not necessarily This is incorrect. The answer to a ques- denote a relationship of direct propor- tion like the one he asks might be no and tionality. it might be that no other situation of pro- portionality is involved. (3:20) The narrator presents a «trick» to find out whether two magnitudes are — Neither the operations in a proportion directly proportionate: «To find out if two magnitudes are directly proportionate, all nor the reason for using cross multipli- you have to do is check that doubling one cation are explained. is the same as doubling the other, tripling year 78, nº 275, January-April 2020, 27-49 is the same as tripling.» We consider that the degree of suitabi- lity regarding relationships between ob- This is a necessary but not sufficient jects, on a low-medium-high ordinal scale, condition for two magnitudes to be direct- is medium, as not all of the propositions revista española de pedagogía ly proportionate. The proportionality of and procedures have an associated argu- magnitudes is a linear function established ment. Furthermore, the various meanings between the values of the magnitudes. of the objects that appear in the exercises are sometimes but not always identified, — When the relation of direct proportio- and so the degree of suitability is medium nality is justified, this is based on the in this aspect. Graph 2. Screenshot from minute 8:15. General method. Image text: General Method of Proportionality. M1: shirts (units) M2: fabric (m2) Source: Clasemáticas, 2012. 33 EV
María BURGOS, Pablo BELTRÁN-PELLICER and Juan D. GODINO (8:15) «In other words, the quotients term proportion instead of ratio to refer are equal between the magnitudes, within to the fractions that appear on screen. them, or comparing one with the other magnitude, so this quotient is also co- rrect.» The final procedure for solving propor- tionality problems that the author of the In the first method he presents, the video presents is the rule of three: «equal quotients» one, he uses external (11:35) Put the magnitudes in a co- ratios. Here, in what the author calls the lumn; «we put x is to 72 as 4 shirts is to 32.» «general proportionality method», he uses internal ratios, without appropriately ex- plaining the relationship between the two proportions. Furthermore, he uses the Graph 3. Screenshot from minute 11:47. Rule of three method. year 78, nº 275, January-April 2020, 27-49 Image text: Rule of three method. M1: shirts (units) M2: fabric (m2) Source: Clasemáticas, 2012. revista española de pedagogía (11:47) «And this, in reality, if you the diagram (using arrows), accompa- rewind the video, is the general method. nied by cross multiplication, which is The thing is I don’t know why you love pu- not justified in the video. tting arrows on it. The general method has a mathematical explanation and this one doesn’t really.» Based on these analyses, the re- searchers quantitatively evaluated the He relates the rule of three method, video’s degree of epistemic suitability which he solves by cross multiplication, in each of the six components, scoring to the general method. Thus, he is re- each indicator according to whether its ferring to to a «debased rule of three», contribution to the suitability is low, that is to say, he does not present the medium, or high (0, 1, or 2 points, res- proportional equation, which he distin- pectively). The total maximum score guishes as another method. Therefore, will, therefore, be 12. Table 1 shows the what he calls «the rule of three» is, in marks given by the research team. 34 EV
The issue of didactical suitability in mathematics educational videos: an analysis experiment... Table 1. Evaluation of epistemic suitability by components. Component Score given to the video Situations-problems 1 Language 2 Rules 1 Arguments 1 Relationships between objects 1 Articulation of meanings 1 Final score 7 Source: Own elaboration. 5. Results As a result of this session, we saw For the second working session, we that the future teachers overlooked the asked the students firstly to watch errors in definitions, propositions or pro- at home three videos 2 about directly cedures present in the videos and that in proportional distributions which had the idea-sharing in the working group, different degrees of suitability. Indivi- they found it hard to agree on the degree dually, they had to decide on the grea- of suitability of the different videos. Dis- year 78, nº 275, January-April 2020, 27-49 ter or lesser degree of suitability of the cussing the individual positions in many videos as well as their level of use of cases led them to modify their prelimi- algebra, taking into account the type nary analyses, identifying new elements of solution developed. Afterwards, in of analysis that had gone unnoticed. revista española de pedagogía class, they were asked to discuss their evaluations with the work group and In this section, we analyse the answers then prepare a group opinion about the the students gave in the final evaluation degree of suitability of the different task (third working session), which conse- videos. The instructions given to the quently reflect what these students have students for analysing the videos are learnt. We then analyse the answers given the same as the ones proposed in the to the quantitative evaluation instruction final task. That is to say, should con- for each of the six components of suitabi- sider: a) the variety of situations-pro- lity, as well as the overall adequacy of the blems presented; b) the presence of video. different registers of representation; c) the clarity and correctness of the Table 2 shows the frequencies and per- definitions, propositions, and procedu- centages of the answers given regarding res; and d) the argumentation of the the characteristics of the situations-pro- propositions and procedures. blems presented in the video. 35 EV
María BURGOS, Pablo BELTRÁN-PELLICER and Juan D. GODINO Table 2. Variety of situations-problems proposed (n = 93). Characteristics of the situations Frequency (%) A representative and defined sample of problems is presented 83 (89.25) The situations appear in context 83 (89.25) The mathematical ideas are connected 87 (93.55) Various ways of tackling the problems are suggested 89 (95.70) Source: Own elaboration. We can see that the majority of the In relation to the presence of different students adequately recognised that the representations and language registers, situations are presented in context in the students have no difficulty in iden- the educational video being analysed, the tifying the natural register and the sym- ideas are connected, and various ways of bolic register. However, they identify the approaching the problems are provided. tabular and graphic registers to a lesser The majority of them (89.25%) also accep- extent. Other students, to a lesser extent, ted that the videos show a representative identify animation and other different and defined sample of problems. types (Table 3). Table 3. Identification of linguistic representations (n = 93). year 78, nº 275, January-April 2020, 27-49 Type of language Frequency (%) Natural (oral) 92 (98.9) Natural (written) 93 (100.0) revista española de pedagogía Symbolic (numerical) 89 (95.7) Symbolic (algebraic) 83 (89.2) Tabular 74 (79.6) Graphic 28 (30.1) Animation 49 (52.7) Others (iconic, multimedia, diagrammatic, etc.) 10 (10.8) Source: Own elaboration. The majority of the future teachers guments given for the transformations, have difficulties locating the errors or or when the relationship of direct pro- inaccuracies in the definitions, proposi- portionality in the situations presented tions or procedures, as well as in the ar- is justified (Table 4). 36 EV
The issue of didactical suitability in mathematics educational videos: an analysis experiment... Table 4. Clarity and correction of definitions, propositions, procedures, and arguments. Frequency (%) Errors and inaccuracies in the Yes but Explicitly Yes and rules and arguments Not does not states there describes stated specify are none it what Errors in arithmetic-algebraic 63 (67.7) 21 (22.6) 2 (2.2) 7 (7.5) treatment Rules Errors in definitions 51 (54.8) 22 (23.7) 2 (2.2) 18 (19.4) Errors in proposi- 51 (54.8) 21 (22.6) 5 (5.4) 16 (17.2) tions or procedures Error or inaccuracy when justifying a 45 (48.4) 20 (21.5) 6 (6.5) 22 (23.7) relationship of proportionality Arguments Error or inaccuracy when justifying an 54 (58.1) 20 (21.5) 4 (4.3) 15 (16.1) arithmetic-algebraic transformation Other errors or 52 (55.9) 20 (21.5) 2 (2.2) 19 (20.4) year 78, nº 275, January-April 2020, 27-49 inaccuracies Source: Own elaboration. revista española de pedagogía When the future teachers identify For example, E50 said: «Ratio: the vi- errors of arithmetic or algebraic processes, deo defines this as the proportion of the some mention that the author of the video quotient between both magnitudes. This does not explain some of the symbols used, could cause confusion; one alternative including subscripts, or that simplifying would be "link between two magnitudes the results of the operations might confuse that can be compared to each other."» the students. — Inaccuracy in the definition of direct With regards to errors or inaccuracies proportionality. the students recognise in definitions, we find the following categories of answers: — Confusing definitions or ones that are inappropriate for primary school. — Error in the definition of ratio. This is the category with most answers that — As well as these categories, some stu- identify conflicts in the definitions. dents include as errors in the defini- 37 EV
María BURGOS, Pablo BELTRÁN-PELLICER and Juan D. GODINO tions descriptions that are not relevant numerator, it is easier for the student to in relation to procedures or modes of place it in denominator of the left fraction expression. For example, E84 notes (E26).» that: «The names used for the methods for calculating the proportion could Or they feel that the explanations that cause confusion as in different places accompany the procedures are complex or different names might be used for the- insufficient. se methods.» Only one student (E83) refers to the The future teachers show difficulties error in the proposition: «To find out we- assigning errors to the appropriate catego- ther two magnitudes are directly proportio- ries and providing relevant descriptions. nate or not, all you have to do is check that They refer to «confusing explanations» in doubling one is the same as doubling the «Errors relating to definitions». For exam- other, tripling is the same as tripling …» ple, E54 identifies as an error in defini- tions: No student mentions as an inaccura- cy the fact that the argumentation of the In the explanation of the proportionali- relationship of direct proportionality is ty method (in the exercise with the shirts) only based on the proposition that «dou- he isolates «x» as if it were an equation. He should have found the proportion between bling one magnitude corresponds to dou- the shirts and the metres of cloth (how bling the other». Most of the students many times bigger the metres of cloth are who place an error in this category do so year 78, nº 275, January-April 2020, 27-49 than the number of shirts) and then divi- incorrectly, either because they indicate ded the metres of cloth to get «x». «confusing explanation» or «limited ar- gumentations» or because they refer to Then adds regarding «Errors in propo- inaccuracies in the explanation of trans- revista española de pedagogía sitions or procedures»: «In procedures, I formations and not in the relationship of would put the same error as in "Errors in proportionality. definitions"». Only six students make any reference Most of the students who identify con- to the lack of argumentation of the ope- flicts in procedures refer to the rule of rations. For example, E67 states that: three: «He crosses out numbers and iso- «The only problem I can see with this lates «x» in the rule of three confusingly, video is that when simplifying he does writing small numbers next to big ones not explain this process, it is true that might give the impression they are powers the video is not about simplification but (E52)». it could mean students get lost when sol- ving problems.» Other students identify procedural errors: «In the equal quotients method, In relation to other errors, the future putting the unknown quantity «x» in the teachers fundamentally identify: 38 EV
The issue of didactical suitability in mathematics educational videos: an analysis experiment... — Errors or inaccuracies in the expres- ing if there is direct proportionality or not, sion (oral) or language used. it seems imprecise as it only mentions dou- bling. He should mention «halves match», — Unsuitable presentation for primary- «sums match», «differences match», in other words, using all four operations. school pupils. Table 5 shows the frequency of errors — Difficulties understanding the diffe- detected by the future teachers. We dis- rences between the methods for solving tinguish between answers that mention the problem. an error in a somewhat relevant way in the appropriate category and answers — Insufficient arguments for arithmetic that are not relevant because they are transformations. not in the appropriate category, because the description of the error is not con- Regarding the «trick» the author of the clusive or is subjective, or because what video presents, E68 includes the following they include cannot be regarded as an as an error: error or inaccuracy. In general, the per- Trick: «To find out whether two mag- centages of students who recognised nitudes are directly proportional, it is errors and inaccuracies were low. The enough to establish that the double of one highest related to the justification of the of them corresponds to the double of the relationship of proportionality, mentio- other». Although this is a quick way of see- ned by 22 students (23.7%). year 78, nº 275, January-April 2020, 27-49 Table 5. Errors identified by the students. Frequency Irrelevant answer Errors and inaccuracies in the It is an Inconclu- revista española de pedagogía rules and arguments detected by Relevant error but sive or Not Total (%) the future teachers answer not in the subjective an category descrip- error identified tion Arithmetic-algebraic 1 1 1 4 7 (7.5) treatment In rules In definitions 7 3 5 3 18 (19.4) In propositions-proportions 4 3 5 4 16 (17.2) When argumenting the rela- 3 8 4 7 22 (23.7) tionship of proportionality In When argumenting argu- 5 3 3 4 15 (16.1) transformation ments Others 5 2 7 5 19 (20.4) Source: Own elaboration. 39 EV
María BURGOS, Pablo BELTRÁN-PELLICER and Juan D. GODINO Section d) of the instructions asked the teachers believed that the mathematical trainee teachers to identify whether the objects are related in a relevant way and mathematical objects and the meanings that, as such, the degree of suitability of are presented in connection in the video. this aspect is high (Table 6). Furthermore, Apart from two students who did not 63.44% said that the different meanings of answer this section, 73.12% of the future the objects involved are always connected. Table 6. Relationships between objects and meanings. Relationships between mathematical objects Suitability Frequency (%) All of the propositions and procedures have an High 68 (73.1) associated argument Some of the propositions Relationships between and procedures have an Medium 23 (24.7) objects associated argument None of the propositions and procedures have an Low 0 (0.0) associated argument Always High 59 (63.4) The meanings of the objects that appear are Sometimes Medium 30 (32.3) identified and interwoven Never Low 2 (2.2) Source: Own elaboration. year 78, nº 275, January-April 2020, 27-49 According to the results obtained in the jects and meanings), the future teachers preliminary analyses (variety and repre- had to quantitatively evaluate the degree sentativeness of the situations-problems of didactical suitability of the video. They revista española de pedagogía proposed, variety of representation sys- had to assign a score of 0, 1, or 2 depending tems, clarity and correctness of the rules on whether they regarded its suitability as and arguments, connection between ob- low, medium, or high, respectively. Table 7. Frequency (%) of evaluation of epistemic suitability by components. Evaluation of the video Components 0 1 2 Situations–problems 1 (1.1) 40 (43.0) 52 (52.9) Language 3 (3.2) 37 (39.8) 53 (57.0) Rules 3 (3.2) 33 (35.5) 57 (61.3) Arguments 1 (1.1) 42 (45.2) 50 (53.8) Relationships between objects 4 (4.3) 22 (23.7) 67 (72.0) Articulation of meanings 2 (2.2) 37 (39.8) 54 (58.1) Source: Own elaboration. 40 EV
The issue of didactical suitability in mathematics educational videos: an analysis experiment... Table 7 shows that over half of the stu- 9.5 points. The most common score (in dents gave the highest mark for relevance 29% of cases) was 10 points. Furthermo- in each of the epistemic suitability com- re, 9 students (10%) gave the video the ponents. The aspect with the highest va- maximum score. luation is the relationship between objects (72.0% indicated high suitability here) fo- The future teachers were asked to ex- llowed by correctness of rules (61.3%). plain the reasons for their epistemic sui- tability scores. Analysing their answers We can see that the highest score has enabled us to identify the catego- that can be assigned to the video is 12 ries in Tables 8 and 9, where we distin- points. The minimum score assigned was guish arguments for a positive evaluation 4 points (one student) and the mean was and arguments for a negative evaluation. Table 8. Arguments for giving a positive evaluation (n = 93). Indicator Frequency (%) Attractive presentation 8 (8.6) Adequate language 43 (46.2) Varied language 21 (22.6) Variety of examples (representative and articulated 26 (28.0) sample of situations-problems) Everyday situations-context/connection with real life 27 (29.0) Appropriate arguments/clear explanations 38 (40.9) year 78, nº 275, January-April 2020, 27-49 Enough arguments 17 (18.3) Varied and adequate procedures/methods 23 (24.7) Coherent/adequate definitions 19 (20.4) revista española de pedagogía Articulated meanings 17 (18.3) Favours reasoning or that pupils construct, perfect, and use their own representations to organise, record, and 14 (15.1) share ideas Appropriate relationships between objects (propositions 15 (16.1) with associated argument; related methods) No error in rules or arguments 7 (7.5) Source: Own elaboration. The future teachers gave a positive The language used is varied: natural valuation to the language used and to the (oral and written), symbolic (numerical arguments used being appropriate and and algebraic), tabular (using tables), the explanations clear. For example, E14 animation (a child thinking and asking a gave 2 points to the language component, question, a gif with movement in the re- saying: sult of the problem), and with arrows es- tablishing relationships of proportionality. 41 EV
María BURGOS, Pablo BELTRÁN-PELLICER and Juan D. GODINO … Also, the level of language is clear and However, these components are whe- simple suitable for the Primary Education re negative evaluations are most often level it is aimed at. given, referring both to errors in ex- E22 gives the arguments component pression and language and to unclear 2 points: «I did not think there were any or confusing arguments (Table 9). E38 notable errors regarding the arguments said: «Sometimes it uses language that and the procedures used in the video. is a bit technical for a primary-school The arithmetic operations are always child. I think the arguments are good, accompanied by an argument and justi- but they could be a bit clearer in some fication. The arguments and procedures of the 4 methods it explains for direct are clear.» proportionality.» Table 9. Arguments for giving a negative evaluation (n = 93). Indicator Frequency (%) Situations-problems not adequate for primary level 3 (3.2) Errors in expression/language 11 (11.8) Language not suitable for primary level 11 (11.8) Poor representations (little connection, lack of graphic or visual lan- 3 (3.2) guage) Difficulty distinguishing methods 4 (4.3) year 78, nº 275, January-April 2020, 27-49 Excessive arguments 3 (3.2) Unclear, confusing or fast arguments 19 (20.4) Propositions with no connected argument 1 (1.1) revista española de pedagogía Incorrect or insufficient definitions 2 (2.2) Definitions not adequate for primary level 4 (4.3) Procedures not adequate for primary level 3 (3.2) Procedures unclear or fast 4 (4.3) Errors in procedures (simplification in rule of 3) 5 (5.4) Arguments not adequate for primary level 4 (4.3) Unconnected meanings 12 (12.9) Lacks situations of meaning construction or own representations 3 (3.2) The author includes ideas out of context or that might cause confusion 3 (3.2) (for example, inverse/compound proportionality) Situations contextualised poorly or only in a mathematical context 4 (4.3) Source: Own elaboration. 42 EV
The issue of didactical suitability in mathematics educational videos: an analysis experiment... The analysis as a whole should lead fu- students’ responses into «yes», «yes, but ture teachers to decide whether the video …» when they make some kind of objection, seems suitable to them, explaining their and «no». Table 10 includes the frequencies decision. In this case, we have classified the and percentages of each of these options. Table 10. Adequacy of the video in the final reflection (n = 93). In your opinion, is this video adequate? Frequency (%) Yes 48 (51.61) Yes but… 38 (40.86) No 7 (7.53) Source: Own elaboration. Of the future teachers, 51.61% consider adequacy of the argumentation. Table 11 the video to be adequate, and they valued summarise the different explanations the most highly the presence of various ways students used to evaluate how adequate of solving the problems and the degree of the video is. Table 11. Arguments when they believe the video is totally adequate (n = 48). Indicator Frequency (%) year 78, nº 275, January-April 2020, 27-49 Various ways of solving problems 46 (95.8) Variety of examples 22 (45.8) Adequate and detailed explanation 42 (87.5) revista española de pedagogía Simplifies definitions/presents the most relevant and representative 13 (27.1) information Adequate representation/language 26 (54.2) Useful/motivational 7 (14.6) Includes tricks/advice 12 (25.0) Relatable context 10 (10.8) Inspires reflection on most adequate method 6 (12.5) 43 EV
María BURGOS, Pablo BELTRÁN-PELLICER and Juan D. GODINO There are no errors 7 (14.6) Adequate length 2 (4.2) Attractive presentation, informal tone 5 (10.4) Source: Own elaboration. Of the future teachers, 40.86% did not methods used being inadequate for pri- believe that the video was wholly adequa- mary-level, or it potentially being boring te (Table 10). They identify as drawbacks for the pupils. the length, the language, and some of the Table 12. Arguments that indicate drawbacks («yes but …») (n = 38). Indicator Frequency (%) Language not adequate for primary level 11 (28.9) Arithmetic procedures not explained 4 (10.5) Excess length 6 (15.8) year 78, nº 275, January-April 2020, 27-49 Boring or causes pupils to switch off, lacks animations or 19 (50) visual resources Causes confusion among the students 6 (15.8) revista española de pedagogía Lacks variety of contexts 3 (7.9) Incorrect explanations 5 (13.2) Too long and dense for primary school 11 (28.9) Not all situations/concepts/methods are adequate 12 (31.6) for primary level Does not take into account prior knowledge or problems 4 (10.5) with learning Contains errors 7 (18.4) Source: Own elaboration. 44 EV
The issue of didactical suitability in mathematics educational videos: an analysis experiment... Finally, only 7.5% of the students did 6. Summary, implications, and li- not believe the video was adequate. They mitations state that the explanations are not very The aim of this work was to design, accurate or not at all accurate and the ar- implement, and evaluate a training ac- guments are inadequate or confusing for tivity for future primary school teachers primary level. focussed on developing the knowledge and competence to analyse the episte- Analysing students’ answers has ena- mic suitability of educational videos on bled us to detect some conflicts relating proportionality. We started by stating to the identification of components and why the topic is of interest, given the descriptors in the analysis of epistemic abundance and availability of videos suitability, essentially relating to rules that are offered as resources to help and articulation of meanings. For exam- teach mathematics. However, given the ple, E32 identifies rules with ways of sol- inconsistent quality and variety of me- ving a problem and states: «I have given anings in the educational videos (Bel- trán-Pellicer, Giacomone, & Burgos, the rules a mark of 2 because they do dis- 2018), there is a need to train teachers play a wide variety of ways of solving the in how to evaluate these resources and problem.» use them suitably. Similarly, E56 noted that: The training activity focusses on pro- For the rules, I have given a score of 2 viding future teachers with a theory- year 78, nº 275, January-April 2020, 27-49 (high) for suitability because I agree with based tool for analysing epistemic sui- how he does the operations in each case tability, that is to say, the mathemati- where he solves the problems and because cal content presented in a video about I do not think he makes any errors when proportionality. Preliminary analysis revista española de pedagogía doing them. by the researchers of the video revealed errors and inaccuracies in definitions, Some students consider that the me- propositions, and procedures, as well as anings are articulated when various me- shortcomings or inaccuracies in the ex- thods are used or what is being done in the planations used to justify the procedures video is justified. For example, E41 said: «I and propositions. Also, the presentation think that the definition of concepts has a and treatment of a variety of situations- high level, because it uses various methods problems and the articulation of me- to solving the problems.» anings of proportionality have major shortcomings, and so we rated its level E30 added: «Regarding the articula- of epistemic suitability as medium on the tion of meanings, the suitability is high low-medium-high ordinal scale. However, as it constantly explains what each thing the majority of the future teachers, after being done means.» the training process had been applied, ra- 45 EV
María BURGOS, Pablo BELTRÁN-PELLICER and Juan D. GODINO ted the degree of suitability of the video as tent knowledge, in this case regarding pro- high in almost all components. portionality, increasing the training time allocated, analysing a larger variety of edu- The evaluation instrument used, based cational videos, and increasing group dis- on epistemic suitability components cussion of the results of the analysis phase. and indicators, considers the variety of situations-problems posed, the presence This type of training action, focussing of different registers of representation, on the content of the discipline but with the clarity and correctness of the defini- tions, propositions, and procedures, and a clear orientation towards knowledge and the justification for procedures and pro- didactic competences, aligns with works positions using arguments that are rele- by other authors such as Davis (2015), vant and adapted to the corresponding where he notes the impact of his concept educational level. Failure to recognise the study, both when revealing the complexity absence of some important indicators led of the underlying mathematical ideas and a high percentage of students (51.6%) to when developing the mathematical ideas regard the video as an adequate teaching necessary for teaching. resource without identifying its shortco- mings. Furthermore, in addition to the epis- temic element, the didactical suitability We also observed a degree of inconsis- theoretical tool includes the cognitive, tency in the allocation of scores by the par- emotional, interactional, media, and eco- year 78, nº 275, January-April 2020, 27-49 ticipants, finding some evaluations with the maximum score where students iden- logical aspects, which are not considered tify more drawbacks than in others with in this piece of research. Although it is not lower scores. While these variations keep relevant to apply some of these aspects to the case of using didactic resources, in par- revista española de pedagogía the overall evaluation coherent, they do indicate that it is perhaps necessary to de- ticular the aspect of learning achieved, the fine the criteria more, in order to achieve other aspects could be the subject of analy- greater uniformity between participants. sis and reflection by the teachers who use Nonetheless, we have to take into account these resources. that this is a qualitative evaluation of sui- tability and that the final number, within certain margins, is only the summary re- Notes sult of a more complex process in which 1 The video from the Clasemáticas channel can the different components of suitability are be viewed at https://www.youtube.com/watch?- identified. v=o1Mu-lkgv-o 2 The videos suggested can be viewed at: These results suggest there is a need https://www.youtube.com/watch?v=0Z5DejetHR8 to consider in greater depth the develop- https://www.youtube.com/watch?v=v8KN44iNPls ment of future teachers’ specialised con- https://www.youtube.com/watch?v=1uAbIb-McLo 46 EV
The issue of didactical suitability in mathematics educational videos: an analysis experiment... Breda, A., Pino-Fan, L., & Font, V. (2017). Meta References didactic-mathematical knowledge of teachers: Aroza, C. J., Godino, J. D., & Beltrán-Pellicer, P. criteria for the reflections and assessment on (2016). Iniciación a la innovación e investiga- teaching practice. Eurasia Journal of Mathe- ción educativa mediante el análisis de la idonei- matics, Science & Technology Education, 13 dad didáctica de una experiencia de enseñanza (6), 1893-1918. sobre proporcionalidad. Avances en Investiga- Chapman, O. (2014). Overall commentary: un- ción e Innovación – Revista de Educación Se- derstanding and changing mathematics tea- cundaria, 6 (1), 1-29. chers. In J. J. Lo, K. R. Leatham, & L. R. Van Azer, S. A., AlGrain, H. A., AlKhelaif, R. A., & AlEs- Zoest (Eds.), Research Trends in Mathematics haiwi, S. M. (2013). Evaluation of the Educa- Teacher Education (pp. 295-309). Dordrecht: tional Value of YouTube Videos about Physical Springer International Publishing. Examination of the Cardiovascular and Res- Clasemáticas Canal (2012, November 8). (Propor- piratory Systems. Journal of Medical Internet cionalidad) - Proporción Directa (1002) [Video Research, 15 (11), e241. doi:10.2196/jmir.2728 file]. Retrieved from https://www.youtube.com/ Bartell, T. G., Webel, C., Bowen, B., & Dyson, N. watch?v=o1Mu-lkgv-o (Consulted on 2019-04- (2013). Prospective teacher learning: recog- 06). nizing evidence of conceptual understanding. Dabbagh, B., & Kitsantas, A. (2012). Personal Journal of Mathematics Teacher Education, 16 Learning Environments, social media, and (1), 57-79. self-regulated learning: A natural formula Beltrán-Pellicer, P., Giacomone, B., & Burgos, M. for connecting formal and informal learning. (2018). Online educational videos according to The Internet and Higher Education, 12 (1), specific didactics: the case of mathematics. Cul- 3-8. tura y Educación, 30 (4), 633-662. Daniel Carreon (2017, June 27). REPARTO Beltrán-Pellicer, P., Godino, J. D., & Giacomone, B. PROPORCIONAL-Super fácil [Video file]. (2018). Elaboración de indicadores específicos year 78, nº 275, January-April 2020, 27-49 Retrieved from https://www.youtube.com/ de idoneidad didáctica en probabilidad: aplica- watch?v=1uAbIb-McLo (Consulted on 2019- ción para la reflexión sobre la práctica docente. 04-06). Bolema, 32 (61), 526-548 Davis, B. (2015). The mathematics that secondary Ben-Chaim, D., Keret, Y., & Ilany, B. (2012) Ratio teachers (need to) know. revista española de revista española de pedagogía and proportion: Research and teaching in ma- pedagogía, 73 (261), 321-342. thematics teachers’ education. Rotterdam: Sen- Duffy, P. (2008). Engaging the YouTube Goo- se Publisher. gle-eyed generation: Strategies for using Web Bergmann, J., & Sams, A. (2012). Flip your class- 2.0 in teaching and learning. Electronic Jour- room. Eugene, Oregon: International Society nal of E-learning, 6 (2), 119-130. for Technology in Education. English, L. D. (2008). Setting an agenda for inter- Berk, D., Taber, S. B., Gorowara, C. C., & Petzl, C. national research in mathematics education. In (2009). Developing prospective elementary tea- L. D. English & D. Kirshner (Eds.), Handbook chers’ flexibility in the domain of proportional of international research in mathematics edu- reasoning. Mathematical Thinking and Lear- cation (pp. 3-19). New York & London: Taylor ning, 11 (3), 113-135. and Francis (Routledge). Borba, M. C., Askar, P., Engelbrecht, J., Gadanidis, Godino, J. D. (2013). Indicadores de idoneidad di- G., Llinares, S., & Aguilar, M. S. (2016). Blen- dáctica de procesos de enseñanza y aprendizaje ded learning, e-learning and mobile learning de las matemáticas. Cuadernos de Investiga- in mathematics education. ZDM. Mathematics ción y Formación en Educación Matemática, Education, 48 (5), 589-610. 11, 111-132. 47 EV
María BURGOS, Pablo BELTRÁN-PELLICER and Juan D. GODINO Godino, J. D., Batanero, C., & Font, V. (2007). The Ruiz-Reyes, K., Contreras, J. M., Arteaga, P., & onto-semiotic approach to research in mathe- Oviedo, K. (2017). Análisis semiótico de videos matics education. ZDM. Mathematics Educa- tutoriales para la enseñanza de la probabilidad tion, 39 (1-2), 127-135. en educación primaria. In J. M. Contreras, P. Godino, J. D., Font, V., Wilhelmi, M. R., & Lurduy, Arteaga, G. R. Cañadas, M. M. Gea, B. Giaco- O. (2011). Why is the learning of elementary mone, & M. M. López-Martín (Eds.), Actas del arithmetic concepts difficult? Semiotic tools for Segundo Congreso International Virtual sobre understanding the nature of mathematical ob- el Enfoque Ontosemiótico del Conocimiento y jects. Educational Studies in Mathematics, 77 la Instrucción Matemáticos. Retrieved from (2), 247-265. http://hdl.handle.net/10481/45382 (Consulted Godino, J. D., Giacomone, B., Batanero, C., & Font, on 2019-07-19). V. (2017). Enfoque ontosemiótico de los conoci- Sadler, D. R. (2013). Making competent judgments mientos y competencias del profesor de mate- of competence. In S. Blömeke, O. Zlatkin- máticas. Bolema, 31 (57), 90-113. Troitschanskaia, C. Kuhn, & J. Fege (Eds.), Hilton, A., & Hilton, G. (2018). Primary school tea- Modeling and measuring competencies in hi- chers implementing structured mathematics gher education: Tasks and challenges (pp. 13- interventions to promote their mathematics 27). Rotterdam: Sense Publishing. knowledge for teaching proportional reasoning. Santos, J. A. (2018). Valoración de vídeo tutoriales Journal of Mathematics Teacher Education, de matemáticas disponibles en internet. Nuevos 22 (6), 545-574. doi: https://doi.org/10.1007/ instrumentos para el análisis de los procesos s10857-018-9405-7 educativos (Doctoral dissertation). Centro de Mason, J. (2016). Perception, interpretation and Investigación y de Estudios Avanzados del Ins- decision making: understanding gaps between tituto Politécnico Nacional, Ciudad de México, competence and performance-a commentary. Mexico. ZDM. Mathematics Education, 48 (1-2), 219- Smatematico (2013, April 7). Problema de repar- 226. to proporcional [Video file]. Retrieved from Pino-Fan, L., & Godino, J. D. (2015). Perspectiva am- https://www.youtube.com/watch?v=0Z5Deje- year 78, nº 275, January-April 2020, 27-49 pliada del conocimiento didáctico-matemático tHR8 (Consulted on 2019-04-06). del profesor. Paradigma, 36 (1), 87-109. Turney, C. S. M., Robinson, D., Lee, M., & Soutar, Ponte, J. P., & Chapman, O. (2016). Prospective A. (2009). Using technology to direct learning mathematics teachers‘ learning and knowledge in higher education. The way forward? Active for teaching. In L. D. English & D. Kirshner Learning in Higher Education, 10 (1), 71-83. revista española de pedagogía (Eds.), Handbook of international research in Tuto mate (2016, May 10). Problemas de repartos mathematics education (pp. 275-296). New directamente proporcionales [Video file]. Re- York: Routledge. trieved from https://www.youtube.com/watch?- Portugal, K. O., Arruda, S. D. M., & Passos, M. M. v=v8KN44iNPls (Consulted on 2019-04-06). (2018). Free-choice teaching: how YouTube presents a new kind of teacher. Revista Elec- trónica de Enseñanza de las Ciencias, 17 (1), Authors’ biographies: 183-199. Maria Burgos is an Associate Lectu- Posadas, P., & Godino, J. D. (2017). Reflexión sobre rer in the Department of Didactic of Ma- la práctica docente como estrategia formativa thematics at the Universidad de Granada. para desarrollar el conocimiento didáctico-ma- She has a doctorate in Mathematics from temático. Didacticae, 1, 77-96. doi: https://doi. org/10.1344/did.2017.1.77-96 the Universidad de Almería and a master’s Ramírez, A. (2010). Youtube y el desarrollo de la in Didactic of Mathematics from the Uni- competencia matemática. Resultados de una versidad de Granada. She is a member of investigación cuasi-experimental. Contextos the FQM-126 Teoría de la Educación Ma- Educativos, 13, 123-138. temática y Educación Estadística (Theory 48 EV
You can also read