1. Andee Rubin
  2. Senior Scientist
  3. INK-12
  4. http://ink-12.terc.edu/
  5. TERC
  1. Lily Ko
  2. Research Associate
  3. INK-12
  4. http://ink-12.terc.edu/
  5. TERC
  1. Kimberle Koile
  2. Research Scientist
  3. INK-12
  4. http://ink-12.terc.edu/
  5. MIT Center for Ed Computing Initiatives, MIT Office of Digital Learning
Presenters’
Choice
Public Discussion

Continue the discussion of this presentation on the Multiplex. Go to Multiplex

  • Icon for: Jacqueline Coomes

    Jacqueline Coomes

    Professor
    May 11, 2015 | 07:45 a.m.

    I’d like to hear about the professional development for teachers in learning to use these tools in their classrooms, especially how they learn to use students’ work in class discussion and how they follow up with students who are showing misconceptions.

  • Icon for: Andee Rubin

    Andee Rubin

    Lead Presenter
    Senior Scientist
    May 13, 2015 | 02:52 p.m.

    Thanks for your question, Jacqueline. There are really two different answers, based on the focus and purpose of the professional development. In terms of using the software itself, we have provided teachers with a brief introduction prior to their using CLP, then been present to provide technical support during the class. We’ve put a lot of effort into making the system interface intuitive and easy-to-use, and we’ve found that most teachers get comfortable with the software itself within a few days.

    However, choosing and using student work for productive class discussion is a different skill, one that relies on a teacher’s deep understanding of the math and “pedagogical content knowledge.” We have not undertaken professional development around this topic as part of the INK-12 project. Some teachers we have worked with have had training in the use of student work for class discussion and/or are using a curriculum that includes explicit support for this practice (e.g. Investigations in Number, Data and Space, which was developed here at TERC). Others, however, have little experience with this approach. In cases where teachers do not have good strategies for building class discussion around student work, we have taken an active co-teaching role, looking over student work with them after class, helping them design class discussions, and occasionally leading class discussions ourselves.

    Successful implementation of any innovation in math instruction that requires teachers to analyze and respond to evidence of students’ mathematical reasoning requires considerable professional development. I have no doubt such PD could be developed and offered – but school districts also need to provide the time and financial support for teachers to engage in such PD.

  • Icon for: Sean Smith

    Sean Smith

    Facilitator
    Senior Researcher and Managing Partner
    May 11, 2015 | 09:11 a.m.

    The PD is interesting to me too. In addition, can the project speak to early evidence of effectiveness? When teachers and students use the tool as intended, what outcomes do you see?

  • Icon for: Kimberle Koile

    Kimberle Koile

    Co-Presenter
    Research Scientist
    May 13, 2015 | 02:05 p.m.

    Thanks, Sean; good question, and one on which we’re focusing at the moment. Our findings so far are in the form of case studies. We’ve seen students make conceptual progress after using the tools. A student, for example, who was quite fluent in using a traditional division algorithm, didn’t understand place value in division: After using the division tool, he had an aha moment when he said that he hadn’t realized that a 1 in the 10s place was actually a 10 rather than a 1. For other students, we’ve seen increased independence and confidence. In one case, a student who was not able to work without a teacher’s help, and who was routinely given smaller numbers than the rest of the class, was able to use the tablet tools to independently work the same problems as her classmates. This student also participated in class discussion, which the teacher said was a rare occurrence. We’ve also seen when working with students who struggled with organizational skills that the tools provided enough structure for the students to be able to start a problem and see a path to a solution, something many of them weren’t able to do on paper. We’ve seen students in a class using the tablet software create more representations on an assessment than students in classes working with paper and pencil, but we’re still analyzing that data—-clearly classroom culture and different teaching approaches make a big difference. One of our summer projects is to more definitively figure out what we’ve learned. So stay tuned!

  • Icon for: Sean Smith

    Sean Smith

    Facilitator
    Senior Researcher and Managing Partner
    May 13, 2015 | 08:01 p.m.

    Thank you, Kimberle. I definitely will stay tuned. The case study evidence you cite above is compelling. I’m guessing that the technology is more than just another mode of engagement, that it has affordances that go beyond traditional modes of engagement. It sounds like the embedded scaffolding of organization might be one of those features.

  • Icon for: Kimberle Koile

    Kimberle Koile

    Co-Presenter
    Research Scientist
    May 15, 2015 | 01:53 p.m.

    Good observation. I’d say that the labeling of the jump size on the number line is another form of scaffolding. There’s a similar feature, not shown in the video, that enables students to turn on a label that shows the size of the group represented by a stamped image they’ve created. We debated about whether to display the group size below a stamped image, thinking that it might be best in some cases for kids to write the repeated addition or skip counting themselves, but opted to let the kids decide when/if they wanted to be reminded of the group size. It certainly makes designing the UI easier if you can let the users make some of their own decisions! But it’s also interesting from a research point of view to look at when kids decide to use labels and what sorts of tools they choose for particular types of problems. We’re looking at these sorts of issues now as we analyze our data.

  • Icon for: Gillian Puttick

    Gillian Puttick

    Principal Investigator
    May 11, 2015 | 01:41 p.m.

    I’m interested in how intuitive the students find the INK tools. What have you found out about how they learn the various tool “conventions” in order to use them?

  • Icon for: Kimberle Koile

    Kimberle Koile

    Co-Presenter
    Research Scientist
    May 13, 2015 | 02:15 p.m.

    Good question, Gilly. We’ve been pleased to find that it takes about 5 minutes for students to learn to use the tools. Kids are very facile with technology these days, and we’ve also worked to make sure that the tools are easy to use, match the task at hand, and use familiar analogies. So the stamp tool resembles a physical stamp; the way the array tool is used resembles the TERC Investigations array cards and associated games; the division tool had its beginnings in the Investigations factor cards. We’ve worked with another curriculum as well—-one that didn’t rely quite as much on students creating their own representations. The students were able, though, to use the tools quite effectively. (Adapting a curriculum for use on the tablets, especially when there is a mismatch between pedagogical approaches, is a whole different conversation, as you can imagine!)

  • Icon for: Arthur Lopez

    Arthur Lopez

    Facilitator
    Computer Science Teacher
    May 11, 2015 | 01:45 p.m.

    Very interesting project and app. What about school sites that do not have tablets available to them? Is there an option for having this tool be web-based or downloadable on desktops systems? I also am curious to know if this project considered English Language Learners and the challenges encountered with segment of the student population? Has any studies been done in regards to teaching this group with this specific tool?

  • Icon for: Kimberle Koile

    Kimberle Koile

    Co-Presenter
    Research Scientist
    May 13, 2015 | 02:48 p.m.

    Thank you, Arthur, and good questions. The software can be used with a mouse (or finger) instead of a pen, though drawing and writing with a pen is much easier and more intuitive than with a mouse. We’re working to get the software running on inexpensive tablets, so that more kids can have access to the use of a pen. Some of the tools can be used fairly easily with a mouse though—-the array and division template, for example. It’s just harder for students to annotate their work. We don’t have a web-based version mainly because browsers currently don’t support pen interaction. We do have some anecdotal evidence that the tools help ELL students in learning math: We worked with a class of seven 4th and 5th grade students who had been identified as having learning difficulties, and several of them were ELL students. We saw the ELL students, especially one boy who had very little knowledge of English, being able to articulate their thinking using the tools, and we saw increased independence and confidence as a result. We have some ideas about a proposal to fund work with that population, but nothing specific yet. We’d be happy to get back in touch when we think more about it, though.

  • Icon for: Kimberle Koile

    Kimberle Koile

    Co-Presenter
    Research Scientist
    May 13, 2015 | 02:50 p.m.

    A p.s.: The software currently is written in C# and runs on Windows machines. The students and teacher have machines, and a machine is connected to a projector. The machines all communicate via a wireless network; we typically use a local peer-to-peer, but any network will work. We’ll be making the software available at some point this next year. We’re also considering implementing a version that would run on Android machines.

  • Icon for: Davida Fischman

    Davida Fischman

    Facilitator
    Professor
    May 11, 2015 | 02:01 p.m.

    I’m interested in the questions other have raised – clearly, technical tools will raise technical questions that will be important to implementation. The tool seems fairly flexible and intuitive, and it nicely supports teachers’ use of formative assessment, and it would be helpful to hear how teachers and students are utilizing it.

    I’m also interested in how – or whether – you see this tool supporting development of multiplicative thinking, rather than seeing multiplication as primarily repeated addition. Could you give some information on that?

  • Icon for: Andee Rubin

    Andee Rubin

    Lead Presenter
    Senior Scientist
    May 13, 2015 | 03:21 p.m.

    Thanks for your questions, Davida. I hope some of the other replies have given you some ideas of how students and teachers use the software. One of things we’ve learned is that individual students tend to gravitate toward particular tools – and that particular types of problems tend to evoke the use of different tools. One fairly obvious example is that students are more likely to use the stamp with a word problem that has objects that are easy and useful to draw – like the problem in the video about the number of legs on spiders and butterflies. Some students, though, will use a stamp even for problems that aren’t as obviously visual – e.g. a problem about bags of rice that sell for $7 each. Several students (all of them girls, it turns out) created a stamp with a brown bag-like lump with the number 7 on it. These students were more likely to use stamps on other problems, as well. In contrast, there were several students who often chose to use number lines – and other who preferred not to use any representational tools. For us, these findings argue for providing students with choice in the kinds of representations they can use, knowing that they will have individual preferences.

    I also wanted to address in particular your question about models of multiplication that are different from repeated addition. Our tools generally support thinking of a multiplicative structure as a number of equal-sized groups. We don’t have tools, for example, that would lead students to the idea of multiplication as a scaling operation. However, our array tool, in particular, helps students think about how numbers can be decomposed and recomposed in multiplicative structures – i.e. how partial products can be combined. This allows them to visualize both the associative and distributive properties. For example, because students can cut and recombine arrays, they can see how 25 X 12 can be thought of as (25 X 4) X 3 = 100 X 3 = 300. I’d be happy to talk more about how other tools could extend the ways students think about multiplication, if you have some particular ideas to share!

  • Icon for: Gerald Kulm

    Gerald Kulm

    Senior Professor
    May 11, 2015 | 02:49 p.m.

    Students often solve a problem first, then show a representation. This is similar to the difficulty in having them write an equation rather than simply doing it mentally or with arithmetic. Do you notice the actual use of the representation tools to solve a problem in addition to a requirement to use it to confirm their answer?

  • Icon for: Andee Rubin

    Andee Rubin

    Lead Presenter
    Senior Scientist
    May 13, 2015 | 03:36 p.m.

    A good point, Gerald. We have definitely seen students use representations to solve problems – but not always! We are currently coding the student work we collected in one third grade class to get a sense of the ratio of times students used the representation to solve the problem vs. to “show their thinking” – although sometimes it’s hard to tell the difference. On the one hand, we’ve seen students write an answer, create a representation, discover that their first answer was incorrect based on the representation and correct their answer. On the other hand, we’ve seen students who created a representation they could only have specified if they already knew the answer – e.g. a student who created a 4 X 5 array in response to the problem 20 / 4. One question we’re pondering: Is it useful for students to create a representation, even if they don’t use it to find the answer? What do you think?

  • Icon for: Gerald Kulm

    Gerald Kulm

    Senior Professor
    May 13, 2015 | 05:05 p.m.

    Of course we ask students to show representations often to assess their understanding of a concept or procedure, so it is important, beyond using it as a tool to solve the problem. Being able to flexibly move between representations, symbolic, graphic, verbal is a clear indication of understanding. On a slightly different note, we try to provide representations for students in an attempt to support and develop understanding. It seems we know less about the types of mental representations students use in their thinking. Is a number line or array, etc the picture that is in the kid’s head? Probably not. But these representations are important to learn as part of their mathematical “vocabulary.”

  • Icon for: Kathy Perkins

    Kathy Perkins

    Director
    May 12, 2015 | 12:42 a.m.

    This looks like a really powerful and flexible tool. I like how the affordances of the tools like stamping, the array slicing, and skip jumping are directly tied to the mathematical concepts and help students express their thinking.

    Lots of great questions above, and I look forward to your answers. I am also curious about whether you do student interviews in your development, and if so, how you see students flowing through the tool and its usability?

    Also, how are you disseminating the technology? Is it openly available for teachers?

  • Icon for: Kimberle Koile

    Kimberle Koile

    Co-Presenter
    Research Scientist
    May 13, 2015 | 03:49 p.m.

    Thanks very much, Kathy. Both power and flexibility have been high priorities for us. We did interview students, both informally during class while they used the software, and also more formally before, during, and after using the software. The classroom observations also gave us a sense for how the students used the tools. In addition. we’re able to look at each student’s process of using the tools because we can play back the history of interactions (as shown in the video). It’s been fascinating to see the underlying differences in students’ creation of what look to be very similar final artifacts. We’re analyzing that work now, but what we’ve learned so far in terms of how students use the tools is that, not too surprisingly, some students create a representation then fill in an answer; others fill in an answer first, then create a representation. In some cases, we think that creating the representation did help a student solve a problem; these situations are most obvious when a student writes in an answer that happens to be wrong, creates a representation, then corrects the incorrect answer. In quite a few cases students try out multiple representations, but leave only one as their final product. In some cases it looks as if students are verifying their answers using the different representations. In other cases, it looks as if students started out with one type of representation, e.g., a number line, then before finishing the representation switched to another. So your question is a good one, and we’re working on answering it “as we speak”.

    As for availability, we’ll be making a version of the software available sometime this next year; it’ll be downloadable from our project website.

  • Icon for: Kathy Perkins

    Kathy Perkins

    Director
    May 15, 2015 | 04:36 p.m.

    Fascinating to hear about the differences in interaction. It sounds like having the back-end data / playback ability is really providing a nice insight into their learning pathways, as well as evidence of the role of the multiple representations. Thanks for the detail!

  • Icon for: Kimberle Koile

    Kimberle Koile

    Co-Presenter
    Research Scientist
    May 15, 2015 | 04:46 p.m.

    And thanks for your insightful questions!

  • Teon Edwards

    Guest
    May 12, 2015 | 08:55 a.m.

    Very interesting. I appreciate the use of the true affordances of the technology. Are students required to use the tool—showing ones work—if they are able to get to the answer without it?

  • Icon for: Andee Rubin

    Andee Rubin

    Lead Presenter
    Senior Scientist
    May 13, 2015 | 03:44 p.m.

    Hi Teon – thanks for your question. Whether students have to show a representation even if they haven’t used one to find their answer is more a matter of classroom culture than technology. We tend to encourage students to do so for several reasons: sometimes they discover that their answer is incorrect when they create a representation; even if their initial answer was correct, we may find out more about their mathematical thinking if they’ve created a representation; modeling a mathematical situation with a representation may push a student’s thinking to deeper levels. Also, see the response to Gerald Kulm’s question above, in which I give a few examples of the ways in which students use representations.

  • Kelly Paulson

    Guest
    May 12, 2015 | 10:29 a.m.

    I was intrigued by this work. I wish my son (autism and fine motor issues) had access to these tools at school. I can see them being incredibly helpful to him as he struggles with representing his work on paper (and then reading what he has created!).

  • Icon for: Kimberle Koile

    Kimberle Koile

    Co-Presenter
    Research Scientist
    May 13, 2015 | 03:55 p.m.

    Thanks very much for your comments, Kelly. As I mentioned in an earlier reply, we have worked with students identified as having learning difficulties, and we were pleased to see that the tools did seem to help them. The stamps in particular seemed to help students who had fine motor issues: They could draw just one image and easily make multiple copies of it. They also were able to use the array tool quite effectively. We didn’t have the number line tool implemented at the time, so they didn’t try that one out. We have seen some students with fine motor issues have trouble drawing the number line arcs, though, e.g., missing the end point of an arc and having to erase and start again multiple times. We’re implementing a new version that we’ll try out with the same students in a few weeks. The idea with the new design is to let them just make a single tick mark on a number, and the software will draw an arc for them. As you can imagine, we’ve had lots of conversations about the tradeoff between what students do themselves and what software does for them. We hope that for students with fine motor issues, the new version of the number line tool will strike a good balance between student agency and software help.

  • Icon for: Janet Kolodner

    Janet Kolodner

    Facilitator
    Regents' Professor Emerita
    May 12, 2015 | 04:21 p.m.

    Like Kathy, I appreciate the power and flexibility in this tool and the affordances in it. I really like the way the tool allows learners to choose the representations they want to use to solve a problem, to work with those representations in ways (I hope) that can help them visualize the ways the operations they are doing work, allows them to integrate drawing that the computer can interpret and freeform, and that allows them to integrate work with operations they are learning (division) with operations they already know (addition). There are all kinds of affordances for really understanding math and for mathematizing the world in here. Really nice!!!

    Doing math in this way looks to me to be a way to encourage the habit of mathematizing the world around them. Anything you know about that yet? Anything you think you might have done right or wrong to make that happen? Or anything you might have to add to what you tell teachers?

    Janet

  • Icon for: Andee Rubin

    Andee Rubin

    Lead Presenter
    Senior Scientist
    May 13, 2015 | 04:36 p.m.

    Thanks for your comment, Janet. We’ve worked hard to create a tool that leaves as much agency in the hands of the students as possible – yet provides some analyzable data for teacher and researcher. This is an interesting and challenging line to walk. One thing we’ve learned – which is alluded to in several other responses – is that it’s useful to provide a variety of tools and representations for students. We’ve found that students often have particular representations that they find easier to think with – or representations that they feel don’t fit certain kinds of problems. Having multiple tools also creates the possibility of asking students to compare across representations, which can generate new insights for students who have become comfortable with one particular approach.
    Our design has been informed by research on mathematical reasoning and by the excellent Investigations in Number, Data and Space curriculum materials, which are themselves based on years of research. We’ve always started with the grounded knowledge of the ways in which students think – and then asked, “What can technology offer that goes beyond the manipulatives and techniques students already use?”

  • Laurie Brennan

    Guest
    May 13, 2015 | 08:01 a.m.

    The tools align closely with the way in which a student may use manipulatives so that you continue to capture the hands on aspect of learning. The tags are terrific for identifying when and which students are struggling or mastering a particular skill.

  • Icon for: Kimberle Koile

    Kimberle Koile

    Co-Presenter
    Research Scientist
    May 13, 2015 | 04:16 p.m.

    Thanks for making these very good points, Laurie. We didn’t want the “virtual” manipulatives to completely replace physical ones either. When the curriculum employed physical manipulatives, the students used those, then segued to the software tools. Also as I mentioned in an earlier reply, we used physical analogies to design the software tools. For the tag work, we’re currently analyzing student work—-both final product and process of creating it—-to figure out what particular characteristics and patterns of use can tell us about student understanding. We’re also using data from interviews and classroom observations. In the case of the “trouble with remainders” example, it was important to use that extra data to determine if the student was actually having trouble with the concept of remainders or just with the software tool. The analysis work is being done by hand at the moment, but we’re also working on machine analysis of the student interaction histories, with the goal of getting the software to add the tags that we identify as important.

  • Jeremy circlcenter.rog

    Guest
    May 13, 2015 | 11:17 a.m.

    I think this work also has important implications for assessment — we see too much of digital testing forcing kids into a representation (which the test developer thinks is best), but what we care about is the students’ mathematical thinking!

  • Icon for: Andee Rubin

    Andee Rubin

    Lead Presenter
    Senior Scientist
    May 13, 2015 | 04:04 p.m.

    Agreed, Jeremy! Digital tools are too often used to restrict students’ expressivity, rather than expanding it. And computer-based assessments tend to focus on questions that can be quickly and automatically scored, which usually means multiple-choice answers. We’ve made some progress in automatically understanding students’ work – and inferring something about their underlying reasoning – but it’s a research challenge to combine free expression with automatic understanding.

  • Wendy Center)

    Guest
    May 14, 2015 | 12:56 p.m.

    I like how this software uses technology to extend what students would normally do by hand as they are working through problems and then offers the tools that can help scaffold the kind practices they need to use to solve the problems. Plus it just looks like fun! It adds a creative, artistic dimension to solving math problems that I’m sure is very appealing to many kids.

  • Icon for: Kimberle Koile

    Kimberle Koile

    Co-Presenter
    Research Scientist
    May 14, 2015 | 01:52 p.m.

    Thank you, Wendy! We’ve been committed to letting kids create their own representations, and you’re right, most really enjoy using the tools. (“Who knew that math could be so fun?” commented one boy.) We’ve had a few students who just wanted to write out answers, but once they see that they can identify mistakes by creating representations to check their work, they generally do use the tools. And most kids love the easy access to colors. We’ve seen some creative use of color for mathematical meaning, e.g., showing which partial products map to particular areas of an array, as seen in the video; or using a number line for two-part problems and using different colored arcs to distinguish the different parts. We should confess, though, that with some kids who like to draw we’ve had to encourage them to not obsess, e.g., over creating the perfect image for a stamp. The teachers assure us, though, that the same students would be obsessing on paper and in some cases would get upset over the state of the paper after many erasures. At least the tablet pen lets them erase easily and quickly!

  • Icon for: Jessica Hunt

    Jessica Hunt

    Assistant Professor
    May 14, 2015 | 01:01 p.m.

    I love this tool. Do you find certain representations to have more affordances in terms of student learning than others?

  • Icon for: Andee Rubin

    Andee Rubin

    Lead Presenter
    Senior Scientist
    May 14, 2015 | 03:33 p.m.

    Thanks, Jessica! We’ve seen all of the tools we’ve developed help students learn at times – what’s been interesting is how different tools seem to provide support for different students at various points in their developing a sense of multiplicative structure. Each tool highlights certain potential issues in students’ reasoning, so they have turned out to quite valuable as research resources as well. For example, watching students use the number line for division gave us new insight into the ways that they distinguish between two kinds of division: partitive (number of groups known, group size unknown) and quotative (group size known, number of groups unknown). Because a jump on the number line is more easily interpreted as a “group,” some students would only use the number line with quotative problems, where the group size was known. The representation didn’t map as easily to their model of partitive division.

  • Icon for: Jessica Hunt

    Jessica Hunt

    Assistant Professor
    May 14, 2015 | 06:04 p.m.

    That makes sense to me. Was there a particular tool that supported their understanding of partitive division? So interesting!

  • Icon for: Kimberle Koile

    Kimberle Koile

    Co-Presenter
    Research Scientist
    May 14, 2015 | 08:47 p.m.

    Good question. Some kids seemed to be able to think about a 1xN array used in conjunction with the division template as a representation for dealing out 1 thing to N groups (as opposed to 1 group of N things), and the missing dimension of the template then was the group size. We have a new tool that we haven’t tested with kids yet that lends itself more easily to partitive problems. It’s based on the stamp tool, so it involves drawing and would be best used with small numbers: It’s called a Pile (and we welcome suggestions for a better name!). The idea is that when kids use this tool, they start out with two squares on the screen, much as they start with a square in which they draw an image for a stamp. They draw something in one square to represent an object, e.g., a fish, and make a specified number of copies of it (resulting in a pile of objects). They then draw something in the other square to represent a single group, e.g., a fish tank. For a partitive problem, they know the number of groups so they make that number of copies of their group object. So they might have 20 fish and 4 fish tanks. They then use the pen or a finger to drag the objects into the groups until all the objects are in groups, just as they would with physical manipulatives. The software helps them keep track of the numbers involved by keeping count of the number of objects grouped so far, the number remaining, and the number in each group. The idea for the tool came from watching kids losing track of the bookkeeping when they were using stamps in a dealing out process. We hope the tool will be as well received as the stamp tool. We’ll see….

  • Icon for: Jessica Hunt

    Jessica Hunt

    Assistant Professor
    May 14, 2015 | 10:34 p.m.

    This sounds interesting. I’d love to hear more about what you find out with this new tool.

  • Myriam Steinback

    Guest
    May 15, 2015 | 07:52 a.m.

    What a great tool for both learning and teaching. The comments and your answers have mostly focused on how the tablet tools support student learning. I’m also curious about what teachers are learning as well as what they find challenging.

  • Icon for: Andee Rubin

    Andee Rubin

    Lead Presenter
    Senior Scientist
    May 15, 2015 | 01:23 p.m.

    Thanks for your comment, Myriam. I hope that teachers with whom we have worked have gained more insight into how their students think. And that is the challenging part for many teachers as well, especially if they haven’t had much experience analyzing student work and having productive class conversations based on students’ thinking.

  • Further posting is closed as the showcase has ended.