assessment

You are currently browsing articles tagged assessment.

Introduction (or Why Should I Care About the NGSS?)

As you could guess, one of the major themes at the recent Denver Regional NSTA meeting was how to begin to implement the Next Generation Science Standards (NGSS) in our science teaching. I started off the conference by attending a talk by Brett Moulding, who is described as being the “writing team leader” for the NGSS, so he probably knows what the NGSS are about.

Mr. Moulding’s talk focused on the following ideas:

    1. No, not everyone has officially adopted the NGSS (Colorado has not, for example) but it does represent the latest research and teachers should always be aware of the latest research into how students learn science.
    2. There are three dimensions to the NGSS: Ideas, Practices, and Crosscutting Concepts.
    3. The past of science education was the “what,” the facts that could be easily assessed.
    4. The future of science education is getting kids to show that they understand the “how and why,” the mechanisms behind phenomena.
    5. “They are going to perform the science.” “Performance is HUGE.” The focus is on student science performances.
    6. This performance should be their assessment. Instruction and assessments should be similar.

It was really amazing to hear one of my favorite messages about science eduction being supported by someone so influential, namely that we should be moving away from focusing on only teaching science facts and instead focus on the doing of science. This was a great morale booster for my talk at the conference later that day about facts vs. skills and the ways that our assessments need to change to measure those skills.

At the end of his talk Mr. Moulding did field several questions about new assessments for NGSS and he pointed out the that National Academy of Sciences National Research Council (NRC) would soon be releasing their proposed guidelines for what the new assessments for NGSS would look like.

The NRC did indeed release new guidelines the week after the NSTA conference and they are summarized here if you are interested in reading them for yourself. All the quotes I’m going to use come from the prepublication download of the National Academies Press book Developing Assessments for the Next Generation Science Standards.

At first, the document reads as I expected, like a manual for those testing companies that are itching to get going on selling us the NGTT (Next Generation of Terrible Tests) with comments like

Designing specific assessment tasks and assembling them into tests will require a careful approach to assessment design. (pg Sum-3)

Nothing earth-shattering here. But then there are some glimmers of daylight that there might be something in this report for us non-test-developers:

…it will not be feasible to cover the full breadth and depth of the NGSS performance expectations for a given grade level with a single external assessment comprised solely or mostly of performance-based questions… (pg Sum-5)

which is pretty obvious if you think about the amazingly large array of tasks that students would have to complete if we are really assessing all the content and performance standards of the NGSS.

To get around this issue of tests not being able to truly measure all that NGSS demands of students, we find the real gold nugget of the document so far:

States or districts might require that students in certain grade levels assemble portfolios of work products that demonstrate their levels of proficiency. (pg Sum-5)

This is the first of several references to the use of portfolios in this report, some of which I’ll mention in a bit.

Without going line by line through the rest of the document, I’ll summarize it by saying that the NRC recommends that educators create an integrated “assessment system” that consists of three parts:

    1. Assessments for classroom instruction (mostly for teachers to see how well students are performing).
    2. Monitoring assessments (external assessments that can be used with large numbers of students).
    3. Indicators of opportunity to learn (measures of the quality and content of science instruction).

What follows is a discussion of why I think that using student digital portfolios can help teachers meet these three requirements listed in the NRC’s report. If you haven’t seen the kind of portfolios we use in my classes, you may want to have a look. The rest of this will make a lot more sense if you can picture the kinds of portfolios that I am talking about.

1. Student Portfolios are Classroom Assessments of the NGSS

From Developing Assessments for the Next Generation Science Standards:

Classroom instruction is the focus of the framework and the NGSS, and it is classroom assessment–which by definition is integral to instruction–that will be the most straightforward to align with NGSS goals (once classroom instruction is itself aligned with the NGSS). (pg 4-2)

By “aligned with the NGSS” they are referring to science courses that can demonstrate that classroom-based assessments measure the different content and skill requirements of the NGSS:

…students need to experience instruction in which they (1) use multiple practices in developing a particular core idea and (2) apply each practice in the context of multiple core ideas. (pg Sum-3)

which ties in nicely to Brett Moulding’s vision for the NGSS as moving away from isolated facts and towards student performances of science.

Can portfolios of student work be used by teachers to assess the core knowledge and skills addressed in the NGSS? Absolutely. I’ve taken some initial steps to do just that with my student portfolios this year. All that is required is that the portfolio be explicitly designed to collect evidence about a particular set of skill and content standards that matches the performance standards laid out in the NGSS. Students and teachers can use such a portfolio to examine and discuss how well students are able to provide evidence that they have met each standard. Of special note given the NRC recommendations, the kinds of portfolios that we use include both content knowledge and skill standards and can allow students to display evidence of applying core ideas and science practices.

2. Student Portfolios are Monitoring Assessments for the NGSS

The NRC report highlights some of the problems with current standardized tests in terms of measuring performance on the NGSS:

The science tests that are currently used for monitoring purposes are not suitable to evaluate progress in meeting the performance expectations in the NGSS, for two reasons. First, the NGSS have only recently been published, so the current tests are not aligned with them in terms of content and the focus on practices. Second, the current monitoring tests do not use the types of tasks that will be needed to assess three-dimensional science learning. (pg 5-3)

In most cases, the items assess factual knowledge rather than application of core ideas or aspects of inquiry that are largely decoupled from core ideas. They do not use the types of multicomponent tasks that examine students’ performance of scientific and engineering practices in the context of disciplinary core ideas and crosscutting concepts nor do they use tasks that reflect the connected use of different scientific practices in the context of interconnected disciplinary ideas and crosscutting concepts. (pg 5-3)

One of the proposed solutions to the issues that surround standardized tests in science is to encourage the development of classroom-embedded assessments such as a

Portfolio of Work Samples and Projects

A third option for classroom-embedded assessments would be for a state or district to provide criteria and specifications for a set of performance tasks to be completed and assembled as work samples at set times during the year. The tasks might include assignments completed during a school day or homework assignments or both. The state or local school system would determine the scoring rubric and criteria for the work samples. Classroom teachers could be trained to score the samples, or the portfolios could be submitted to the district or state and scored centrally. (pg 5-18)

The report goes on to state that portfolios can and have been used for standardizing or auditing across classrooms:

One example is Kentucky’s portfolio program for writing, in which the portfolios are used to provide documentation for the state’s program review. In Wyoming, starting officially in 2003, a “body of evidence system” was used in place of a more typical end-of-school exit exam. (pg 5-19)

Since I developed my portfolio system based on standards not only from the NGSS, but also from a variety of sources such as AP Biology and Colorado Community College Common Course guidelines, the NRC’s discussion of “teacher moderation methods” struck a particular chord and also speaks to the utility of student portfolios to allow for comparison of students from multiple locations:

Moderation is a set of processes designed to ensure that assessment results (for the courses that are required for graduation or any other high-stakes decision) match the requirements of the syllabus. The aim of moderation is to ensure comparability; that is, that students who take the same subject in different schools or with different teachers and who attain the same standards through assessment programs on a common syllabus will be recognized at the same level of achievement. This approach does not imply that two students who are recognized as at the same level of achievement have had the exactly same collection of experiences or have achieved equally in any one aspect of the course: rather, it means that they have on balance reached the same broad standards. (pg 5-19)

Furthermore, the NRC report goes on to explore examples of successful “school-based assessments” such as that found in Queensland where:

Assessment is determined in the classroom. School assessment programs include opportunities to determine the nature of students’ learning and then provide appropriate feedback or intervention. This is referred to as “authentic pedagogy.” In this practice, teachers do not teach and then hand over the assessment that “counts” to external experts to judge what the students have learned: rather, authentic pedagogy occurs when the act of teaching involves placing high-stakes judgments in the hands of the teachers.
Samples of student work (are) annotated to explain how they represent different standards (pg 5-20)

I love this section because it describes perfectly how my students and I use portfolios. I provide the framework of standards for the portfolio and students fill the portfolio with evidence of learning and they have to explain how their artifacts meet each standard.

And finally, the fact that our portfolios are online meets one of the major recommendations of the report:

New technology and platforms that support further upgrades make it much easier than in the past to accumulate, share, store, and transmit information. Such possibilities will make it easier to work with evidence collected in systems of assessment that are composed of multiple elements. (pg 5-22)

3. Student Portfolios are Indicators of the Opportunity to Learn Using the NGSS

“Indicators of Opportunity” is mostly a fancy way of saying “accountability.” Are teachers using the NGSS to the greatest possible extent to support student learning of science? There are many possible measures for such a system, listed here by the NRC:

The report includes a number of indicators that we think are key elements of a science accountability system: program inspections, student and teacher surveys, monitoring of teachers’ professional development, and documentation of classroom assignments of students’ work. (pg 6-9)

Therefore, a portfolio-based assessment system can serve the additional purpose of holding a classroom teacher like myself accountable for which types of activities I provide for my students to carry out:

Documentation of curriculum assignments or students’ work might include portfolios of assignments and student work that could also provide information about the opportunity to learn (and might also be scored to provide direct information about student science achievement). (pg 6-10)

See what they did there? The NRC itself mentions the possibility that portfolios will be used for multiple aspects of this new assessment system. Not only will this portfolio my students produce hold them accountable for learning the different standards for a given course, it will also hold me accountable for providing them plenty of opportunities to meet each content and skill standard.

Conclusions

Like it or not, the NGSS are probably not going away any time soon and at the very least represent the latest and greatest thing to come along in science education. Educators can either sit back and let the big testing companies have their say about how to assess for the NGSS or we can dig in and create our own ways of showing that we are helping our students perform to the level that the NGSS demands. Its pretty clear that everyone knows that technology will be involved. What remains to be decided is whether we as teachers will be content with our students doing “science simulations” in online assessments or whether we’ll have them do the real thing in class and create ways for students to document their learning for all to see. I’m going with door number 2 on that one. How about you?

 

Tags: , , , ,

This post is about the “points” game that schools play and how to avoid it. By points I mean those numbers we award to students for performances of learning in our classes. Such numbers must have something to do with measuring student learning, but how points-based grading is being used and abused is worth a deeper look.

Why do teachers use points to quantify student learning?

I suspect this answer varies from person to person, but probably for most of us it comes down to tradition. Its “always” been done this way: the teacher sets a maximum number of points possible on an assignment or test, kids do the task and turn it in, then the teacher rates the work as some percentage of the maximum value possible.

These numbers are collected, processed, massaged, and ultimately used to determine an “objective” numerical score that measures learning. Its easy. Any of the popular gradebook software programs will take whatever numbers you throw at them and crunch them into something seemingly meaningful. For example, one student is an 87%. Another is a 57%. Parents, students, and teachers “know” what this number tells us about the student. We use this type of grading system because it provides us the illusion of scientific observation of a student’s achievement.

We train students to want more points (or give up entirely when they fail to get them)

Another use of points is as a reward system. “Oh, you completed that worksheet? Here’s 10 points. You did well on my test? Here’s 89 points. You didn’t annoy me in class today? Here’s 5 points. Didn’t turn that in on time? Oops, that’s 5 points off for late work. Gotcha! That will teach you some responsibility.”

Students love points. They are like coins in Temple Run, gold in WoW, and experience points in Fallout/Skyrim/etc. Gotta rack ‘em up if you want to succeed. Our message with points-based grading systems is that students are in our rooms to collect points towards a grade, to get that great level-up rush (to extend the gaming metaphor). Sadly, students don’t automatically get new skills and abilities in real life just because they’ve racked up points.

Earning and withholding points is a game we play at school

Since we’re talking about games, I think that we can game a points-based system in so many ways that the entire enterprise has to be questioned. Do you give extra credit points for extra effort or bringing in a box of tissues? Gaming. Do you give points when lab safety agreements are turned in? Gaming. Do you give a student who is at 89.4% an A even though 90% is the cutoff? Gaming.

Do you slap a kid with zero points for missed assignments? Most thinking people agree that zeros devastate a student’s overall grade if you are summing all points earned as a fraction of the total possible. At least give the kid 50/100, but again you’re gaming the system to get closer to a number that you know the kid “deserves.”

Did your students not do as well on a test as you hoped? Guess what? We’ve got a game for you too. Its called curving the results. Just tack on 15 points for everybody! We all win when we play that game.

Do you average all assignments together into one score? This is everyone’s favorite game to play while trying to observe and document student learning. Unfortunately, averaging all points into a final grade loses any information that the original scores may have had about exactly what a student did and did not know. By the end of a grading period we’ve reduced our information about learning down to our One Number to Rule Them All and no one can tell which topics and skills a student is good at, just whether or not they’ve been playing your points-collecting game.

Changing the game

If you want to abandon a points-gaming system, you’ll need to find a replacement, perhaps something with a bit more narrative component to it. The requirements of such a system are these:

      1. Provide content area and skill goals for students and use these in your grade book instead of columns of point totals for individual assignments.  Some people call this kind of system standards-based grading. Others just ask “what do you want students to know and be able to do?” and “what will you be looking for in their performances of learning?”
      2. Provide actionable feedback to students so that they can understand what they know and don’t know and can and can’t do. This replaces points. Instead of telling a student that their project is worth 67 points out of 100, tell them what was wrong and what to do about it. Don’t even give them a number, just feedback on how to make it better.
      3. Let them make it better. If you give feedback, you really should let students respond to your feedback by fixing what needs fixed or digging deeper into whatever it is you are trying to get them to learn or demonstrate.
      4. Keep records of student learning without resorting to using number scores. If you are giving students narrative feedback in a system like BlueHarvestFeedback or using your own spreadsheets that students can access, you’ve already done this step.  As soon as you post student feedback it is recorded somewhere where you and your students can get at it again to check for improvement and plan next steps and future learning activities.
      5. Connect your grading system to whatever system you are working within or convince your school to change its grading system along with you. Out of necessity, most of us find ourselves, especially at the high school level, bowing to the demons of class rank GPA battles and scholarship applications and need to produce letter grades “because colleges need them.” Just do it honestly and consistently and stick to a set of published guidelines for how you are going to arrive at the letter grade. It will be subjective. But so is everything about teaching if you are doing it right and responding to different student needs and abilities.

Student ownership of learning

I always had the sense that when I was giving a numerical score (1-4 scale) along with feedback that I was doing all the work of judging the quality of their work and that students would ignore the feedback as long as the number was something they found pleasing. If narrative feedback is the only thing happening (and I’m still learning how to do it well) then students are more likely to read it and respond by improving their work.

Weekly Progress in BlueHarvestFeedback

This year I’ve started using student-generated weekly progress updates in BlueHarvest Feedback. Every Friday students log in to BlueHarvest and post a comment on the Weekly Progress standard that I created for their course. Students suggest what letter grade I should put in to our Eligibility grade in Infinite Campus and they have to justify why they think they deserve that grade for the week. This does two things: 1. it forces most students to actually log in to BlueHarvest where they have an opportunity to see the feedback that I’ve left them on their work and 2. it lets students practice self-analysis and argument from evidence.

Thus far in the school year I’ve found that most students are quite good at determining and defending their own weekly progress grade and usually land pretty close to what I would have assigned from a teacher’s perspective. There are many who still need some practice with arguing from evidence for their grade (“I think I deserve an A because I got all my work done”) but that’s not a bad thing in a system that aims to show student improvement.

Its a new game, to be sure, but hopefully its one in which each student is more active in determining their overall grade rather than letting the teacher or an algorithm in a software program calculate how much they’ve learned.

Tags: , , ,

This quote from Dean Shareski came across my Twitter feed yesterday just as I was archiving some of my favorite examples of student portfolios:

shareskionachievementChallenge accepted.

First off, I’ll state that even portfolios are a weak form of proving “achievement.” The real kind of achievement that we should be aiming for as teachers will be only evident in the lives of our students once they’ve left our buildings. But that sort of thing is about as immeasurable as it gets and is unlikely to be used by anyone other than teachers to prove that we’re doing our jobs.

How do we demonstrate that kids are learning in our classes? One route is obvious: give your kids a test that everyone takes and see how they do in comparison to everyone else. This seems to be the go-to choice for most educators these days, willing or not, given the corporate takeover of student assessment. The problem with a lot of these tests, though, is that they are usually one-time, shot-in-the-dark maybe-you-were-feeling-bad-that-day assessments that really don’t capture what a kid was able to learn and create over the 9 months that they were in your classroom.

That’s where portfolios can demonstrate achievement far better than tests, no matter how rigorous or authentic we try to make our exams. With a well-built student portfolio, educators can look for evidence of what they think is important by requiring students to provide evidence of those outcomes. Do you value collaboration in your classes? Then make a spot in your student portfolios where kids provide evidence of being able to collaborate. Do you value good communication skills? Include a portfolio page about communication. The structure of the portfolio defines what you hope kids will achieve while in your classes. It can include test scores, but a good portfolio is much more than test scores.

It might be clear by now that I’m in favor of creating the structure of the portfolio for the student. There are arguments against that, I’m sure, but if I am going to be held accountable for what my kids are learning, then I’m at least going to provide them some standards against which to measure themselves. For me that means using standards-based grading and portfolio templates for students to fill with evidence for each standard.

As for the portfolios themselves, there are plenty of tools out there for creating digital portfolios, but some have too much reliance upon the teacher (they upload everything, student does nothing) and some have no structure to them (“Here’s this thing I did in March”). I think a good portfolio tool or platform should have the following functionality:

    1. A blank portfolio can be delivered to the student with a built-in, standards-based structure designed by the teacher.
    2. Each portfolio should be continually updated and upgraded by the student as the school year progresses and they learn new content and skills.
    3. Students should be doing all the work of collecting their best work into the portfolio and defending why their work meets or exceeds the standards for the course.
    4. The portfolio should be easily accessible by both teacher and student from school and from home.
    5. The portfolio needs to have a variety of options for sharing with other students, educators, and community members who have a stake in particular students’ performances.
    6. Students should be able to customize the appearance of their portfolio to suit their tastes in graphics, design, and layout.

I’ve been having my students create Google Site portfolios for two years now, primarily because I can create template Google Sites that are populated with web pages for each standard that I want students to provide evidence for. At the beginning of each school year, students log into their school Google accounts, find my template site for their course in Google Sites, and then make a copy of it as their new portfolio. They then spend some time learning the ropes of Google Sites, if they don’t know them already, and customize their sites a bit with new graphics, fonts, and color schemes as they see fit.

The rest of the school year is spent engaging in learning activities that probably could be found in most any science classroom. The major difference is that in the back of students’ minds is always the question: how will I document this in my portfolio? Students are allowed to make decisions about how best to communicate learning. Will they just post a Google Doc copy of an activity or will they write a longer blog post about it? Will they do a certain lab report in Google Docs, Glogster, or Prezi? Will they do the lab report on their own or collaborate with their lab group? What goes into the portfolio is up to the student, so although the class as a whole might do a similar set of labs and activities, each portfolio comes out relatively unique due to the choices students make about how they document activities and which ones they choose to include in their portfolio.

One downside of using Google Sites is that, of course, the portfolio is tied to the student’s account. This means that these awesome showcases of student achievement might get deleted once students graduate and our IT department deactivates their accounts. As I mentioned at the top of this post, I’ve recently been archiving some of the most impressive portfolios to use as exemplars for next year’s classes. Our IT department was nice enough to make me a super boss in our Google Apps domain at least long enough to copy over some of the sites to my account.

Here are some students’ finished portfolios that I’ve archived, sorted by course:

Anatomy:

https://sites.google.com/a/lajunta.k12.co.us/4acresanatomyportfolio/

https://sites.google.com/a/lajunta.k12.co.us/katrinasanatomyportfolio/

https://sites.google.com/a/lajunta.k12.co.us/stevenssanatomyportfolio/

https://sites.google.com/a/lajunta.k12.co.us/tiffanysanatomyportfolio/

AP Biology:

https://sites.google.com/a/lajunta.k12.co.us/mandiapbiologyportfolio/

https://sites.google.com/a/lajunta.k12.co.us/michaelsapbiologyportfolio/

https://sites.google.com/a/lajunta.k12.co.us/steven-sapbiologyportfolio/

Biology:

https://sites.google.com/a/lajunta.k12.co.us/ashleysbiologyportfolio/

https://sites.google.com/a/lajunta.k12.co.us/stevensbiologyportfolio/

https://sites.google.com/a/lajunta.k12.co.us/taylorsbiologyportfolio/

https://sites.google.com/a/lajunta.k12.co.us/tiffanysbiologyportfolio/

Chemistry:

https://sites.google.com/a/lajunta.k12.co.us/sierrachemistryportfolio/

https://sites.google.com/a/lajunta.k12.co.us/stevenschemistryportfolio/

https://sites.google.com/a/lajunta.k12.co.us/nikkischemistryportfolio/

These are just a sampling of some of the better portfolios from the last couple of years. I’m sure there’ll be issues with permissions and such that pop up with some of the students’ artifacts, particularly for those that have used their school Blogger accounts, but these should at least give you a taste of the organizational schemes that I try to use for each course’s portfolio.

What makes these portfolios stand out from those of other students is not necessarily the quality of the artifacts that are linked in the portfolio, but that each of these students really understood the purpose of the portfolio, namely that of showing that they truly did meet the standards for the course. Not only did they do the required work, but they were also able to explain what they learned and why it met the course requirements.

A majority of the student portfolios shared above were already made public by their authors, although the default sharing setting is private within our school’s Google Apps domain. What does that say about the whole point of the portfolio process? Is it for me, the report card, or the junior college that might give them concurrent credit? Maybe all these things, but by choosing to make their portfolios public, these students have made a statement about what they believe the portfolio is all about.

These students have decided that their achievements are worth noticing. By everyone. In all the Internet. I doubt we’ll see that same kind of passion about their state test scores.

 

Tags: ,

This post is an update to my older year end wrap up that seems to get a lot of traffic from people searching for “standards-based grades” and similar terms. I can only assume that there are lots of folks out there trying to get their heads around what SBG is about and how to do it. What follows will be a (hopefully) concise discussion of my spin on SBG and how I assess students using blogs and portfolios.

If you’ve drunk even a little bit of the SBG kool-aid you’ll know that the lofty goals of grading and assessment reform can be stated something like this:

  • have students show what they really know and can do
  • make learning rather than grades the focus
  • if you have to produce a “grade,” reform your grade book to reflect learning, not compliance/completion
  • ditch points-based, averaging nonsense and banish “zeros” since neither concept helps describe what a student knows and can do
  • since grades reflect learning, allow reassessments to show new understanding of concepts

If these sound like ideas you can get behind, read on. If you like your current, points-based system, read on too, because you’ll feel justified in a little bit.

How do you meet the lofty goals listed above? Here is roughly the sequence of steps that I would recommend:

Step 1: Define your standards

Notice I didn’t say to parrot back your state standards or (goodness gracious) our new national standards. These have to be yours. As in “these are the things that I really believe to be important” standards. There should be some overlap, of course, if your state department of education has done its job reasonably well. Different people will approach this very differently, from having lots and lots of standards to having only a few. Marzano suggests that we should “limit measurement topics to 20 or fewer per subject area and grade level.” I read this after I had done my standards-crunching, but I agree with it, since I identified just 9 major areas that I wanted to assess. These are Content Knowledge, Research, Lab Skills, Experimental Design, Data Analysis, Tech Savvy, Communication, Self-Analysis, and Contribution to Community.

The most unique thing about this set of standards compared to others I’ve seen is the smashing of all the content for each course into one standard. I teach science and so have lots and lots of content to discuss in each of my courses (anatomy, biology, chemistry, physics, and AP Biology and yes, I’m at a rural school with only 4 science teachers in grades 7-12 for 600 kids). I don’t think that content is the most important thing, though, not anymore, with the interwebz and such just a Google away. I don’t ignore content ideas, I just don’t overemphasize them in the final grade determination. Instead, I’m more interested in building a skill set for students that they are going to take with them regardless of which little factoids that they remember from my classes. But that’s my take on standards. Yours will be yours.

Step 2: Develop an Assessment Philosophy

Yes, I know this sounds like something that you did for an assignment once upon a time in teacher-school, but really, it will help you out greatly if you put it down in words, especially if you make it available to parents and students. Mine’s here, if you want an example. I’m sure it would fail all of the guidelines for an official teacher-school document, but there it is. This doc is where you need to think about what you believe about assessment of student learning: Do you give quizzes and tests to see what kids know? Does every student do the same set of assignments in the same way? Will you assess using your favorite worksheets but score them by standard? Can students make up for failing or missed assignments or is assessment a one-shot deal so they learn the value of deadlines?

Basically, what you want to do in this Assessment Philosophy is lay out how you plan on determining what students know and what they can do. Again, my way of doing it may be very different from yours. I have students do a ton of writing and creating in blogs and portfolios but do almost no formal testing. Other teachers that I adore do lots of tests and quizzes that show how much their students have learned. Good arguments exist for both kinds of assessments.

Step 3: Determine how you will assign final grades

Ah, the stickiest issue of all, particularly for high school teachers who get to deal with parents and students worried about class rank, scholarships, and acceptance to their favorite college. Woo hoo!? If you have to assign grades, and most of us do, this is the part where your idealistic standards hit the wall of whatever online gradebook your school happens to suscribe to. Some play nicer with standards than others, but in any case you are going to have to figure out how to mesh what you do with standards with what students and parents see in the gradebook. I happen to have been fortunate enough to be good friends with my tech director who set up some lovely manually entered standards within Infinite Campus so I can determine the grade however I want and just report it out online. Other teachers I’ve read about have not been so lucky, having to prove that x% of their grade comes from labs and y% from tests or whatever, which will take a bit more massaging in a standards-based system.
You will want to carefully consider how you convert what students do on lots of separate standards into a single letter grade. This task sucks and essentially reverse-engineers everything you’ve been trying to do, but until more teachers and school districts get behind just reporting learning standards, we’ll have to deal with it. Many options exist: Will you figure out an average score using scores from all the standards? Will you have basic and advanced standards and use achievement of the advanced ones to assign higher letter grades? Will you look at performance on all the standards at once and apply a set of rules to determine a final grade? I lean towards the latter and have a system in place that counts the number of advanced, proficient, partially-proficient, and unsatisfactory standards to determine the final grade.

Step 4: Try it out!

Implementation time! After a summer of planning and writing about your new standards-based grading system, the first days of school are going to be great! Except don’t expect students to want to hear every detail all at once. Spend some time getting to know your students and building up your classroom community before digging into the nitty gritty of how their grades will be determined. Oh sure, make your pretty documents and web pages available, but don’t expect students to read them right away, if ever. Instead, coach students on the philosophy of your class, about what they can do to show you that they are learning something in your class. Give them the tools to be successful on your assessments, even if they don’t quite see the big picture of how standards-based grading in your class works. And constantly remind them that they can improve on past failures and mistakes, if you allow that sort of thing, because chances are your students have been trained to fire and forget on most assessments. Its the mental shift that you need to work on, not just in yourself, but in your students as well for this sort of assessment scheme to succeed.

Be warned, though. These changes will come at a serious price: your time.

There are some school days that I look enviously at the student aides for one of my neighbor teachers, slogging away with an answer key and a red marker at piles of that teacher’s turned-in assignments. Oh, says I upon seeing such sights, why didn’t I stay with the worksheet and my lovely 10 (or 1) point grading system? I could have aides do my grading for me. It was so easy to check off whether someone had done some learning or not. But I know that system didn’t really do much besides speed up the process of assigning a grade, and wasn’t really about assessment at all.

It takes time to really get to know what kids are learning in your classroom. Anyone, including student aides, can grade a worksheet, tally a point total, and enter it into a grade book without knowing a darn thing about the student that turned it in. It will take more time to grade by standards, particularly if you are going to go the route I did and develop student blogs and online portfolios. Those sorts of things take time to make and take time to assess so be prepared to spend more class time on assessments and be ready to spend more of your own time on reviewing them.

I love this note that a reader left in a conversation on my Assessment Philosophy:

I’ve been reading this document and now have a clearer idea of what you were talking about. My principal question, which I’m sure is answered somewhere, is how does one manage it? Reading and commenting on scores of portfolios that vary greatly in quality would seem to be an extremely time-consuming endeavor. I have been in a 17 year struggle to have a normal life outside of teaching, one I have largely lost. I want the students to do most of the thinking and the work while I do relatively little, but for general classes anyway, the reverse seems to be most true. Do you know where in Chris’ webpage or blog he reveals the secrets to evaluating the portfolios without committing evenings and weekends to the task? Thanks,

Larry

Larry is absolutely in the right in thinking that reading and commenting on blogs and portfolios is extremely time consuming. But the tradeoff is that no two student blogs are the same and reading a student’s writing is so much more interesting than scoring worksheets. The digital artifacts they create will be very unique and entertaining if they are done well, as most are in my experience. Is it overwhelming at times? Sure! But strategies like using Google Reader to keep track of when students post and which ones I’ve read and using Google Doc spreadsheets (or Blue Harvest) for keeping track of comments helps a lot. I also keep links to all student portfolios in one place using Pearltrees, which makes access to the otherwise clunky Google Sites in our district much more useable.

I found, too, that as the school year progressed, I spent much less time “grading” the blogs and was able to just read them to keep tabs on what the students were writing about and making sure they weren’t straying too far afield in putting their portfolio together. This happened somewhere around the end of the first semester when there was an “aha” moment of sorts for a lot of students when they finally understood what the portfolio was about and how it was being used to determine their overall grade. From that point on, it was obvious to students that the blank portfolio pages that I provided for them represented what I wanted them to know before they left the class. From then on, they became much more aware of what had to be done and they just did it, regardless of whether I “graded” their posts every time or not. In fact, for most of 2nd semester I only graded the portfolio (since that’s what I said I would grade anyway) and just read the blog posts for fun as part of the portfolio.

I think there will always be some sort of “training period” each school year in which I have to do a lot of “grading” and actually give blog posts scores on the 4 point scale just to give students an idea of what I’m looking for, but from then on, they seem pretty capable of producing artifacts for the portfolio without me having to grade each and every one of them. Grading the portfolios was an awesome way to end the year and a real triumph for standards-based grading since the portfolio made it so easy to assess what a student had learned in specific areas.

Still, I won’t claim to be sad to hit summer so I can spend some more time with my own little grumkins:

Ludwig kids

Thanks for hanging on through this not-so-concise romp through how I implement standards-based grades in my classes. I encourage you to try even small steps to reform your grading system, if you haven’t already. As for all the details, I’m sure there’s tons of stuff I left out so drop me a comment and we’ll fill in the gaps together.

Tags: , , , , ,

Q: What’s an ePortfolio?
A: Let me start by saying that, like most of what I use in my teaching, I didn’t invent ePortfolios and I can’t answer for everyone since ePortfolios mean different things to different people. But I will define an ePortfolio as an online space that gets used to collect and showcase evidence of individual student learning.

Q: You mean its like a blog?
A: Sorta. Blogs certainly can be used to show what a student has learned. In fact, thats how my classes operated last year, with student work nearly exclusively being posted to personal blogs. But an ePortfolio is different from a student’s blog. A blog is organized chronologically by date of publication, but an ePortfolio is organized by skill and content area standards and represents an attempt to prove that those standards have been met.

Q: Why add another site for students to manage? Isn’t a blog enough work?
A: What I found with the blogs was that students worked incredibly hard and produced amazing pieces of work but often couldn’t tell me which standards their posts met. As long as I was the only one evaluating their work, the standards for the class mattered only to me. Self-reflection of learning was really missing.

Q: So how does creating an ePortfolio lead to more self-reflection?
A: For starters, students have to look through all the blog posts that they have written so far and select which ones will go into their portfolio and on which pages to include them. This leads naturally to a discovery of which standards have a lot of evidence of mastery and which have less. Furthermore, there is a page within the portfolio that is for evidence of self-reflection, either in blog posts or as demonstrated while completing the portfolio. Many students used this page to assess the current status of their learning as shown by the portfolio.

Q: You mention pages in the ePortfolio and have many references to “standards.” How are the two related?
A: Each skill and content area standard gets its own page in the portfolio, which will vary with the content of each course.

Q: How did you decide which skill and content area standards to use for the pages in the portfolios?
A: The short answer is that those are the standards that I piloted last year as I implemented standards-based grading in each of my anatomy, biology, and chemistry courses. All of my science courses share the same set of 9 major skill standards, the first of which is broken down into specific content areas for each course. The common skill standards are those things that usually get called science process skills: graph interpretation, experimental design, lab and research skills, to name a few. The content-specific standards were derived from the Colorado Community College standard competencies for each individual course.

Q: These portfolio pages you keep referring to, where are they, exactly?
A: In a student-owned Google Site.

Q: ?
A: Early in the school year, I built a template site for each subject area course in Google Sites and then shared those templates to our district’s GoogleApps domain. Students could then go into Google Sites and create their own portfolio site from the template that I had created. Since the template had pages set up for each skill and content area standard, each student portfolio site also had these pages set up automatically as well. All students have to do is edit each page of the portfolio to include their blog posts, reflections, and other artifacts such as test scores that demonstrate mastery of that particular standard.

Q: So when do I get to see one of these ePortfolios?
A: The ePortfolios live within our schools’ GoogleApps domain and are mostly set to be visible only within our district at the moment. However, a few seniors have hit on the idea that colleges and scholarship providers might be interested in their work, and so have made their portfolios publicly visible. Here are a few links that I think will work:
Steven’s A&P ePortfolio
Audie’s A&P ePortfolio
Katrina’s A&P ePortfolio
Steven’s Chemistry ePortfolio
I hope to convince more students to make their portfolios public and will add links as they do so.

Q: Ok, I’m interested enough to want to know more. Got any references for me?
A: Here are a couple links to get you started:
Levels of eportfolio development in k-12 schools
Creating student portfolios with Google Sites

Tags: , , , , ,

This is a work in progress, as most of my stuff is, but here is my Assessment Philosophy for the 2011-2012 school year that I’ll be sharing with students and their parents.

Some key new features I’m trying:

  • student blog posts will receive only feedback, not grades
  • the spreadsheets I used last year will be editable by both myself and the student for each to add comments
  • students will create portfolios of their work by selecting and analyzing their best evidence of learning
  • portfolios will be organized and assessed using standards-based criteria
  • the only letter grades used will be assigned when portfolios are assessed at the ends of grading periods

Some things still to work out:

Feel free to leave suggestions for improvements/implementation in the comments and please snag a copy for yourself if you want to borrow any of it.

Tags: , , ,

One of the major changes that I made this year was to switch to using individual student blogs as the centerpiece of student assessment (the other major change was to implement standards-based grading). I started using student blogs for a number of reasons including:

  1. I was tired of grading worksheets with the same copied answers on them.
  2. I realized that these worksheets weren’t always helpful in learning content, and in fact, much of the time they got in the way of learning.
  3. Student in my classes have access to a MacBook cart whenever they are in my classroom and we have fantastically dependable wireless internet connectivity for these laptops (yay tech support!).
  4. Blogging platforms like Blogger and WordPress are free.
  5. I’m increasingly wary of multiple choice anything as real assessment and wanted students to write more.
  6. I wanted students to have a permanent, online record of their achievement throughout the year, not some pile of papers shoved in a binder (or trash can).
  7. I wanted students to have an audience for their work that would include each other, their families, the community, and the world.

With all these highfalutin ideals in mind, we launched our blogs at the beginning of this school year, with some fear and trembling.  Very few students had done any blogging before, although a couple had existing blogs from their English classes. The first challenge was to get everyone signed on to one of the blogging services. Most students chose Blogger, probably because we thought that that would be easier initially since we all had Google accounts. The only problem was that, at that time, at least, Google Apps accounts like my students had did not work with Blogger very well. Students ended up having to create their own Google accounts just so they could use Blogger. This wasn’t a big deal, just not as smooth as if Blogger were integrated into Google Apps.

So how did we use the blogs? They became the go-to location to post assignments for me to read and grade. For a week or two, though, I operated a lot like I did last year, posting assignments on Edmodo and using its great assignment features to have students turn things in online, as well as posting them to their blogs. I realized that this was a duplication of effort and soon instead of sending out “assignments” in Edmodo, I just sent files and links as “notes.” This meant that these resources no longer came with a due date and that I was not using Edmodo to see who turned in which assignments.

Instead, I figured out how to work Google Reader to monitor my students’ blogs. After subscribing to each students RSS or Atom feed, I organized all of their feeds into folders in Google Reader:

Reader allowed me to keep track of when students published new posts and to quickly find a particular student’s blog if we wanted to discuss something that they had posted. We still used Edmodo extensively for communication, just not for assessment. For example, if students made changes to their blogs, the changes would not always be highlighted in Reader so I asked students to message me on Edmodo if they made changes to a blog post that I had commented on already.

Speaking of comments, I did not personally comment directly on each student blog post. I figured that other readers of their blogs could do that. Instead, I gave feedback about each post as part of the student’s gradesheet entry. Some comments were pretty general (nice job! or something similarly lame) but I got better (I think) at commenting and left specific advice for ways to change the posts to better meet the standards.

One criticism that I’ve heard about my grading system is that it doesn’t spell out for students exactly what they need to do to meet a standard. I think that would be a concern, except for the fact that I tried to provide constructive comments on most everything students did and I let them respond to the comments by fixing their posts for a higher grade. Students did have to make the first effort at a blog post to try to show what they have learned about a particular topic or skill. I worked with them from there to improve their understanding by providing comments and discussing their posts with them. I had a number of students say that this was their favorite part of my class this year: the fact that they could try out a post, get some feedback, and go back and fix it as needed.

What did students blog about? Everything, really. Most of it was even related to the class ; )   As students and I discussed topics or performed labs in class, those topics and labs found their way in some form into students’ blogs. Some posts were simple text-based blog posts but at other times, students used a variety of web2.0 tools to put “learning artifacts” on their blogs. These learning artifacts included the use of Prezi, Glogster, Quizlet, Google Docs, Photobucket, DomoNation, Xtranormal, bubbl.us, and other tools.

If you’ve viewed the example posts linked above, you may have noticed that different students used different tools to discuss the same topic. That’s because I did not require that a particular tool be used with each assignment. Students were free to use the tool that they thought would work best for that particular post. If you are interested in exploring the wide range of content and quality that was produced this year, here are the links to all the student blogs.

Here are some of the awesome things about student blogging, in my experience:

Variety

Since students used many different tools to create artifacts for their blogs, I was never bored grading their posts, and in fact, was usually incredibly entertained and impressed by what students can create given the freedom to do so.

Portfolios of learning

The blogs became a record of student achievement that we can look back on for proof of learning. Along with their color-coded gradesheet, a student’s blog is a powerful indicator of the level of understanding for any given topic or skill that we learned throughout the year.

Wide audience of readers

Many people ended up looking at the students’ blogs, not just me. For example, parent conferences will never be the same again, since it was so easy to pull up a student’s blog in order to view and discuss the student’s level of performance. Parents have access to the entire list of student blogs, too, so it was easy at conferences to point parents there if they wanted to compare how their student was doing to how others were. The kid who has three blog posts starts squirming in conferences when their parents see other students blogs that have 10 or more posts.

Student blogs were also publicized via Twitter or my blog, which led some traffic their way. At least one student and future teacher made lots of connections with the edublogging community this year.

Resources for each other

Not all students learn at the same rate or in the same way. This is one of those things about teaching that is easy to say, but hard to do something about. However, the blogs let kids work at their own speed and with tools of their own choosing.  Inevitably, some student posts were finished before others and became learning tools for those students who were behind the rest of the class. Towards the end of the year, when they were a bit more mature in the whole process, some students even started giving credit for their peers’ work that helped them write their own posts. It was very cool to see them learning from each other via the blogs.

There were some challenges along the way, of course, as we tried blogging our way through the year:

Blog writing is time intensive

If you want students to do a good job writing their own blogs, be prepared to give them plenty of class time to write, revise, and experiment with new tools.  Every year it seems I get to discuss less and less content with students, but this year saw a big jump in the time I had to allow students to have workdays on the computer so that they could stay current with their blogs. I wouldn’t have it any other way, but it will force me to look very carefully at what I have planned for next year’s classes.

Fair access to blogs

Part of the reason for spending time blogging in class is concern over the issue of fair access to the Internet in order to complete the blogging activities. Many students do not have easy computer access at home, although some do. I wanted to try to rule out any unfair advantage that students might have over others, but was only partly successful.  Of course a kid with his own computer and Internet access is going to have more chances to blog and make amazing products than another kid who has to rely on computer access during the 50 minutes I see them in class. I’m not sure that’s a reason, though, to not blog. Its more of a reason to agitate for more equitable Internet access in my community.

The Mac blogging platform is not as useful

There were some students, fortunately few in number, that for one reason or another, kept forgetting their Blogger account passwords and would get locked out of the system. For these few (maybe 5 students in all my classes) I set them up with blog accounts through our local MacServer. That let them use the same password as they used to log on to their laptop, but the advantages stopped there. We found that with the Mac-hosted blogs, there was no separate publish option, so as soon as a kid saved their blog, finished or not, it posted to my Reader. Also, we never figured out how to allow embedding within the Mac blogs so those students had to post simple hypertext links to the artifacts that they created rather than having them appear right in the blog page.

Plagiarism

There was some plagiarism of blog posts, but it was usually incredibly easy to detect. The most obvious ones occurred when students simply lifted another student’s blog post and pasted it in as their own. I had one student, famous among teachers at our school for this sort of behavior, try this stunt about 5 times in a row trying to meet one particular standard. I simply refused to put any grade in her gradesheet until I was convinced it was her own work. Google searches and Plagium worked great for me in providing evidence that someone had copied material from a source or another student blog. I probably didn’t catch everything, and might jump in with our English teachers and somehow use Turnitin with the blogs to try to avoid problems next year.

Are blogs a rigorous assessment strategy?

One of the concerns that I had during the year was whether or not the new blogging paradigm is rigorous enough compared to the old model of lecture-worksheet-quiz-test-rinse-lather-repeat. This is a concern, of course, since I almost completely abandoned the traditional testing that I used to do (my Moodle site was very lonely this year).  Could I tell whether students were learning? Aren’t they just goofing around with web tools and having fun instead of suffering through the lectures that they need?

It was this article (via @mrsebiology) that convinced me that blogging can be just a rigorous as the tests that I used to give:

Rigor is the goal of helping students develop the capacity to understand content that is complex, ambiguous,
provocative, and personally or emotionally challenging.

Blogging in many ways is an incredibly difficult task for students. Not only do they have to research background information about a topic, they have to synthesize a variety of ideas together in a coherent piece of writing or media. They encounter interesting ideas about the course content and write about how these concepts effect their lives and society in general. In many ways, that’s much more rigorous than any test I could give about stuff that I lectured on.

The worksheet is dead. Long live the blog.

Tags: , , ,

As I’ve written elsewhere, my focus this year has shifted from tinkering with educational technology to tinkering with, well, most everything else about my classroom. The main focus has been about changing how I grade students. When I started teaching I used the typical points-based grading structure where 10 or 100 point assignments are given and students rack up points towards a total. From there, as I got sick of the points game (can you say cheating?) and tried to limit it, I moved to a more streamlined system in which students still earned points, just fewer of them.  This year has seen the implementation of a standards-based assessment and reporting system, variously called standards based grading, or occasionally skills-based grading.

The main focus of this system is to provide feedback to students, parents, and myself about how students are performing on specific, predefined learning targets. This puts the focus on learning specific skills and content, not simple completion of tasks for points. So how was this accomplished? In short, I had to restructure my gradebook to reflect each major skill or content area in which I wanted students to be able to demonstrate proficiency. This meant that I first had to define the standards that I would assess students on. This task was not too terrible, since I teach a variety of concurrent credit (sometimes called dual credit) classes and had great guidelines from the college-level classes to pull from.

Next, I had to decide what tool to use to do the actual reporting of student progress on the standards. Our school’s online grading program was certainly not up to the task, so I designed a gradesheet in GoogleDocs instead. This let me set up conditional formatting of spreadsheet cells to use different colors to highlight areas of strengths and weaknesses. Once an appropriate gradesheet was created for each course I taught, it was a straightforward task to clone the gradesheet for each student and share it with them via their GoogleApps account. Using GoogleDocs also gave me the option to share students’ gradesheets with their parents as the need arose, since the school’s online gradebook really doesn’t show the detailed feedback that the gradesheet does.

Then, of course, came the real test of the system: actually using it with students. This meant having to explain standards-based grading to them during the first few days of class. Let’s just say there were lots of blank stares. Talking about standards-based grading with students was probably a lot like talking about dancing, you might get the general idea and like the theory, but until you do it for yourself, there is no real sense of how it works.

But students did figure it out and, by the end of the first semester, they had a pretty good feel for what their gradesheets were all about and were beginning to use them to guide their learning. I began to hear the language of the classroom change a bit to where students began talking about which standards they still needed to meet instead of asking how many points an assignment was worth. Some students even asked me to give other students access to their gradesheets so that they could discuss them together and figure out what steps to take next.

It wasn’t all rosy, of course. Some students were so used to a points system that the idea that one unmet standard could lower their grade was really foreign to them. Even some of the higher-performing students, used to building up a surplus of points, had to think a bit differently. But most students caught on, and many seemed to really enjoy the flexibility of the system.

Here is a quick rundown of the things that impressed me about a standards-based grading system:

Guiding instruction

If you really want to know what your students are learning, try laying it out visually in your gradebook. For me, the big aha moment came after several weeks of school when I realized that there was no evidence of one of the major standards, Experimental Design (Std 4), in anyone’s gradesheet. Why not? I hadn’t provided them any opportunities to meet that standard yet. After that, I tried to plan activities that would help students design their own labs. I struggled with that standard all year, actually. Looking ahead to next year, I know for sure that one of the areas that I need to work on is to get students more involved in performing real scientific investigations.

Informing students of specific strengths and weaknesses

After several weeks of trying standards-based grades, it became obvious in the gradesheet what I knew from my experience of teaching over several years: each student brings a different set of skills with them to my classes. Some students were rocking the technology savvy standard (Std. 6) with their prezis, videos, and animations while others were brilliant writers that were at high levels for their communication standard (Std. 7). Each student gradesheet was unique, but having the gradesheet as a reference made conversations with students about their grade much more meaningful than simply saying “you have to work harder”or “just turn stuff in.” We could see exactly which content or skills each student needed to work on.

Allowing for mistakes and experimentation

One of the great things about standards-based grading using a 4 tier scale is that students don’t dig themselves into holes like they can in some points systems. Using cumulative points, the kid who forgets to turn in an assignment loses points and their grade suffers (sometimes drastically), unless you later give “extra credit,” which is usually unrelated to any real learning. Instead, standards-based grades separate out the areas of difficulty into discrete chunks which can be addressed individually without necessarily dragging down the entire grade.  My students were allowed multiple chances to meet each skill or content area standard, a fact that they really appreciated. This meant that students could botch a quiz or try some web tool that didn’t work, but they could try again with a different assessment to try to show an increase in their ability or understanding. For example, here’s part of a gradesheet from a student who fixed some misunderstandings:

In at least three of the standards (columns), there is evidence that the student performed better on a second try at each standard.

 

Showing student progress and achievement over time

This is perhaps my favorite part of using standards-based grades and the individual gradesheets. Each gradesheet starts out the year as a blank slate, but as we work together through the year, encountering new challenges, students begin to see a color-coded record of their achievements, sort of a trophy case, perhaps, of all that they have done throughout the year. Yes, numbers are involved (0-4) just like a regular gradebook, but there is something about color that draws the eye and paints a picture of what has been achieved in a way a numerical score cannot. For example, here are the content knowledge (Std. 1) gradesheets for a few of my students:

Evidence of content knowledge 1

Content area knowledge learned by Student A

Content area knowledge learned by Student B

Content area knowledge learned by Student C

You can see at a glance that Student A had some strengths and weaknesses throughout the year, Student B showed excellent understanding in all that they did, and that Student C struggled to produce evidence of learning for a number of content areas.

I’m going to let my students have the final word in this discussion of standards-based grading. I asked students in my biology classes to produce a short “advice” video that I could share with next years students to make the transition to SBG easier on them (and me). Here and here are a couple of the videos that best explain what students think about my grading system. I love the quote at the end of Cherlyn’s and Tenchita’s advice video: “Its different, but you’ll get used to it. Its better than anybody else’s.”

Tags: , , ,

Student use of social media invalidates state and national standardized testing results. Here’s why:

When students take our state-mandated standardized assessment, CSAP, they do so within a “testing window.” This means that students are sometimes taking the test days or even weeks apart from each other in different districts across the state. Students see the exact same test items, as far as I can tell, so that all schools can be compared on an equal footing. And that’s where student use of social media begins to make things unequal.

Here’s the problem: There is an incredible focus on staff ethical practices regarding “test security” but little to no mention of how to regulate student discussions about test items.

We certainly can and do ban phones during the test so that kids taking the same test at the same time don’t text each other answers. But what happens once the test is over and students get their phones back or they go back home to their computers/iPods/etc?  A phone/electronics ban reduces direct imaging (photography) of the actual test items and direct synchronous communication during the test, but it does not stop information about the test from finding its way online.

Lets say for example that Student A runs home from their test, gets on Facebook, and updates their status to say “Whew! CSAP testing is over for today. Gee, that math section 2 sure was hard!” Maybe this is not a big deal, but what if Student B  says “Gee that science section 1 was hard! All of those questions about (_______) drove me nuts! What did you put for #3?” Other students might join the conversation and explain whatever it was that student B missed. And then we have a problem. Once information about the tests they just took is online in their Facebook status or their latest tweet it becomes a permanent, searchable, and replicable (Danah Boyd‘s terms) record of the test items and students who have not taken the test yet are the invisible, unintended audience.

Due to their friendly banter on Facebook, Students A and B and their friends have just violated three of the “ethical practices” that apply to teachers (from this year’s CDE Proctor’s Manual (pdf), pg 6-7):

Presenting items verbatim or paraphrased from the assessment (not ethical)

Telling students the correct responses or allowing them to discuss answers among themselves (not ethical)

Allowing the use of notes or other materials that may give students an unfair advantage (not ethical)

Why include the last one? They weren’t passing notes during the test! No, but what they did create is an online body of knowledge that other students who haven’t taken the test yet can use to prepare for the test. If students in Denver take the test a week before we do, I’ll bet that my students can find some interesting hints about what’s on the test.  And if we were unlucky enough to schedule our tests before others? Well, I guess we are helping them out instead. Can everyone in Colorado publish when you are going to be CSAP testing next year? ; )

Because of the asynchronous nature of the testing, and this would be especially true for nationwide testing, all of the ethical violations listed above will occur through social media and will differentially effect the outcomes of the test.  The bottom line is that no one really has “standard conditions” for test taking anymore. The outcome of these so-called “standardized” tests not only depends on your abilities in a particular subject, but also on your abilities to comb through social media sites for hints about what to expect. And what about those poorer students or entire districts who may not have access to all these wonderful “hints” about the test that are floating around Facebook and Twitter? They’re out of luck, apparently.

So how do we stop this breach of ethics and return our tests to “standard conditions?” We could ban/block Facebook, Twitter, and other social media sites, but that’s been tried in a few other countries lately and doesn’t seem to work : ) We could have students sign some sort of nondisclosure statement the same as teachers do (No, really. We do.). I doubt, though, that anyone could monitor every kid’s account for possible disclosures of CSAP items. Even if we could then there would be accounts called CSAPPirate or PassMyCSAP popping up to spread information around. There is absolutely nothing to stop students from sharing information about tests that they just took with students everywhere else.

Maybe the answer lies with the testing companies.  Maybe they should (do?) create multiple versions of the test with different questions for different regions of the state or different test administration dates. I’m sure they would love to charge taxpayers for the extra work that that would add. Besides, wouldn’t that make different sets of “standard conditions?” Yuck.

I suppose we could all take the same test at the exact same time on the same date (with our phones off, of course). That would be especially fun to coordinate in the event of nationwide tests.

The question that we need to answer is this: are there ways to tell which students have received advanced knowledge of test items through their social networks? If the answer is “no,” then state and national testing is not “standardized” for our students because access to technology will, at least in part, determine their degree of success. Due to differential access to test prep programs and private tutors, testing probably hasn’t really ever been “standardized,” but social media has made it even less so.

Tags:

Since I teach several science courses that are concurrent with similar courses at our local community college, I have the chance to be formally evaluated by students each semester as do all “regular” college faculty. The most recent batch of evaluation results turned up in my box a few days ago, and I was eager to see what students were saying about my classes. I’d given a survey a few weeks into the school year, but the results of these evaluations would be another chance for me to gauge student reactions to this year’s implementation of skills-based grading. As soon as I could, I cracked the envelope containing the summary of student responses and read what my students had to say.

I’ll skip over the numerical averages for my “performance” (this is a mostly standards-based blog after all) and cut right to my favorite part: actual student comments. Overall, the written comments were very well thought out and were pretty positive about my class (Anatomy and Physiology in this case). One comment in particular stuck with me and I’ve been trying to figure it out. Its the one I used for the title of this post: “I do not think the grading system was appropriate for the course. I felt like I was teaching myself!”

Are students really “teaching themselves” in my skills-based grading system? Does this comment mean that I run the sort of classroom where the teacher sits at their desk while students run amok? Does it mean that students feel there is no direction to the class? Those issues would certainly be worth fixing, if that is indeed what my class is like.

This comment came right after a couple others in which students claimed to be disappointed that we weren’t using worksheets very much and were using too much technology. Taken together, these comments highlight the fact that at least a few students are uncomfortable with how they are being assessed in my classes. In fact, there were a couple of low votes in the “fairness of grading” category that I can only assume came from the students who wrote the comments mentioned above.

I’m left with some confusion, though, as to how to help students who are not taking advantage of the structure of my classroom. What to some is “teaching themselves” and a lack of worksheets and lectures has been a very different experience for many others who have embraced different ways to learn and to show that they are learning in my class. Some students treat me as their coach for learning the course content and skills, but many students are still wrapped up in getting a good grade, passing the class, or simply not failing it. I’ve taught too long the way some students expected, with worksheets turned in for points, often copied from neighbors and not true products of learning. Some students were clearly expecting more of the same and are still parsing out how to achieve a “good grade” without doing much learning.

I’ve got some work to do, obviously. My first step will be to look carefully at my instructional practice to make sure that I am supporting students as fully as I can for them to be successful. If that is in place, then I’m going to move on to the bigger job ahead of me, that of tackling “the system” that makes completion of assignments equal to measuring learning. Part of that work is happening right now, as I write this post to proselytize for a careful reassessment of what we do in our classrooms. If I can convince some or all of my colleagues to stop giving grades for completion and maybe even get them to try some sort of standards-based assessment and reporting system, then students should arrive in my classes already expecting to be held accountable for their actual learning.

In some ways, “I felt like I was teaching myself!” is the most complimentary comment of all. If they are learning to teach themselves, then I’m on the right track. If students can leave my classroom knowing how to learn, I’ve done my job, because I won’t be part of their lives forever. They’ll have to be able to do it on their own, and they might as well learn how to learn now before it really matters in college or their careers.

Tags: ,

« Older entries