Assessing Formative Assessment

1/15/2006 5:00:00 AM

It's no secret that much of the focus in K-12 education has shifted to assessment. While summative assessments — evaluations conducted at the end of an academic year — are nothing new, formative assessments that reveal student performance throughout the year are increasingly being used by districts to better target curriculum, instruction, and staff development. Many companies have developed technology-based tools to help school districts make these efforts more manageable. But how do you know which ones will work best for you?

1. How do formative assessment systems work?

Formative assessment tools come in two main varieties: Web-based and software-based. The Web-based tools, also known as application service providers, are online versions of traditional paper-based tests. Vendors offering this approach include Tungsten Learning, STI, SchoolNet, Scantron, Renaissance Learning, Pearson School Systems, and Harcourt Assessment (Edusoft plans to introduce online assessment in the coming year).

The software-based tools come as programs to be uploaded to a server or to individual computers in a networked classroom. They include products such as Focus on Standards from ETS and state-specific applications from CTB/McGraw-Hill.

With both of these options, students get on a computer in a lab or in the back of the classroom and take an assessment that the teacher has queued up for them. In some cases, teachers can tinker with program protocols so different students receive different sets of questions. With the right presets, for instance, special needs students in a particular class can receive questions that quiz concepts at a more basic level.

There is also an emerging generation of formative assessment tools that work with handheld computers. These systems take perhaps the least cumbersome approach, combining hardware and software in a way that lets educators administer research-based assessments without the manual score calculations and data entry often required to meet state and federal guidelines. Educators administer these tests verbally in one-on-one situations and record answers and observations directly onto the handhelds. Vendors in this niche include Wireless Generation and Liberty Solutions.


Harcourt Assessment's Stanford Learning First is a custom-built, Web-based summative and formative assessment tool that is configured to state standards.

2. What subject areas do formative assessment tools cover?

Most formative assessment solutions cover math, reading, science, social studies, and English language arts.

In most cases, assessment technology comes equipped with a database of subject-specific standard questions.

In rare cases, certain sets of questions in particular subject areas come as add-on modules, and districts are required to purchase the content after they buy the assessment technology itself.

A few products are designed to assess knowledge in specific areas only. The Benchmark Assessment System from Tungsten Learning and the mCLASS solution from Wireless Generation only assess skills in reading and math, for example. Before you decide which assessment tool to purchase, it's important to make sure you're investing money in a tool that assesses all of the subject areas you need to test.


STIAssessment from Software Technology automatically generates individual and aggregate reports by class, school, and population subgroups.

3. Where do assessment questions come from?

Most vendors hire writers with curriculum development experience to formulate questions for formative assessment tools. One reason traditional textbook publishers like Houghton Mifflin, Harcourt Brace Jovanovich, McGraw-Hill, and others have jumped into the formative assessment market is because they have tens of thousands of these questions on file already. It's important to investigate content fully — some vendors may use questions that were created years ago and therefore fail to adequately evaluate knowledge on modern subjects.

The questions themselves can take many forms, ranging from multiple-choice to short-answer questions or longer performance tasks engaging students in real-world problems. Sound assessment questions meet technical criteria of validity, the degree to which particular uses and interpretations of assessment results can be justified, and reliability, the degree to which scores are free of measurement error. One simple way to determine whether an assessment's questions meet those standards is to ask the vendor who authored the assessment. Also, it's important for districts to do psychometric research to analyze the items in the assessments and make sure they do the job.

4. How do I know if a formative assessment tool is aligned to my state standards?

Just about every formative assessment vendor claims its system is aligned to state standards, but district-level leaders must dig deeper to see just how valuable the system actually is. The best formative assessment tools are those that exist in several iterations that were developed from the very beginning with specific state standards in mind. Unfortunately, many vendors cut corners by conducting one-time development efforts, then aligning those efforts to meet the standards of each individual state. To find out more about your assessment, ask for a blueprint of the assessment itself. Laws in most states require that vendors specify whether their tools fulfill their educational standards, and from this document, educators can get a good sense of how a particular assessment measures up to others on the market.

5. In what forms do formative assessment systems generate data?

All formative assessment systems include methods to communicate results through reports. In most cases, these reports are generated online, giving teachers the option to share results with parents by passing on a Web address and some log in information. Many assessment tools also come with the option of printable reports, which can be added to a student's file or scanned as part of a summative diagnostic. Some formative assessment vendors offer modules that integrate assessment data into student information systems for reporting across a variety of data categories.

6. Once I get the data, what do I do with it?

Assessment data is only as good as the actions that arise from it. Only a handful of formative assessment systems include tutorials to help educators understand what data means. As a result, many formative assessment tools aren't used to their full potential. Compounding this problem is the fact that few professional development providers have enough contextual information about a particular classroom environment to make a difference. Currently, the best way to solve this problem is to turn to a consultant (such as the Assessment Training Institute in Portland, Ore.) or hire an in-house data expert.

7. How much classroom time should formative assessment take up?

No teacher will embrace a new technology that requires a lot of valuable classroom time. Districts must therefore select a formative assessment tool that's quick and easy for teachers to use and then train them how to use it. Finally, districts must instruct their teachers how to incorporate the technology into ordinary lesson plans. Many vendors offer optional support and training services; consultants do the same. However you go about familiarizing teachers with formative assessment, buy-in is essential. If teachers don't support the technology from the beginning, chances are it won't be assessing very much.

Matt Villano is a California-based freelance writer.

Pick Her Brain

Last year, when Lakeland School Corp., in LaGrange, Ind., selected formative assessment tools from Software Technology, MIS Coordinator Gail Nezworski was right at the center of the implementation. "Assessment is wonderful because instead of teaching to specific standards, you can target your teaching approach for each individual student. In our district, we have used assessment tools to empower our teachers to determine how much their students understand by giving them the ability to get real-time results. As teachers finish each lesson, instead of waiting for a high-stakes test at the end of the year, they do the assessment right then and there. After the assessment, if it's clear that a student needs more time to understand a subject, the teacher can spend more time on the subject with that student. If not, the teacher can move on. The system allows for teacher flexibility and ensures that every student is learning what they need to learn in the way they can learn it best."

Who's Who

CTB/McGraw-Hill
www.ctb.com

ETS
www.ets.org

Harcourt Assessment
www.harcourtassessment.com

Liberty Source (Tango)
www.tango-software.com

Pearson NCS
www.pearsonncs.com

Pearson School Systems
www.pearsonschoolsystems.com

Princeton Review
www.princetonreview.com

Renaissance Learning
www.renlearn.com

Scantron
www.scantron.com

SchoolNet
www.schoolnet.com

STI
www.sti-k12.com

Wireless Generation
www.wirelessgeneration.com

Buyer's Checklist
  • Select a medium for your formative assessment: Web-based, software-only, or a combination of software and hardware.
  • Make sure the tool evaluates all necessary subject areas.
  • Check to see that the questions in the tool's database have been written by a professional and are relatively current.
  • Investigate the product blueprint to ensure compliance with your state's standards.
  • Test the tool's data-generation mechanism to be sure the data will be easy to manage and contextually worthwhile.
  • Train teachers how to use the tool, and make sure it is something they will use in their classrooms on a regular basis.

Want to read more stories like this?

Get our Free Newsletter Here!

comments powered by Disqus

Kajeet Enhances Sentinel® Platform to Prepare for Explosive Online Learning Growth

Latest Upgrade Supports Advanced Reporting, Improved Filters as Distri...

Pocomoke City Educator Michael Browne Honored as 2017 Maryland National Distinguished Principal

Mentoring Minds Partners with Maryland Principals Association to Recog...

Utah State Evaluation Report Validates Literacy Gains For Students Using Lexia Reading Core5

External Evaluators Also Find Lexia’s Blended Learning Program t...

Schoology Expands Partner Ecosystem With BrainPOP Integration

NEW YORK (March 22, 2017) – Schoology, Inc., the leader in learn...

EPS Instruction and Intervention Earns Finalist Honors in 2017 EdTech Digest Awards

Research-Based Intervention Program, iSPIRE TM, Recognized as a “...

Measured Progress introduces eMPower Assessments

DOVER, NEW HAMPSHIRE—March 21, 2017—Measured Progress, Inc...

Second Avenue Learning Welcomes Director of Research and Learning Design

Rochester, N.Y. (March 21, 2017) – Second Avenue Learning, a lea...

VariQuest Combines STEM Curriculum and 3D Printing for the K-12 Market at the ASCD Empower17 Conference

With new CREATE Packages, educators now have access to a powerful suit...

T&L Partner Post
Tweets
Photo GalleriesView All Galleries >
Acer C720-2844 Chromebook

(www.acer.com) The Acer C720-2844 Chromebook model delivers speedy performance, a quick boot time of seven seconds, and a matte anti-glare display tha...

Britannica ImageQuest

(www.britannica.com) Britannica Digital Learning has upgraded ImageQuest, a resource for schools and libraries that provides nearly three million rig...

ClassFlow

(www.classflow.com) Promethean has released ClassFlow, a free, all-in-one, cloud-based teaching tool that lets teachers create and deliver interactive...

Adobe Voice

(www.adobe.com) Adobe has released Adobe Voice, an animated video app for the iPad that lets users create and share video stories. The app incorporate...

DeskBoard

(www.boxlight.com) The BOXLIGHT DeskBoard mobile cart adjusts both height and tilt for the P8 ultra short throw interactive projector on a white surfa...

Core 36M

(www.bretford.com) Bretford has introduced Core 36M, a 36-unit charging cart that is optimized for Chromebooks but which also supports most tablets, l...

Edmentum Sensei

(www.edmentum.com) Edmentum Sensei is a mobile optimized solution that helps administrators visualize and track overall school, teacher, and student p...

HMH Player

(www.hmhco.com) HMH has released HMH Player, a new native app for iOS and Google Chrome that streamlines the learning experience for improved digital ...

Juice Power System

(www.bretford.com) Bretford has unveiled an easy-to-use modular power system with exchangeable power components. The Juice Power System uses unique &#...

LightSail

(www.lightsailed.com) LightSail Education has announced a literacy accelerator that combines books with in-text embedded assessments and real-time dat...

myON

(www.myon.com) myON has expanded its digital library to include a set of literacy tools to further personalize the reading experience for students whi...

Nervanix Clarity

(www.nervanix.com) Nervanix has released Clarity, an application that monitors student attention levels as they study and guides them to revisit conce...

MathBall

(www.robotslab.com) RobotsLAB has introduced MathBall, a smart sensor basketball and tablet system that offers curricula in algebra, pre-calculus, phy...

MobileAsset.EDU

(www.waspbarcode.com) Wasp Barcode’s MobileAsset.EDU solutions include everything administrators need to account for their assets, from software...

OpenEd Assessment Creation Tool

(www.opened.io) OpenEd has announced a free tool that lets teachers easily create assessments with the question types required by Common Core standard...

Panasonic TH-80LFB70U

(www.panasonic.com) Panasonic’s TH-80LFB70U interactive LED display features high-speed, multi-touch, interactive capabilities to promote partic...

penveu interactive display system

(www.penveu.com) The penveu interactive display system is a handheld device that turns projectors and large screen displays into interactive whiteboar...

PresentationPro

(www.califone.com) Califone has updated its PresentationPro speaker. The PA310 readily connects with computers, LCD projectors, mobile devices, intera...

PowerSync+ Mobile Companion App

(www.bretford.com) Bretford Manufacturing, Inc. has announced the availability of the companion app for its PowerSync+ enabled charge and sync produc...

PureCharge Carts and Stations for iPad

(www.bretford.com) Bretford Manufacturing, Inc. has debuted the PureCharge family of iPad and iPad mini charging carts and stations. By offering pre-i...

ProQuest Research Companion

(www.proquest.com) ProQuest’s new information literacy product, Research Companion, offers videos that guide users through the research process,...

Sphere2 & Class Send Student Engagement Software Platform

(www.averusa.com) AVer Information has developed a Student Engagement platform, providing teachers and students with the tools to transmit document ca...

TabChargeCT2

(www.averusa.com) AVer has released the TabChargeCT2 charge cart solution, which can hold up to 40 Chromebooks, iPads, Android or Windows tablets, lap...

VoiceLift with Instant Alert and Emergency Video Monitoring

(www.extron.com) The Instant Alert function of the Extron VoiceLift Microphone, combined with a PoleVault, WallVault, or PlenumVault classroom AV sys...

SMART Board 6065

(www.smarttech.com) The SMART Board 6065 is an ultra HD, 4K interactive flat panel that offers collaborative capabilities while ensuring lessons run s...

Gaggle Unity Partner Program

(www.gaggle.net) The new Gaggle Unity Partner Program provides free data integration services for all educational technology vendors. Through the Gagg...

Waterford Early Learning, Reading, Math & Science

(www.waterford.org) Waterford Early Learning Cloud can be used at home or to supplement lessons in classrooms. It can also be used for individual adap...

NetSupport School

(www.netsupportschool.com) The latest version of NetSupport School allows teachers to monitor and collaborate with any mix of technology. An enhanced ...

Camtasia

(www.techsmith.com/camtasia) TechSmith’s Camtasia gives teachers the tools to record lessons, create videos, and engage their audiences. Educato...

Panasonic 3E

(www.panasonic.com) Intel has teamed up with Panasonic to announce the Panasonic 3E, which uses the Intel Education 2-in-1 reference design. Designed ...