Critical Evaluation in the Collaborative Era - Tech Learning

Critical Evaluation in the Collaborative Era

from Technology & Learning What role should a wiki play in authentic research? I began using critical evaluation techniques back in 1995, when I was choosing sites to add to my then-new portal, Kathy Schrock's Guide for Educators. I would look at a potential entry and use a series of analytical
Publish date:

from Technology & Learning

What role should a wiki play in authentic research?

I began using critical evaluation techniques back in 1995, when I was choosing sites to add to my then-new portal, Kathy Schrock's Guide for Educators. I would look at a potential entry and use a series of analytical questions to determine, first, if the content would be useful for teachers, followed by a rather formal process to determine the authority of the author and the validity of the information, and, finally, look at the navigability of the site.

I then created Web site critical evaluation tools for teachers and students to use based on my process—tools that have been used extensively over the years. As social collaborative tools such as blogs and podcasts proliferated, I added new tools to evaluate them. As even newer tools show up on the Web, I investigate them to determine how they can be used in education.

One of the new types of social collaborative tools I feel is useful to support teaching and learning is a wiki. With a wiki, a user creates and posts content, and then anyone else can log in and change or update the content, and all iterations are archived and accessible. For student collaboration, peer editing, note taking, and many other uses, the wiki is a great educational tool. Teachers can easily track student postings and acquisition of knowledge since all of the changes and updates are logged.

However, the multi-creator, informational character of the public wiki defies my ability to critically evaluate the information. One of the largest and best-known wikis is Wikipedia, which touts itself as a "free encyclopedia." I have difficulty, as a library media specialist and an educator, coming up with a process to evaluate the information located on a Wikipedia page. Granted, content creators who are passionate about a topic maintain these pages, but this passion may also lead to biased information. And does passion about a topic also mean the information is valid and reliable?

Since anyone can post content, and anyone can edit the content on a wiki, how do students determine if the information is correct? Do they look at every iteration of the page and try to determine the authority of everyone who edited the information? What about the fact that the creator's real name may not appear anywhere? True, Wikipedia does allow viewers to see all the edits made by other users. So should students then take a look at each editor's summary page to see if that particular user is posting to many Wikipedia pages on similar topics, which may (or may not) indicate he or she is an expert on the topic? The traditional methods of attempting to determine the authority of an author would include looking at the "About the Author" page, conducting a Web search on the author's name to find out how he or she is mentioned by others in the field, and doing a backward search on the author's Web page to see who links to the author's site. How does one complete this task on Wikipedia with so many authors of a single article and no real names?

Even if I go along with the users of Wikipedia who say that it is self-correcting—since so many volunteer "editors" monitor the pages and correct any erroneous information—I would still like to find out a little bit about these "editors" who are creating content with no vetting of their expertise. I did a little research on the Web and located a 2006 Harris Poll study indicating that in the United States, younger people are using the Web more than older people; Internet users are more likely affluent; and the majority of Net users have earned a high school diploma or less. So, the United States "editors" of content in Wikipedia may have one or all of these characteristics. However, Wikipedia reaches the entire world, not just the United States. Since only about 18 percent of the world's population uses the Internet, a potential Wikipedia "editor" is part of a small, select group. What about the expertise of the other 82 percent?

Wikipedia does have guidelines for the addition of content. The most important one is the requirement that information is "verifiable," and it asks the creators to include bibliographic citations to the original content. Why don't our students just conduct their own search, go directly to the original content, and use their own critical evaluation skills to determine if the information on the original site is valid and authoritative and meets their research needs? An argument can be made that, if the user did not know anything about a topic, he or she could use Wikipedia to acquire background information and keywords to begin his or her formal research. I agree that this might be a good use of this wiki. But, then again, the students are gathering the information from a person whom they know nothing about. How does this help them determine the reliability of information presented on topics they know nothing about?

There have been many high-profile cases regarding Wikipedia editors and entries—including a citizen finding erroneous information about himself in Wikipedia, to many noted instances of posting copyrighted information from both print and Web sources, to employees giving false credentials as editors. With a collaborative project this large, high numbers of such incidents might be expected. However, is this collaborative "encyclopedia" the place we want to send students to gather information? Why not have them use primary and secondary sources (not a tertiary source like Wikipedia) to allow them to employ their own critical evaluation skills to determine the authority and validity of information and to draw their own judgments about the relevant facts found in the original source?

Overall, I am most concerned about the creation of content that is "research worthy" by authors I know nothing about in online collaborative environments. Wikipedia is the most noted of these online collaborative tools, but there are many others. I don't have the answer for the best way to treat these tools in educational settings. Should we allow students to use these tools as "sources consulted" but not "sources cited"? How do we teach critical evaluation of information when we have no way to determine authority? I guess I have more questions than answers at this point. I will keep trying to figure it out.

Kathy Schrock is administrator for Technology, Nauset Public Schools, Orleans, MA. Her Web portal is



Collaboration for PD

Tip: There are several tools that you can use for staff development that extend the initial workshop. Podcasting: I think that portions of staff development could be recorded and then podcasted through the workshop's Web site. See the Wikipedia entry on Podcasting or do a Google search for podcast to learn more

The Science of Class Collaboration promo image

The Science of Class Collaboration

It’s safe to say that Bruce Gorrill, Science Department Chair at the 360 student Brewster Academy of Wolfeboro, NH, is a techie. He uses all the latest Web based tools for his classes, such as wikis, podcast, and Ning (see

Using Wikis for Collaborative Note-Taking

Tip: I created an interactive Wiki* for participants to contribute their ideas and reflections during a keynote presentation. The benefit of using a Wiki for this is that after the presentation people will be able to link back to the common Wiki and then out to read and even contribute to any of the note pages from

Evaluating Technology-Based Student Work

The teachers have pledged to incorporate more project-based, technology-infused learning activities in this year's assignments. Now we're struggling with how to evaluate this kind of assignment. What do you suggest? The teachers probably use rubrics to evaluate student projects already. If not, this is a good

Collaborative Writing

Web-based collaborative writing tools offer a simple means to generate text exercises, research reports, and writing assignments in a collaborative mode. The authors discuss how Google Docs, ThinkFree, Zoho Writer, and WriteBoard can jazz up any writing curriculum.

Discovery Education’s Statement on’s Recent Review of the Math Techbook promo image

Discovery Education Streaming Services Enter New Era with Enhanced Content Creation Features and Resources to Deepen Classroom Engagement and Develop Students’ Critical Thinking, Collaboration, and Reasoning Skills

Discovery Education, the leading provider of digital content and professional development for K-12 classrooms,today announced a number of new features will be added to its award-winning Discovery Education Streaming services in the coming weeks.  With these planned enhancements, which are scheduled to go live in August 2017, Discovery Education Streaming is positioned to serve a new generation of teachers and students with resources they can immediately use to deepen students’ engagement in learning and develop pupils’ critical thinking, collaboration, and reasoning skills.

Image placeholder title

Teacher Evaluation Tips

When evaluating teachers, a new book by Robert Marzanoand Michael Toth, Teacher Evaluation That Makes aDifference: A New Model for Teacher Growth and StudentAchievement (ASCD, 2013), offers a variety of tips thatcan be useful to school administrators.