Revolution Lullabye

November 18, 2014

Jamieson, Reading and Engaging Sources: What Students’ Use of Sources Reveals about Advanced Reading Skills

Jamieson, Sandra. “Reading and Engaging Sources: What Students’ Use of Sources Reveals About Advanced Reading Skills.” Across the Disciplines 10.4 (11 December 2013). Web.

Jamieson uses data from the Citation Project and research on student reading skills and source-based writing from 1985 to the present to argue for revised pedagogies in first-year writing courses and beyond that help students acquire the advanced reading skills they need to successfully write source-based research papers. Jamieson contends that college faculty assume students have more sophisticated reading skills than they actually do, and she shows through an analysis of the Citation Project data that students are often working with sources shallowly and on the sentence level.

Jamieson argues that students’ reading difficulties are not the result of Internet-based reading habits; rather, she questions whether the students profiled in earlier research studies in the 1980s and 1990s ever had strong, consistent reading habits.

Jamieson suggests that the traditional research paper, assigned in a majority of first-year writing courses in US colleges and universities, be reframed in order to help students read more deeply, thoroughly, and critically. Instead of asking students to search for and synthesize a dozen or more sources, Jamieson points out that the goals of synthesis and research could be achieved by asking students to write a research paper that includes common course readings and extends the conversation with two carefully-selected outside sources. Jamieson argues that this approach could help instructors focus on teaching reading strategies and summary skills.

Quotable Quotes

“It is my contention that it is an error to assume that the goals instructors believe are being fulfilled by reading are actually the goals their students set out to fulfill by reading. This error leads to additional erroneous assumptions about how and why students read, assumptions that obscure the skills and practices that writing courses across the curriculum should be teaching.”

“Shirley is the student who lives in our collective imagination so strongly that what we believe to be her skills and needs shape curriculum, assignments, information literacy programs, and academic integrity policies.”

“Since I have begun paying systematic attention to the ways students use sources in researched papers, though, I have come to suspect that Shirley never existed. I do not believe that in 1990 there were many college sophomores who were able to read and engage with sources in the way we believed they could. And I don’t believe their children can do so today. This has huge implications for the way we teach and assess student writing and the way we assign and guide student reading. Indeed, I believe it challenges us to entirely rethink our pedagogy and expectations across the curriculum.”

Citation Project data and earlier research “specifically points to the possibility…that first-year writers have uneven success in reading and writing from sources, even from one sentence to the next.”

makes a distinction between misuse of sources and plagiarism: “such source misuse requires a pedagogical intervention rather than judicial action, although I do not mean to in any way minimize the seriousness of the problem by making this recommendation.”

“So, we need to take a second look at Ashley and her peers, a group of students who might be considered the poster children of the first-year writers the Citation Project multi-institutional research has uncovered: well-meaning students who are often anxious about correct citation, sometimes but not always able to paraphrase correctly, and sometimes but not always able to identify relevant sources. These students rarely analyze or engage with the sources they cite and tend to simplify the arguments within them…Viewing this data in the context of research on the reading abilities of students from a generation before them challenges popular assumptions about the laziness of the ‘Google generation’ and emphasizes the need for new responses.”

“In order to engage with our students in this way, instructors will benefit from a less-is-more philosophy. If students are all assigned to read the same sources, summarize them and place them into dialogue with each other, they can evaluate each other’s work and understand that not all summaries are the same.”

“However, if we develop pro-active pedagogies designed to increase the abilities of our students to engage with texts and their understanding of how texts work in general and as sources within academic texts, we may actually avoid the necessity of developing reactive pedagogies to respond to patch writing and other misuse of sources. That seems like a very fine reading goal for us and our students to work toward.”

Notable Notes

Margaret Kantz (1990) published a study focused on “a typical college sophomore” (qtd. in Kantz) named “Shirely.” Jamieson introduces a typical sophomore of 2012, “Ashley,” who could be Shirley’s daughter. Jamieson argues that their problems writing with sources and reading with sources are largely the same, unaddressed in college pedagogy for over twenty years.

Uses Mary Lynch Kennedy’s 1985 study of students writing with sources

Great overview of studies of student reading, writing with and from sources from 1985 through today

explains the methodology of the Citation Project – coding for source use, frequency of source citation, page of source that was cited, type of source, etc. Definitions of the different kinds of source use: 1. direct copying, cited but not marked as quotation; 2. direct copying, cited and marked as a quotation; 3. patch writing; 4. paraphrasing; 5. summarizing

when students write from sources, they are not engaging with whole-text arguments

students need more than one year to acquire consistent, expert reading skills

students often read for research papers with the goal of retrieving information from sources, not synthesizing ideas or understanding the larger conversation

students have trouble transferring reading, summary skills into a larger research paper

Citation Project data:

  • only 6.3% of student papers contained summary; 91.4% of the student papers used quotation
  • 77.4% of all citations were from the first 3 pages of the source; 9.4% were from page 8 or later
  • 56.5% of sources were cited once, 76.1% were cited twice

few college writing assignments (from those collected in research studies about college writing assignments across the disciplines) have explicit guidance on how to read, the goals of reading, how to use sources.

 

November 17, 2014

Odom, Not Just for Writing Anymore: What WAC Can Teach Us about Reading to Learn

Odom, Mary Lou. “Not Just for Writing Anymore: What WAC Can Teach Us about Reading to Learn.” Across the Disciplines 10.4 (11 December 2013). Web.

Odom argues that in order to improve students’ reading skills, faculty should adopt some of the pedagogical practices that have worked in writing-across-the-curriculum initiatives. Odom bases her argument on a three-year study of her institution’s WAC program. She looks at student course feedback and reflections from the WAC faculty (called WAC fellows) to describe pedagogical strategies that did work and that did not work to improve students’ reading skills. She shows that just merely asking students to read does not mean they will read well or learn what the faculty want them to learn from the reading.

Among the pedagogical strategies that worked to improve students’ reading were explaining to students the disciplinary conventions of a discipline-specific reading, asking students to engage with a reading on a personal level, and asking students to make connections between the reading they were assigned to read and either other readings or current events. Odom points out that all these strategies are also principles of effective WAC teaching. Among the strategies that did not work was using writing in the classroom or in electronic discussion boards to merely check that students had done the reading. Faculty complained that students in these forums rarely engaged with the texts beyond a cursory level.

Odom argues that problems in student writing can often be traced to students’ poor reading skills, and points out that reading is rarely taught beyond the elementary level: faculty assume students have the reading skills necessary to succeed in college. Reading in the disciplines is as invisible as writing in the disciplines once was, Odom contends, and she suggests that taking a WAC approach might solve this problem and better equip students with the critical reading skills they need to succeed in college and fully participate in contemporary civic life. In order for this to work, faculty need to be willing to reconsider how they ask students to read and what they ask students to do with the reading that they do.

Quotable Quotes

“It has been my experience that when we talk about student literacy struggles and practices in higher education, writing is talked about more frequently, more specifically, and with greater urgency than reading.”

“Reading instruction can be, particularly for faculty who want to move on and teach other content, unintentionally yet easily ignored.”

“Few and far between are the classes that do not incorporate or depend on reading, although reading skills cease to be taught or assessed.”

“Reading has in many ways become an invisible component of academic literacy” – it is not seen as the problem by faculty or students.

“Indeed perhaps the best reason efforts to rethink student reading should look to writing across the curriculum strategies is the WAC movement’s broad goal of improving not just student writing but student learning.”

“In sum, the issue of student reading is more than just complex; it is characterized by a transparency that renders it too easily and too often overlooked. Explicit reading instruction tapers off precipitously after elementary school, and students, teachers, and testing then tend to focus on the texts being read rather than the strategies used to read them. Just as texts alone do not provide meaning in isolation, the act of assigning texts alone does not guarantee that students will read. It is no surprise, therefore, that faculty dissatisfaction with student reading is vocal and widespread across the disciplines. When looking for ways to address this challenge, WAC, already proven to be a transformative force for teachers when it comes to writing, is a natural place to turn. Just as writing across the curriculum encourages faculty to consider the ways they ask students to write, efforts at improving student reading must begin with a conscious awareness that we ask and expect students to read in particular ways that may not always be familiar to them.”

“Our choices as teachers have very real consequences regarding how or if students read.”

How faculty can encourage better student reading across the disciplines: “First and foremost, faculty must see that they have a role – beyond simply assigning texts – to play in student reading behavior. Second, at the heart of this role must be a clear sense of the goals faculty have for student reading as well as a willingness to share those goals with students. Third, faculty must be willing to provide guidance for students reading complex, discipline-specific texts. Such guidance may come in the form of explicit conversation about disciplinary conventions and practices, but more often than not it can be conveyed in thoughtful, authentic assignments that students can connect to on an either a personal or ‘real world’ level. Adherence to these principles will not solve all the challenges of student reading; they can, however, begin conversations and initiate practices about reading that are long overdue.”

Notable Notes

research to look at: Newkirk (2013); Joliffe and Harl (2008); Horning (2007)

When faculty point to a problem in student writing, do they realize that this may be, at its core, a reading problem that is contributing to the lack of student learning?

Reading is an “assumed ability” as writing was in the 1960s and 1970s before composition studies challenged that paradigm (Mina Shaughnessy et al) – writing was shown to be far more complex than what students or faculty assumed.

Research shows that there is big discrepancy between what faculty assume students are doing as they read and what students are actually doing.

faculty have “a rather uncomplicated view of how writing and reading might work together,” such as the belief that merely asking students to write about the readings they read will result in critical engagement with those texts.

problem with assigning writing merely to assess or check that students have completed a reading (“quiz/coercion approach”), “reading compliance”

Freedman, “Reading to Write” in East Asian Studies

Freedman, Leora. “‘Reading to Write’ in East Asian Studies.” Across the Disciplines 10:4 (11 December 2013). Web.

Freedman describes how teaching students specific reading strategies, many developed for English language learners, can help both ELL and native-English speaking students read disciplinary-specific texts better. She describes an partnership at her institution, the University of Toronto, between the East Asian Studies department and the English Language Learning Program that used TA-led discussion sessions to help students in introductory-level East Asian Studies courses develop stronger reading strategies and skills. The TAs taught students specific reading techniques, asked students to apply those techniques on other texts in the course, and asked students to write several low-stakes writing assignments, like reading responses and summaries, that gauged students’ reading comprehension levels. Freedman claims that given feedback from the students, TAs, and faculty involved in this partnership, that students seem to understand the course material more deeply and their writing seems to be improved. Freedman argues that reading pedagogy belongs at the college level for all students.

Quotable Quotes

“Linguistic development, like students’ intellectual development in general, is often uneven and non-linear. Students need to understand that successful performance in academic writing, which may be a more immediate goal, is linked to efforts in other areas which are often invisible to the people marking their papers. (e.g. a grader will comment on an overly general sentence, and it will be identified as a writing problem, but the same grader may not comment on or necessarily perceive the student’s vague grasp of the reading material; the grade is given officially for the quality of the writing).”

“Reading was seen as the most fundamental area to address, underlying the difficulties many of the students have with research, writing, vocabulary, and speaking.”

Notable Notes

need to change the institutional culture around reading – it is not remedial education, but something that is tied to students’ writing and critical thinking

TAs led weekly sessions in each 12-week term (fall, spring) to 25 students. The sessions complemented the lectures (200 students in the lecture.)

low-stakes writing assignments used to gauge reading comprehension included writing an account of previewing strategies, writing summaries, writing informal responses in preparation for a bigger, critical argumentative/analytical paper

TAs used a technique dubbed “question-based active reading discussion” where they came to the sessions with prepared questions, a mix of comprehension and more critical analysis to lead small group discussion

Faculty and TAs noticed less patch writing, less plagiarism in the students’ writing

Reading techniques taught in the TA-led sessions:

  • previewing
  • skimming and scanning
  • active reading
  • learning vocabulary from context clues
  • summarizing
  • distinguishing an author’s opinion from the opinion of a cited source
  • distinguishing between argument and information
  • how information is used in an argument
  • visual mapping of an article

October 29, 2014

Horning, Where to Put the Manicules

Horning, Alice S. “Where to Put the Manicules: A Theory of Expert Reading.” Across the Disciplines 8.2 (October 2011). Web. 29 October 2014.

Horning argues that expert readers are “meta-readers”: they have a specific set of awarenesses and skills that distinguish them from novice readers. She presents this meta-cognitive theory of expert readers and argues that in order to be successful, students need to acquire the particular abilities and skills of expert readers through direct modeling and scaffolded instruction. Knowing what expert readers do as they read helps faculty develop specific instructional methods and goals for the needs of novice-reader students. Horning draws on research in education, literacy, and writing studies as well as specific examples from her own teaching, when she asked students to complete reading guides and do a book review assignment.

Quotable Quotes

“Part of what makes me a good reader is that I know what to mark and where to put the little hands. It is this ability and related skills in text processing, analysis, evaluation and application that distinguish expert from novice readers. A theory of readers’ awarenesses and skills accounts for experts’ appropriate placement of their manacles; the theory reveals the abilities student novices lack and urgently need to develop in order to be successful in any major in college and in their personal and professional lives” (1).

“The theory proposes that expert readers are meta-readers, drawing on the meta-cognitive view for its base. The prefix ‘meta’ is drawn from the Greek, according to the dictionary (‘meta,’ def. 1, 1966). It means after, along with, beyond, among, behind. Experts are able to do things with texts as they read, among the ideas presented and beyond them, so that behind, after, and beyond the reading, they are abel to get the essential meaning of a text. They can then analyze, synthesize, evaluate and apply, that is, engage with the text as expert readers.”

“Most faculty don’t aim to help students become expert readers, at least not in introductory or general education courses. Instead, to achieve ordinary instructional goals, most faculty want students to DO the reading and get concepts and content that connect with the rest of their learning in the course.”

“Expert readers, then, have both awareness and skill that allows them to read informational prose quickly and efficiently.”

Notable Notes

the awarenesses of meta-readers

  1. meta-textual awareness (organization, structure of a text)
  2. meta-contextual awareness (how the text is part of a larger conversation in the field, how it fits into a topic, influence of author/time/place)
  3. meta-linguistic awareness (the language of a text, including disciplinary jargon, diction, tone, structure)

the skills of meta-readers

  1. skills in analysis (reading quickly, selectively, able to pick out important information, depends on strong vocabulary knowledge in that discipline)
  2. skills in synthesis (can see the relationships between the text being read and other texts, these readers read widely and often, draw inferences, see larger concepts)
  3. skills in evaluation (can critically evaluate the texts they read – authority, currency, bias, relevancy, accuracy)
  4. skills in application (know when and how to use the information that they read – whole arguments, specific facts or evidence – can use texts for their own purposes)

manicules are little hands used in medieval text marking to note passages that are interesting/important – what was important or interesting depended on the individual reader (readers read differently)

focus on reading informational prose text

uses her own definition (Horning, 2007) of expert literacy: “Expert literacy is best defined as the psycholinguistic processes of getting meaning from or putting meaning into print and/or sound, images, and movement, on a page or screen, used for the purposes of analysis, synthesis, evaluation and application; these process develop through formal schooling and beyond it, at home and at work, in childhood and across the lifespan and are essential to human functioning in a democratic society”

Harold Herber, Teaching Reading in the Content Areas (1978)

uses an example about how she taught her students to read an experimental research report – understanding the goals and information presented in each section, how the report follows APA

Linda Nilson, Teaching at its Best (2010) – argues that students don’t do the reading that’s assigned to them not because they don’t want to but because they don’t know how too. Nilson argues that teachers need to help students develop strategies for reading the texts that are assigned, marking texts, etc.

David Jolliffe and Allison Harl’s 2008 study published in College English on how novice readers read and what they need to help them be better readers

Charles Bazerman’s 1985 study published in Written Communication of how expert readers read – “Physicists Reading Physics”, argues for the importance of context in expert reading

October 23, 2014

Morgan and Pytash, Preparing Preservice Teachers to Become Teachers of Writing: A 20-Year Review of the Research Literature

Morgan, Denise N. and Kristine E. Pytash. “Preparing Preservice Teachers to Become Teachers of Writing; A 20-Year Review of the Research Literature.” English Education 47.1 (October 2014): 6-37. Print.

Morgan and Pytash, in their review of the 31 published peer-reviewed research studies focused on preparing preservice teachers (PST) to teach writing, argue for an explicit focus on writing teacher preparation in undergraduate teacher education programs. They reiterate the National Commission on Writing’s recommendation for PSTs to have a writing pedagogy methods course in their undergraduate teacher preparation.

Morgan and Pytash organized the 31 studies they found in four thematic categories: 1. studies that focused on PST’s attitudes and beliefs toward writing; 2. studies that focused on PST’s interactions with student writers and writing; 3. studies that looked at PST’s influential experiences in methods courses that expanded their understanding of how to think and read as a writer; and 4. studies that looked at how PST applied what they had (or had not) learned in their methods courses about the teaching of writing in their student teaching and first few years of teaching.

Morgan and Pytash contend that the teaching of reading and the teaching of literature overshadow the teaching of writing, and they argue that it is time, especially in the advent of the CCSS, to rebalance the focus in teacher preparation coursework and in K-12 language arts classrooms. They also point out that there is a need for further research in how PSTs learn and enact the teaching of writing, pointing out that the literature available on how inservice teachers learn and enact the teaching of writing through venues such as the National Writing Project do not address the same needs and concerns as PSTs and beginning teachers. They call for further, longitudinal, cross-institutional research studies that can explore what kinds of concepts and practices learned in methods coursework helps PSTs negotiate both their past experiences as student writers and their current school contexts as they teach writing to whole classes of students.

Quotable Quotes

Goal of the research review: “To develop a coherent picture of the research concerning PSTs’ preparation to teach writing” (7)

“It is critical that PSTs enter the classroom, whether as student teachers or in their early careers, with strong theoretical and pedagogical knowledge for teaching writing” (7).

“Writing is a complex, nuanced, and layered activity. Teaching writing is even more so as teachers are challenged with making visible the in-the-head processes associated with writing, often to 30 students at a time, each with individual writing processes. To make instructionally sound decisions, teachers need to develop a conceptual framework that will guide their interactions with students. PSTs should be able to look to teacher education for that initial guidance” (33).

“Without writing methods coursework, the topic of writing is ‘sandwiched in’ the semester, with often just a few class periods devoted to teaching writing and the rest devoted to teaching reading. This provides PSTs with, at best, surface understandings of and experiences with teaching writing” (30).

“Now more than ever teacher educators are faced with the critical need to prepare PSTs to become confident and capable teachers of writers. With the current national focus on writing instruction in schools due to the adoption of the Common Core State Standards (National Governors Association Center for Best Practices & Council of Chief State School Officers, 2010) teachers must be prepared to enter the profession with strong pedagogical knowledge of how to teach writing and with a sense of their own writing self-efficacy. Just as schools at the K-12 level are being required to increase their writing instruction, universities should consider increasing the amount of writing preparation PSTs receive. Reading coursework cannot dominate literacy teacher education preparation” (28).

The literature review shows there is “a crucial need for PSTs to experience methods courses that provide explicit, consistent, and thoughtful writing experiences” (28)

Notable Notes

what sorts of preparation do PST get for designing and teaching digital and multimodal writing? (32)

future research project could be analyzing the syllabi of writing methods courses (repeat a similar study done by Smagorinsky and Whiting in 1995)

the methods course for teaching writing must provide PST with a conceptual framework to teach writing and practical strategies to implement in the classroom (29)

there is a divide between what is taught in methods courses at the university and what is implemented in K-12 classrooms – more studies needed about the transition of PSTs to the classroom to see what causes this (29)

studies done with experienced or inservice teachers are helpful, but they do not fully address the particular challenges faced by PST who are teaching writing (30)

without a methods course (or without a strong one), PSTs and beginning teachers revert to teaching as they were taught (27)

good methods courses give PST a reference of both theoretical concepts and hands-on practical strategies (26)

Question about methods courses that are run as modeling/writer workshops: “Is ‘living through’ a writing workshop and all it entails a significant method for learning how to teach writing?” (23) – the difference between being a writer and being a writing teacher (23)

Questions about methods courses that ask students to work one-on-one with student writers: How does working one-on-one with a student writer help a PST learn how to teach writing to a whole class? (19) If the PST only focuses on providing feedback, how do they learn how to create assignments and teach writing before and during the drafting stage? (19)

PSTs who have negative self-images as writers end up not valuing writing in their classroom and/or providing poor writing instruction (14)

Their methods: search databases using key word search terms (“systematic browsing”) and “footnote chasing” (9)

October 9, 2014

Drucker, Graphesis: Visual Forms of Knowledge Production

Drucker, Johanna. Graphesis: Visual Forms of Knowledge Production. Cambridge, MA: Harvard UP, 2014. Print. 

Drucker’s project in this book is to show how visual forms of knowledge not only display knowledge but create and generate knowledge. Drucker argues for humanist graphical knowledge: visual forms of knowledge that account for complexity, not simplicity, and that understand information as constructed, not context-less, given, or value-less. Drucker crosses multiple disciplinary boundaries as she traces the history of visual and graphical forms, showing how different categories of visual forms of knowledge situate knowledge and make arguments about hierarchies, relationships, and individual agencies. Her book juxtaposes her text and her argument with visual forms of knowledge from ancient hieroglyphics and stone carvings to screenshots of digital texts and maps. One of her goals is to show how the informational graphics and the interfaces that have become such an intertwined part of our everyday experience are arguments themselves, designed for specific purposes. She works in this book to bring these more invisible visual elements to the forefront and analyze them in critical, humanistic terms.

Quotable Quotes

“Humanists work with fragmentary evidence when researching cultural materials. They produce interpretations, not repeatable results. We have to find graphical conventions to show uncertainty and ambiguity in digital models, not just because these are conditions of knowledge production in our disciplines, but because the very model of knowledge itself that gets embodied in the process has values whose cultural authority matters very much” (191).

Writing and composition in a networked and digital world: “In spite of the networked condition of textual production, the design of digital platforms for daily use has hardly begun to accommodate the imaginative possibilities of constellationary composition, graphic interpretation, and diagrammatic writing…Very few acts of composition are diagrammatic, constellationary, or associative. Fewer still are visual or spatial. The predominant modes of composition in digital displays have remained quite linear, even when they have combinatoric or modular underpinnings” (183).

the future of humanistic interface: “More attention to the acts of producing and less emphasis on the product, the creation of an interface that is meant to expose and support the activity of interpretation, rather than to display finished forms, would be a good starting place” (179).

The graphical interface (our screen) is an argument, not a thing: “We ignore its graphicality, its constructedness, the very features that support its operations and make it work. We look at the interface as a thing, a representation of computational processes that make it convenient for us to interact with what is ‘really’ happening. But the interface is a mediating structure that supports behaviors and tasks. It is a space between human users and procedures that happen according to complicated protocols. But it also disciplines, constrains, and determines what can be done in any digital environment” (138-139).

“Perhaps the most striking feature distinguishing humanistic, interpretative, and constructivist graphical expressions from realist statistical graphics is that the curves, bars, columns, percentage values would not always be represented as discrete bounded entities, but as conditional expressions of interpretative parameters – a kind of visual fuzzy logic or graphical complexity. Thus their edges might be permeable, lines dotted and broken, dots and points might vary in size and scale or degree of ambiguity in placement. These graphical strategies express interpreted knowledge, situated and partial, rather than complete.” (132)

“The rendering of statistical information into graphical form gives it a simplicity and legibility that hides every aspect of the original interpretative framework on which the statistical data were constructed. The graphical force conceals what the statistician knows very well – that no “data” pre-exist their parameterization. Data are capta, taken not given, constructed as an interpretation of the phenomenal world, not inherent in it” (128)

“Maps, like other graphic conventions, construct normative notions about time, space, and experience that become so familiar that we take them for accurate representations rather than constructions” (82).

“Visualization formats exist independent of particular media. Calendars don’t have to be scratched into stone and bar charts don’t need to be rendered by engravers with finely tooled burins – any more than scatter plots have to be generated computationally.” (67)

“The interpretative acts that become encoded in graphical formats may disappear from final view in the process, but they are the persistent ghosts in the visual scheme, rhetorical elements of generative artifacts. The challenge is to develop a terminology for the rhetorical iconography of graphical forms that is grounded in the features of spatialized relations such as hierarchy, juxtaposition, and proximity (66).

The forms of our visual communication are arguments themselves: the forms were culturally-constructed and still contain that history: “We are still Babylonians, in our use of the calendar, our measure of days, hours, and minutes, just as we remain classical in our logic, medieval in our classification systems, and modern in our use of measurements expressed in rational form. Each of the many schematic conventions in daily use and the frequently unquestioned appearance in our documents and websites replicate ideologies in graphics” (65).

“Though we often use visual means to make images of invisible things, much of contemporary life simply can’t be shown. The workings of power, the force of ideology, the transmission of values, and other abstract ideas have no specific visual form, even if they work through a material social world.

“Speed, scale, complexity, and the infrastructure in place and at work in systems of communications, production, distribution, much scientific discovery, and humanistic thought simply cannot be made apparent in visual images. But an endless stream of visualizations continues to turn complex phenomena into images, reifying abstractions, turning them into objects to be seen” (22-23).

Goal: “the urgency of finding critical languages for the graphics that predominate in the networked environment” (17)

Methodology: “draw on the rich history of graphical forms of knowledge production that are the legacy of manuscript and print artifacts as well as digital media works in the arts and applied realms” (17)

“Even though our relation to experience is often (and increasingly) mediated by visual formats and images, the bias against visual forms of knowledge production is longstanding in our culture. Logocentric and numero-centric attitudes prevail” (16).

Notable Notes

Introduction

Key terms in the introduction

information graphics = “visualizations based on abstractions of statistical data…Visualizations are always interpretations – data does not have an inherent visual that merely gives rise to a graphic expression” (7)

graphical user interface – “dominant feature of screens in all shapes and sizes…In a very real, practical sense we carry on most of our personal and professional business through interfaces. Knowing how interface structures our relation to knowledge and behavior is essential.” (8)

Visual epistemology – “ways of knowing that are presented and processed visually” (8)

Language of form – “a systematic approach to graphic expression as a means as well as an object of study” (9)

Image, Interpretation, and Interface

Looks at different theoretical and methodological ways of understanding visual forms as knowledge, cross disciplinary and across history

There have been efforts in the late 19th, 20th, and 21st century to create a language for graphics – formal rules and descriptions (18)

We use visualization a lot, but it is still treated as less than, suspect (23) Maybe in part because there is no universal grammar of visualization – visuals by their nature are not consistent, don’t hold meaning with “stable, fixed, and finite rules” like words/language/mathematics does. (24)

In science, visuals were used to represent and record knowledge, not produce knowledge (26-27)

Change in the late nineteenth century (Eugene Guillamume, industrial revolution) from a graphic language based on the human body (fine arts) to one based on geometry (industrial design, design to be produced and reproduced through mechanical means) (31).

Growth of formal education/principles/methods in graphic and visual design in the 20th century, modernism (35)

20th century – rise of the use of visual/graphical/statistical displays of knowledge

Interpreting Visualization/Visualizing Interpretation

The histories of visual forms of knowledge

Forms that Drucker investigates: 1. Timekeeping (star charts, calendars, timelines; 2. Space-making (maps); 3. Administration and record-keeping (tables, charts, grids, flow charts); 4. Trees of knowledge (family trees, network diagrams, evolutionary diagrams, division and hierarchy and relationships); 5. Knowledge generators (diagrams, volvelles, Venn diagrams; 6. Dynamic systems (model processes and events, weather maps and meteorology, fluid dynamics, chaos theory and systems mapping

Distinction between “static” representations (those visual representations that are merely representations of information) and “dynamic” representations (those visual representations that can create or generate knowledge) (65).

Interface and Interpretation

Looks at digital and book interface as encoding and producing knowledge, explores what a humanistic interface design might be and entail.

Afterword

Call for new rhetorics, grammars of the digital media age

August 27, 2014

Newton, Value-added Modeling of Teacher Effectiveness

Newton, Xiaoxia A, et al. “Value-added Modeling of Teacher Effectiveness: Exploration of Stability across Models and Contexts.” Educational Policy Analysis Archives, 18 (23). 2010. Print.

Newton et al investigate measures of teacher effectiveness based on VAM (value-added modeling) to show that these measures, based on in large part on measured student learning gains, are not stable and can vary significantly across years, classes, and contexts. The study focused on 250 mathematics and ELA teachers and approximately 3500 students they taught at six high schools in the San Francisco Bay Area. The researchers argue that measures of teacher effectiveness based solely on student performance scores (those measures that don’t take into account student demographics and other differences) cannot be relied on to get a true understanding of a teacher’s effectiveness because so many other unstable variables impact those student test scores. Models of teacher evaluation that rely heavily on student performance scores can negatively impact teachers who teach in high-need areas. This is especially true with teachers who teach disadvantaged students or students with limited English proficiency.

Quotable Quotes

“Growing interest in tying student learning to educational accountability has stimulated unprecedented efforts to use high-stakes tests in the evaluation of individual teachers and schools. In the current policy climate, pupil learning is increasingly conceptualized as standardized test score gains, and methods to assess teacher effectiveness are increasingly grounded in what is broadly called value-added analysis. The inferences about individual teacher effects many policymakers would like to draw from such value-added analyses rely on very strong and often untestable statistical assumptions about the roles of schools, multiple teachers, student aptitudes and efforts, homes and families in producing measured student learning gains. These inferences also depend on sometimes problematic conceptualizations of learning embodied in assessments used to evaluate gains. Despite the statistical and measurement challenges, value-added models for estimating teacher effects have gained increasing attention among policy makers due to their conceptual and methodological appeal” (3).

Differences in teacher effectiveness in different classes: “An implicit assumption in the value-added literature is that measured teacher effects are stable across courses and time. Previous studies have found that this assumption is not generally met for estimates across different years. There has been less attention to the question of teacher effects across courses. One might expect that teacher effects could vary across courses for any number of reasons. For instance, a mathematics teacher might be better at teaching algebra than geometry, or an English teacher might be better at teaching literature than composition. Teachers may also be differentially adept at teaching new English learners, for example, or 2nd graders rather than 5th graders. It is also possible that, since tracking practices are common, especially at the secondary level, different classes might imply different student compositions, which can impact a teacher’s value-added rankings, as we saw in the previous section.” (12)

“the analyses suggested that teachers’ rankings were higher for courses with “high-track” students than for untracked classes” (13).

“These examples and our general findings highlight the challenge inherent in developing a value-added model that adequately captures teacher effectiveness, when teacher effectiveness itself is a variable with high levels of instability across contexts (i.e., types of courses, types of students, and year) as well as statistical models that make different assumptions about what exogenous influences should be controlled. Further, the contexts associated with instability are themselves highly relevant to the notion of teacher effectiveness” (16).

“The default assumption in the value-added literature is that teacher effects are a fixed construct that is independent of the context of teaching (e.g., types of courses, student demographic compositions in a class, and so on) and stable across time. Our empirical exploration of teacher effectiveness rankings across different courses and years suggested that this assumption is not consistent with reality. In particular, the fact that an individual student’s learning gain is heavily dependent upon who else is in his or her class, apart from the teacher, raises questions about our ability to isolate a teacher’s effect on an individual student’s learning, no matter how sophisticated the statistical model might be” (18).

“Our correlations indicate that even in the most complex models, a substantial portion of the variation in teacher rankings is attributable to selected student characteristics, which is troubling given the momentum gathering around VAM as a policy proposal. Even more troubling is the possibility that policies that rely primarily on student test score gains to evaluate teachers – especially when student characteristics are not taken into account at all (as in some widely used models) — could create disincentives for teachers to want to work with those students with the greatest needs” (18).

“Our conclusion is NOT that teachers do not matter. Rather, our findings suggest that we simply cannot measure precisely how much individual teachers contribute to student learning, given the other factors involved in the learning process, the current limitations of tests and methods, and the current state of our educational system” (20). 

Notable Notes

The problem of variables impacting the calculation of teacher effectiveness: the students’ background (socioeconomic, cultural, disability, language diversity), the effects of the school environment, how teachers perform year-to-year, the curriculum

VAM makes assumptions that schools, teachers, students, parents, curriculum, class sizes, school resources, and communities are similar.

The variables the researchers collected and measured included CST math or ELA scaled test scores, students’ prior test scores for both average and accelerated students, students’ race/ethnicity, gender, and ELL status, students’ parents’ educational level and participation in free or reduced school lunch, and individual school differences. Tries to look at the issue longitudinally by looking at student prior achievement (7). They were able to link students to teachers (8).

Darling-Hammond, Creating a Comprehensive System for Evaluating and Supporting Effective Teaching

Darling-Hammond, Linda. Creating a Comprehensive System for Evaluating and Supporting Effective Teaching. Stanford, CA: Stanford Center for Opportunity Policy in Education. 2012. Print.

This report argues for the development of an aligned, comprehensive K-12 teacher evaluation system that supports students, teachers, curriculum, schools, and communities by being an integral part of a larger teaching and learning system. The report outlines seven “best practices” for creating teacher evaluation systems. Teacher evaluation systems, the report argued, should serve teachers at all stages of their careers and be used for critical decisions at the licensing, hiring, and granting tenure/merit stages. Teacher evaluation systems need to be directly connected to ongoing teacher professional development and encourage collaboration among teachers, not competition. The report makes a distinction between “teacher quality” and “teaching quality,” arguing that helping teachers improve their teaching practices across different kinds of students, contexts, and curriculum will result in better teaching and better student learning. The report includes examples of district and state evaluation systems and procedures that it believes serves as models and starting points for creating a comprehensive teacher evaluation system.

 

Quotable Quotes

“Today, much attention is focused on identifying and removing poor teachers. But what we really need is a conception of teacher evaluation as part of a teaching and learning system that supports continuous improvement, both for individual teachers and for the profession as a whole. Such a system should enhance teacher learning and skill, while at the same time ensuring that teachers who are retained and tenured can effectively support student learning throughout their careers” (1-2)

The problem: “Virtually everyone agrees that teacher evaluation in the United States needs an overhaul. Existing systems rarely help teachers improve or clearly distinguish those who are succeeding from those who are struggling. The tools that are used do not always represent the important features of good teaching. Criteria and methods for evaluating teachers vary substantially across districts and at key career milestones—when teachers complete pre-service teacher education, become initially licensed, are considered for tenure, and receive a professional license.

A comprehensive system should address these purposes in a coherent way and provide support for supervision and professional learning, identify teachers who need additional assistance and—in some cases—a change of career, and recognize expert teachers who can contribute to the learning of their peers.” (i)

Distinction between teacher quality and teaching quality: “Teacher quality might be thought of as the bundle of personal traits, skills, and understandings an individual brings to teaching, including dispositions to behave in certain ways. Teaching quality refers to strong instruction that enables a wide range of students to learn. Teaching quality is in part a function of teacher quality— teachers’ knowledge, skills, and dispositions—but it is also strongly influenced by the context of instruction: the curriculum and assessment system; the “fit” between teachers’ qualifications and what they are asked to teach; and teaching conditions, such as time, class size, facilities, and materials. If teaching is to be effective, policymakers must address the teaching and learning environment as well as the capacity of individual teachers” (i).

Five elements to this teacher evaluation system, as part of a larger teaching and learning system:

  1. “Common statewide standards for teaching that are related to meaningful student learning and are shared across the profession.” These should help direct the preparation of teachers and ongoing professional development (i)
  2. “Performance assessments, based on statewide standards, guiding state function such as teacher preparation, licensure, and advanced certification” – there should be multiple assessments for different points in the profession (initial, mid, advanced) that look at how well teachers can “plan, teach, and assess learning” (ii)
  3. “Local evaluation systems aligned to the same standards, which asses on-the-job teaching based on multiple measures of teaching practice and student learning.” – things like observations, teaching artifacts like lessons plans/assignments, “evidence” of how teachers contribute to their colleagues’ work and student learning (ii) (example on page 11)
  4. “Support structures to ensure trained evaluators, mentoring for teachers who need additional assistance, and fair decisions about personnel actions” – including access to master teacher mentors, fair “governance structures,” and continued resources to maintain the system (ii)
  5. “Aligned professional learning opportunities that support the improvement of teachers and teaching quality” – all kinds of professional development (formal, embedded) that “trigger continuous goal-setting” and “opportunities to share expertise” (ii)

 “To transform systems, incentives should be structured to promote collaboration and knowledge sharing, rather than competition, across organizations” (ii)

“Criteria for an Effective Teacher Evaluation System

“In conclusion, research on successful approaches to teacher evaluation suggests that:

  1. “Teacher evaluation should be based on professional teaching standards and should be sophisticated enough to assess teaching quality across the continuum of development from novice to expert teacher.
  2. “Evaluations should include multi-faceted evidence of teacher practice, student learning, and professional contributions that are considered in an integrated fashion, in relation to one another and to the teaching context. Any assessments used to make judgments about students’ progress should be appropriate for the specific curriculum and students the teacher teaches.
  3. “Evaluators should be knowledgeable about instruction and well trained in the evaluation system, including the process of how to give productive feedback and how to support ongoing learning for teachers. As often as possible, and always at critical decision-making junctures (e.g., tenure or renew- al), the evaluation team should include experts in the specific teaching field.
  4. “Evaluation should be accompanied by useful feedback, and connected to professional development opportunities that are relevant to teachers’ goals and needs, including both formal learning opportunities and peer collaboration, observation, and coaching.
  5. “The evaluation system should value and encourage teacher collaboration, both in the standards and criteria that are used to assess teachers’ work, and in the way results are used to shape professional learning opportunities.
  6. “Expert teachers should be part of the assistance and review process for new teachers and for teachers needing extra assistance. They can provide the additional subject-specific expertise and person-power needed to ensure that intensive and effective assistance is offered and that decisions about tenure and continuation are well grounded.
  7. “Panels of teachers and administrators should oversee the evaluation process to ensure that it is thorough and of high quality, as well as fair and reliable. Such panels have been shown to facilitate more timely and well- grounded personnel decisions that avoid grievances and litigation. Teachers and school leaders should be involved in developing, implementing, and monitoring the system to ensure that it reflects good teaching well, that it operates effectively, that it is tied to useful learning opportunities for teachers, and that it produces valid results.

“Initiatives to measure and improve teaching effectiveness will have the greatest payoff if they stimulate practices known to support student learning and are embedded in systems that also develop greater teaching competence. In this way, policies that create increasingly valid measures of teaching effectiveness—and that create innovative systems for recognizing, developing and utilizing expert teachers—can ultimately help to create a more effective teaching profession” (iii-iv).

 

“Good systems must be designed so that teachers are not penalized for teaching the students who have the greatest educational needs. Rather, they should explicitly seek to provide incentives that recognize and reward teachers who work with challenging students” (24)

Notable Notes 

Need to create a system for evaluating teachers (and developing teaching) that takes into account all the stakeholders at local/state/national levels as well as the curriculum and standards.

The problem with relying on student performance scores to evaluate teaching: a teachers’ scores vary considerably from class-to-class and year-to-year, are affected by and tied directly to the type of students in the classroom (student differences), and the scores themselves are flattened – it’s impossible to discern what exactly impacted student learning: the teacher, the curriculum, the school environment, the home environment? (iii)

Student learning scores can be used in determining teacher effectiveness, but they can’t be the sole indicator and if used, they must be “appropriate for the curriculum and the students being taught” (iii)

Good graphic for representing the three tiers of a teacher career (and the argument to assess and evaluate teachers along these three tiers): initial, professional licensure, experienced/master teacher (7) and an example of New Mexico’s standards-based teacher evaluation system that evaluates teachers at these three tiers (8-9)

discussion of peer-based review of teachers, examples of systems using peer review (28-35)

August 25, 2014

NCTE Position Statement on Teacher Evaluation

NCTE Position Statement on Teacher Evaluation. National Council of Teachers of English. 21 April 2012. Web. 25 August 2014.

This 2012 position statement on K-12 evaluation argues that teacher evaluation is important and necessary way to improve schools, teachers, and student learning. NCTE bases this position statement on the belief that teaching is a complex process that must take into account the socioeconomic, political, cultural, and linguistic contexts of the students teachers teach and the schools and communities that they teach in. The position statement explains that the conversation surrounding teacher evaluation falls into two areas, distinguished by the end purpose of the teacher evaluation. The first purpose is “Test-Based Accountability,” which NCTE defines as using standardized student test scores to rank teachers and identify (and remove) ineffective teachers solely through student test score performance. The second purpose is “Professional-Development-Based Accountability,” which NCTE defines as using teacher evaluation as a way to promote ongoing teacher professional development. Ongoing teacher professional development helps teachers be better by allowing them to continually learn more about their subject matter, pedagogical methods, and their students. This position statement warns that an overreliance on this first kind of teacher evaluation – one based on student test scores – will take the craft out of teaching, resulting in cookie-cutter approaches to student learning and a curriculum focused on testing. The position statement also outlines principles for creating fair and effective evaluations for English Language Arts teachers.

 

Quotable Quotes

Epigraph: “For more than two decades, policymakers have undertaken many and varied reforms to improve schools, ranging from new standards and tests to redesigned schools, new curricula and new governance models. One important lesson from these efforts is the repeated finding that teachers are the fulcrum determining whether any school initiative tips toward success or failure. Every aspect of school reform depends on highly skilled teachers for its success.” – Linda Darling-Hammond, 2010

“NCTE recognizes that quality assurance is an important responsibility of school leaders and accepts that a successful evaluation system must assist school leaders in making major personnel decisions such as retention, tenure, and dismissal. Still, it firmly believes that an overemphasis on accountability rooted in testing sets the bar much too low for school improvement and leads to a curriculum too heavily devoted to test preparation.”

NCTE believes that multifaceted teacher evaluation is a significant component for student, teacher, and school improvement and advocates strongly for a system that emphasizes professional growth. English teachers must continually study their subject along with the craft of teaching in their efforts to make learning happen.”

“Student test scores are unreliable indicators of teacher performance and should play a very small role in evaluation.”

 

Notable Notes

Principles for creating teacher evaluation systems for ELA teachers:

  1. “based on a comprehensive review of effective teaching behaviors”
  2. “relies on a wide range of evidence”
  3. “aligns quality assurance purposes to professional growth”
  4. “is fair and nonthreatening”

Popham, Tough Teacher Evaluation and Formative Assessment

Popham, W. James. “Tough Teacher Evaluation and Formative Assessment: Oil and Water?” Voices from the Middle 21.2 (December 2013): 10-14. Print.

Popham argues that teachers who commit to using formative assessment techniques in their classroom will have better student performance on the new Common Core student assessments, and therefore these teachers, whose evaluations increasingly depend on student performance on high-stakes assessments, will have better evaluations. Popham explains that although the high-stakes state and federal assessments seem to only value summative assessments, students and teachers who regularly do formative assessment do better on these tests. Popham’s article shows how federal policies, such as the 2009 “Race to the Top” initiative and the 2002 No Child Left Behind Act, not only change curriculum and testing but also change teacher evaluation. He explains how teacher evaluation criteria vary considerably from state to state and district to district. Althoguh there is great diversity in the measures and the relative weight of those measures used, Popham insists student performance scores on high-stakes assessments are going to continue being one of the most significant factors used to evaluate teacher performance and effectiveness.

Quotable Quotes

“In short, because students’ achievement will play such a prominent role in almost all states’ teacher-evaluation procedures, and because teachers who employ the formative-assessment process will almost always engender improved achievement in their students, this is precisely the moment when sensible teachers should learn to employ the formative-assessment process. The higher the stakes associated with a given teacher-evaluation system, the greater should be a teacher’s interest in becoming a skilled user of formative assessment. This is a classic “win-win” situation” (14).

Notable Notes

explains formative assessment – not a particular kind of assessment, but a process of using a few or occassional “checks” to determine how well students are learning and to adapt instruction based on that feedback. Describes it as a “means-ends approach” (11)

Analysis of the teacher-evaluation system: is it that simple, really?

Next Page »

The Toni Theme. Create a free website or blog at WordPress.com.

Follow

Get every new post delivered to your Inbox.