Chapter 23 of 26

Appendix

Appendix

appendix

method

As noted throughout this edition, the content of this book is driven by the data, results, conclusions, discussions, and limitations of the initial two-part study, sometimes referred to as the Hurt Project, that a research team and I conducted from 2001 to early 2004, as well as the added data from the third phase (2004 to 2010). The initial phase of the project has been driven by the data discovered in my role as a substitute teacher from late 2001 to June 2002 in the Glendale Unified School District at Crescenta Valley High School using an ethnographic methodology known as participant-observation. At the same time, a team conducted a thorough literature review of all relevant material, in both popular and academic sources, that served to inform, shape, and nuance these observations and emerging perspectives. The second phase of the project, from the summer of 2002 to spring 2004, consisted of seventeen open-ended conversations with high school juniors and seniors where I sought to gather a new batch of data giving texture and thickness to the observations and literature reviews previously utilized. This is what was reported in the first edition of Hurt. The continuing phase of the project is an ongoing synthesis of observation, interviews, open-ended conversations, and deliberate focus groups that provide additional data to the original results. This phase reveals conclusions that have changed over the past several years, and focuses more specifically on populations and environments that the original study understudied.

The method used for the original Hurt Project and reported in this edition is basically the same integration of participant-observation, literature review, intentional open-ended conversations, focus groups, and occasional interviews. What has changed from the first edition to the second is the level of depth we have explored in the literature review, the intentional investigation and analysis of what we are calling “kids at the margins” (those who either have overwhelming obstacles to healthy development or have been smothered by a tsunami of adult directives), and several more conversations and focus groups with midadolescents that have provided additional and significant insight into how the world is exponentially changing for today’s teenagers.

As in the original edition of Hurt, we are convinced that our results and conclusions generally fall into the category of “grounded theory.” Our hope, therefore, is that other scholars from a variety of disciplines will take what we have seen and go deeper by engaging in the work of understanding how cultural change affects adolescents without a disciplinary bias or a priori assumptions that could keep them from moving this research forward.

The Method

While participant-observation was the initial and motivating strategy used for the study, all of the supporting methodologies we used were integrated in such a way as to bring out the most complete and robust picture of teenagers’ sense of their world and life. While there are a myriad of possible ways to investigate the general sense adolescents share regarding their perception of their reality, what is vital is that any methodology must be able to provide a relatively authentic and honest portrait of those being studied. As Paula Saukko notes, “The worth or validity of [a] project depends on how thoroughly and defensibly or correctly [it] has been done.” This concern has been at the very heart of every aspect of the research process for Hurt and now Hurt 2.0.

As has been stated, the data reported in this edition are the integration of a four-part research process: my role as participant-observer in a high school; a literature review team investigating the issues that emerged from my observation; a series of conversations and focus groups; and finally an ongoing synthesis of these observations, conversations, and focus groups, interaction with new scholarship, and a proactive commitment to dialogue with practitioners and scholars, even those who have publicly or even privately dismissed the findings from the first edition of Hurt. In other words, the Hurt Project is an ongoing dialogue with scholars, parents, youth advocates, educators, social scientists, and a wide array of others who are interested in understanding the world of today’s adolescents.

Participant-Observation/Ethnography

Perhaps the most fundamental question a social scientist can ask is “How do we really know about a given population?” As the lead researcher in the Hurt Project, for nearly a decade I have wrestled long and hard with this question. As the world changes and widespread cultural trends increasingly demonstrate how these changes affect us all, this question nudges scholars to move in a little closer to those who can teach the most about their world, the adolescents themselves. Today’s teenagers have a great deal more to share than what we can see and know through the more typical research methods of focus groups, questionnaires, or even individual personal interviews. Participant-observation of a population is especially important when studying adolescents, whose answers to self-report queries may not be consistent and whose actual perspectives, attitudes, and behaviors do not readily correlate with what they might say to a researcher. In order to even begin to paint an accurate picture of the complex, multitiered world of today’s teenager, it takes someone who is outside of the direct experience of the constantly changing nature of adolescence itself to carefully and deliberately listen, watch, ask, invite, and pursue. It takes someone who is close enough to get a well-rounded picture of what is going on, and at the same time is safe enough to be invited into authentic and unfiltered behaviors and conversation. Patricia and Peter Adler, leading ethnographic scholars, consistently affirm that participant-observation is the most productive methodology in studying adolescent life and behavior, as they describe in the Journal of Contemporary Ethnography: “Given ethnography’s strength of getting inside groups’ inner workings, this methodology has been central to the exploration of how teenagers make sense of their social worlds.”

The specific strategy I employed was to find a way to honor the agreement with the school and district by serving in the role of a substitute teacher. While I maintained the integrity of the role by following the directions the teacher had left regarding the class, the coprincipals and I agreed that the method required the students (and faculty and administrators) to also be made aware of why I was there beyond substitute teaching. In every class I would begin by explaining that I was on a lengthy sabbatical leave in order to listen to and observe the world of high school students and that I was planning on writing a book about what I saw and heard. At the end of each day, I would record impressions—without using any names of students or even specific classes—of what I observed that day. At the end of each week I would synthesize my diary notes into a loose but comprehensive narrative, and then put the daily logs away. Within a few weeks, themes began to emerge, and I would allow myself to reflectively test out these emerging themes in my future daily observations at that time.

During the semester-plus I was on campus I received over one thousand unsolicited poems, notes, songs, and letters from students (and a few teachers). Our team later coded these texts and, changing the names of students, created a database of impressions of my observations, conversations, and preliminary conclusions. This type of coding data is what Charmaz suggests is an important aspect of the participant-observer’s process in order to allow for various random materials to be integrated and synthesized. She writes, “Coding gives a researcher analytic scaffolding on which to build. Because researchers study their empirical materials closely, they can define both new leads from them and gaps in them. Each piece of data—whether an interview, a field note, a case study, a personal account, or a document—can inform earlier data.”

Although participant-observation is objectively recognized as one of the most robust of research methodologies, a relatively consistent critique of it is the possibility that researcher bias may influence the reported conclusions, sometimes to the point of invalidating the entire project. Since the first edition of Hurt I have occasionally heard this as a critique of our study. In an undergraduate class at a major U.S. university, for example, a student asked his prominent sociologist professor how my work and Hurt in particular spoke into the theory he was espousing. The professor is reported to have said, “That guy spent a few months on a high school campus and calls that research? He was just out to prove what he already believed.” When this student emailed me this exchange, I was less concerned about the professor’s comments than I was with the potential that there were others “out there” who had similar misgivings about the academic strength of this research.

It is impossible to deny that when a researcher engages with a given population and has any affinity for or even relationship with members of the subject group, the potential for bias, and perhaps significant bias, is a very real concern. Yet many scholars who use this method for their own research question the perception that the potential for researcher bias plays as significant a role in the value, veracity, and power of ethnographic observations and conclusions as some assert. Research scholars like Michael V. Angrosino, in his article “Recontextualizing Observation,” for instance, make precisely the opposite case, arguing for the value of an invested researcher being sympathetic to and even connected with her subjects. Because the method requires a great deal of time, for researchers to be trusted they have no choice but to build some sort of rapport with their subjects. It is in the context of this relational ecology, Angrosino argues, that the researcher has the best opportunity to uncover, detail, and report the reality being studied. While I am clearly an advocate for the young and want to raise awareness of how they have been systemically led and treated, I believe that the observed data, the impressions forming into conclusions, and the results written herein are ultimately faithful and honest objective reflections of what other researchers would discover if they were to replicate the study with openness.

Literature Review

While the Hurt Project initially relied on my work as an ethnographer on a high school campus, the method used in this study is not limited to that singular strategy; we have also taken great care to align, or at least measure, our conclusions with relevant literature. Our commitment to a thorough interdisciplinary literature review, then, provides as much a dynamic data set as any of the other forms of data collection we used. This edition is a point-by-point, paragraph-by-paragraph revision of the first edition of Hurt, written in order to maintain the deliberative connection between my continuing observations of adolescents in contemporary culture and the most recent and best scholarship and thinking. In participant-observation, the literature review offers a grounding and delimiting structure that enables both open-ended ethnographic inquiry and, at the same time, a sense of place for contextualized analysis. The literature review is vital because it forces an ethnographic researcher to either position observations and conclusions within a previously delineated conceptual framework or, if necessary, to push for a new way of thinking. This is what keeps ethnography in general and participant-observation in particular located as a bona fide and trustworthy social science methodology.

In participant-observation, the conceptual boundaries that literature provides, however, must not be allowed to shape ideas and perspectives before the observations themselves have bubbled to the surface of the researcher’s impressions. In other words, relevant literature should be used as a potential corrective to observations and conclusions that violate previous theoretical assumptions, not to shape the impressions a priori. Throughout the Hurt study—both the initial study and the ongoing work—that is how we have employed relevant literature and theory.

Informal Conversations and Focus Groups

Focus groups and their research cousins, informal group conversations, have provided ethnographers with a wealth of insight not easily captured using other methods. First, even the most astute participant-observer is only able to see snapshots of a given population, so a focus group will be able to fill in gaps. In addition, focus groups can help to prevent researchers from forming premature conclusions without having enough firsthand information. I found our procedure of adjusting conclusions according to the focus group comments to be vital to our overall understanding of this population. And lastly, the greatest value of the focus groups was the way they allowed teenagers to “reveal unarticulated norms and normative assumptions” that perhaps in many cases I generally suspected but that were made all the more clear by the collective descriptive and corporate assent of the group participants. Thus throughout the entire project, and since, we have utilized some form of small group interaction as a third primary source of data.

As stated, for the initial study I conducted seventeen “official” informal conversations, all with written parental consent. After the conversations were complete I received word that a small handful of parents from five of the groups were uncomfortable with their children’s involvement, so we did not include any of the comments or impressions from those five groups in any of the books, articles, or lectures related to the Hurt Project. Interestingly, the issue was the same for every concerned parent: the adolescents had discussed, without my prompting, oral sex. To my knowledge no other issue caused any parental angst with any part of the study.

The groups were comprised of between fifteen and twenty high school juniors and seniors who were chosen from at least three, and usually six to ten, population pools that were all geographically proximate. The cities and communities were chosen to represent a wide spectrum of the U.S. population centers, as well as a wide demographic—ethnic, urban, rural, suburban, etc. (I also conducted two Canadian focus groups, one each on the east and west coast). Before arriving in a city or town, I would contact at least two local nongovernmental agencies (and usually more) to enlist their help in connecting with a group of youth and youth-serving organizations with access to teenagers who could serve as potential subjects and who were articulate and willing to discuss with peers, many of whom they would not know, their impressions of the world they lived in, for a research project seeking to understand how teenagers perceive their life and world. Each city ended up with its own unique process, but our team insisted on the following conditions: if at all possible, no more than three of the students would know each other well; no more than 50 percent could be actively involved in any single major category (sports team, church and/or religious youth organization, service clubs, etc.); they must be available for a one-time sitting (including pizza); and a parent had to sign a release form. In most cases we followed up with a letter to each parent asking to reaffirm their willingness for their child to participate. In the years since the first edition I have conducted between eight and fifteen similar conversations, depending on how formally I would define “conversation.”

The format of the groups was straightforward. I wanted to allow for any kind of perception or perspective to emerge without being shaped by the presence of the researcher or by the way a question was asked. Therefore I came alone to almost every focus group and took notes sparingly, for only a few direct and especially pithy quotes, thus trying to stay true to the observation method by relying largely on my memory. In deciding how to facilitate the groups, we chose to err in the direction of simplicity and openness by simply asking group participants to, for example, “Tell me about school” or “Discuss friends” (or dating or family or pressure). Once the teens achieved a level of safety with each other, usually within the first thirty to forty-five minutes, the most important work I had to do was to avoid groupthink, where the information being offered appears to be swelling into too clean a uniformity. The research on a facilitator’s avoidance of groupthink is well documented and entails a relatively easily accessed skill set, with the researcher employing strategies like inviting a quiet person to answer a relatively unrelated question, or reintroducing or redirecting words one subject has said that would contradict the direction the group was headed. This proved not to be a problem with any of the groups.

The Ongoing Work of the Hurt Project

The work of the Hurt Project, as we’ve already noted, was not complete with the release of the book. As a graduate school professor, I have continued to enlist students and graduates to investigate a wide range of literature, to ask ethnographic questions while in the field, and to personally work with and consult organizations and communities that seek to improve their ability to understand and serve their teenagers. Our teams have intentionally chosen to see this research as an ongoing inquiry and to report what is seen and heard in the natural course of networks and relationships, as opposed to formalizing the project by means of a committee, grant, or institutional project. For example, when a private school invites me (or a member of my team) to spend time on their campus observing and interviewing students and faculty to determine the level and places of systemic abandonment, we operate under the guidelines of the institution and the authority of their board of directors. When given the opportunity to conduct focus groups, we do insist, as we have from the beginning, that the institution or agency is responsible for obtaining parental consent, but for the most part we observe and operate under the auspices of the inviting party.

Finally, the reason we have continued this project, and will continue this project for years to come, is that what was discovered in writing the first edition of Hurt is not improving. The level of responsibility and competencies required of children from very early ages has risen exponentially over the past decade, and yet the ongoing adult support and guidance offered them without a self-serving agenda has diminished at roughly the same rate. We are convinced that today’s children and teenagers have never experienced less social capital than they do today, and that they experience more stress than any generation in history. We stand with people who are committed to raising the flag of awareness, conversation, and action so that our children, and their children, will grow up where they are known, loved, and cherished as vital and valuable members of our community, nation, and world.

↑ Back to top

↑