Describe the three principles of data collection and why those are significant to researchers. Also, describe six sources of evidence and their strengths and weaknesses which Yin reveals.
The three principles of data collection are: use multiple sources of evidence; create a case study database; and maintain a chain of evidence. Yin cites multiple sources of evidence as a major strength of case study data collection. The most important advantage of using multiple sources of evidence is that it provides for the development of converging lines of inquiry. Creating a case study database is also important in that it increased the reliability of the study so other investigators can review the evidence directly. The database could include notes, documents, tabular materials, and narratives. The third principle, maintaining a chain of evidence, increases the reliability of the information in a case study. This involves organizing the information so anyone could follow the evidence trail from research question through conclusion, or from conclusion backwards to research question. These principles establish the validity and reliability of case study evidence.
According to Yin, the six sources of evidence are: documents, archival records, interviews, direct observation, participant-observation, and physical artifacts. Documents are critical to a case study. Documents can include such items as letters, emails, diaries, agendas, administrative documents, formal studies of the case you are studying, or news clippings or articles appearing in the mass media. Strengths of documents as evidence include they contain exact details, can be reviewed repeatedly, are unobtrusive, and have broad coverage over time, events, and settings. Weaknesses of documents as evidence include that it may be difficult to find them, they may be selected based on researcher bias, they may include reporting bias of the author, and it may be difficult to obtain access to needed documents. Archival records, often taking the form of computer files and records, may be important evidence in case studies. Strengths of this type of evidence include those of documentation, as well as the fact that this evidence is precise and usually quantitative. Weaknesses are also the same as those for documentation with the addition of a lack of accessibility due to privacy. Interviews are one of the most important sources of information in a case study. Interviews allow researchers to ask questions and seek answers to participants in the case study research, since most case studies are about human affairs or behavioral events. Strengths are that interviews focus directly on the targeted study topics, and provide valuable insight into inferences and explanations.
Direct observation takes place in the natural setting of the case study. The researcher can observe in formal or casual settings. Advantages include covering the events in real time, and the ability to cover the context of the case first hand. Weaknesses of this method of evidence are that it is time consuming, it is difficult to do without a team of researchers, the observation itself may affect what is being observed, and it can be costly if many researchers are needed to complete the observation. Participant-observation, in which an observer actually participates in a situation and at the same time collects evidence, has all the advantages of participation, but adds greater insight into interpersonal behavior and attitudes. Weaknesses of this method are similiar to observation, with the adddition of bias due to the participant-observer's manipulation of events. Physical evidence includes such articles as technological devices, tools or instuments, a work of art, or some other physical evidence. This type of evidence, although used less frequently in case studies, can be significant in the study. Strengths of this type of evidence include valuable insight into cultural features and technical operations. Weaknesses include the availability and selectivity of physical artifacts for study. Yin notes that none of the types of evidence has a complete advantage over the others, and that they are most effective when used to complement each other.
Qoute: (page 101) "You should immediately note that no single source (of evidence) has a complete advantage over all the others. In fact, the various sources are highly complementary, and a good case study will therefore want to use as many sources as possible."
Fact: (Page 101) Except for studies of preliterate societies, documentry information is likely to be relevant to every case study topic.
Question: I am intrigued by the participant-observer method of obtaining evidence. Even though the evidence gained would be rich, wouldn't this be a difficult position for the researcher? To borrow a word from Dr. Smith, wouldn't this be "messy"?
Three principals of data collection: Use Multiple Sources of Evidence: Using numerous sources of evidence is one way that case studies stand out compared to other methods. Using a variety of sources helps the researcher to address a broader range issues and have a more convincing and accurate conclusion to their research. Create a Case Study Database: The data collections are completed in two ways data base and report of the investigator. This is away to arrange the data and make it available for both the current researcher and/or others who are reading your research or who may want to duplicate it. Maintain a Chain of Evidence:Reliability is the concern and having the evidence orderly in place is the key. This procedure is a way to link all the parts of the research and to prove validity.
Six sources of evidence: Documentation: This can take place in many forms, but needed! The strengths: explicit, stable, broad coverage, and unobtrusive. The weaknesses: biases, retrievability, and access. Archival Records: These are now taking place as computer files and are precise but often hard to access. Interviews: An important source that is targeted and insightful, but can have biases and inaccuracies. Direct Observation: This can be formal or casual and covers events in real time along with the context of the case. On the other hand, it is time consuming can have a cost involved, and selectivity and reflexivity is an issue. Participant Observation: Roles are taken on by the researcher as observations are completed. Observations also cover events in real time along with the context of the case, but biases may occur along with cost and time. Physical Artifacts: Can be insightful into cultural features and technical operations, but can be selective and unavailable.
Quote: "The data collection process for case studies is more complex than those used in other research methods." (Page 124)
Question: (Goes along with above quote.) All the methods last semester touched base on collecting data and documenting. Does it just seem like more, because the book is entirely about case studies or is it really more difficult? Question: Dr. Hendrix my research question is: How does technology-enhanced instruction compare with traditional instruction in student academic achievement, student motivation to learn, and student attitude towards technology? So is this a Case Study??????????????
Fact: I am beginning to feel a bit overwhelmed!!! Oh wait, that fact has nothing to do with Yin! If research was easy everyone would be doing it!
Barb, I think the participant-observer method of obtaining evidence would be "messy." I would worry that I would get too involved and not be able to have documentation of anything that took place. Maybe video?
Corey, you know me, I would get to talking to people around me and forget I needed to be an observer. Video would be okay, but if you are using the video camera, then how do you participate?
The three principles of data collection Yin mentions include the use of multiple sources, development of a case study database, and establishment of a chain of evidence. The use of multiple sources in case studies allows the researcher to address a broader range of historical and behavioral issues. Most importantly, multiple sources of evidence enhances the development of converging lines of inquiry. Creation of a case study database is a way of organizing and documenting the data collected for case studies. Maintaining a chain of evidence should allow an external observer to follow the conclusions back to initial research questions or from questions to conclusions. The three principles of data collection are intended to make the process of data collection as explicit as possible and reflect a concern for construct validity and reliability.
Six sources of case study evidence: Documentation: For case studies, according to Yin, the most important use of documents is to corroborate and augment evidence from other sources. These documents include letters, agendas, administrative documents, formal studies, and news clippings. Strengths include stability, unobtrusive, exact, and broad coverage. Weaknesses include difficulty to find, biased selectivity, unknown bias of author, and limited access. Archival records: These records often take the form of computer files and official records. Examples of archival records include public use files, service records, organizational records, maps, charts, and survey data. Archival records share the same strengths as documentation plus being precise and usually quantitative. Weaknesses are also the same as documentation. Interviews: Stated by Yin as the most important source of case study information, interviews of a case study should be guided conversations rather than structured queries. Yin discusses three types of interviews: in-depth,focused, and survey. Strengths of interviews are that they are targeted and insightful. Weaknesses of interviews include poorly articulated question bias, response bias, poor recall inaccuracies, and reflexivity (telling what the interviewer wants to hear). Direct observations: Direct observations can be made when the setting of the case study is in the natural setting of the "case." Direct observations include observing relevant behaviors or environmental conditions. Yin suggests a case study investigator to increase the reliability of the study by having more than a single observer making observations. Strengths of direct observation are reality and contextual. Weaknesses are that direct observations can be time consuming, selectivity, reflexivity, and costliness. Participant-observation: These are observations that may involve the researcher in a variety of roles within a case study investigation and may incorporate direct participation in the case by the researcher. Strengths for participant observation are the same as direct observation in addition to being more insightful into interpersonal behavior and motives. Weaknesses are the same as direct observations in addition to bias due to participant-observer's manipulation of events. Physical artifacts: Physical artifacts have been used extensively in anthropological research and have less potential relevance in the most typical kind of case study. When relevant, though, physical artifacts can be important to the overall case. Strengths include insight into cultural features and technical operations. Weaknesses include selectivity and availability.
Question: Would not becoming a participant-observer in a case study lead to a greater possibility for developing bias?
Quote: "One of the most important sources of case study information is the interview." (p. 106) This makes perfect sense to me (perhaps the first time this semester!)
Fact: No single source of evidence has complete advantage over all the others. The researcher should use as much various sources as possible to lend to a quality case study.
Barb, You would need an additional person to video or use a tri-pod and microphones. Now we're getting more costs involved if these items aren't already owned. Isn't research grand?
Barb, I, too, am concerned about the participant-observer source of evidence. I would say that novice researchers like ourselves should probably refrain from using this type of evidence. More experienced researchers could probably pull it off.
Corey, I am totally with you on the overwhelming feeling. It is good to know that I am not the only one. I think not feeling overwhelmed is abnormal for novice researchers.
The three principles of data collection: 1- Use multiple Sources of Evidence: Following this principle allows the investigator to address a broader range of historical and behavior issues and helps to form converging lines of inquiry. Using only once source of evidence would limit the insight for the researcher and may provide limited insight. 2- Create a Cased Study Database: This principle states this to be a way of organizing and documenting the data collected for case studies. There are four different components: notes, documents, tabular materials and narratives. The Case Study Database is crucial to researchers so that they are able to in an organized manner track their work and then to retrieve information gathered easily at a later date. 3- Maintain a Chain of Evidence: The main purpose of this principle is to increase reliability of case study. This principle also allows the external observer(reader of the case) to follow the derivation of the evidence from initial research questions to the ultimate case study conclusions. This principle is essential for researchers to follow so that others can read and understand their research as well as to be able to revisit the research down the road and be able to follow and understand what was done.
describe six sources of evidence and their strengths and weaknesses which Yin reveals.
The six sources of evidence: 1-Documentation: Ways to gather information on research topic. The forms range from letters, memos, email and other personal documents to agendas, announcements and minutes of meetings, administrative documents such as proposals, progress reports and other internal records. Other forms of documentation are formal studies or evaluations of the same "case" that you are study. As well as news clippings and other articles from mass media. Strengths: stable, unobtrusive, exact and broad coverage. Weaknesses: retrievability, biased selectivity, reporting bias and access 2- Archival Records: computer files and records. These are described as "public use files" such as the U.S. Census, service records, such as showing a number of clients served over a given period of time, organizational records such as budget or personal records, maps and charts of the geographical characteristics of a place and survey data, previously collected data about a site's employees and residents or participants. Strengths: same as documentation and precise and usually quantitative. Weaknesses: same as documentation and accessibility due to privacy reasons. 3- Interviews: one of the most important sources of case study information. They operate on two levels: satisfying the needs of your line of inquiry and putting forth "friendly" and "nonthreatening" questions in your open-ended interviews. There are three types of interviews: in-depth, focused and the survey Strengths: targeted and insightful Weaknesses: bias by the investigator, response bias, inaccuracies due to recall, reflexivity 4- Direct Observation: Can range from formal to casual. To increase reliability of observational evidence it is necessary to have more than a single observer. Strengths: reality of events and contextual Weaknesses: time consuming, selectivity, reflexivity and cost 5- Participant observation: This is where the researcher is not a passive observer. Assumes a variety of roles and may participate in events being studied. Strengths: same as direct observations and insightful into interpersonal behavior and motives Weaknesses: same as for direct observations and biases due to participant manipulations of events. 6-Physical Artifacts: technological device, a tool or instrument, work of art or some other physical evidence. Strengths: insightful into cultural features and into technical operations Weaknesses: selectivity and availability
Fact: page 103 - For case studies, the most important use of documents is to corroborate and augment evidence from other sources.
Quote: page 106 "Most archival records were produced for a specific purpose and a specific audience other than the case study investigation, and these conditions must be fully appreciated in interpreting the usefullness and accuracy of these records."
Question: Yin states that interviews are guided conversations and allow for fluidity rather than being rigid as survey questions tend to be. So....for my research of getting back to the basics of reading and writing. From what I have read am I correct that the conferences I have with students be the interview component? Don't you believe this would be a better methods than to using a survey?
Mrs. Dalyrmple - I appreciate your fact. The variety of resources needed in a case study can relate to many avenues of life! Having a varied workout, diet, people who we associate with and on and on.
ADotson, I appreciate your quote about archival records being only as valuable as the source or the reason for their creation. I have always assumed if it was in print or published, it must be valid. I guess a researcher can't assume anything-yikes, another thing to check out!
Mrs. Dalrymple,I also like your quote about the importance of interviews as evidence in case studies. The whole interview setting in which you interact with people who are directly involved in your study, and can look them in the eye seems so authentic. The problem would be setting them up and giving them adequate time in your schedule, and transcribing the interview. I'm confident I am not ready for this!
Corey, in response to your comment about needing help to video tape during participant observation, you are right. Having a research team to assist us would be awesome. There is so much work to be done on a research project, and it looks like it could get expensive. Your grant-writing idea is right on target. Get all the kinks out of that, and you can be the go-to person for grant writing.
Yin lists three principles of data collection. One is the use of multiple sources of evidence that result in the same findings. This principle is important because it addresses the issue of construct validity. The second principle is having a case-study database which provides evidence separate from the final case study report. The third, having a chain of evidence, provides links among questions asked, data collected and conclusions drawn from the study. Both the case-study database and the chain of evidence are important because they increase the reliability of the case study.
Six Sources of Evidence: 1. Documents. A strength of this type of evidence is that it is exact, while a weakness is that it may be difficult to find. 2. Archival records. Like documents, these are exact, yet may not be easily accessible due to privacy issues. 3. Interviews. A strength here is that interviews are exact and focus directly on the topics being studied. However, bias may result if the questions are poorly written. 4. Direct observations. These are strong because they focus on events happening in real time. One weakness is that they can be time-consuming. 5. Participant-observation. This type of evidence has many of the same strenths and weaknesses as direct observations. Another strength is that they can be insightful into interpersonal behavior, another weakness is bias due to manipulation of the events by the participant-observer. 6. Physical artifacts. These are insightful into technical operations and cultural features yet may not be available in all situations.
Question: I noticed that one of the forms of documentation Yin lists is diaries. Yet he writes these may not be accurate and could very well be bias. Since bias is such a relevant concern, how can a diary be considered a true form of documentation?
Quote: (p 114) "... a major strength of case study data collection is the opportunity to use many different sources (of information)..."
Fact: (p119) The lack of a formal database for most case studies is a major shortcoming of case study research and needs to be corrected. (How would this be done?)
Barb, in response to your question, (and Mrs. Dalrymple's response) I would think being a participant-observer would be a difficult position, especially from the standpoint of trying not to be bias.
Corey, in response to your quote and question, just the thought that case studies are more complex is enough to scare me off!
Fact: Yin explains that the 6 sources of evidence commonly found in case studies are documentation, archival records, interviews, direct observations, participant-observation, and physical-observation. Page 101
Question: Yin states that when using a document as evidence that the investigator has to constantly try to identify the objectives because most documents are for a different audience. Is the investment a waste of time it seems this type of evidence is very time consuming. Page 105
Quote: Overall, interviews are an essential source of case study evidence because most case studies are about human affairs or behavioral events. Page 108
The first principle is the use of multiple sources of evidence. This is significant because this type of evidence in case studies allows an investigator to address a broader range of historical and behavioral issues. The second principal is to create a case study database. This principle allows the investigator to organized and document data collection for a case study. Types of data collection are case study notes, case study documents, tabular materials, and narratives. The third principal is to maintain a chain of evidence. This is significant because it allows an increase in reliability of the information in the case study. 6 sources of evidence: Documentation: This type of evidence can be reviewed repeatedly, are not created because of a case study, contains names, references, and details of events, and consist of many events and setting. Weaknesses are that they can be difficult to find, can show bias, and may be deliberately withheld. Archival records: This evidence can be precise and in a quantitative form so it may be easier to read. Weaknesses could be accessibility due to privacy reasons. Interview’s strengths focus on specific topics, and perceive casual inferences and explanations. Weaknesses would be bias because of poor questions, bias, inaccuracies, and interviewees are not honest. Direct observations cover real time events and context. This evidence can become time consuming, contains broad coverage with lack of people, the cost because of the hours needed by observers.
Participant-Observation is insightful to behavior and motives. Weaknesses are similar to direct observations and contain bias.
Physical artifacts are insightful into cultural features and technical operations. Weaknesses can consist of being selective and availability.
Quote: p100 “Unlike other methods, there is no clear cut-off point. You should try to collect enough data so that (a) you have confirmatory evidence (evidenced from two or more different sources) for most of your main topics, and (b) your evidence includes attempts to investigate major rival hypotheses or explanations.” Question: Does the observer being part of the community he or she is studying affect the validity of the study? For example, on p111, Gans is a resident of the neighborhood he is studying. Does this undermine his research or add to it? And, in order for it to add to his research, what precautions must he take in order for his participation to be a benefit rather than a disadvantage? Fact: p110 When combining field observations with other types of case study evidence, it is beneficial for the findings of the case study to be based on the convergence of information from different sources, not relying only on quantitative or qualitative data.
The 3 Principles of Data Collection: 1: The use of multiple sources of evidence allows the researcher to develop converging lines of inquiry which is more convincing and accurate. 2: Creating a database for collecting data assists the researcher in organizing and documenting their data and sources. 3: Researchers increase the reliability of their case study by creating a chain of evidence in which the reader is able to link the research question to the conclusions that were drawn through each step of the research. Six Sources of Evidence: 1: Documentation: used to corroborate and augment evidence from other sources; strengths-stable, unobtrusive, exact, broad coverage; weaknesses-difficult to find, biased selectivity, reporting bias, access may be limited 2: Archival Records: can be used extensively in quantitative research; strengths-precise, usually quantitative, stable, unobtrusive, exact, broad coverage; weaknesses-privacy limiting access, retrievability, biased selectivity, reporting bias, access withheld 3. Interviews: in case study research the interview questions are often fluid and may be modified as the interview proceeds; strengths- targeted, insightful; weaknesses-bias due to poor questions, response bias, inaccuracies due to poor recall, reflexivity 4. Direct Observation: allows the observations to be made in the natural setting of the case; strengths: covers events in real time, covers context of a case; weaknesses: time-consuming, selectivity, reflexivity, cost 5. Participant-Observation: used when the researcher participates in the events being studied; strengths: covers events in real time, contextual, insightful into interpersonal behavior and motives; weaknesses: time-consuming, selectivity, reflexivity, cost, bias due to participant-observer’s manipulation of events 6. Physical Artifacts: can be important to case study research because the artifact can add to the researcher’s perspective beyond what can be merely observed in a field study; strengths: insightful to cultural and technical operations, weaknesses; selectivity and availability
Ann D: I do think student interviews would be a great way for you to collect data. Mrs. Dalrymple: I agree that participant-observer method could lead to a stronger bias. I was worried about this too. Corey: I love your research question. I am interested to hear more about your study or grant.
The three principles of data collection are 1) using multiple sources of data collection, 2)developing a case study database and 3)maintaining a chain of evidence they are significant to research because according to Yin they have been neglected in the past, and they help construct validity and reliability. Multiple sources of data collection help the researcher corroborate and augment evidence from other sources. A case study database allows a researcher to see what has been done in the past, and to check validity of data collected. The chain of evidence is a way of keeping the researcher and the data intact; a valid way of checking to see that the researcher went from one collection to another, and didnt just infer what to do next.
Documentation: most commonly used during a case study. It's strengths are can be reviewed repeatedly, exact in detail, many events and setting. It's weaknesses are hard to find reporting bias of author and access may be deliberatly withheld. Archival records can be "public use files" or other statistical data created by government, or maps and charts. The usefulness of using this type may vary from study to study. Kind of like an all or nothing either they will work for your study or they may not, a weakness I think. Also, not all local government websites are easy to negoiate. Their strengths would be that they are easy to find per internet, not just in your state, and they help create a visual, and they are precise for the researcher. Interviews: To say that you will ask questions of another party seems easy enough, however the researcher has to operate on two levels at the same time. Satisfying the needs of your line of inquiry at the same time putting forth friendly and nonthreatening line of open ended questioning. So the weakness of this would be to maintain a non-biased leading voice during questioning, the strength would be to find out the hows and whys a subject answered questions. Direct observations: a main strength of this type is to provide additional information of the topic being studied and the observation takes place in the same room that the study is being done, so an easy way to collect data. The weakeness would be time consuming for the researcher and the subjects being observed may act differently due to the observation. Participant observation: It is similar to direct observation except that you as a researcher will also be in the observation. And then that may help you gain access to groups that may not be interested in being a part of straight observation. The weaknesses will be for the researcher to maintain biases as the observation takes place and the time it takes to do both and not to miss the data while you are participating. Physical Artifact: They can be insightful to different cultures or technical operattions,and the weaknesses would be availability, harm to the artifact, and not losing it.
Fact:pg 118 Yin says, the requirement for mastering multiple data collection techniques raises important questions regarding the training and expertise of the investigator. Question: I would think that multiple data collection is the goal for most of we researchers, so what extra training are we to get if any? Quote:pg 118 "Yet a third way is to design different pilot studies that will provide an opprotunity for practicing different techniques." My guess is we will do this Christina, I agree that docuementation seems like it will take the longest, yet it seems as if we have all thought that was the way we would go. I guess we better get started! Ann D. I was wondering too which makes more sense to do a survey or an interview. I wonder if the time component will have anything to do with our decision?!
The three principles of data collection are: use multiple sources of evidence; create a case study database; and maintain a chain of evidence. Yin cites multiple sources of evidence as a major strength of case study data collection. The most important advantage of using multiple sources of evidence is that it provides for the development of converging lines of inquiry. Creating a case study database is also important in that it increased the reliability of the study so other investigators can review the evidence directly. The database could include notes, documents, tabular materials, and narratives. The third principle, maintaining a chain of evidence, increases the reliability of the information in a case study. This involves organizing the information so anyone could follow the evidence trail from research question through conclusion, or from conclusion backwards to research question. These principles establish the validity and reliability of case study evidence.
ReplyDeleteAccording to Yin, the six sources of evidence are: documents, archival records, interviews, direct observation, participant-observation, and physical artifacts. Documents are critical to a case study. Documents can include such items as letters, emails, diaries, agendas, administrative documents, formal studies of the case you are studying, or news clippings or articles appearing in the mass media. Strengths of documents as evidence include they contain exact details, can be reviewed repeatedly, are unobtrusive, and have broad coverage over time, events, and settings. Weaknesses of documents as evidence include that it may be difficult to find them, they may be selected based on researcher bias, they may include reporting bias of the author, and it may be difficult to obtain access to needed documents. Archival records, often taking the form of computer files and records, may be important evidence in case studies. Strengths of this type of evidence include those of documentation, as well as the fact that this evidence is precise and usually quantitative. Weaknesses are also the same as those for documentation with the addition of a lack of accessibility due to privacy. Interviews are one of the most important sources of information in a case study. Interviews allow researchers to ask questions and seek answers to participants in the case study research, since most case studies are about human affairs or behavioral events. Strengths are that interviews focus directly on the targeted study topics, and provide valuable insight into inferences and explanations.
ReplyDeleteDirect observation takes place in the natural setting of the case study. The researcher can observe in formal or casual settings. Advantages include covering the events in real time, and the ability to cover the context of the case first hand. Weaknesses of this method of evidence are that it is time consuming, it is difficult to do without a team of researchers, the observation itself may affect what is being observed, and it can be costly if many researchers are needed to complete the observation. Participant-observation, in which an observer actually participates in a situation and at the same time collects evidence, has all the advantages of participation, but adds greater insight into interpersonal behavior and attitudes. Weaknesses of this method are similiar to observation, with the adddition of bias due to the participant-observer's manipulation of events. Physical evidence includes such articles as technological devices, tools or instuments, a work of art, or some other physical evidence. This type of evidence, although used less frequently in case studies, can be significant in the study. Strengths of this type of evidence include valuable insight into cultural features and technical operations. Weaknesses include the availability and selectivity of physical artifacts for study. Yin notes that none of the types of evidence has a complete advantage over the others, and that they are most effective when used to complement each other.
ReplyDeleteQoute: (page 101) "You should immediately note that no single source (of evidence) has a complete advantage over all the others. In fact, the various sources are highly complementary, and a good case study will therefore want to use as many sources as possible."
ReplyDeleteFact: (Page 101) Except for studies of preliterate societies, documentry information is likely to be relevant to every case study topic.
Question: I am intrigued by the participant-observer method of obtaining evidence. Even though the evidence gained would be rich, wouldn't this be a difficult position for the researcher? To borrow a word from Dr. Smith, wouldn't this be "messy"?
Three principals of data collection:
ReplyDeleteUse Multiple Sources of Evidence: Using numerous sources of evidence is one way that case studies stand out compared to other methods. Using a variety of sources helps the researcher to address a broader range issues and have a more convincing and accurate conclusion to their research.
Create a Case Study Database: The data collections are completed in two ways data base and report of the investigator. This is away to arrange the data and make it available for both the current researcher and/or others who are reading your research or who may want to duplicate it.
Maintain a Chain of Evidence:Reliability is the concern and having the evidence orderly in place is the key. This procedure is a way to link all the parts of the research and to prove validity.
Six sources of evidence:
Documentation: This can take place in many forms, but needed! The strengths: explicit, stable, broad coverage, and unobtrusive. The weaknesses: biases, retrievability, and access.
Archival Records: These are now taking place as computer files and are precise but often hard to access.
Interviews: An important source that is targeted and insightful, but can have biases and inaccuracies.
Direct Observation: This can be formal or casual and covers events in real time along with the context of the case. On the other hand, it is time consuming can have a cost involved, and selectivity and reflexivity is an issue.
Participant Observation: Roles are taken on by the researcher as observations are completed. Observations also cover events in real time along with the context of the case, but biases may occur along with cost and time.
Physical Artifacts: Can be insightful into cultural features and technical operations, but can be selective and unavailable.
Quote: "The data collection process for case studies is more complex than those used in other research methods." (Page 124)
Question: (Goes along with above quote.) All the methods last semester touched base on collecting data and documenting. Does it just seem like more, because the book is entirely about case studies or is it really more difficult?
Question: Dr. Hendrix my research question is: How does technology-enhanced instruction compare with traditional instruction in student academic achievement, student motivation to learn, and student attitude towards technology? So is this a Case Study??????????????
Fact: I am beginning to feel a bit overwhelmed!!! Oh wait, that fact has nothing to do with Yin! If research was easy everyone would be doing it!
Barb, I think the participant-observer method of obtaining evidence would be "messy." I would worry that I would get too involved and not be able to have documentation of anything that took place. Maybe video?
ReplyDeleteCorey, you know me, I would get to talking to people around me and forget I needed to be an observer. Video would be okay, but if you are using the video camera, then how do you participate?
ReplyDeleteThe three principles of data collection Yin mentions include the use of multiple sources, development of a case study database, and establishment of a chain of evidence. The use of multiple sources in case studies allows the researcher to address a broader range of historical and behavioral issues. Most importantly, multiple sources of evidence enhances the development of converging lines of inquiry. Creation of a case study database is a way of organizing and documenting the data collected for case studies. Maintaining a chain of evidence should allow an external observer to follow the conclusions back to initial research questions or from questions to conclusions. The three principles of data collection are intended to make the process of data collection as explicit as possible and reflect a concern for construct validity and reliability.
ReplyDeleteSix sources of case study evidence:
Documentation: For case studies, according to Yin, the most important use of documents is to corroborate and augment evidence from other sources. These documents include letters, agendas, administrative documents, formal studies, and news clippings. Strengths include stability, unobtrusive, exact, and broad coverage. Weaknesses include difficulty to find, biased selectivity, unknown bias of author, and limited access.
Archival records: These records often take the form of computer files and official records. Examples of archival records include public use files, service records, organizational records, maps, charts, and survey data. Archival records share the same strengths as documentation plus being precise and usually quantitative. Weaknesses are also the same as documentation.
Interviews: Stated by Yin as the most important source of case study information, interviews of a case study should be guided conversations rather than structured queries. Yin discusses three types of interviews: in-depth,focused, and survey. Strengths of interviews are that they are targeted and insightful. Weaknesses of interviews include poorly articulated question bias, response bias, poor recall inaccuracies, and reflexivity (telling what the interviewer wants to hear).
Direct observations: Direct observations can be made when the setting of the case study is in the natural setting of the "case." Direct observations include observing relevant behaviors or environmental conditions. Yin suggests a case study investigator to increase the reliability of the study by having more than a single observer making observations. Strengths of direct observation are reality and contextual. Weaknesses are that direct observations can be time consuming, selectivity, reflexivity, and costliness.
Participant-observation: These are observations that may involve the researcher in a variety of roles within a case study investigation and may incorporate direct participation in the case by the researcher. Strengths for participant observation are the same as direct observation in addition to being more insightful into interpersonal behavior and motives. Weaknesses are the same as direct observations in addition to bias due to participant-observer's manipulation of events.
Physical artifacts: Physical artifacts have been used extensively in anthropological research and have less potential relevance in the most typical kind of case study. When relevant, though, physical artifacts can be important to the overall case. Strengths include insight into cultural features and technical operations. Weaknesses include selectivity and availability.
Question: Would not becoming a participant-observer in a case study lead to a greater possibility for developing bias?
ReplyDeleteQuote: "One of the most important sources of case study information is the interview." (p. 106) This makes perfect sense to me (perhaps the first time this semester!)
Fact: No single source of evidence has complete advantage over all the others. The researcher should use as much various sources as possible to lend to a quality case study.
Barb, You would need an additional person to video or use a tri-pod and microphones. Now we're getting more costs involved if these items aren't already owned. Isn't research grand?
ReplyDeleteBarb, I, too, am concerned about the participant-observer source of evidence. I would say that novice researchers like ourselves should probably refrain from using this type of evidence. More experienced researchers could probably pull it off.
ReplyDeleteCorey, I am totally with you on the overwhelming feeling. It is good to know that I am not the only one. I think not feeling overwhelmed is abnormal for novice researchers.
The three principles of data collection:
ReplyDelete1- Use multiple Sources of Evidence: Following this principle allows the investigator to address a broader range of historical and behavior issues and helps to form converging lines of inquiry. Using only once source of evidence would limit the insight for the researcher and may provide limited insight.
2- Create a Cased Study Database: This principle states this to be a way of organizing and documenting the data collected for case studies. There are four different components: notes, documents, tabular materials and narratives. The Case Study Database is crucial to researchers so that they are able to in an organized manner track their work and then to retrieve information gathered easily at a later date.
3- Maintain a Chain of Evidence: The main purpose of this principle is to increase reliability of case study. This principle also allows the external observer(reader of the case) to follow the derivation of the evidence from initial research questions to the ultimate case study conclusions. This principle is essential for researchers to follow so that others can read and understand their research as well as to be able to revisit the research down the road and be able to follow and understand what was done.
describe six sources of evidence and their strengths and weaknesses which Yin reveals.
ReplyDeleteThe six sources of evidence:
1-Documentation: Ways to gather information on research topic. The forms range from letters, memos, email and other personal documents to agendas, announcements and minutes of meetings, administrative documents such as proposals, progress reports and other internal records. Other forms of documentation are formal studies or evaluations of the same "case" that you are study. As well as news clippings and other articles from mass media.
Strengths: stable, unobtrusive, exact and
broad coverage.
Weaknesses: retrievability, biased selectivity, reporting bias and access
2- Archival Records: computer files and records. These are described as "public use files" such as the U.S. Census, service records, such as showing a number of clients served over a given period of time, organizational records such as budget or personal records, maps and charts of the geographical characteristics of a place and survey data, previously collected data about a site's employees and residents or participants.
Strengths: same as documentation and precise and usually quantitative.
Weaknesses: same as documentation and accessibility due to privacy reasons.
3- Interviews: one of the most important sources of case study information. They operate on two levels: satisfying the needs of your line of inquiry and putting forth "friendly" and "nonthreatening" questions in your open-ended interviews. There are three types of interviews: in-depth, focused and the survey
Strengths: targeted and insightful
Weaknesses: bias by the investigator, response bias, inaccuracies due to recall, reflexivity
4- Direct Observation: Can range from formal to casual. To increase reliability of observational evidence it is necessary to have more than a single observer.
Strengths: reality of events and contextual
Weaknesses: time consuming, selectivity, reflexivity and cost
5- Participant observation: This is where the researcher is not a passive observer. Assumes a variety of roles and may participate in events being studied.
Strengths: same as direct observations and insightful into interpersonal behavior and motives
Weaknesses: same as for direct observations and biases due to participant manipulations of events.
6-Physical Artifacts: technological device, a tool or instrument, work of art or some other physical evidence.
Strengths: insightful into cultural features and into technical operations
Weaknesses: selectivity and availability
Fact: page 103 - For case studies, the most important use of documents is to corroborate and augment evidence from other sources.
ReplyDeleteQuote: page 106 "Most archival records were produced for a specific purpose and a specific audience other than the case study investigation, and these conditions must be fully appreciated in interpreting the usefullness and accuracy of these records."
Question: Yin states that interviews are guided conversations and allow for fluidity rather than being rigid as survey questions tend to be.
So....for my research of getting back to the basics of reading and writing. From what I have read am I correct that the conferences I have with students be the interview component? Don't you believe this would be a better methods than to using a survey?
Mrs. Dalyrmple - I believe avoiding the participant observation option would be wise of us. Especially since we are novice researchers.
ReplyDeleteBarbara, I appreciate your quote! I was beginning to think that I was pulling from to many resources. The more the better and reliable. Yeah!
ReplyDeleteMrs. Dalyrmple - I appreciate your fact. The variety of resources needed in a case study can relate to many avenues of life! Having a varied workout, diet, people who we associate with and on and on.
ReplyDeleteADotson, I appreciate your quote about archival records being only as valuable as the source or the reason for their creation. I have always assumed if it was in print or published, it must be valid. I guess a researcher can't assume anything-yikes, another thing to check out!
ReplyDeleteMrs. Dalrymple,I also like your quote about the importance of interviews as evidence in case studies. The whole interview setting in which you interact with people who are directly involved in your study, and can look them in the eye seems so authentic. The problem would be setting them up and giving them adequate time in your schedule, and transcribing the interview. I'm confident I am not ready for this!
Corey, in response to your comment about needing help to video tape during participant observation, you are right. Having a research team to assist us would be awesome. There is so much work to be done on a research project, and it looks like it could get expensive. Your grant-writing idea is right on target. Get all the kinks out of that, and you can be the go-to person for grant writing.
Yin lists three principles of data collection. One is the use of multiple sources of evidence that result in the same findings. This principle is important because it addresses the issue of construct validity. The second principle is having a case-study database which provides evidence separate from the final case study report. The third, having a chain of evidence, provides links among questions asked, data collected and conclusions drawn from the study. Both the case-study database and the chain of evidence are important because they increase the reliability of the case study.
ReplyDeleteSix Sources of Evidence:
1. Documents. A strength of this type of evidence is that it is exact, while a weakness is that it may be difficult to find.
2. Archival records. Like documents, these are exact, yet may not be easily accessible due to privacy issues.
3. Interviews. A strength here is that interviews are exact and focus directly on the topics being studied. However, bias may result if the questions are poorly written.
4. Direct observations. These are strong because they focus on events happening in real time. One weakness is that they can be time-consuming.
5. Participant-observation. This type of evidence has many of the same strenths and weaknesses as direct observations. Another strength is that they can be insightful into interpersonal behavior, another weakness is bias due to manipulation of the events by the participant-observer.
6. Physical artifacts. These are insightful into technical operations and cultural features yet may not be available in all situations.
Question: I noticed that one of the forms of documentation Yin lists is diaries. Yet he writes these may not be accurate and could very well be bias. Since bias is such a relevant concern, how can a diary be considered a true form of documentation?
Quote: (p 114) "... a major strength of case study data collection is the opportunity to use many different sources (of information)..."
Fact: (p119) The lack of a formal database for most case studies is a major shortcoming of case study research and needs to be corrected. (How would this be done?)
Barb, in response to your question, (and Mrs. Dalrymple's response) I would think being a participant-observer would be a difficult position, especially from the standpoint of trying not to be bias.
Corey, in response to your quote and question, just the thought that case studies are more complex is enough to scare me off!
Good job here! You are getting Yin's points!
ReplyDeleteFact: Yin explains that the 6 sources of evidence commonly found in case studies are documentation, archival records, interviews, direct observations, participant-observation, and physical-observation. Page 101
ReplyDeleteQuestion: Yin states that when using a document as evidence that the investigator has to constantly try to identify the objectives because most documents are for a different audience. Is the investment a waste of time it seems this type of evidence is very time consuming. Page 105
Quote: Overall, interviews are an essential source of case study evidence because most case studies are about human affairs or behavioral events. Page 108
Tanya, I think an interview would be one of the eaiest form of evidence. It is more structured and follows a procedure/protocol.
ReplyDeleteAnn, you make a great point about the use of diaries. I was very surprised that diaries could be considered a form of evidence.
The first principle is the use of multiple sources of evidence. This is significant because this type of evidence in case studies allows an investigator to address a broader range of historical and behavioral issues.
ReplyDeleteThe second principal is to create a case study database. This principle allows the investigator to organized and document data collection for a case study. Types of data collection are case study notes, case study documents, tabular materials, and narratives.
The third principal is to maintain a chain of evidence. This is significant because it allows an increase in reliability of the information in the case study.
6 sources of evidence:
Documentation: This type of evidence can be reviewed repeatedly, are not created because of a case study, contains names, references, and details of events, and consist of many events and setting. Weaknesses are that they can be difficult to find, can show bias, and may be deliberately withheld.
Archival records: This evidence can be precise and in a quantitative form so it may be easier to read. Weaknesses could be accessibility due to privacy reasons.
Interview’s strengths focus on specific topics, and perceive casual inferences and explanations. Weaknesses would be bias because of poor questions, bias, inaccuracies, and interviewees are not honest.
Direct observations cover real time events and context. This evidence can become time consuming, contains broad coverage with lack of people, the cost because of the hours needed by observers.
Participant-Observation is insightful to behavior and motives. Weaknesses are similar to direct observations and contain bias.
Physical artifacts are insightful into cultural features and technical operations. Weaknesses can consist of being selective and availability.
Quote: p100 “Unlike other methods, there is no clear cut-off point. You should try to collect enough data so that (a) you have confirmatory evidence (evidenced from two or more different sources) for most of your main topics, and (b) your evidence includes attempts to investigate major rival hypotheses or explanations.”
ReplyDeleteQuestion: Does the observer being part of the community he or she is studying affect the validity of the study? For example, on p111, Gans is a resident of the neighborhood he is studying. Does this undermine his research or add to it? And, in order for it to add to his research, what precautions must he take in order for his participation to be a benefit rather than a disadvantage?
Fact: p110 When combining field observations with other types of case study evidence, it is beneficial for the findings of the case study to be based on the convergence of information from different sources, not relying only on quantitative or qualitative data.
The 3 Principles of Data Collection:
ReplyDelete1: The use of multiple sources of evidence allows the researcher to develop converging lines of inquiry which is more convincing and accurate.
2: Creating a database for collecting data assists the researcher in organizing and documenting their data and sources.
3: Researchers increase the reliability of their case study by creating a chain of evidence in which the reader is able to link the research question to the conclusions that were drawn through each step of the research.
Six Sources of Evidence:
1: Documentation: used to corroborate and augment evidence from other sources; strengths-stable, unobtrusive, exact, broad coverage; weaknesses-difficult to find, biased selectivity, reporting bias, access may be limited
2: Archival Records: can be used extensively in quantitative research; strengths-precise, usually quantitative, stable, unobtrusive, exact, broad coverage; weaknesses-privacy limiting access, retrievability, biased selectivity, reporting bias, access withheld
3. Interviews: in case study research the interview questions are often fluid and may be modified as the interview proceeds; strengths- targeted, insightful; weaknesses-bias due to poor questions, response bias, inaccuracies due to poor recall, reflexivity
4. Direct Observation: allows the observations to be made in the natural setting of the case; strengths: covers events in real time, covers context of a case; weaknesses: time-consuming, selectivity, reflexivity, cost
5. Participant-Observation: used when the researcher participates in the events being studied; strengths: covers events in real time, contextual, insightful into interpersonal behavior and motives; weaknesses: time-consuming, selectivity, reflexivity, cost, bias due to participant-observer’s manipulation of events
6. Physical Artifacts: can be important to case study research because the artifact can add to the researcher’s perspective beyond what can be merely observed in a field study; strengths: insightful to cultural and technical operations, weaknesses; selectivity and availability
Ann D: I do think student interviews would be a great way for you to collect data.
ReplyDeleteMrs. Dalrymple: I agree that participant-observer method could lead to a stronger bias. I was worried about this too.
Corey: I love your research question. I am interested to hear more about your study or grant.
The three principles of data collection are 1) using multiple sources of data collection, 2)developing a case study database and 3)maintaining a chain of evidence they are significant to research because according to Yin they have been neglected in the past, and they help construct validity and reliability. Multiple sources of data collection help the researcher corroborate and augment evidence from other sources. A case study database allows a researcher to see what has been done in the past, and to check validity of data collected. The chain of evidence is a way of keeping the researcher and the data intact; a valid way of checking to see that the researcher went from one collection to another, and didnt just infer what to do next.
ReplyDeleteDocumentation: most commonly used during a case study. It's strengths are can be reviewed repeatedly, exact in detail, many events and setting. It's weaknesses are hard to find reporting bias of author and access may be deliberatly withheld.
ReplyDeleteArchival records can be "public use files" or other statistical data created by government, or maps and charts. The usefulness of using this type may vary from study to study. Kind of like an all or nothing either they will work for your study or they may not, a weakness I think. Also, not all local government websites are easy to negoiate. Their strengths would be that they are easy to find per internet, not just in your state, and they help create a visual, and they are precise for the researcher.
Interviews: To say that you will ask questions of another party seems easy enough, however the researcher has to operate on two levels at the same time. Satisfying the needs of your line of inquiry at the same time putting forth friendly and nonthreatening line of open ended questioning. So the weakness of this would be to maintain a non-biased leading voice during questioning, the strength would be to find out the hows and whys a subject answered questions.
Direct observations: a main strength of this type is to provide additional information of the topic being studied and the observation takes place in the same room that the study is being done, so an easy way to collect data. The weakeness would be time consuming for the researcher and the subjects being observed may act differently due to the observation.
Participant observation: It is similar to direct observation except that you as a researcher will also be in the observation. And then that may help you gain access to groups that may not be interested in being a part of straight observation. The weaknesses will be for the researcher to maintain biases as the observation takes place and the time it takes to do both and not to miss the data while you are participating.
Physical Artifact: They can be insightful to different cultures or technical operattions,and the weaknesses would be availability, harm to the artifact, and not losing it.
Fact:pg 118 Yin says, the requirement for mastering multiple data collection techniques raises important questions regarding the training and expertise of the investigator.
ReplyDeleteQuestion: I would think that multiple data collection is the goal for most of we researchers, so what extra training are we to get if any?
Quote:pg 118 "Yet a third way is to design different pilot studies that will provide an opprotunity for practicing different techniques." My guess is we will do this
Christina, I agree that docuementation seems like it will take the longest, yet it seems as if we have all thought that was the way we would go. I guess we better get started!
Ann D. I was wondering too which makes more sense to do a survey or an interview. I wonder if the time component will have anything to do with our decision?!