Describe the three principles of data collection and why those are significant to researchers. Also, describe six sources of evidence and their strengths and weaknesses which Yin reveals.
Data collection has three principles. They include: 1. Use Multiple Sources of Evidence Researchers need to use many sources of evidence when doing a case study. This will allow the researcher to address a broader range. The data will also be more accurate. Lacking many sources may turn your case study into something else.
2. Create a Case Study Database This is the way the researcher organizes and documents the data collected. Usually the data will be collected in two ways (data base and report of the investigator). Researchers need to try to make the research available to others. This will also make the case study more reliable. The reports need to hold enough information that readers can draw their own conclusions.
3. Maintain a Chain of Evidence Another way to increase reliability is with a case study is to keep a chain of evidence. If outside people want to trace your case study backwards.
Researchers will want to use as many as the six sources of evidence to make the case study better. The six sources are:
1. Documentation: They are sometimes hard to find, but usually valid. Researchers can use them to find correct information and spelling of things involoved in the research. researchers can make inferences from the documents. 2. Archival Records: These are usually precise but often hard to access. 3. Interviews: These are insightful, but can be bias or incorrect. Interview questions are more likely to be fluid than rigid. There are different types of interviews. These can be very time consuming. 4. Direct Observation: This can be formal or casual. To make this more reliable have more than one observer. 5. Participant Observation: The researcher takes on roles while observing. This is a very insightful way to collect data but is not always available to researchers. 6. Physical Artifacts: Artifacts can be insightful however not also available. Some artifacts may also be picked selectively.
Wow. That is a lot of stuff BUT it does make sense and it was not that hard to read about.
Question: I don't have one at this point. Fact: DOCUMENT EVERYTHING YOU ARE DOING! Quote: Page 124 "The data collection process for case studies is more complex than those used in other research methods." I have figured that out!
Good job here! Did you see I put your group's journal in the journal 1 section? I will try to grade those this weekend, and send you your grades individually. I loved your image for the ISEEI strategy, and from scanning it, the content looked good too.
Ch. 4 Discussion Post Describe the three principles of data collection and why those are significant to researchers. Also, describe six sources of evidence and their strengths and weaknesses which Yin reveals.
6 sources of evidence 1) Documentation: Stable and can be reviewed repeatedly, Exactness BUT it can be biased and hard to find 2) Archival Records: Precise and usually quantitative BUT may have accessibility issues due to privacy 3) Interviews:Targeted and insightful BUT can be biased becasue of poor questioning or reflexivity(participant tellinh the interveiwer what they think they want to hear 4) Direct Observation: Reality-real time events and covers context of the case BUT is time consuming and reflexivity can occur 5) Participant Observation: Insightful into interpersonal behavior and motives BUT can be biased because of reflexivity 6) Physical Artifacts: Insightfu into cultural and technical operations BUT may have issues with selectivity and availability
3 principles of data collection 1)Use Multiple Sources of Evidence: This allows the reseacher to further prove the reliability of their study because the flaws of some methods can then be overcome in another. Data triangulation helps prove the rationale for using multiple sources of evidence. It allows researchers to address a broader range of historical and behavioral issues. 2)Create a Case Study Database: Includes bothe the actual data or evidentiary base and the report of the investigator. It is needed so that the reader of the case study can readily find the data without reading the entire study. 3)Maintain a Chain of Evidence: This helps with the reliability of the study. If it is clearly laid out, any researcher should be able to trace your exact porcedures.
Quote-"Every report should contain enough data fo that the reader of the report can draw independent conclusions about the case study. Fact- Physical artifacts may be difficult to obtain. Question- How much physical evidence should "we" include?
I think Annie and Erin both covered the info from this chapter very well. To summarize I guess then, the three principles in data collection are: use multiple sources of evidence would this include our literature review and our observations?), create a case study data base, and maintain a chain of evidence. All three of these as described by Annie and Erin will help with reliability. The six sources are documentation, archival records, interviews, direct observations, participant interviews, and artifacts. I think for us we will be using a lot of observation, interviews, and participant observations. However, I'm concerned about the observations made by 5-7 year olds but I'll cross that bridge when I get there. I think that the observations made by myself, other teachers, and parents will be more beneficial. Question: Can we be each others extra observer? If possible can we watch some of the activties like for instance, Annie could watch a pathways lesson or testing and make her own observations then we could compare and see what we both picked up on or what one may have missed? Or could we use a teacher not involved in the study, like a reading teacher who works with the kids I'm also studying? Could Annie and Laurel use each other since they teach the same grade and both give the spelling test? Erin, I would think "how much evidence depends on what you can find for your lit review and then what observations, interviews, etc that you conduct" I wouldn't think there would be a set amount since everyone's will be so different. Does that make sense? If I'm way off the mark here Dr. Hendrix please let me know.
The 3 principals of data collection are; 1. Using multiple sources of evidence- This allows for "multiple measurement of the same phenomena". Hopefully your data collected in various ways will complement each other and verify each other. Case studies that use multiple sources are rated more highly. It seems more scientific because you are exploring more avenues to get to the same truth. 2. Creating a case study database- This has to do with the organization and documentation of the data collected. It is usually separated into two collections; data or evidence and reports of investigators. This information has to be later accessible by others, so independent analysis can occur. This increases the reliability of the case study. 3. Maintain a chain of evidence- You should be able to retrace the steps of the evidence--forwards or backwards--to arrive at the same results. In this way the data collection chain is much like forensic evidence in a crime scene. The six sources of evidence are as follows: - Documentation The strength of documentation is it can be repeatedly reviewed, is exact,and has broad coverage. The weakness is that is can be biased by author, access may be withheld, and it can be hard to retrieve.
- Archival Records The strength is the same as documentation, and it is precise and usually quantitative. The weakness is accessibility due to privacy issues, as well as those listed for documentation.
- Interviews- The strengths are it is targeted on case study topics, and it can be very insightful. The weakness is there can be bias due to poor questioning, there can be bias in responses, poor recall can effect accuracy, and pleasing the interviewer can effect results.
- Direct Observations- The strength is it is recorded in real time and it covers the context of the case. The weakness is it is time consuming, broad coverage is difficult, observation may inhibit what is observed, and the cost in hours is high.
- Participant-Observation The strength is the same as direct observations and it has insight into interpersonal behavior and motives which would be otherwise unknown to outsiders. Weakness is the same as direct observations and the possibility that the participant/observer could somehow manipulate the events.
- Physical Artifacts The strength is the insight received into culture and technical operations. The weakness is the availability of artifacts and which ones are selected.
Question: I have a big question about studying the implementation of our new reading testing/intervention plan because we are so lacking in our progress. I need help with how to structure it and even get it approved by my administrators because at this point looking at how we are(or are not) implementing it may involve some negative points they do not want highlighted. Do I forge ahead? Is it all in how I word it?
1. Documentation- anything from letters and e-mails to minutes of meetings and news clippings. These are beneficial because they can be reviewed repeatedly, but they also may be biased (personal documentation especially). 2. Archival records- more “official” documents such files and records. These are a bit different from documentation because they are usually more precise and quantitative but may be hard to access. 3. Interviews- may be in-depth, focused, or more along the lines of a formal survey. Interviews are targeted and insightful, but must be conducted carefully to prevent problems due to poorly articulated questions or poor recall. 4. Direct observation- researcher watches the person being studied in his/her natural setting. This source of evidence covers events in real time and covers context of the case, but it may be very time-consuming. 5. Participant-observation- researcher takes an active role rather than just being a passive observer. This method is very insightful, yet it may be biased due to the participant-observer’s manipulation of events. 6. Physical artifacts- includes a physical or cultural artifact. May include a technological device that is relevant to the study. This is insightful into various cultures or technologies but may not be highly available.
Three principles of data collection 1. Use multiple sources of evidence- This is very important to develop converging lines of inquiry. A single source of evidence is not recommended for case studies. 2. Create a case study database- make a collection of your database and a collection of your reports. Write down and keep EVERYTHING! The key is organization. 3. Maintain a chain of evidence- an external observer must be able to follow the derivation of any evidence from initial research questions to ultimate case study conclusions (everything should be there from beginning to end). This increases reliability of the case study.
Question: Would my external observer be you, Dr. Hendrix, or would it be another teacher in my school? Also should I use computer printouts of student work and written work as artifacts for my research? Fact: Notes don’t necessarily need to be revised and edited; just keep them organized. Quote: “The lack of a formal database for most case studies is a major shortcoming of case study research and needs to be corrected.”
You are thinking like a researcher here. You are right on the mark. If you have someone else back up your observations and work on your triangulation of data from multiple sources, that will help you. Help each other here!
6 sources of evidence: 1. Documentation: Easy to find due to the internet. The most important use of them for case studies is to corroborate evidence from other sources. It is important to mention that they can be very biased and may not always be accurate.
2. Archival records: May be very important in some cases while in others they may not be as relevant. Must remember that they were created for a specific purpose and must be reviewed for bias and accuracy.
3. Interviews: Interviews are guided conversations. You will need to have a "line of inquiry" but will also need to be flexible with the direction the conversation may take. May be in-depth or focused. Interviews are essential to case study evidence.
4. Direct Observation: Range from formal to casual data collection. Observations take place during a field visit. Often useful in providing additional information about the topic of study.
5. Participant-Observation: The researcher takes on the role of participant. Most often used in anthropological studies. Allows a researcher to gain access to events or groups. Potential bias is seen as a weakness.
6. Physical Artifacts: Physical or cultural artifacts. While not relevant for all case studies, often used in anthropological case studies.
3 principals of data collection: 1. Use multiple sources of evidence: using multiple sources will create a more valid study as your results will be supported by multiple measures. It will also allow you to "address a broader range of historical and behavioral issues"
Quote:"With data triangulation, the potential problems of construct validity also can be addressed because the multiple sources of evidence essentially provide multiple measure of the same phenomenon". This makes sense but I can see another time crunch coming on! :)
2. Create a case study database: this has to do with the organization and collection of data. "The lack of a formal database for most case studeis is a major shortcoming of case study research and needs to be corrected." Consists of case study notes, case study documents, tabular materials, and narratives. Need to be stored in a manner that makes them easily accessible.
3. Maintain a chain of evidence: increases reliability. An external observer follows the evidence from the initial research to the study conclusions. They should be able to make the same conclusions.
Question:How do you go about creating a case study database? It makes sense to me that you would want it to be mostly electronic so that it would be easier to access but how do you make it accessible to others?
Ok this chapter was much easier to digest. Maybe it would help if I would stay caught up instead of trying to read so many at once... :)
Principle 1: Use multiple sources of evidence Use this in order to triangulate and increase validity 2. Create a case study database A collection of resources used, referenced, or possible sources. This also increases validity. 3. Maintain a chain of evidence Allows an eternal observer to follow the study
6 sources of evidence 1. Documentation 2. Archival records 3. Interviews 4. Direct observation 5. Participant-observation 6. Physical artifacts
Most all of these sources give insight to the case study, but with that insight comes the possibility that the insight is biased and not readily available.
Data collection has three principles. They include:
ReplyDelete1. Use Multiple Sources of Evidence
Researchers need to use many sources of evidence when doing a case study. This will allow the researcher to address a broader range. The data will also be more accurate. Lacking many sources may turn your case study into something else.
2. Create a Case Study Database
This is the way the researcher organizes and documents the data collected. Usually the data will be collected in two ways (data base and report of the investigator). Researchers need to try to make the research available to others. This will also make the case study more reliable. The reports need to hold enough information that readers can draw their own conclusions.
3. Maintain a Chain of Evidence
Another way to increase reliability is with a case study is to keep a chain of evidence. If outside people want to trace your case study backwards.
Researchers will want to use as many as the six sources of evidence to make the case study better. The six sources are:
1. Documentation: They are sometimes hard to find, but usually valid. Researchers can use them to find correct information and spelling of things involoved in the research. researchers can make inferences from the documents.
2. Archival Records: These are usually precise but often hard to access.
3. Interviews: These are insightful, but can be bias or incorrect. Interview questions are more likely to be fluid than rigid. There are different types of interviews. These can be very time consuming.
4. Direct Observation: This can be formal or casual. To make this more reliable have more than one observer.
5. Participant Observation: The researcher takes on roles while observing. This is a very insightful way to collect data but is not always available to researchers.
6. Physical Artifacts: Artifacts can be insightful however not also available. Some artifacts may also be picked selectively.
Wow. That is a lot of stuff BUT it does make sense and it was not that hard to read about.
Question: I don't have one at this point.
Fact: DOCUMENT EVERYTHING YOU ARE DOING!
Quote: Page 124 "The data collection process for case studies is more complex than those used in other research methods." I have figured that out!
Annie,
ReplyDeleteGood job here! Did you see I put your group's journal in the journal 1 section? I will try to grade those this weekend, and send you your grades individually. I loved your image for the ISEEI strategy, and from scanning it, the content looked good too.
Keep working hard,
Dr. Hendrix
Ch. 4 Discussion Post
ReplyDeleteDescribe the three principles of data collection and why those are significant to researchers. Also, describe six sources of evidence and their strengths and weaknesses which Yin reveals.
6 sources of evidence
1) Documentation: Stable and can be reviewed repeatedly, Exactness BUT it can be biased and hard to find
2) Archival Records: Precise and usually quantitative BUT may have accessibility issues due to privacy
3) Interviews:Targeted and insightful BUT can be biased becasue of poor questioning or reflexivity(participant tellinh the interveiwer what they think they want to hear
4) Direct Observation: Reality-real time events and covers context of the case BUT is time consuming and reflexivity can occur
5) Participant Observation: Insightful into interpersonal behavior and motives BUT can be biased because of reflexivity
6) Physical Artifacts: Insightfu into cultural and technical operations BUT may have issues with selectivity and availability
3 principles of data collection
1)Use Multiple Sources of Evidence: This allows the reseacher to further prove the reliability of their study because the flaws of some methods can then be overcome in another. Data triangulation helps prove the rationale for using multiple sources of evidence. It allows researchers to address a broader range of historical and behavioral issues.
2)Create a Case Study Database: Includes bothe the actual data or evidentiary base and the report of the investigator. It is needed so that the reader of the case study can readily find the data without reading the entire study.
3)Maintain a Chain of Evidence: This helps with the reliability of the study. If it is clearly laid out, any researcher should be able to trace your exact porcedures.
Quote-"Every report should contain enough data fo that the reader of the report can draw independent conclusions about the case study.
Fact- Physical artifacts may be difficult to obtain.
Question- How much physical evidence should "we" include?
Erin,
ReplyDeleteGood points here!
Let me know if I can help you in any way.
Take care!!
I think Annie and Erin both covered the info from this chapter very well.
ReplyDeleteTo summarize I guess then, the three principles in data collection are: use multiple sources of evidence would this include our literature review and our observations?), create a case study data base, and maintain a chain of evidence. All three of these as described by Annie and Erin will help with reliability.
The six sources are documentation, archival records, interviews, direct observations, participant interviews, and artifacts. I think for us we will be using a lot of observation, interviews, and participant observations. However, I'm concerned about the observations made by 5-7 year olds but I'll cross that bridge when I get there. I think that the observations made by myself, other teachers, and parents will be more beneficial.
Question: Can we be each others extra observer? If possible can we watch some of the activties like for instance, Annie could watch a pathways lesson or testing and make her own observations then we could compare and see what we both picked up on or what one may have missed? Or could we use a teacher not involved in the study, like a reading teacher who works with the kids I'm also studying? Could Annie and Laurel use each other since they teach the same grade and both give the spelling test?
Erin, I would think "how much evidence depends on what you can find for your lit review and then what observations, interviews, etc that you conduct" I wouldn't think there would be a set amount since everyone's will be so different. Does that make sense? If I'm way off the mark here Dr. Hendrix please let me know.
Thanks Dr. Hendrix! I did notice you posted the journal. Thanks for your ongoing help and support!
ReplyDeleteThe 3 principals of data collection are;
ReplyDelete1. Using multiple sources of evidence-
This allows for "multiple measurement of the same phenomena". Hopefully your data collected in various ways will complement each other and verify each other. Case studies that use multiple sources are rated more highly. It seems more scientific because you are exploring more avenues to get to the same truth.
2. Creating a case study database-
This has to do with the organization and documentation of the data collected. It is usually separated into two collections; data or evidence and reports of investigators. This information has to be later accessible by others, so independent analysis can occur. This increases the reliability of the case study.
3. Maintain a chain of evidence-
You should be able to retrace the steps of the evidence--forwards or backwards--to arrive at the same results. In this way the data collection chain is much like forensic evidence in a crime scene.
The six sources of evidence are as follows:
- Documentation
The strength of documentation is it can be repeatedly reviewed, is exact,and has broad coverage. The weakness is that is can be biased by author, access may be withheld, and it can be hard to retrieve.
- Archival Records
The strength is the same as documentation, and it is precise and usually quantitative. The weakness is accessibility due to privacy issues, as well as those listed for documentation.
- Interviews-
The strengths are it is targeted on case study topics, and it can be very insightful. The weakness is there can be bias due to poor questioning, there can be bias in responses, poor recall can effect accuracy, and pleasing the interviewer can effect results.
- Direct Observations-
The strength is it is recorded in real time and it covers the context of the case. The weakness is it is time consuming, broad coverage is difficult, observation may inhibit what is observed, and the cost in hours is high.
- Participant-Observation
The strength is the same as direct observations and it has insight into interpersonal behavior and motives which would be otherwise unknown to outsiders. Weakness is the same as direct observations and the possibility that the participant/observer could somehow manipulate the events.
- Physical Artifacts
The strength is the insight received into culture and technical operations. The weakness is the availability of artifacts and which ones are selected.
Question:
I have a big question about studying the implementation of our new reading testing/intervention plan because we are so lacking in our progress. I need help with how to structure it and even get it approved by my administrators because at this point looking at how we are(or are not) implementing it may involve some negative points they do not want highlighted. Do I forge ahead? Is it all in how I word it?
Kristin- You are probably right about my lit reviews... Hmmm.
ReplyDelete1. Documentation- anything from letters and e-mails to minutes of meetings and news clippings. These are beneficial because they can be reviewed repeatedly, but they also may be biased (personal documentation especially).
ReplyDelete2. Archival records- more “official” documents such files and records. These are a bit different from documentation because they are usually more precise and quantitative but may be hard to access.
3. Interviews- may be in-depth, focused, or more along the lines of a formal survey. Interviews are targeted and insightful, but must be conducted carefully to prevent problems due to poorly articulated questions or poor recall.
4. Direct observation- researcher watches the person being studied in his/her natural setting. This source of evidence covers events in real time and covers context of the case, but it may be very time-consuming.
5. Participant-observation- researcher takes an active role rather than just being a passive observer. This method is very insightful, yet it may be biased due to the participant-observer’s manipulation of events.
6. Physical artifacts- includes a physical or cultural artifact. May include a technological device that is relevant to the study. This is insightful into various cultures or technologies but may not be highly available.
Three principles of data collection
1. Use multiple sources of evidence- This is very important to develop converging lines of inquiry. A single source of evidence is not recommended for case studies.
2. Create a case study database- make a collection of your database and a collection of your reports. Write down and keep EVERYTHING! The key is organization.
3. Maintain a chain of evidence- an external observer must be able to follow the derivation of any evidence from initial research questions to ultimate case study conclusions (everything should be there from beginning to end). This increases reliability of the case study.
Question: Would my external observer be you, Dr. Hendrix, or would it be another teacher in my school?
Also should I use computer printouts of student work and written work as artifacts for my research?
Fact: Notes don’t necessarily need to be revised and edited; just keep them organized.
Quote: “The lack of a formal database for most case studies is a major shortcoming of case study research and needs to be corrected.”
Kristin,
ReplyDeleteYou are thinking like a researcher here. You are right on the mark. If you have someone else back up your observations and work on your triangulation of data from multiple sources, that will help you. Help each other here!
Keep reading and thinking!
Jill,
ReplyDeleteIf you have someone there who can verify what you say is accurate, that would be good.
Good job here everyone!!!
6 sources of evidence:
ReplyDelete1. Documentation: Easy to find due to the internet. The most important use of them for case studies is to corroborate evidence from other sources. It is important to mention that they can be very biased and may not always be accurate.
2. Archival records: May be very important in some cases while in others they may not be as relevant. Must remember that they were created for a specific purpose and must be reviewed for bias and accuracy.
3. Interviews: Interviews are guided conversations. You will need to have a "line of inquiry" but will also need to be flexible with the direction the conversation may take. May be in-depth or focused. Interviews are essential to case study evidence.
4. Direct Observation: Range from formal to casual data collection. Observations take place during a field visit. Often useful in providing additional information about the topic of study.
5. Participant-Observation: The researcher takes on the role of participant. Most often used in anthropological studies. Allows a researcher to gain access to events or groups. Potential bias is seen as a weakness.
6. Physical Artifacts: Physical or cultural artifacts. While not relevant for all case studies, often used in anthropological case studies.
3 principals of data collection:
1. Use multiple sources of evidence: using multiple sources will create a more valid study as your results will be supported by multiple measures. It will also allow you to "address a broader range of historical and behavioral issues"
Quote:"With data triangulation, the potential problems of construct validity also can be addressed because the multiple sources of evidence essentially provide multiple measure of the same phenomenon". This makes sense but I can see another time crunch coming on! :)
2. Create a case study database: this has to do with the organization and collection of data. "The lack of a formal database for most case studeis is a major shortcoming of case study research and needs to be corrected." Consists of case study notes, case study documents, tabular materials, and narratives. Need to be stored in a manner that makes them easily accessible.
3. Maintain a chain of evidence: increases reliability. An external observer follows the evidence from the initial research to the study conclusions. They should be able to make the same conclusions.
Question:How do you go about creating a case study database? It makes sense to me that you would want it to be mostly electronic so that it would be easier to access but how do you make it accessible to others?
Ok this chapter was much easier to digest. Maybe it would help if I would stay caught up instead of trying to read so many at once... :)
Principle 1: Use multiple sources of evidence
ReplyDeleteUse this in order to triangulate and increase validity
2. Create a case study database
A collection of resources used, referenced, or possible sources. This also
increases validity.
3. Maintain a chain of evidence
Allows an eternal observer to follow the study
6 sources of evidence
1. Documentation
2. Archival records
3. Interviews
4. Direct observation
5. Participant-observation
6. Physical artifacts
Most all of these sources give insight to the case study, but with that insight comes the possibility that the insight is biased and not readily available.
I like all information that you provide in your articles.
ReplyDeleteppi
Your articles don't displace around the bushes correct t to the part.
ReplyDeleteppi