Q&A Hero

Q: Grace conducts research on race and achievement in mathematics. She designs a study to see if a new intervention she designed increases African-American students' math achievement scores. She goes to a local school with a representative Aftrican-American student population and randomly assigns college-bound African-American students to the intervention or to a control condition. Grace gives a mathematics achievement test in September to both groups. Through the academic year the treatment condition receives the intervention. She uses end of year achievement tests to see if there are differences between conditions. Which of the following external validity threats should most concern Grace regarding her study? a. Selection b. History c. Instrumentation d. Maturation

Q: Ida is a teacher who is interested in other teachers' opinions of full day versus part day kindergarten programs. Ida's study can best be described as a a. developmental survey. b. school survey. c. practical survey. d. sample survey.

Q: Dom investigates how students with processing disorders read web pages. In a previous study, he found that elementary learning disabled students with processing disorders read web pages from top to bottom. In this current study he is testing how high school students read web pages. Which of the following is the dependent variable in Dom's study? a. Elementary grades b. Processing disorders c. Web page reading d. High school grades

Q: Sevil found through his study of college bound students that some high achieving female mathematics students elect to pursue mathematics related fields and others do not consider such fields. He conducts follow-up interviews with some of the young women that are, and some that are not, pursuing mathematics degrees. Sevil is best displaying which type of mixed-methods design? a. Triangulation b. Explanatory c. Exploratory d. Descriptive

Q: Field notes should be written a. in the field during the observation. b. after a time delay to assure reflection. c. as concisely as possible. d. by an assistant not the researcher.

Q: Ewa is an athletic trainer at the university. She conducts research on violence in sport. She has designed a study to examine the effects of a new sportsmanship class. She randomly assigns teams by sport to be in either her new class or not. That is, some teams are in the class and others are not. She then compares incidents of violence between groups. What is one threat that Ewa must be particularly concerned about? a. Instrumentation b. Mortality c. Selection d. History

Q: The most common form of surveys in education are referred to as a. developmental surveys. b. school surveys. c. sample surveys. d. practical surveys.

Q: Dom investigates how students with processing disorders read web pages. In a previous study, he found that elementary learning disabled students with processing disorders read web pages from top to bottom. In this current study he is testing how high school students read web pages. Dom's study can best be classified as a ________ study. a. replication b. duplication c. generalization d. extension

Q: Marci has collected qualitative data and survey data. She codes the qualitative data and quantifies it and then compares these data to her survey data. Marci is best displaying which type of mixed-methods design? a. Triangulation b. Explanatory c. Exploratory d. Descriptive

Q: Geir is a qualitative researcher interested in studying the role playing games of current children that relate to Nordic heroes. To collect data he goes to afterschool programs that allow a free play period. He observes the children as they play, documenting who they are role playing and the behaviors they engage in as well as how they socially negotiate the script of their play. Geir is best described as a a. Participant observer b. Non participant observer c. Privileged observer d. Covert observer

Q: Ingrid works as a teacher in a small private school that does not have a food service program. She sees what kids bring to school and is very worried that families are not supporting their children's nutritional needs enough. This year she decides to conduct a study to see if sending home literature and homework that parents must do with their children makes a difference in their application of appropriate selections in children's lunches at the end of the year. Which of the following designs best represents Ingrid's research design plan? a. One shot case study b. Static group comparison c. Pretest-post-test control group d. Soloman Four group

Q: Survey data are collected in two primary ways. These two ways are through a. self-report instruments and achievement tests. b. projective assessments and self-report instruments. c. Interviews and questionnaires. d. Projective assessments and observation.

Q: Which of the following is an example of a researchable topic? a. Should we teach children formal reading skills before they enter school? b. Is there a relationship between SES and children's amount of reading in the home? c. Are high school students best served by taking numerous electives or a core curriculum? d. Should all children be exposed to exercise at school daily?

Q: For classification purposes, the primary differences among mixed-methods designs as presented in your text, relates to all EXCEPT which of the following? a. Data analysis b. Sequence c. Interpretation d. Priority

Q: Field notes include a. the informant's descriptions. b. the gatekeeper's reflections. c. both informant and researcher descriptions. d. the researcher's descriptions and reflection.

Q: Archimedes read about a study that found that soft music during stressful events was soothing for many workers. He thinks that test taking is stressful for many learners and wants to conduct an experiment to determine if music playing during testing assists in student test performance. Therefore, he randomly assigns all of the introductory biology classes into one of three groups. One group that tests as usual without music, one group that listens to soft music during the test, and the final group that listens to a CD with the latest pop music tracks playing. Which of the following designs best represents Archimedes' study? a. One shot case study b. Static group comparison c. Post-test only control group design d. Soloman four group design

Q: Ms. Wang's study addresses the reasons that parents report for sending their children to dance lessons. She has defined her topic and reviewed the literature, and has stated her questions. The next step in Ms. Wang's study is to a. identify and select research participants. b. create her research instrument. c. seek informed consent permission. d. report on her research findings.

Q: Servio is particularly interested in how families react to an initial learning disability diagnosis. Unfortunately he needs more participants than there are actual new diagnoses in his school. Therefore, in the design of his study he proposes to tell parents that their children have been tested and diagnosed as learning disabled and will conduct an interview with the parents to get their initial reactions. However, the children will not have been diagnosed. His advisor tells him that he cannot conduct the study. Of the following what is the likely reason why. a. The study is too broad. b. The study is not ethical. c. The study is not relevant. d. The study is too narrow.

Q: When researchers obtain themes and specific statements from individuals to create new scales and items for questionnaires, they are said to be employing a(n) ________________ approach to mixed-methods research. a. triangulation. b. interpretation. c. exploratory. d. explanatory.

Q: In the initial observation session it is suggested that the researcher a. stay for an extended length of time to better understand the setting. b. stay for a short time until the process of writing field notes is established. c. observe only, do not take any field notes as it will diminish your focus. d. ask numerous questions of all potential participants to establish rapport.

Q: Archimedes read about a study that found that soft music during stressful events was soothing for many workers. He thinks that test taking is stressful for many learners and wants to conduct an experiment to determine if music playing during testing assists in student test performance. Therefore, he randomly assigns all of the introductory biology classes into one of three groups. One group that tests as usual without music, one group that listens to soft music during the test, and the final group that listens to a CD with the latest pop music tracks playing. Given Archimedes' study, the dependent variable is __________________. a. biology class. b. test performance. c. type of music. d. test anxiety.

Q: Melanie is conducting a survey for her thesis that examines administrative policies in middle schools that are intended to decrease bullying. After developing her survey and piloting the instrument with a small group, she then administers the instrument to a sample of 2300 middle school administrators. Which of the following survey research designs best describes Melanie's study? a. Cross-sectional b. Trend c. Cohort d. Panel

Q: Dei read this really interesting study that examined the benefits of a structured program that taught problem-solving to disadvantaged children. Although the population that he works with is not considered disadvantaged, Dei would like to conduct a similar study at his school. Of the following types of studies, which best describes Dei's idea? a. Replication b. Generalization c. Application d. Extension

Q: When researchers follow up on outliers or extreme cases with qualitative methods based upon their quantitative data, they are employing a(n) __________ approach to mixed-methods research. a. triangulation. b. interpretation. c. exploratory. d. explanatory.

Q: Of the following types of observation for qualitative data collection, which is considered the LEAST obtrusive? a. Participant observer b. Nonparticipant observer c. Overt observer d. Privileged observer

Q: Chin-Hsing conducted a study that examined motivation for sport and academics in a Taiwanese school for gifted athletes. One concern that Chin-Hsing has is that the findings from the study may not relate to findings that would be found in another school or country. The validity threat most evident in his concern is a. Internal validity b. External validity c. Construct validity d. Predictive validity

Q: Of the following, which is most likely a survey research topic? a. Is there a gender difference in science achievement on The Programme for International Student Assessment (PISA)? b. Do parents believe that the new middle school science club is worth the funds the district spent? c. What is the experience of ten-year olds at the summer Science day camp held at the university? d. Is there a relationship between science self-efficacy and students science grades in eleventh grade?

Q: Of the following, which is most likely addressed as a quantitative research topic? a. The purpose of the study is to examine the relationship between IQ score and Post-graduate GPA. b. The purpose of the study is to describe the typical day of a high school history teacher. c. The current study shares a summary of the coping strategies used by a n ADHD student in an inclusion classroom. d. This work shares the history of the events that led to consolidation of two local rural high schools.

Q: The QUAL-quan model of mixed methods design is also known as a. triangulation. b. interpretation. c. exploratory. d. explanatory.

Q: Jill, a sociologist, is interested in social networking behaviors of exceptional business students. She goes to the business student socials, honorary meetings, and other public events. She does not interact with the business students but does observe and record their behaviors. In this scenario, Jill is best described as a(n) a. participant observer. b. nonparticipant observer. c. overt observer. d. privileged observer.

Q: One caution with factorial designs is that a. they are less valid than most other designs. b. they require more participants. c. interactions impede the significant findings. d. they are not used in educational studies.

Q: According to your text, one particular challenge of self-report studies is that a. people don"t believe the findings from self-report studies. b. self-report studies are more challenging to conduct than other types of research. c. self-report studies often suffer from lack of participant response. d. It is not possible to obtain valid results from self-report studies.

Q: Kyle is a quantitative researcher doing research in a relatively new area of study. He is testing his hypothesis with a study. Which type of hypothesis is he most likely testing? a. Null b. Directional c. Nondirectional d. Post-hoc

Q: The QUAN-QUAL model of mixed methods design is also known as a. triangulation. b. interpretation. c. exploratory. d. explanatory.

Q: Damir is a music educator interested in successful high school Jazz programs. He goes to work as a "˜new" teacher at a high school with a high-ranking Jazz program. He works with the students and with the music educator at the school while exploring the Jazz program. Given this scenario, which of the following research sites is likely MOST pertinent to Damir's study? a. The teachers' lounge in the music wing of the building b. The Jazz programs' concerts c. The Jazz programs' practice sessions d. Individual student lessons with the Jazz instructors

Q: A study that addressed the effects of gender and type of practice (massed, distributed, massed and distributed) would be symbolized as a. 2x2 factorial design b. 3x2 factorial design c. 2x3 factorial design d. Soloman four group design

Q: Of the following, which is an example of a survey research topic? a. Does the intervention increase reading skills? b. Is there a relationship between task performance and age? c. What are the participants' opinions regarding effective instruction? d. Are there differences by SES on the new aptitude measure?

Q: Lindsay studies community and school relationships. She is currently working on a qualitative study in a rural school district. Which of the following is likely true of her study? a. Her hypothesis were stated prior to the start of data collection. b. Her hypothesis determined her data collection procedures. c. Her hypothesis were generated while she collected data. d. Her hypothesis may be rejected after data collection.

Q: The QUAN-qual model of mixed methods design is also known as a. triangulation. b. interpretation. c. exploratory. d. explanatory.

Q: Damir is a music educator interested in successful high school Jazz programs. He goes to work as a "˜new" teacher at a high school with a high-ranking Jazz program. He works with the students and with the music educator at the school while exploring the Jazz program. In this scenario, Damir is best described as a a. participant observer. b. nonparticipant observer. c. covert observer. d. experienced observer.

Q: A study that investigates the effects of three different types of instruction (text only, text with pictures, text with animation), and spatial ability (high, low) would be symbolized as a a. 2x2 factorial design b. 3x2 factorial design c. 2x3 factorial design d. Soloman four group design

Q: Jonah has developed a new scale to measure tolerance of software engineers during technology renovations. He selects a sample of software engineers and administers the draft instrument to them and calculated a KR 20 of .45. Given what you know about this type of measurement, please answer the following questions. Given the KR 20 value, which can you conclude about this instrument? a. It demonstrates high reliability b. It demonstrates sound reliability c. It demonstrates average reliability d. It demonstrates inadequate reliability

Q: Which of the following is a nondirectional hypothesis for the research topic, Are there differences in end of course biology test grades between those who use simulated labs and those who use traditional labs? a. There are differences in end of course biology test grades between those taught through the use of simulated versus traditional labs. b. There are no differences in end of course biology test grades between those taught through the use of simulated versus traditional labs. c. Those taught in simulated labs perform better on end of course biology tests than those taught in traditional labs. d. Those taught in traditional labs perform better on end of course biology tests than those in simulated labs.

Q: In the wake of a recent school violence incident, Laura studied people's reactions at the school through the simultaneous use of observations, interviews, and surveys, and triangulated these data. Laura's research is best classified as a. qualitative. b. QUAN-QUAL. c. QUAL- quan. d. QUAN-qual.

Q: Lupe's study describes the experiences of Division I cross country athletes. She uses observations as her primary data collection methods. Which of the following research sites is likely MOST pertinent to Lupe's study? a. Cross country practice b. Coaches' conference meeting c. Parent's of athletes homes d. Athlete's high school coaches offices

Q: How many cells does a 2 x 4 factorial design have? a. 2 b. 4 c. 6 d. 8

Q: Jonah has developed a new scale to measure tolerance of software engineers during technology renovations. He selects a sample of software engineers and administers the draft instrument to them and calculated a KR 20 of .45. Given what you know about this type of measurement, please answer the following questions. The type of instrument that Jonah developed is referred to as a. An aptitude measure b. An attitude scale c. An personality scale d. A projective measure

Q: Which of the following is a null hypothesis for the research topic Are there differences in final class grades between students who are taught psychology in a lecture format or self-paced? a. There are differences in final class grade between students taught psychology in lecture versus self-paced format. b. There are no differences in final class grade between students taught psychology in lecture versus self-paced format. c. Students taught psychology in lecture format receive higher class grades than those in self-paced conditions. d. Students in self-paced conditions have higher class grades in psychology than those in lecture classes.

Q: Brenda studies first-generation college students. She uses institutional data that tracks these students from high-school into college until subsequent drop-out or graduation. She uses their student grades, major, and inventories of their feelings of success and attitudes about college. She also interviews a select number of the students. Brenda's study is best described as a _____________ study. a. QUAN-QUAL b. quantitative c. QUAL- quan d. QUAN-qual

Q: Lakyle's study explores social interactions among mentally disabled adult piece workers. She uses observation as her primary data collection method. Which of the following research sites is likely MOST pertinent to Lakyle's study? a. The assembly room where participants work b. Transportation of individual participants to work c. Participants classroom type training experiences d. Participants interactions with their caregivers about work

Q: Kari wants to make sure that all students in her study get both of the treatments she is testing. To assure all subjects get both interventions, which of the following designs should Kari consider? a. Within-subjects design b. Soloman Four-Group design c. Counterbalanced design d. Nonequivalent groups control group design

Q: Jianan is conducting a thesis study that relates learners' working memory to speed in algebraic problem solving. She measures working memory by a digit span task. She uses a researcher created test to measure problem solving. She will also collect demographic data and measure beliefs and attitudes about science. Tristan is a participant in Jianan's study. His score on the problem solving measure is considered a. data. b. a construct. c. a variable. d. knowledge.

Q: Which of the following is a nondirectional hypothesis? a. There are no differences in reading comprehension between those taught a summarization strategy and those not taught the strategy. b. Readers who are taught a summarizing strategy have higher reading comprehension scores than those not taught the strategy. c. Readers taught a summarizing strategy have lower reading comprehension scores than those who were not taught the strategy. d. There are differences in reading comprehension between readers who are taught a summarizing strategy and those who are not taught the strategy.

Q: Marcy is interested in the achievement of low-SES high achieving females in rural school districts. She uses measures of achievement in her analysis and tracks the students' grades from middle school to high school graduation. Marcy's study is an example of ______________ research. a. QUAN-QUAL b. quantitative c. QUAL- quan d. QUAN-qual

Q: As a researcher interested in young children's motivation to read, Cynthia works as a volunteer in a pre-kindergarten setting for approximately 6 months as she collects data regarding children's reading motivation. In this scenario, Cynthia is best described as a a. Participant observer. b. Nonparticipant observer. c. Covert observer. d. Experienced observer.

Q: Given the following notation, which design is illustrated? R X1 O R X2 O a. Pretest-posttest control group design b. Posttest only control group design c. Nonequivalent groups control group design d. Static group comparison design

Q: Jianan is conducting a thesis study that relates learners' working memory to speed in algebraic problem solving. She measures working memory by a digit span task. She uses a researcher created test to measure problem solving. She will also collect demographic data and measure beliefs and attitudes about science. Jianan operationalized which of the following variables? a. Age b. Science c. Working memory d. Beliefs

Q: The hypothesis statement, There are no differences in long term achievement between those who are taught through a face-to-face only class and those who are taught through blended instruction, illustrates which type of hypothesis statement? a. Null hypothesis b. Nondirectional c. Directional d. Correlational

Q: Babukar is conducting a study on children who are suspended for bringing weapons to schools. He collects data from achievement tests, aptitude measures, and questionnaires that consider children's connection to school. He also conducts interviews with suspended children, their teachers, and their parents. He interprets these data to decide if there is a typical profile of students who are suspended for such offenses. Babukar is best illustrating which type of mixed methods designs? a. Triangulation b. Exploratory c. Explanatory d. QUAL-quan

Q: Lan is working on a study of teachers' use of technology in their classrooms. She uses observation as her primary data collection method. Which of the following research sites is likely MOST pertinent to Lan's study? a. Faculty/Staff rooms where teachers' talk about technology b. Conference sessions that teachers attend about technology c. The classrooms of her teacher participants d. The computer lab that the students go to after school.

Q: Given the following notation, which design is illustrated? O X1 O O X2 O a. Pretest-posttest control group design b. Posttest only control group design c. Nonequivalent groups control group design d. Static group comparison design

Q: Maya recently conducted a survey to ask community members about whether they would like the town to invest money into widening roads to accommodate a bicycle lane. Her survey included the following 5 questions. 1) Do you live in Healthy Township? Y_______ N_______ 2) Do you own a bicycle? Y_______ N _______ 3) How many miles a week do you drive your car? a. 0-15 b. 15-30 c. 30-45 d. 45-60 e. Greater than 60 Given the following scale answer questions 4 and 5. 1=Strongly Disagree, 2=Disagree, 3 =Neutral, 4=Agree, 5=Strongly Agree 4) I would ride my bike to work if there was a bike lane. 1 2 3 4 5 5) I believe we should widen the roads to accommodate a bike lane. 1 2 3 4 5 Given the following information about a test, compute the KR-21 reliability estimate. The test has 20 items, the median is 12, the mode is 14, the mean is 12, and the standard deviation is 3. a. .33 b. .37 c. .45 d. .49

Q: The hypothesis statement, Children in elementary school who exercise at least 5 hours a week are more popular in school than children who do not exercise at least 5 hours a week, illustrates which type of hypothesis statement? a. Null hypothesis b. Nondirectional c. Directional d. Correlational

Q: Caelan is interested in the trading card culture in elementary schools. He has noticed that many children go through a phase of playing with and trading cards with their peers. He decides to more systematically observe children's behaviors while they are given free time. His study will be primarily observational although he may conduct follow up informal interviews with the children and their teachers. Caelan's study is best described as a ___________ design study. a. qualitative b. quantitative c. QUAL-quan d. QUAN-qual

Q: Melanie is a qualitative researcher studying veteran teachers' perceptions of the State's new teacher certification criteria. Which of the following is NOT likely part of her primary data sources? a. Interviews with veteran teachers b. Observations of Teachers' Union meetings where the new criteria are discussed c. The articles written in the popular press by teachers who are participants in her study d. The test scores of the districts students who have veteran teachers.

Q: Given the following notation, which design is illustrated? X1 O X2 O a. One shot case study a. One group pretest-posttest design b. Posttest only control group design c. Static group comparison

Q: Maya recently conducted a survey to ask community members about whether they would like the town to invest money into widening roads to accommodate a bicycle lane. Her survey included the following 5 questions. 1) Do you live in Healthy Township? Y_______ N_______ 2) Do you own a bicycle? Y_______ N _______ 3) How many miles a week do you drive your car? a. 0-15 b. 15-30 c. 30-45 d. 45-60 e. Greater than 60 Given the following scale answer questions 4 and 5. 1=Strongly Disagree, 2=Disagree, 3 =Neutral, 4=Agree, 5=Strongly Agree 4) I would ride my bike to work if there was a bike lane. 1 2 3 4 5 5) I believe we should widen the roads to accommodate a bike lane. 1 2 3 4 5 Item 5 best represents an example of which of the following types of items? a. Semantic Differential Scale b. Cronbach's Scale c. Pearson's Scale d. Likert Scale

Q: Which type of hypothesis involves making generalizations from observations? a. Inductive b. Deductive c. Null d. Speculative

Q: Rich is studying social competencies of hearing-impaired children. He selects five children that he studies through observation in multiple contexts, including their classrooms, their extra-curricular activities, and their family life. Rich is best illustrating a. qualitative research. b. QUAN-QUAL research. c. QUAN-qual research. d. QUAL-quan research.

Q: According to your text, the three primary data collection techniques qualitative researchers use include all of the following EXCEPT a. Observations b. Interviews c. Examining records d. Attitude surveys

Q: Given the following notation, which design is illustrated? X O a. One shot case study b. One group pretest-posttest design c. Posttest only control group design d. Static group comparison

Q: Maya recently conducted a survey to ask community members about whether they would like the town to invest money into widening roads to accommodate a bicycle lane. Her survey included the following 5 questions. 1) Do you live in Healthy Township? Y_______ N_______ 2) Do you own a bicycle? Y_______ N _______ 3) How many miles a week do you drive your car? a. 0-15 b. 15-30 c. 30-45 d. 45-60 e. Greater than 60 Given the following scale answer questions 4 and 5. 1=Strongly Disagree, 2=Disagree, 3 =Neutral, 4=Agree, 5=Strongly Agree 4) I would ride my bike to work if there was a bike lane. 1 2 3 4 5 5) I believe we should widen the roads to accommodate a bike lane. 1 2 3 4 5 Given the above survey, Item 2 would represent ________ level data. a. nominal b. ordinal c. interval d. ratio

Q: Which of the following is a non-directional hypothesis? a. There are no differences in motivation between students who are given a free breakfast at school and those students who are not given breakfast at school. b. There are differences in motivation between students who are given a free breakfast at school and those students who are not given breakfast at school. c. Children given breakfast at school are more motivated than children who are not given breakfast at school. d. Children given breakfast at school are less motivated than children who are not given breakfast at school.

Q: Chris is studying computer lab culture in post-secondary schools. He goes to the local 24-hour lab and observes four times a week for an academic year. He occasionally seeks some information from those in the lab about what they are doing via informal interviews. Chris is best illustrating a. qualitative research. b. QUAL-QUAN research. c. QUAN-qual research. d. QUAL-quan research.

Q: Myles is conducting a qualitative research study of middle management engineers enrolled in an executive MBA program. If Myles' study is consistent with practice, which of the following represents his primary data source? a. Records from the school that show the program requirements b. Observations of the students while engaged in coursework c. Opinion surveys regarding participants purposes for enrollment d. Students' academic transcripts

Q: Nora is interested in differences in amount of content retained from a lecture based on time of class. She compares her two sections--one that meets at 8 am and one that meets at 2 pm-- by testing them, unannounced, on content that she taught two weeks ago. Which of the following designs is Nora best illustrating? a. One shot case study b. One group pretest-posttest design c. Posttest only control group design d. Static group comparison

Q: Maya recently conducted a survey to ask community members about whether they would like the town to invest money into widening roads to accommodate a bicycle lane. Her survey included the following 5 questions. 1) Do you live in Healthy Township? Y_______ N_______ 2) Do you own a bicycle? Y_______ N _______ 3) How many miles a week do you drive your car? a. 0-15 b. 15-30 c. 30-45 d. 45-60 e. Greater than 60 Given the following scale answer questions 4 and 5. 1=Strongly Disagree, 2=Disagree, 3 =Neutral, 4=Agree, 5=Strongly Agree 4) I would ride my bike to work if there was a bike lane. 1 2 3 4 5 5) I believe we should widen the roads to accommodate a bike lane. 1 2 3 4 5 Given the above survey, Item 4 data would represent _______level data. a. nominal b. ordinal c. interval d. ratio

Q: Pedro studies inclusion. He needs to generate a directional hypothesis for his study. Which of the following is an appropriate research hypothesis for Pedro. a. Children who are fully included do not learn in school. b. There are no differences in student learning between children who are fully included and those who are not. c. There are differences in learning between children who are fully included and those who are not. d. Children who are fully included learn more than children who are not fully included.

Q: Nancy is studying after-school programs that are housed in the district's school buildings. She interviews staff, students, and parents, observes programs, and reviews school board documents that illustrate how the after-school programs developed. She also administered a survey to enrolled children that rated satisfaction with their program. Which type of research does Nancy's study illustrate? a. Qualitative research b. Quantitative research c. QUAL-quan research d. QUAN-qual research

Q: Ankur is conducting a qualitative research study that explores the context of youth competitive soccer. Of the following, which is likely the most prevalent source from which he will collect data? a. Times of speed drills completed in practice b. Individual player's statistics for the season c. Observations of players and others at games d. Surveys of community members opinions