I. Ways of Knowing About the World
   Scientific research is often viewed by people as some sort of specialized enterprise for the intellectually gifted.  A mysterious and incomprehensible array of techniques and skills carried out hidden away, out of sight, behind laboratory doors.  But science is really just one way out of several to understand and gain knowledge about the world.  There are several which we'll cover: Authority, Logic, Intuition and Science.  And science is easily the most accessible and democratic way to do so.  Science is based on multiple repeatable objective independent observations while following specific detailed procedures.  The procedures, though, are not secret or guarded.  Anyone, who is willing, can be taught to perform them.  That is why science can be viewed as accessible and democratic.  Unlike some other ways of knowing abut the world, in science, if I follow a series of procedures and observe a result then anyone else should be able to follow the same procedures and observe the same or similar results.  In an odd way it is just like cooking and following a recipe: if the procedures and materials are faithfully duplicated then the results should be the same or very similar each time.  Not everyone is Emeril Lagasse, but if you follow his recipes you can cook just like him.  Screaming "BAM!" at the top of your lungs each step of the way while you "kick it up a notch" as you make pork egg rolls with sweet and sour sauce is optional, though. 

 

A. Authority
  
Simply put, authority is taking somebody's word for it.  Whether you ask first or you are lectured, apparently out of the blue, someone tells you something about the nature of the world: what something means, how to behave, what not to do, what will happen if you run across the street without looking or eat less than thirty minutes before swimming.  Basically, we rely on authority all the time.  It isn't necessarily a bad thing to do so.  It can save a lot of time and unpleasantness that we might otherwise go through if we had to learn everything about the world around us by trial and error.  However, authority does have its problems.  Those we look towards for authoritative statements often disagree among themselves.  Parents may say that it's acceptable for their eighteen year old child to drink wine with a meal but the government says that the legal drinking age is twenty-one.  And authorities sometimes change their minds.  For instance, government's legal drinking age at one time was eighteen.  And sometimes authorities change their minds because they can be very wrong.  The government, at one time in the distant past, said slavery was legal; not anymore.

 

B. Logic
   Logic is a powerful tool for understanding the world.  However, it has limitations.  It requires that the bases for logical reasoning be true.  Otherwise, the conclusions drawn can be wrong. For example, here's a flawed logical argument:  The major I pick this semester will determine what I do for the rest of my life.  I declared history as my major.  Therefore, I will become an historian.  It may be a nice thought.  It may even be comforting.  But even if someone never changes their major, the degree they obtain may not correspond to their eventual career.  Even if the bases for logical reasoning are true, the reasoning can still be flawed.  Here's another flawed conclusion:  Parrots eat crackers.  Parrots live in trees. Therefore, crackers grow on trees.  Logic has limitations. See what I mean?

 

C. Intuition
   Just about everyone has gut feelings, hunches.  Often they're correct.  And often they're wrong.  If we're asked for the basis of those hunches we're typically at a loss to explain them.  Sometimes, we're able to give some sort of after-the-fact explanations but usually those intuitive judgments seemingly come out of nowhere.  There are two forms of intuition that we'll discuss, common sense and mysticism.

 

1. Common Sense
   Common sense is something we often hold in high regard.  We've all known or heard of people that might be highly educated or intellectual but lacked the sort of practical everyday intelligence that is called common sense.  And common sense can be a very accurate description of how the world works in a sort of after-the-fact sort of a way.  We've all heard common sense sayings like "you can lead a horse to water but you can't make him drink" which can be true in both a literal as well as a figurative sense.

   But common sense has its limitations.  For instance, it changes in different times and places.  In the 1600's in Salem, Massachusetts numerous accusations were made of witchcraft and several people were tried and executed as witches.  Much of what happened can be understood through what was considered "common sense" at that place and time.  First, it was common sense that witches existed.  It was also common sense that, since water was associated with purity and holiness, one could determine if someone was a witch by submerging them under water for an extended period of time.  Therefore, if the accused were unholy witches, then the water would not enter their bodies and they wouldn't drown and they could be hanged or burned at the stake.  If the person drowned they were clearly innocent and though they were dead, at least it was certain that they were in Heaven with God.

   Common sense, relying on "after-the-fact" labeling of the outcome of an event, also is unable to predict what will happen in some situations.  Take, for example, a situation in which two people who are dating and one moves away to a different city.  What will happen to their relationship?  Common sense says "absence makes the heart grow fonder."  We can find many examples to verify that little bit of common sense.  But there are also many examples that we can find to support the common sense saying, "out of sight out, out of mind."  So, which one will it be in any specific instance?  To rely on common sense, we have to wait for the situation to resolve itself before we know how to categorize that specific case.

 

2. Mysticism
   Mystical experiences rely on an altered state of consciousness, whether that state is attained by prayer, meditation, ingesting a substance, or perhaps through some sort of "gift."  Mysticism often incorporates authority as well, asking us to rely on people with special skills, talents or gifts like psychics or mediums or shamans for guidance.  This is not to dismiss the personal effects and significance that mystical experiences may have on some people, which can be beneficial and profound in some cases.  However, mysticism has limitations.  Communicating the meaning of a mystical experience to another person may be difficult or impossible because of the deeply unique and subjective nature of the experience.  It may be not even be possible to find the words to fully and sensibly comprehend the experience ourselves.  Also, because consciousness may be altered, perhaps due to drugs, the experience or its meaning may be entirely wrong.

 

D. Science
   Science relies on objective and repeatable observations.  There are no special skills, techniques or procedures that are not available to all, though some may require extensive time and practice to use effectively.  But anyone can do science.  If observations cannot be duplicated by others, they are not accepted.  Therefore, only those observations or results that are consistent and repeatable and can be agreed upon by more than one person, even those (or, especially those) who may have been skeptical, can be called scientific.  This openness, objectiveness and accessibility defines science.  However, this also highlights a limitation of science.  It is not a good tool for understanding the subjective, the rare and the unique.  Events or occurrences that can only be observed by one point of view or are "one-in-a-million" cannot easily meet the requirement for multiple objective observations.  And science also has some implicit assumptions which underlie it as well.

 

II. Working Assumptions of Science

A. Reality
   One implicit assumption of science is that the world around us has some sort of underlying reality apart from our observation of it.  To borrow and mangle an old expression, if a tree falls in the woods and no one there to hear it, it still makes a sound.  The existence of the universe and ourselves is not a cosmic illusion, nor is it some sort of dream we all share like something out of the movie, "The Matrix."  The world doesn't disappear when we fall asleep and magically come back into existence when we wake up.  Reality is real.

 

B. Rationality
   Science also assumes that the world is rational, that is, it can be understood through logical reasoning.   Even though our reasoning can falter from time to time, the universe is rationally assembled and is potentially comprehensible, even if we cannot understand it presently.  Through persistent effort and progress over time, it can be eventually be understood.

 

C. Regularity
   Regularity holds that the rules and laws and properties of the universe are (as well as have been and will continue to be) the same at every point in the universe.  The universe, and everything in it, is stable and consistent in that regard.

 

D. Causality
   Another assumption is causality, which means in plain English that things don't just happen.  Nothing happens spontaneously without some sort of cause, even though that cause may not be obvious at first.  All things or events occur because a previous thing or event caused them. 

 

E. Discoverability
   Lastly, science assumes that the universe hold no secrets that cannot be ultimately known and understood.  The difference here is that between a puzzle and a mystery. A mystery may not be solvable, but a puzzle, even a difficult one, can eventually be solved and understood.

 

III. Research Strategies
   Scientific research, while it has the basic goal of understanding the world, does employ a variety of approaches and methods in conducting the pursuit of knowledge.  Those strategies can be grouped according to how the research enterprise is designed, how the data are collected and the location of the setting in which the research is performed.

 

A. Research Design
1. Experiment
   Experimental studies are the preferred method for conducting research.  Conducting experiments involves controlling and manipulating some conditions, called independent variables, and recording the resulting changes in other conditions, dependent variables.  Often large numbers of subjects are used in psychological experiments because the variability in individual behavior can make conclusions difficult to draw. Because of the control over variables, experiments are the only method which allow for cause-and-effect determinations to be drawn.  While that is a strong point, the weakness of the method is that since conclusions are drawn from aggregate group behavior, very little, if anything can be inferred about what may influence the behavior of single individuals.

 

2. Correlation
   Correlational studies find associations and relationships between factors, or variables.  However, there is no control or manipulation of those factors, only the recording and determination of events or conditions which tend to accompany each other. There can be no determination
of cause-and-effect relationships with any correlational study, no matter how "common-sense" such cause-and-effect relationships may appear to be.

 

3. Descriptive
   Descriptive studies involve the intensive detailed collection of information about single individuals or specific small groups of individuals.  However, while a great deal can be learned about the history, motives and behavior of individuals, there is no control over the conditions or the accuracy of the information collected.  For instance, individuals may lie
or the observer may have some bias in the information collected or how they interpret or filter it.

 

B. Data Collection
1. Self Report
   Self report data include questionnaires, surveys and interviews. The strengths are that self reports are relatively quick and easy to collect or administer.  However, questions can be poorly written or asked introducing some bias or confusion to the data.  People may lie on a questionnaire or in an interview out of embarrassment or an attempt to please the researcher.  And interviewers may also insert their own bias in their interpretation of a subject's responses

 

2. Observation
   The collection of observational data is as minimally intrusive as possible, which minimizes any changes in behavior that might be unintentionally elicited by the researcher.  However, the researchers may still potentially insert their own bias into their observations.

 

C. Research Setting
1. Laboratory

   Laboratory settings include any sort of uniform and controlled environment, such as a hospital, research facility or even a doctor's or therapist's office.  Such control is especially beneficial for experimental studies, but correlational or descriptive studies can be conducted there as well.  The weakness of the laboratory environment though is that it is artificial and subjects may not behave as naturally as they normally would.

 

2. Field
   The field is anywhere that is not in a laboratory.  It could literally be a field, or a school or a day care center or a sidewalk or a grocery store aisle; anywhere that isnĠt a laboratory.  The advantage is that subjects can now act naturally, but the disadvantage is that conditions are uncontrolled and unpredictable and may change day by day or even minute by minute and make the collection or interpretation of data difficult or even impossible in some cases.

 

IV. Correlation vs. Experiment
   Experimental and correlational studies are often confused by the general population.  The distinction between causation and association is often lost, especially in the popular press where many people hear or read mistaken or misrepresented reports of research findings.

 

Association vs. Causation
   Perhaps the source of confusion that arises from the sorts of conclusions that can and cannot be drawn from correlational and experimental studies is that "causes" and "effects" are associated together but it is a very specific type of relationship called a causal (from the word, "cause") relationship.  But what scientists and statisticians mean when they say that correlational studies reveal associations is that the factors can only be said to tend to occur together and nothing further can be concretely stated.  However, some correlatioanal associations are often taken as indicating a cause-and-effect relationship. For instance, a correlational study may indicate that there is an association between exercise and long life.  Informally, most people assume that exercise causes a longer life, but that may not be the case.  All that can be drawn from the study is that people who exercise more live longer.  There may be additional hidden factors that may influence BOTH tendencies.  For instance, general health may influence exercise and longevity. It may be that the healthier people are the simply more likely to exercise and also their better health leads to a longer lifespan.  Or it could be other acquired habits that influence both factors.  Heavy smokers and drinkers might be less likely to exercise because of their substance use and also more likely to die earlier.  To illustrate things perhaps more clearly, there is a strong correlational association between murder rates and ice cream sales, both reaching their peaks in the summer months.  But it would be a mistake to conclude that ice cream consumption triggered homicidal tendencies or that committing murder increased the appetite for frozen dairy treats.  It would be wiser to suspect that an increase in heat and humidity might underlie both increases.

   The experimental approach, however, can determine causation and causal relationships.  In the simplest possible example, experimentation does this by taking a practical approach and selecting a sample of subjects from the general population of all possible participants.  The selection of the sample should be conducted randomly from the population to best approximate the random distribution of the general population's traits and conditions.  Non-random selection procedures, even such innocent-seeming ones like asking for volunteers, may exclude some possible subjects and unintentionally bias the research results.  The factors, or variables, to be considered are then weighed or assigned.  The independent variable is the variable thought to be the cause and the dependent variable is thought to be the effect.  Subjects will be randomly assigned to groups, one in which the independent variable will be present and one in which it will be absent.  Any differences in the dependent variable will be observed and recorded.  It is the capacity to directly compare the differences in the values of the dependent variable between groups based on the presence or absence of the independent variable that allows the experimental procedure to determine casual relationships.

 

V. Theory & Experiment
The Scientific Method
   The scientific method relies on practical and theoretical methods to experimentally collect facts, or data, control the manipulation of factors, or variables, and explain the outcomes of our observations as well as to refine those procedures.  The goal of the scientific method is to continually refine our understanding of the world.  Scientific discoveries and understanding are constantly under revision.  Not necessarily because the original findings were incorrect, but because our understanding and knowledge is continually growing.

   In the beginning of a scientific inquiry, a researcher becomes curious about a phenomenon or condition in the world.  In an effort to understand that phenomenon an explanation is advanced. That explanation is a theory.  The theory, or explanation, may or may not reflect the truth about the phenomenon.  But if that explanation is true, logical reasoning will lead to a prediction about the outcome should certain conditions be changed. That predictive statement is a hypothesis.  Experiments are procedures which test the hypothetical predictions that arise from a theoretical explanation.  The next step is to design the actual procedures and methods to test the hypothesis though more abstract reasoning.  Once the procedures and methods have been prepared the experiment is conducted and the resulting data are compared to the hypothetical predictions. If the results verify the predictions, the cycle is complete and the theory has been supported.  If the results do not correspond to the predictions, which happens more often than not, then the theory (or the experimental procedures or both) need revision.  The cycle begins again and continues with constant refinement until eventually the results match the predictions of the hypothesis.  One important thing should be noted. Even if a theory is verified by an experiment, it remains a theory, because a theory is an explanation and an explanation is an explanation, whether it is an accurate one or an inaccurate one, whether it has been tested experimentally or not. 

 

VI. Statistical Methods
   You may ask how can we be certain that the results of our research are reliable or true?  How can we know if our theoretical explanations and our hypotheses reflect the real nature of the world?  Especially when weĠre often dealing with groups of subjects and their individual responses can vary, sometimes greatly.  Scientists do this with statistics, a branch of mathematics that relies on the analysis of probabilities to gauge the reliability differences in groups of data.

 

A. The Correlation Coefficient
   Correlational studies rely on the calculation of a number called a correlation coefficient
to determine how closely two values are related.  It is a number between -1.0 and 1.0 which measures the degree to which the values observed for two variables would fall on an imaginary straight line, with one variable's values plotted against a y-axis and the other variable's values plotted against a x-axis on a grid.  If there is perfect linear relationship between the two variables where as both values increase in a positive direction along the grid (both values increasing), we have a correlation coefficient of 1.0.  If there is a perfect linear relationship with one variable's values decreasing as the other variable's values increase, we have a correlation coefficient of -1; a perfect negative correlation.  A correlation coefficient of zero means that there is no linear relationship between the two variables.

 

B. Populations, Samples & Distributions
   A
population is the sum total of all people, animals, or things that we may study and from which we wish to collect data and draw conclusions.  However, it is typically not a practical matter or even a possibility to include an entire population of interest in a research study.  Therefore, a sample that is meant to be representative of the population is often studied instead. For example, we may want to study intelligence in children, but we will be unable to include all the children in the world, so we may pick 100 children selected at random.  Statistically, we would expect that the distribution of values for a random sample will reflect that of the entire population.  Such distributions are typically expected to cluster around a central value.

 

1. Variability of the Distribution
   While the observed values may have a central value, there will be greater and lesser values varying around it.  The "spread" around that central value can be arithmetically calculated (the exact formula is not of concern to us here) and that number is called the variance
and tells us how scattered the values of our observations are; the larger the number value of the variance, the greater the scatter.

 

a. Standard Deviation
   The standard deviation
is the square root of the variance and as such also a number that gives us an indication of the scatter of our measured values.  If we go up and down one standard deviation from the central value, two-thirds of all our observations should fall within that range.  The larger the standard deviation, the broader the scatter.  The smaller standard deviation, the tighter the concentration of values around the central value.

 

2. Centrality of the Distribution
   The values we observe center around one value.  However, there are several ways to describe the most central value.  Under ideal conditions the three descriptions of the central value will be the same.  However, that may not always be the case.  There can be a need for more than one way to describe that central value because our samples may not always smoothly represent the variability within the population, especially when we have a small sample. 

 

a. Mean
   The mean is simply the arithmetic mean or average.  It is calculated by adding up the values of all our measurements and then dividing the grand sum by the total number of subjects.

 

b. Median
   The median is determined by counting the total number of subjects and ordering the measured values from lowest to highest.  The value which is greater than half the observations and less than the other half is the median value.

 

c. Mode
   The mode is the most frequently occurring value within the distribution.  However, sometimes there can be more than one mode.  Distributions with multiple modes can sometimes (but not always) be a clue that our sample may not be a true representation of the population and may contain identifiable subpopulations.

 

C. Comparing Distributions.
   When we compare the distributions that our data form, there are specific statistical tests that we can use to determine if our experimental manipulation of independent variables has reliable changed the values of our dependent variable.  Some of the most commonly used are t-tests and ANOVAs (short for analysis of variance).  T-tests are used when there is only one
comparison made between two distributions.  This can be the distributions of two groups or even two distributions of data from one group collected at two points in time; like before a drug is administered and then afterwards.  Then more than one comparison is being made, for instance a drug study with a placebo group and two or more doses of a drug, then an ANOVA is used.  One thing to keep in mind is that the power to reliably determine differences between distributions depends on the number of observations (the size of the groups). For instance, a small difference in the arithmetic mean between two groups may not be statistically significant when there are only 10 subjects per group.  But the same sized difference in the mean may be significantly different if there are 50 subjects (or even more) per group.