Essay Instructions: TEST EVALUATION FORMAT GUIDELINES
The test to be use for this evaluation is the Beck Depression Inventory
1. Guidelines for paper
• The paper must be written in APA format. Check the current edition of the APA Style Manual for a description of this format. Don’t assume on-line summaries or crib sheets are accurate. Many libraries have copies you can examine.
• You must base this paper on one or more reviews from Mental Measurements Yearbook plus four (4) peer reviewed professional journals. If you use the EBSCO databases provided by the ILRC, you can check a box that will restrict the search to peer reviewed articles. If you have questions on whether a specific journal is acceptable, email the name of the journal and the name of the article to the instructor of this course. For this paper, you cannot use:
o Information from the textbook. If the textbook contains an interesting fact, you must track down the original article the textbook is summarizing. You can read and cite articles that are referenced in the textbook. In fact, this is an excellent way to find articles.
o Web sites and web articles. These are off limits, even if the web site is maintained by the publisher of the test.
o Books.
o Newspaper, popular magazines & trade magazines. Psychology Today is a trade magazine…it is not an acceptable source for this paper.
o Book reviews, editorials or introductions to a volume in peer reviewed journals.
• Make sure that you define any terms or acronyms that you use in the paper. Don’t assume that the reader will know what these terms might mean. You must use your OWN WORDS when writing this paper. You are not allowed to copy or quote material from Mental Measurements Yearbook or the articles. Do not quote
• Copying material from any source (even if you make minor changes to the words and phrases) is considered PLAGIARISM; therefore please do not copy material.
plagiarism will include the following:
o Copying material from a published source (e.g., journal article, book, web site) without using clearly marking it as a quote according to APA format. Note that merely citing a published source (i.e., listing the author and publication date in parentheses) does not mark it as a quote. Including copied material followed by such a citation will be considered plagiarism.
o Copying material and then editing it (e.g., changing words, eliminating portions of sentences).
o Paraphrasing a specific passage or idea(s) without properly citing the source using APA format.
o To avoid the possibility of inadvertently plagiarizing published sources, individuals are strongly encouraged to take notes rather than copying sentences/paragraphs when reading original sources. Then write their papers using those “in their own words” notes.
.2. Major sections & sub-sections headings of test evaluation paper
Following APA guidelines, use the following major sections and sub-sections headings in your test evaluation paper.
• Title page (separate page)
• Abstract (new page with Abstract as major heading)
• Body of paper (start on new page, include Title of paper centered at top of page). The
• body will provide the following information about the test:
o Purpose, design & format of test
o Psychometric properties of test
o Use in clinical or research settings
o Strengths and weaknesses
• References (start on new page with References as major heading)
• Annotated Bibliography (start on new page with Annotated Bibliography as major heading)
The content of each of these sections is described below.
A. Title page. See the template posted on blackboard for the format of this page.
B. Abstract. Your abstract should be a single paragraph on a separate page that briefly summarizes the main points of your paper. Start by mentioning the name of the psychological test and what it is designed to measure. Then briefly summarize what your paper says about this test. It should be limited to 150 words and should be double spaced.
C. Body of paper. Include the title of the paper as a major heading of this section. The body of the paper should be about five pages long, double spaced (this does not include the pages for title page, abstract, etc.). Begin the body of the paper by stating the psychological test you selected and give a brief overview of what it is. It is optional whether you use subheadings for each of these sections of the body. Your paper should provide the following information about the test you selected:
a. Purpose, design & format of test. This section should answer:
i. What is the purpose of the test is (e.g., is it designed to determine if a patient is clinically depressed, is it designed to assess the personality of normal individuals).
ii. What population is this test intended for? Is it a test that is only used with patients in mental hospitals? Is it a test that is used for young children? Is it a test that is used with adults 18 years and older?
iii. What is the test designed to measure (e.g., does it measure depression, intelligence, interpersonal skills)? Be specific. For example, if it is a test of intelligence, do not merely state that the test measures intelligence. State the specific types of intelligence (e.g., verbal, spatial, etc) the test is designed to measure.
iv. What type of items does the test contain? Mention both the number of items and the format of the items (e.g., T/F, multiple choice). If the information is available, you can also provide an example of a test question. Showing the exact wording of a question is the one acceptable exception to the “no quote” rule described above.
v. What population was used to define the norms for this test? When describing the normative population, be specific. Mention the number and types of individuals (e.g., 1000 adult males and 750 adult females) that were used. Be warned that some reviews in Mental Measurement Yearbooks do not contain this information. If you can’t find it, you might want to select another test because you are responsible for finding this information even if it is not in the Yearbooks. You can contact the instructor for assistance if you have trouble on this point.
b. Psychometric properties of test. You will describe at least one measure of the reliability and two measures of validity of the test. The information you provide must be specific. If you merely state that the test is “reliable” or that it “meets accepted standards of reliability” you will lose points.
i. Describe the type of reliability measure you use in the paper. If it is a test-retest reliability estimate, state that it is test-retest reliability. If it is a coefficient alpha, state that it’s coefficient alpha. List the specific number used to quantify the reliability. If the test-reliability estimate is .80, then state this number in your paper. If you omit this numerical information, your score will be lowered.
ii. Depending on the test you select, you may be able to include multiple measures of reliability in this section. For example, you might find both test-retest and coefficient alpha estimates that you can describe and list. But you must include at least ONE reliability measure in this section.
iii. Describe and correctly label the two specific types of validity measures that you are using. If scores on your test correlate with scores on a different test that is designed to measure the same trait, then make sure you describe this as convergent validity. If scores on your test accurately predict future behavior (e.g., SAT scores predict GPA in college), then make sure you describe this as predictive validity. At least one of the validity measures must based upon a journal article instead of Mental Measurements Yearbook.
iv. For validity measures that are based on statistics (i.e., Construct and Criterion Measures), list the specific numbers used to quantify validity. If the correlation between your test and another test that measures the same trait is .90, then list this number in your paper. If you omit specific numerical support, your score will be lowered.
v. For validity measures that are not based on statistics (e.g., face validity and content validity), make sure you include enough detail in your description so that the reader is convinced the test is reliable. Merely stating, for example, that experts believe the test has face validity will not convince the reader that will grade your paper, and it will lower your score.
vi. Remember that many journal articles will contain information about the validity of a test. For example, an experiment showing changes on test scores between groups may demonstrate the validity of the test. See lecture notes and textbook to see what type of validity this would demonstrate.
c. Use of test in counseling, clinical or research settings. Describe at least one and at most two examples of how the test is used in a clinical or research setting. This example(s) must come from the journal articles that you read for this paper. If you describe multiple examples, make sure that you write this section so that you link the examples into a coherent story. Mention how the examples are similar or different in this section. This will help ensure that the section reads well. When describing these examples, provide enough detail so that the reader understands how the test was used. But don’t provide too much detail that overwhelms the reader.
d. Strengths and weaknesses of test. Describe the strengths and weaknesses of the test. This type of information is often included in Mental Measurements Yearbooks and may be included in other articles that you read for this paper. When writing this section, remember that this is a research paper. Refrain from citing your personal experiences in using the test, and do not include your own opinions. Also make sure that you support each claimed strength or weakness that you mention in this section. Citing a specific source (e.g., Mental Measurements Yearbook notes that the test is not appropriate for non-Caucasian adults) is an acceptable form of proof that you can site.
D. References. List the references you used as the basis for your paper. These references must be in APA format. References should be double spaced. Read the current edition Publication manual of the American Psychological Association to make sure you are listing these references accurately. Please note that many of the ILRC databases (e.g., EbscoHost) do not list references in APA format. Merely cutting and pasting these references into your paper will cause you to lose points. Also, take advantage of the fact that all references in the textbook for this course are listed in APA style, as will be the references in the APA journal articles you read.
a. The following in an example of an APA formatted reference. Note the use of punctuation, capitalization, italics, indents, initials & parentheses. [If there are more than 6 authors, list the first 6 authors followed by et. al.]
Devine, P.G. (1989) Stereotypes and prejudice: The automatic and controlled
components. Journal of Personality & Social Psychology, 56, 680-690.
b. Students often are often confused on how to accurately reference reviews from Mental Measurement Yearbooks. When creating a reference, make sure you reference the actual review(s), not the test itself. If a test has two different reviews, you will need to create two separate references. Consider an example, for the Beck Depression Inventory-II, there are 2 reviews. At the bottom of this page is a screen clip of what was found using the library database on May 26, 2009 that lists the first of two reviews for this test. This screen clip shows that: the review was in the 14th yearbook (yellow arrow), the author of the review is P. A. Arbisi (red arrow), and the title is Review of the Beck Depression Inventory-II (green arrow). We can use the volume number & the following list to look up that 14th yearbook was published in 2001: 9th-1985; 10th-1989; 11th-1992; 12th-1995; 13th-1998; 14th-2001; 15th-2003; 16th-2005; 17th-2007.
From this information, the following is an appropriate APA formatted reference.
Arbisi, P. A. (2001). Review of the Beck Depression Inventory-II. In The fourteen mental measurements yearbook. Retrieved May 26, 2009, from EBSCO Mental Measurements Yearbook database.
The generic format of this reference is…
Last name, first initial of review author. (Year of MMY publication). Review of the name of test. In The [edition] mental measurements yearbook. Retrieval statement including date and database.
Note that Liberty uses the ESBCO database listed in the example.
c. You must cite each of the references in the body of the paper. The APA publication manual will define how to cite references in the body of the paper. Again, take advantage of the fact that the textbook uses APA format when it cites sources in the chapters you read. Use these as a guide. There are two formats that are often used when citing a source.
i. These examples are shown below, based on the article by Devine listed on the previous page.
1. One study found that … (Devine, 1989)
2. Devine (1989) found that …
ii. The following table provides additional information the format rules for citations.
d. It is also important to NOT CITE any source in the body of your paper that is not listed in this reference section. Avoid the temptation of citing a source that you did not read, even if it is discussed in an article that you did read. Base your paper only on articles and reviews you read and list in this reference section. For this paper, citing a source that is not referenced will reduce your score.
E. Annotated Bibliography. This final section of the paper will contain a one page summary of each journal article you read and cite in this paper. For each journal article, first list the APA citation and then write a one-page (double spaced) summary of the article.
This summary should contain the main points and conclusions of the article as well as any critical statistics (e.g., reliability estimates) that you cite in the paper. Essentially, this section contains the notes that you should take when you read the article.
a. Each summary should be on a separate page.
b. While you will not be penalized for including too much material in this summary, you will be penalized if it is too short. If your summary contains only a few lines, you will not obtain full credit.
c. You must use your own words! Do not simply copy and paste the article’s ABSTRACT as your summary. Coping material from the article will be considered plagiarism.
d. If you use review(s) from Mental Measurements Yearbook as a source, you get a break. You do not have to include summaries of any Yearbook review in this appendix.
There are faxes for this order.