PSYCHFILES: PSYC 7106G

RESEARCH AND PROGRAM EVALUATION METHODS IN APPLIED PSYCHOLOGY

Welcome! This website contains all materials pertaining to our course. Please use the navigation below to get started.

  • Alla Chavarga
  • W 6:30-9:15pm
  • 2613 James Hall
  • alla.chavarga@gmail.com
  • T 1-3pm 4305J

Syllabus

  • Course Information

    PSYC 7106G: Research and Program Evaluation Methods in Applied Psychology

    LECTURE

    Alla Chavarga

    alla.chavarga@gmail.com

    W 6:30-9:15PM 2613J

    Office Hours: T 1-3pm 4305J
    • Course Description3 credits

      PSYC 7106G: Research and Program Evaluation Methods for Psychology

                   Studying human behavior can be messy and difficult but conducting research in organizations is even more challenging. In organizations, circumstances can be dynamic and uncontrollable, employees and employers may not be willing to provide time and resources, new employees come and old ones leave, employees may not trust the researcher, standard laboratory methodology may not be suitable or available, and so on. A researcher in an organization could be an HR employee charged with the task of finding out why there is a lot of turnover in the organization, a consultant hired by the management or by the HR director to deal with the problem that people are not very motivated to do their jobs, or the head of a department who realizes that there are communication problems between her department and another department yet both are expected to work together.

                   Before we discuss research methods, we will talk about problems in organizations. Once we have identified a problem, we have to find out why the problem exists. But how do we make sure that it is not just our own, biased interpretation of the situation? Well, a literature review is the answer: What do researchers and scientists say about this problem? Which psychological construct is at the core of the problem? What research methods did they use to study this construct? What were their findings? Knowing this will help us plan and conduct our own research study to see whether the problem actually exists in our organization. Only then can we try to find a way to fix it. A program may be designed to address the specific issues that contributed to the problem. More specific results of our research will allow us to design more specific programs to address the issue. Such programs could be, for instance, a new employee training program to reduce turnover or a new benefits program to improve employee satisfaction. To find out whether those programs really work, we will need to use program evaluation methods to see whether the money spent on the program is money well invested.

                   There are no good or bad research methods, only wrongly applied methods if they don’t appropriately address the problem or the research question. The method we use to investigate a problem directly depends on the type of question we ask. Each question requires a specific type of method. We will discuss various research and program evaluation designs specifically useful in applied settings, which we will use to explore various problems and constructs relevant to I/O Psychology.

    • Course Goals and Objectives

      Primary objective of this course is to prepare you to critically evaluate the validity, adequacy, and relevance of research in I/O psychology and to apply the principles of good research to specific organizational problems. You will learn the strengths and weaknesses of various methods of investigating behavior in organizations and their respective applications. This course has three main goals:

      • Provide an understanding of how various research designs can be used to answer questions in I/O psychology.

      • Enable you to plan and conduct basic studies answering common problems typically posed in an organizational context, either as HR professionals or as consultants.

      • Enable you to understand research reports and become critical readers of research reports as found in scientific journals.

    • Required Textbooks

      Swanson, R. A., & Holton III, E. F. (Eds.). Research in organizations: Foundations and methods of inquiry. San Francisco, CA: Berrett-Koehler. (PDF available)

      American Psychological Association. (2010). The Publication Manual of the American Psychological Association (6th ed.). Washington, DC: Author. (PDF available)

    • CITI Training

      To ensure responsible conduct of research and the protection of human participants, every researcher is required to complete one online training course: Human Subjects Research (HSR) for Social & Behavioral Faculty, Graduate Students & Postdoctoral Scholars. The certificate must be submitted by the class session in which ethics and responsible conduct in research are discussed. To take the online training, please go to this site: CITI Trainiing

      If you have completed a certificate before and it is still valid, you can simply send a PDF copy of the existing report and submit it via email. If it is no longer valid, you can take a short refresher course and submit that certificate. Animal certificates or biological sciences certificates are not acceptable for this course.

    Course Policies

    • Grading

      Performance in this course will be evaluated on the basis of five assignments, one weekly presentation, one term paper (research proposal), one research proposal presentation, and a final exam.

      5 Assignments: 4HWs and CITI (4% each)       20%
      Weekly Presentation     20%
      Term Paper (Research Proposal)     20%
      Final Exam     20%
      Proposal Presentation      20%

    • Brooklyn College Regulations Regarding Academic Integrity Cheating, Plagiarism, and Academic Dishonesty

      The faculty and administration of Brooklyn College support an environment free from cheating and plagiarism. You are responsible for being aware of what constitutes cheating and plagiarism and for avoiding both. The complete text of the CUNY Academic Integrity Policy and the Brooklyn College procedure for implementing that policy can be found at this site: http://www.brooklyn.cuny.edu/bc/policies. If a faculty member suspects a violation of academic integrity and, upon investigation, confirms that violation, or if the student admits the violation, the faculty member MUST report the violation. if you plagiarize any of your work (assignments, term paper, oral presentation, final exam), you will fail this course (i.e., receive the grade F not only for the specific work but for the entire course).

    • Center for Student Disability Services

      In order to receive disability-related academic accommodations students must first be registered with the Center for Student Disability Services. Students who have a documented disability or suspect they may have a disability are invited to set up an appointment with the Director of the Center for Student Disability Services, Ms. Valerie Stewart-Lovell at (718) 951-5538. If you have already registered with the Center for Student Disability Services, please provide your professor with the course accommodation form and discuss your specific accommodation with him/her.

Course Schedule Spring 2018

  • 1/31:



    What do employers expect from I/O graduates?
  • 2/7:



    Writing research reports, APA-style; What are concepts? Model for empirical research, validity, reliability
    Ch 22 & 23
  • 2/14:



    CLASS CANCELLED
  • 2/21:



    Basics of quantitative research; Scientist-Practitioner Model
    Ch 1, 2, 3
    HW1 Due: CITI Certificate
  • 2/28:



    Ethics in research, Plagiarism and Retractions
    HW2 Due: Construct Map
  • 3/7:



    SNOW DAY CLASS CANCELLED
    HW3 Due: Theory Map
  • 3/14:



    Measurement Theory, Statistical Methods
    Swanson & Holton, Chap 14, 18, 19, 21
  • 3/21:



    SNOW DAY CLASS CANCELLED
    HW4 Due: Research Article Map
  • 3/28:



    Sampling Theory, Survey Methods, Scale development for survey research
    Ch 7, 10;
  • 4/4:



    NO CLASS: Spring Break
  • 4/11:



    NO CLASS: Conversion to Friday Schedule
  • 4/18:



    Applied research designs; Quasi-experiments
    Ch 6
    HW5 Due: Research Proposal Map
  • 4/25:



    Program Evaluation: What is it? How is it done?
  • 5/2:



    Research Proposal Presentations
  • 5/9:



    Research Proposal Presentations
  • 5/16:



    Research Proposal Presentations

Disclaimer

  • The schedule and procedures described in this syllabus are subject to change in the event of extenuating circumstances. You will always be notified of changes both in class AND by email. Your enrollment in the course represents your acknowledgment and acceptance of the non-negotiable policies described in the syllabus.
Lecture Slides by Chapter


Assignments


Academic Guide Maps

You will complete four Academic Guide Maps as directed in class: Construct Map, Theory Map, Research Article Map (from journal article), and Research Proposal Map (own research proposal). Each map is worth 10% of the final grade. The construct chosen for the maps is the same as the construct for the term paper.

In the Construct Map, you will answers the following questions based on a thorough literature review: What is the name of the construct? What is the definition of the construct (based on what the literature says)? Why is this construct important in organizations? What are related constructs (similar, so they could be confused, yet different)? Which theories explain the construct? What empirical research has been done before, and what are the results of this research, what do we know empirically?

The Theory Map will ask questions on theory and present the theory that best describes and explains the concept/construct. It should be the most up-to-date, current theory. Both, Construct Map and Theory Map will use review articles and meta-analyses found through the literature review and published in peer-reviewed journals.

The Research Article Map will present one specific, original, empirical, peer-reviewed study that has been published in a peer-reviewed professional journal. The research must have been conducted in organizations or be highly relevant to organizations. Acceptable studies use predominantly quantitative techniques, questionnaires or surveys. Experimental studies are only acceptable if they address program evaluation. The Research Article Map will briefly answer questions regarding the research problem and research question(s) studied by the authors of the article, type of methodology used (in sufficient detail), results, and interpretation of these results.

For the Research Proposal Map, you will have to design your own study by expanding on the study presented in the Research Article Map. This expansion has to be interesting, significant, and non-trivial. Multiple previous studies can be combined. The Research Proposal Map will answer the exact same questions as Research Article Map but with regard to your own planned research study. The Research Proposal Map must be written in future tense because it is reporting on a study that has not yet been conducted but is in its planning stages.


Four Steps to Research Proposal (Term Paper)


A review article (and meta-analysis if available) will be the basis for the Construct Map and the Theory Map. The research article will be the basis for Research Article Map. Then, you will develop their own research proposal. The Research Proposal Map will be your proposal for a research study. All four maps will be the basis for the term paper (research proposal).

The Construct and Theory Maps will be part of the introduction section of the term paper. The Research Article Map will be part of the last portion of the introduction section and will develop then into the description of your own study proposal. The Research Proposal Map will constitute mostly the very end of the introduction section and then be used to write the methods, (expected) results, and discussion sections of the term paper.

Although the focus will be on two specific peer reviewed journal publications (the review article that informed your Construct/Theory Maps and the Research article that informed he Research Article Map), you are expected to review, read, evaluate, and browse a large number of published articles for a successful completion of all portions of this class. Often, in order to find one good article, you will have to have reviewed (or at least skimmed) at least 15-20 articles on your topic. Therefore, successful library research is at the core of success in this class. Search for specific articles must be conducted outside of class.


Presentation


At the end of the semester, you will individually present a 15-20-minute PowerPoint-based research proposal to the class. This presentation will be based on your written proposal, and must include a brief introduction to your topic, background information (including results of past studies), your hypothesis/es and rationale, proposed methods and results, and discussion.

Download template for Academic Guide Maps
Four Steps to Term Paper Handout

Resources