Outcome Monitoring Toolkit

Introduction

Background

The Outcome Monitoring Toolkit was produced by the DSHS HIV/STD Program. The toolkit was developed to provide prevention partners with information and resources useful in reflective practice.

Description

The Outcome Monitoring Toolkit for HIV prevention programs contains:

  • A one-page description of the program, including suggested assessible objectives using the questionnaire;
  • A questionnaire tailored for use with that program
  • A Microsoft Access data entry form
  • A Microsoft Excel data entry form

Questionnaire Development

Questionnaire development involved several steps.

  • Logic models were reviewed or created for each prevention program.
  • Existing questionnaires were matched to the logic models to determine appropriateness.
  • Prevention partner staff members were included in a discussion about the surveys and asked to suggest areas of improvement. Discussions addressed questionnaire length, language appropriateness for the target population, and the match between questionnaire items and the prevention program goals.
  • In some cases, pre-existing surveys were used in pilot studies and, in other cases, new surveys were developed.
  • Questionnaires were piloted in the field by prevention partners.
  • Following the pilot studies, the questionnaires were revised based on input from both the program partners and the DSHS staff.

Appropriate Use of Surveys

These questionnaires have been used in the field but have not been subjected to rigorous psychometric analysis. As such, results from responses to questionnaires are appropriate for identifying potential areas for program improvement. They can also identify program strengths. The results they provide should not be seen as the basis for inferences about the associations between determinants and client behaviors.

Toolkit

Mpowerment

PIP-WE

SISTA

VOICES/VOCES

WiLLOW

Documentation

Questionnaire Item Documentation

Questionnaire Determinant/Item#/Source
Mpowerment
  • All
    • All - Source 1
PIP-WE
  • Behavioral risk
    • Part 1, #1a-h; Part 2, #1-4 - source 2
  • Perception of risk
    • Part 2, #5 (only item) - adapted from source 3
  • Knowledge about HIV infection and prevention
    • #1-4 - source 2
  • Knowledge about safe sex negotiation
    • #5 (only item) - source 2
  • Intentions
    • #1 & 2 - source 2
SISTA
  • Knowledge about HIV infection and prevention
    • #1, 2, 7 - 15 - source 3
    • #3, 4, 5, 6 - adapted from source 3
  • Perception of risk
    • Only item - adapted from source 3
  • Intentions
    • #K-T - source 3
VOICES/VOCES
  • Knowledge about HIV infection and prevention
    • #1 - source 4
    • #2,3 - source 5
    • #4 - adapted from source 5
    • #5 - source 6
  • Knowledge about safe sex negotiation
    • #6, 7 - source 7
WiLLOW
  • Knowledge about HIV infection and prevention
    • #1,2,4,5 - adapted from source 8
    • #3,6 - source 8
    • #7-9 - source 6
    • #10 - source 2
  • Perception of risk for transmitting HIV
    • #1 - source 6
  • Attitudes toward condom use
    • #1 - adapted from Source 9
    • #2 - adapted from source 8
    • #3 - source 8
  • Intention to use condoms
    • #1 - source 9
  • Self-perceptions
    • #1-5 - source 8

Questionnaire Items Sources

  1. Developed in discussions with Mpowerment program staff at two prevention programs in Texas.
  2. UTSA staff collaborative discussion with UT evaluation expert
  3. Austin Outreach SISTA Program Questionnaire
  4. Adapted from Project Fate Baseline Survey, Partners in Prevention, The University of Texas Health Sciences Center at San Antonio
  5. Advocates for Youth. Training Youth to be Peer Educators. TAP Evaluation Survey: Pretest. Cited in Monitoring Outcomes of HIV Prevention Programs – question bank.
  6. Toolkit authors
  7. Valley AIDS Council staff in collaboration with UT staff
  8. WILLOW HIV Transmission Reduction Among Women Living with HIV. (1999) Original Evaluation Instruments:
    • Self-Esteem Scale, p. 6.
    • Knowledge Scale, p. 42
    • Condom Attitudes Scale, p. 58
  9. SISTA Implementation Manual, p. 291