Library
National HIV Testing Day—June 27, 2010
National HIV Testing Day—June 27, 2010
National Gay Men’s HIV/AIDS Awareness Day—September 27, 2010
Proceedings of the National Roundtable on Evaluation of Mutlilevel/Combination HIV Prevention Interventions
The National Roundtable on Evaluation of Multilevel/Combination HIV Prevention Interventions had the goals of examining the present state of the art of multilevel and combination HIV prevention interventions, both domestically and internationally; to define the significant challenges and scientific gaps in current evaluation methods and identify the most promising methodological approaches to address these gaps; and to guide the future agenda for HIV prevention research. To address these methodological gaps, we must combine the methodological and statistical rigor associated with clinical trials, the conceptual framework of implementation science, the on-the-ground strategies of programmatic monitoring and evaluation, and the strengths of pre- and post-intervention mathematical modeling. In looking at the HIV epidemic in the US, the group discussed current initiatives guided by the National HIV/AIDS Strategy and the increased optimism over treatment as prevention. We noted that considerable progress has been made in developing core metrics to evaluate outcomes along the “treatment-as-prevention cascade” that could be captured through public health surveillance—number of new HIV cases detected and proportion linked to care, retained in care, on active treatment, and virally suppressed. Our understanding of the optimum package of interventions with regard to both effectiveness and efficiency remains incomplete. Progress was reported, however, in the collection of process data at the local level to better assess how to improve programs. Devising epidemic impact measures to quantify reductions in HIV incidence attributable to combination interventions remains challenging, mostly due to barriers to testing impact through methods like community cluster randomization in the US. Looking globally, the group discussed a number of planned clinical trials of combination interventions also spurred by optimism over treatment as prevention. Common elements of combination approaches included expansion of voluntary counseling and testing, adult male circumcision, prevention of mother-to-child transmission, and management of sexually transmitted infections, along with expanding ART treatment. Outcome measures were generally framed in terms of the treatment-as-prevention cascade, though these data are not available from current surveillance systems, pointing to the need to create improved systems of data collection. The most common approach to measuring epidemic impact was clustered community randomization, with incident infections measured through cohorts or newer cross-sectional, multi-assay algorithms. Recommendations from the roundtable include the following:
- A new coalition of interventionists, implementation scientists, public health program and surveillance specialists, mathematical modelers, and behavioral scientists is needed to adequately address the evaluation of multilevel/combination HIV interventions at the community-level.
- The use of the conceptual frameworks of the HIV prevention continuum and engagement-in-HIV-care cascade should be used in structuring evaluation of combination HIV interventions.
- Common public health surveillance systems to evaluate combination HIV prevention interventions at the community level are recommended, and this capacity should be further developed internationally.
- Mathematical modeling before, during, and after multilevel/combination HIV interventions should be incorporated in the design, implementation, and interpretation of intervention results.
- Because an emphasis on efficiency as well as effectiveness from implementation science is helpful, costing and cost-effectiveness evaluations of combination HIV prevention interventions are recommended and are important to policy makers.
- Use of innovative trial and observational study designs outside of the traditional randomized, controlled trial paradigm should be used to account for the complex multilevel and combination nature of new HIV prevention interventions, and emerging design and analysis methods (e.g., stepped-wedge designs, adaptive trial designs, causal inference modeling of “natural experiments”) should be considered to address the challenges of community-level effectiveness evaluation.
- Because social factors and human behaviors are integral factors all along the HIV care and treatment cascade, it is crucial to include social and behavioral science in the design, implementation, and evaluation of combination interventions (e.g., community engagement and mobilization interventions).
- Mixed methods, including qualitative data collection (e.g., key informant interviews with implementers, in-depth interviews with target population members), are recommended to increase our understanding of how and why interventions are successful or not.
- Increased funding opportunities for methods development, whether as standalone projects or as supplements to large trials, is recommended as is funding for career development in methods research (e.g., methods-focused K awards).
The San Francisco Department of Public Health and AIDS Research Institute/UCSF Response to the Updated Estimates of HIV Infection in San Francisco, 2000
A Survey of AIDS Prevention Funders: Which Programs Are Funded, and Why?
- HIV prevention grants represented 52% of all AIDS-related grants
- The average HIV prevention grant was for almost $14,000, ranging from $750 to $1.4 million.
- Public policy, capacity building, outreach and technical assistance were among the most frequently funded HIV prevention programs.
- Some useful HIV prevention programs, such as condom distribution and needle exchange, were rarely funded. • Women and youth received 25% of the funding for HIV prevention.
- More grants targeted the general population than drug users, gay men or ethnic minorities, although these groups contain more people at risk for HIV infection.
- Print media, site visits and colleagues were the main sources of AIDS related information for funders.
- Better sources of information are available to help funders gauge the effectiveness of proposed programs.
- Several factors (such as using culturally relevant language, providing creative rewards for participants, designing flexible programs and creating a forum for open discussion) that make HIV prevention programs more effective are provided for use when evaluating programs.