Piper Lincoln is the Senior Research Associate at IRETA. Piper plays a crucial role, handling all aspects of research and evaluation. This includes designing data collection methods and analyzing and interpreting results. Her work involves the technical side of data and ensuring that our research and evaluation projects align with best practices. Whether it’s selecting the right surveys for a project or conducting literature reviews, Piper’s expertise helps IRETA deliver data-driven insights that improve substance use disorder treatment programs.
Q: Can you provide an overview of the work you’ve done with data and substance use disorder treatment programs over the past year?
Piper: Over the past year, my work has primarily focused on conducting an extensive systematic review for a guideline development project with the American Society of Addiction Medicine (ASAM). It involves gathering and interpreting data from published research and synthesizing the results. I have also worked on internal projects for IRETA, such as training and evaluation surveys and conducting focus groups for programs like the Scaife program.
When working with treatment programs, our efforts fall into two main categories: planned program evaluations and organizational readiness assessments. For example, in our projects with DDAP, we conducted patient surveys at the end of each session to gauge the program’s success. We also surveyed organizational readiness to change within treatment programs, focusing on staff needs and how supervisors can support their teams better. Ultimately, this data improves patient outcomes by enhancing staff capabilities and morale.
Recently I have also been preparing for a project that will combine public and private health data to estimate SUD treatment need and capacity within a regional behavioral health system. It will involve combining various data sources like census data, emergency department admission data, and national school surveys on drug and alcohol use. The goal is to determine treatment needs rather than just demand, allowing us to identify and address any allocation issues within the treatment system.
Q: How does data help IRETA with our consultation projects?
Piper: Data plays a critical role in our consultation projects in two main ways. First, it helps identify problems and the need for change, which can either be the conclusion of a project or the starting point of a clinical quality improvement (CQI) project. Second, it allows us to assess how well a CQI change has been implemented, providing us with valuable insights into the effectiveness of our interventions.
Q: What does the process of gathering data from a program look like? How long does the process take?
Piper: The data collection process varies depending on the project. For instance, designing and conducting a survey tailored to a program can take about two months, while scheduling and holding a focus group might take just two weeks. The design phase of a project can be time-consuming, especially when it involves getting timely feedback from project stakeholders.
In cases where programs already have the data we need, like service records or billing data, the process can be much quicker, sometimes taking only a few weeks. On the other hand, there is a project in the development stage where we will need to sift through state and county arrest databases, which can be more time-consuming. No two projects follow the same schedule or process, as each has its unique challenges and requirements.
Q: Can you talk a little bit more about some of the projects you’re currently working on or projects where data were particularly useful?
Piper: One notable project was an evaluation of Renewal Inc.’s residential treatment program for Allegheny County Jail reentrants, a project we did 10 years ago. The project was primarily data-driven. We conducted a cost-benefit analysis, where we were able to determine what every dollar invested in the program was worth in terms of reduced recidivism. We analyzed various data points, such as the number of treatment hours, previous arrests, and other factors that could influence outcomes. Although we didn’t have a control group, we were able to compare our findings to national averages and identify predictors of participants’ success in the program.
Q: What do you think are the most important pieces of data to look at when measuring the success of a substance use disorder treatment program?
Piper: This is a big debate in the field because success can mean different things to different people. Traditionally, success was measured by abstinence, but now, there’s a broader focus on improving quality of life, mental health, and physical health. While reduced use or abstinence is still an important data point, we’re increasingly looking at overall quality of life as a key measure of success. However, this can be subjective, and what influences it varies from person to person, making it a challenging metric to standardize.
Q: What are some of the biggest challenges when it comes to data collection?
Piper: One of the biggest challenges is getting people to complete surveys, because it depends on their willingness to participate and our ability to find them, which can be difficult, especially if they are no longer in the program we are evaluating. I prefer getting data directly from participants because it allows us to be more specific, but it can be burdensome for them, and finding ways to motivate people is not always clear. For example, in past projects, we’ve found that former program clients were more willing to complete a pretty lengthy one-time survey to help improve the experience for future patients than current clients were to complete super short weekly surveys to improve their own experience. That wasn’t the expected outcome. Framing participation as a way to help can be a strong incentive, but reducing the burden is still a challenge.
Data is at the heart of IRETA’s mission to improve substance use disorder treatment programs. Through meticulous data collection, analysis, and interpretation, Piper helps provide the evidence-based insights needed to guide decision-making and enhance program effectiveness. Whether it’s evaluating the success of an ongoing project or identifying areas for improvement, data ensures that IRETA’s efforts are informed, precise, and impactful. As the field continues to evolve, the role of data will remain crucial in driving meaningful change and improving the lives of those affected by substance use disorders.
