Federal Register: September 20, 2007 (Volume 72, Number 182)
DOCID: fr20se07-56 FR Doc E7-18555
DEPARTMENT OF HEALTH AND HUMAN SERVICES
Substance Abuse and Mental Health Services Administration
NOTICE: NOTICES
DOCID: fr20se07-56
SUBJECT CATEGORY:
Agency Information Collection Activities: Submission for OMB Review; Comment Request
DOCUMENT SUMMARY:
Periodically, the Substance Abuse and Mental Health Services Administration (SAMHSA) will publish a summary of information collection requests under OMB review, in compliance with the Paperwork Reduction Act (44 U.S.C. Chapter 35). To request a copy of these documents, call the SAMHSA Reports Clearance Officer on (240) 2761243. Project: Independent Evaluation of the Substance Abuse Prevention and Treatment Block Grant ProgramNEW
The Substance Abuse and Mental Health Services Administration
(SAMHSA), Center for Substance Abuse Treatment (CSAT), Division of
State and Community Assistance administers the Substance Abuse
Prevention and Treatment Block Grant (SAPT BG) in collaboration with
the Center for Substance Abuse Prevention (CSAP), Division of State
Programs. The Substance Abuse Prevention and Treatment Block Grant is
funded by Congress to provide monies to States, Territories, and one
Native American Tribe for the purpose of planning, carrying out, and
evaluating activities to prevent and treat substance abuse and other
allowable activities. The SAPT BG constitutes approximately 40 percent
of all States budgets for substance abuse prevention and treatment
services and activities, and is the primary Federal source of funding.
States have flexibility in determining how funds should be allocated,
but there are specific setaside and maintenance of effort requirements
that must be met in order to receive funding. These requirements,
introduced by both the ADAMHA Reorganization Act of 1992 and the Children's Health Act of 2000, are listed below:
Table 1.SAPT BG SetAside Provisions \a\
Category Setaside provision
Prevention and treatment Not less than 35 percent of SAPT BG activities regarding alcohol. funding*.
Prevention and treatment Not less than 35 percent of SAPT BG activities regarding other funding*.
drugs.
Primary prevention programs.. Not less than 20 percent of SAPT BG funding.
Pregnant women and women with Not less than amount equal to expenditure dependent children. in FY 1994.
Tuberculosis services........ No set amount but services must be
provided to receive SAPT BG funds.
HIV services \b\............. No more than 5 percent increase over
State allotment for HIV services in FY 1991.
[[Page 53782]]
Prohibition of sale of State must enforce law against sale of
tobacco to individuals under tobacco to underage individuals to
age of 18 (Synar amendment). receive SAPT BG fundsnoncompliance
leads to a 10 percent reduction in funds
the first applicable fiscal year; 20
percent, the second year; 30 percent,
the third year; and 40 percent, the fourth year.
Maintenance of effort (MOE) State will maintain funding at no less
for State expenditures. than the average level of expenditures
for the 2 years preceding the fiscal
year for which the State is applying.
Administrative expenses...... Limited to 5 percent of SAPT BG funding.
\a\ These setasides shown in this table were included in the 1992 SAPT
BG authorizing legislation 42 U.S.C. 300x21 to 42 U.S.C. 300x62). In
the Children's Health Act of 2000 (Pub. L. 106310) Sec. 3303(a)(1)),
however, the setasides marked with asterisks were removed.
\b\ For designated States whose rate of AIDS cases is 10 or more per
100,000 individuals as confirmed by the Centers for Disease Control and Prevention.
In addition to the setasides, the SAPT BG Program has identified
17 goals which must be met by States in order to receive this Federal funding:
Table 2.Federal Goals for the Substance Abuse Prevention and Treatment Block Grant
GOAL
GOAL
GOAL
GOAL
GOAL
GOAL
GOAL
GOAL
GOAL
GOAL
GOAL
GOAL
[[Page 53783]]
GOAL
Source: Performance Partnership Grant Branch, Division of State and
Community Assistance, Center for Substance Abuse Treatment, Substance
Abuse and Mental Health Services Administration, ``Uniform
Application, FY 2007, Substance Abuse Prevention and Treatment Block
Grant (42 U.S.C. 300x21 through 300x64),'' Rockville, MD, 2004.
The FY 2003 Office of Management and Budget (OMB) Program Assessment Rating Tool (PART) assessment of the SAPT BG Program rated the program as ``Ineffective.'' The SAPT BG received high scores on three of four PART areas rated, including Program Purpose and Design, Strategic Planning, and Program Management. However, the scores could have been even higher in these areas if data were available to document that the resources were reaching the intended beneficiaries or the program had ambitious targets and longterm measures. In the fourth area, Program Results/Accountability, where a low rating was achieved, it was found that ``no independent evaluation of the program has been completed'' to establish that the SAPT BG Program is effective and fulfilling its legislative mandates.
In direct response to this OMB finding, a contract was developed and awarded in FY 2003 to conduct an Evaluability Assessment (EA) to determine the feasibility of conducting an independent evaluation of the SAPT BG Program, and subsequently, to fund such an evaluation effort. EA is a recognized program evaluation methodology which involves collaboration with multiple stakeholders and development of a program logic model used to plan formal evaluations of large and/or complex programs, such as the SAPT BG Program. The findings of the EA were used as a foundation in the development and awarding of a multi year contract in FY 2004 to conduct an independent, comprehensive evaluation of the SAPT BG Program.
As noted in the OMB PART Assessment, the legislative intent of the SAPT BG is to provide funding to States by formula to plan, carry out, and evaluate activities to prevent and treat substance abuse. Therefore, the evaluation is designed to examine the systemlevel activities, outputs, and outcomes associated with the program in relation to its goals.
In this evaluation, a multimethod evaluation approach is being used to examine Federal and State performance with regard to the SAPT BG and its identified goals. This approach emphasizes a qualitative and quantitative examination of both the SAPT BG process (e.g., activities and outputs in the logic model) and systemlevel outcomes whereby Federal and State stakeholder perspectives on the SAPT BG, as captured through semistructured interviews and surveys, are corroborated and compared to the considerable amount of alreadycollected source documents and data provided by States, CSAT, and CSAP (e.g., Web Block Grant Application System (BGAS), Treatment Episode Data Set (TEDS), National Survey on Drug Use and Health (NSDUH), the Minimum Data Set (MDS), Technical Review Reports, State Prevention and Synar System Reports).
The purpose of the evaluation is to determine the extent to which
States and the Federal Government are implementing the SAPT BG
according to the authorizing legislation and implementing regulations.
The evaluation will cover the following domains: The State SAPT BG
planning process, Federal review of SAPT BG applications including
annual reports, progress reports and intended use plans, Federal
technical assistance, State SAPT BG implementation, Federal oversight
and management, State SAPT BG reporting, and Statelevel outcomes. The
results of this evaluation will not only document the effectiveness of
the SAPT BG Program in supporting the Substance Abuse Prevention and
Treatment system, they will also help guide CSAT and CSAP and the
States to improve the methods by which they implement the SAPT BG,
including the capacity to collect, analyze, and interpret the National
Outcome Measures (NOMs). As a separate, parallel SAMHSA initiative, the
NOMs project began after the SAPT BG Evaluation contract inception and
was not used in the SAPT BG EA or the development of the evaluation
framework and logic model. However, selected NOMs items that relate to
the evaluation framework and logic model will be examined in the independent evaluation. These selected NOMs items include:
In addition, the evaluators will attempt to collect information on systemwide client perception of care. Statistical tests for association between outcome measures and a number of independent variables will be conducted. Examples of independent variables include, but are not limited to, level of funding, level of the Single State Agency (SSA) for substance abuse services within State government, degree of SSA partnership with other State agencies and community organizations, and amount of Statefunded support available for research and training activities.
In addition to information about the selected NOMs domains, the evaluation will also examine systemic measures related to
infrastructure. Infrastructure refers to the resources, systems, and
policies that support the nation's public substance abuse prevention
and treatment system, and is a potential contributor to significant
State behavioral health system outcomes. Examples of infrastructure
include staff training, policy changes, and service availability.
Because this is the firstever comprehensive evaluation of the SAPT
BG Program, the data collection activities are more extensive (and time intensive) than would be expected of a
[[Page 53784]]
program that has been regularly evaluated. These data will serve as a
baseline for future evaluations. The two primary data collection
strategies will include openended interviews and webbased surveys.
Interviews will be conducted with Federal staff involved in the
administration of the SAPT BG and State staff from all States and
Territories involved in their State's implementation of the SAPT BG
Program. Two webbased surveys will be administered to all individuals
who formally participate in monitoring the SAPT BG as part of the
Technical Review or State Prevention and Synar System Review Teams.
The interview protocol for Federal staff includes 80 questions (mostly openended), and, on average, should take 90 minutes to complete. The interview protocol for the State staff includes 99 questions (again, mostly openended), and should take, on average, 3 hours to complete. Both the Federal staff interviews and the State staff interviews will be conducted as inperson interviews. While the Federal staff will each be interviewed individually, a single group State staff interview will be conducted for all relevant State staff. The SSA Directors will be asked to select those State staff who they believe are most knowledgeable about the SAPT BG for participation in the interviews. It is anticipated that, at a minimum, the State Planner, the State Data Analyst, the State Prevention Lead, the State Treatment Lead, one additional State staff member, and the State SSA Director will participate.
The two webbased surveys will be distributed to the two current sets of formal reviewers for the SAPT BG: Technical Reviewers and State Prevention and Synar System Reviewers. The webbased surveys are designed so that each stakeholder group receives survey questions designed to capture their specific knowledge of and experience with the SAPT BG. The Technical Reviewer survey contains 47 questions and the State Prevention and Synar System Reviewer survey has 27 questions. Each survey should take approximately 1 hour or less to complete. Reviewers will submit their responses to the survey online over a 3 week period.
Table 3 summarizes the estimated annual total burden hours for the
inperson and webbased surveys for the Federal and State staff stakeholders and Technical Reviewers, Synar Reviewers.
Table 3.Estimated Reporting Burden of Interviews and WebBased Surveys
Average hours
Respondents Number of per interview/ Estimated total
respondents survey burden (hours) Inperson Interviews:
State Substance Abuse Prevention and Treatment Agency 60 3 180 Commissioner.............................................
State Planners............................................ 60 3 180
State Data Analysts....................................... 60 3 180
State Prevention Lead..................................... 60 3 180
State Treatment Lead...................................... 60 3 180
Additional State Staff.................................... 60 3 180
Federal SAPT Block Grant Staff............................ 35 1.5 52.5 ¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤ Subtotal.............................................. 395 ............... 1,132 ¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤ Webbased Interviews:
Technical Reviewers....................................... 15 1 15
State Prevention and Synar System Reviewers............... 30 1 30 Subtotal.............................................. 45 ............... 45 ¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤ Total............................................. 440 ............... 1,177
This Federal Register Notice is focused on the interviews and surveys that will be administered to the SAPT BG stakeholders as those methods of data collection require OMB approval. It is anticipated that in future independent evaluations of the SAPT BG Program focus will be given to the NOMs and their implications for program performance and goals.
Written comments and recommendations concerning the proposed
information collection should be sent by October 22, 2007 to: SAMHSA
Desk Officer, Human Resources and Housing Branch, Office of Management
and Budget, New Executive Office Building, Room 10235, Washington, DC
20503; due to potential delays in OMB's receipt and processing of mail
sent through the U.S. Postal Service, respondents are encouraged to submit comments by fax to: 2023956974.
Dated: September 12, 2007.
Elaine Parry,
Acting Director, Office of Program Services.
[FR Doc. E718555 Filed 91907; 8:45 am]
BILLING CODE 416220P
SUMMARY:
Agency information collection activities; proposals, submissions, and approvals,
DOCUMENT BODY 2:
Periodically, the Substance Abuse and Mental Health Services Administration (SAMHSA) will publish a summary of information collection requests under OMB review, in compliance with the Paperwork Reduction Act (44 U.S.C. Chapter 35). To request a copy of these documents, call the SAMHSA Reports Clearance Officer on (240) 2761243. Project: Independent Evaluation of the Substance Abuse Prevention and Treatment Block Grant ProgramNEW
The Substance Abuse and Mental Health Services Administration
(SAMHSA), Center for Substance Abuse Treatment (CSAT), Division of
State and Community Assistance administers the Substance Abuse
Prevention and Treatment Block Grant (SAPT BG) in collaboration with
the Center for Substance Abuse Prevention (CSAP), Division of State
Programs. The Substance Abuse Prevention and Treatment Block Grant is
funded by Congress to provide monies to States, Territories, and one
Native American Tribe for the purpose of planning, carrying out, and
evaluating activities to prevent and treat substance abuse and other
allowable activities. The SAPT BG constitutes approximately 40 percent
of all States budgets for substance abuse prevention and treatment
services and activities, and is the primary Federal source of funding.
States have flexibility in determining how funds should be allocated,
but there are specific setaside and maintenance of effort requirements
that must be met in order to receive funding. These requirements,
introduced by both the ADAMHA Reorganization Act of 1992 and the Children's Health Act of 2000, are listed below:
Table 1.SAPT BG SetAside Provisions \a\
Category Setaside provision
Prevention and treatment Not less than 35 percent of SAPT BG activities regarding alcohol. funding*.
Prevention and treatment Not less than 35 percent of SAPT BG activities regarding other funding*.
drugs.
Primary prevention programs.. Not less than 20 percent of SAPT BG funding.
Pregnant women and women with Not less than amount equal to expenditure dependent children. in FY 1994.
Tuberculosis services........ No set amount but services must be
provided to receive SAPT BG funds.
HIV services \b\............. No more than 5 percent increase over
State allotment for HIV services in FY 1991.
[[Page 53782]]
Prohibition of sale of State must enforce law against sale of
tobacco to individuals under tobacco to underage individuals to
age of 18 (Synar amendment). receive SAPT BG fundsnoncompliance
leads to a 10 percent reduction in funds
the first applicable fiscal year; 20
percent, the second year; 30 percent,
the third year; and 40 percent, the fourth year.
Maintenance of effort (MOE) State will maintain funding at no less
for State expenditures. than the average level of expenditures
for the 2 years preceding the fiscal
year for which the State is applying.
Administrative expenses...... Limited to 5 percent of SAPT BG funding.
\a\ These setasides shown in this table were included in the 1992 SAPT
BG authorizing legislation 42 U.S.C. 300x21 to 42 U.S.C. 300x62). In
the Children's Health Act of 2000 (Pub. L. 106310) Sec. 3303(a)(1)),
however, the setasides marked with asterisks were removed.
\b\ For designated States whose rate of AIDS cases is 10 or more per
100,000 individuals as confirmed by the Centers for Disease Control and Prevention.
In addition to the setasides, the SAPT BG Program has identified
17 goals which must be met by States in order to receive this Federal funding:
Table 2.Federal Goals for the Substance Abuse Prevention and Treatment Block Grant
GOAL
GOAL
GOAL
GOAL
GOAL
GOAL
GOAL
GOAL
GOAL
GOAL
GOAL
GOAL
[[Page 53783]]
GOAL
Source: Performance Partnership Grant Branch, Division of State and
Community Assistance, Center for Substance Abuse Treatment, Substance
Abuse and Mental Health Services Administration, ``Uniform
Application, FY 2007, Substance Abuse Prevention and Treatment Block
Grant (42 U.S.C. 300x21 through 300x64),'' Rockville, MD, 2004.
The FY 2003 Office of Management and Budget (OMB) Program Assessment Rating Tool (PART) assessment of the SAPT BG Program rated the program as ``Ineffective.'' The SAPT BG received high scores on three of four PART areas rated, including Program Purpose and Design, Strategic Planning, and Program Management. However, the scores could have been even higher in these areas if data were available to document that the resources were reaching the intended beneficiaries or the program had ambitious targets and longterm measures. In the fourth area, Program Results/Accountability, where a low rating was achieved, it was found that ``no independent evaluation of the program has been completed'' to establish that the SAPT BG Program is effective and fulfilling its legislative mandates.
In direct response to this OMB finding, a contract was developed and awarded in FY 2003 to conduct an Evaluability Assessment (EA) to determine the feasibility of conducting an independent evaluation of the SAPT BG Program, and subsequently, to fund such an evaluation effort. EA is a recognized program evaluation methodology which involves collaboration with multiple stakeholders and development of a program logic model used to plan formal evaluations of large and/or complex programs, such as the SAPT BG Program. The findings of the EA were used as a foundation in the development and awarding of a multi year contract in FY 2004 to conduct an independent, comprehensive evaluation of the SAPT BG Program.
As noted in the OMB PART Assessment, the legislative intent of the SAPT BG is to provide funding to States by formula to plan, carry out, and evaluate activities to prevent and treat substance abuse. Therefore, the evaluation is designed to examine the systemlevel activities, outputs, and outcomes associated with the program in relation to its goals.
In this evaluation, a multimethod evaluation approach is being used to examine Federal and State performance with regard to the SAPT BG and its identified goals. This approach emphasizes a qualitative and quantitative examination of both the SAPT BG process (e.g., activities and outputs in the logic model) and systemlevel outcomes whereby Federal and State stakeholder perspectives on the SAPT BG, as captured through semistructured interviews and surveys, are corroborated and compared to the considerable amount of alreadycollected source documents and data provided by States, CSAT, and CSAP (e.g., Web Block Grant Application System (BGAS), Treatment Episode Data Set (TEDS), National Survey on Drug Use and Health (NSDUH), the Minimum Data Set (MDS), Technical Review Reports, State Prevention and Synar System Reports).
The purpose of the evaluation is to determine the extent to which
States and the Federal Government are implementing the SAPT BG
according to the authorizing legislation and implementing regulations.
The evaluation will cover the following domains: The State SAPT BG
planning process, Federal review of SAPT BG applications including
annual reports, progress reports and intended use plans, Federal
technical assistance, State SAPT BG implementation, Federal oversight
and management, State SAPT BG reporting, and Statelevel outcomes. The
results of this evaluation will not only document the effectiveness of
the SAPT BG Program in supporting the Substance Abuse Prevention and
Treatment system, they will also help guide CSAT and CSAP and the
States to improve the methods by which they implement the SAPT BG,
including the capacity to collect, analyze, and interpret the National
Outcome Measures (NOMs). As a separate, parallel SAMHSA initiative, the
NOMs project began after the SAPT BG Evaluation contract inception and
was not used in the SAPT BG EA or the development of the evaluation
framework and logic model. However, selected NOMs items that relate to
the evaluation framework and logic model will be examined in the independent evaluation. These selected NOMs items include:
In addition, the evaluators will attempt to collect information on systemwide client perception of care. Statistical tests for association between outcome measures and a number of independent variables will be conducted. Examples of independent variables include, but are not limited to, level of funding, level of the Single State Agency (SSA) for substance abuse services within State government, degree of SSA partnership with other State agencies and community organizations, and amount of Statefunded support available for research and training activities.
In addition to information about the selected NOMs domains, the evaluation will also examine systemic measures related to
infrastructure. Infrastructure refers to the resources, systems, and
policies that support the nation's public substance abuse prevention
and treatment system, and is a potential contributor to significant
State behavioral health system outcomes. Examples of infrastructure
include staff training, policy changes, and service availability.
Because this is the firstever comprehensive evaluation of the SAPT
BG Program, the data collection activities are more extensive (and time intensive) than would be expected of a
[[Page 53784]]
program that has been regularly evaluated. These data will serve as a
baseline for future evaluations. The two primary data collection
strategies will include openended interviews and webbased surveys.
Interviews will be conducted with Federal staff involved in the
administration of the SAPT BG and State staff from all States and
Territories involved in their State's implementation of the SAPT BG
Program. Two webbased surveys will be administered to all individuals
who formally participate in monitoring the SAPT BG as part of the
Technical Review or State Prevention and Synar System Review Teams.
The interview protocol for Federal staff includes 80 questions (mostly openended), and, on average, should take 90 minutes to complete. The interview protocol for the State staff includes 99 questions (again, mostly openended), and should take, on average, 3 hours to complete. Both the Federal staff interviews and the State staff interviews will be conducted as inperson interviews. While the Federal staff will each be interviewed individually, a single group State staff interview will be conducted for all relevant State staff. The SSA Directors will be asked to select those State staff who they believe are most knowledgeable about the SAPT BG for participation in the interviews. It is anticipated that, at a minimum, the State Planner, the State Data Analyst, the State Prevention Lead, the State Treatment Lead, one additional State staff member, and the State SSA Director will participate.
The two webbased surveys will be distributed to the two current sets of formal reviewers for the SAPT BG: Technical Reviewers and State Prevention and Synar System Reviewers. The webbased surveys are designed so that each stakeholder group receives survey questions designed to capture their specific knowledge of and experience with the SAPT BG. The Technical Reviewer survey contains 47 questions and the State Prevention and Synar System Reviewer survey has 27 questions. Each survey should take approximately 1 hour or less to complete. Reviewers will submit their responses to the survey online over a 3 week period.
Table 3 summarizes the estimated annual total burden hours for the
inperson and webbased surveys for the Federal and State staff stakeholders and Technical Reviewers, Synar Reviewers.
Table 3.Estimated Reporting Burden of Interviews and WebBased Surveys
Average hours
Respondents Number of per interview/ Estimated total
respondents survey burden (hours) Inperson Interviews:
State Substance Abuse Prevention and Treatment Agency 60 3 180 Commissioner.............................................
State Planners............................................ 60 3 180
State Data Analysts....................................... 60 3 180
State Prevention Lead..................................... 60 3 180
State Treatment Lead...................................... 60 3 180
Additional State Staff.................................... 60 3 180
Federal SAPT Block Grant Staff............................ 35 1.5 52.5 ¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤ Subtotal.............................................. 395 ............... 1,132 ¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤ Webbased Interviews:
Technical Reviewers....................................... 15 1 15
State Prevention and Synar System Reviewers............... 30 1 30 Subtotal.............................................. 45 ............... 45 ¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤¤ Total............................................. 440 ............... 1,177
This Federal Register Notice is focused on the interviews and surveys that will be administered to the SAPT BG stakeholders as those methods of data collection require OMB approval. It is anticipated that in future independent evaluations of the SAPT BG Program focus will be given to the NOMs and their implications for program performance and goals.
Written comments and recommendations concerning the proposed
information collection should be sent by October 22, 2007 to: SAMHSA
Desk Officer, Human Resources and Housing Branch, Office of Management
and Budget, New Executive Office Building, Room 10235, Washington, DC
20503; due to potential delays in OMB's receipt and processing of mail
sent through the U.S. Postal Service, respondents are encouraged to submit comments by fax to: 2023956974.
Dated: September 12, 2007.
Elaine Parry,
Acting Director, Office of Program Services.
[FR Doc. E718555 Filed 91907; 8:45 am]
BILLING CODE 416220P