RUNNING HEAD: CRITICAL REVIEW OF PACT

Abstract: 87 words

Text including references and notes: 7351 words

53 references

4 notes

 

Programs of Assertive Community Treatment (PACT): A critical review.

Tomi Gomory, Ph.D.

School of Social Work

The Florida State University

Tallahassee, Florida, 32306-2570

Tel. 850-644-2328

tgomory@mailer.fsu.edu

Published in Ethical Human Sciences and Services, Vol. 1 No. 2 1999 pp. 1-17
Abstract

Advocates of Programs of Assertive Community Treatment (PACT) make numerous claims for this intensive intervention program, including reduced hospitalization, overall cost, and clinical symptomatology, and increased client satisfaction, and vocational and social functioning. However, a reanalysis of the controlled experimental research finds no empirical support for any of these claims. Instead, there is evidence that the program is both coercive and potentially harmful. The current promotion of PACT appears to be based more on professional enthusiasm for the medical model than upon any benefit to the clients.


 

Introduction

The Programs for Assertive Community Treatment model, commonly known as PACT or ACT, was invented approximately 25 years ago by Marks, Test, and Stein (1973; Stein & Test, 1980). It is the most well researched and promoted community mental health treatment for those labeled persistently and severely mentally ill (SMI’s). According to Mueser, Bond, Drake, and Resnick (1998), 27 random assignment and 23 uncontrolled studies have been completed on the model. The growth of the Training in Community Living Program (as PACT was originally named) in just 14 states went from 223 programs in 1992 to 397 programs by 1996. These PACTs treat 24,436 individuals, with total annual costs exceeding 157 million dollars, about half of which is paid through Medicaid (Community Support Network News [CSNN], 1997, p. 3).

In 1997, a National Alliance for the Mentally Ill (NAMI) “Initiative for National Dissemination of the PACT Model of Care for Adults with Psychiatric Brain Disorders” was launched with the support of the National Institute of Mental Health (NIMH). It sought to “implement a means of rapid and effective replication of the PACT model … [and to] Influence state and local mental health authorities … to adopt ACT as a core program within their service delivery system” (CSNN, 1997, p. 10). Other well researched models exist, such as the broker service, clinical case management, intensive case management, strengths, and rehabilitation models (Mueser et al., 1998). The choice of PACT seems based on claims such as “The effectiveness of the [PACT] model has been proven, not only in terms of clinical care, but also in terms of the quality of life and satisfaction of clients” (CSNN, 1997, p. 19).

Is the PACT model even a clear and distinct approach that can be studied and evaluated on its own and fruitfully compared to other community care models? The literature suggests otherwise. For example, Mueser et al. (1998) state that "In practice, the differences between models … of community care can be difficult to establish" (p. 40). A further complication is the phenomenon of ad hoc definitional blurring, with the literature on assertive types of treatment now referring to the latter as “aggressive community treatment”: “Defined broadly, aggressive community treatment includes ACT teams, intensive case management, mobile crisis teams, and out-reach to difficult to reach populations. The 'active ingredients' of aggressive community treatment include in vivo service delivery, low client/staff ratios (usually 10:1) and receipt of services 'as long as their need for help persists'” (Dennis & Monahan, 1996, p. 2).

As a consequence, the analysis which follows--although referring to PACT[1]--can be applied to the various intensive community treatment models listed above. As we shall see, they appear to share the chief characteristics of intensity, assertiveness, or aggressiveness, which may better be identified as coercion. As Diamond (1996) succinctly put it, "The development of Programs for Assertive Community Treatment (PACT), assertive community treatment (ACT) teams and a variety of similar mobile, continuous treatment programs has made it possible to coerce a wide range of behaviors in the community" (p. 52).

 

What is PACT and what does it claim to accomplish?

According to Test (1992), PACTs have four essential characteristics:

Core Services Team The team's function is to see that all the patient's needs are addressed in a timely fashion. ... Having one team provide most of these services minimizes the ... fragmentation of ... care systems and allows for integrated clinical management….

Assertive Outreach and In Vivo Treatment An essential ingredient ... is the use of assertive outreach. … [staff] reaches out and takes both biological and psychological services to the patient[in the community]….

Individualized Treatment Because persons with serious mental illnesses … are greatly heterogeneous and both person and disorder are constantly changing over time, treatment … must be highly individualized….

Ongoing Treatment and Support It must be concluded that even very intensive community treatment models do not provide a cure for severe mental illness, but rather provide a support system within which persons with persistent vulnerabilities can live in the community and grow. It appears these supports must be ongoing rather than time limited.” (1992, pp. 154-156)

These characteristics are said to be based on the “broad biopsychosocial model of serious mental illness” (pp. 156-157). A prior critical analysis of the theoretical framework of this model (a brief version of which will follow) suggests that it is nothing more then the “medical model” and contains serious conceptual and empirical difficulties (Gomory, 1998).

Various authors claim that PACT is significantly more effective than alternate treatments in reducing hospitalization rates, that it is more cost effective, that it provides greater client satisfaction than alternate treatments, that it improves client functioning and symptomatology, and that it improves vocational functioning (Burns & Santos, 1990; Mueser et al., 1998; Olfson, 1990; Scott & Dixon, 1995; Solomon, 1992). However, an in-depth review of the 27 randomized clinical trials of PACT suggests that the PACT approach does not, contrary to these claims, demonstrate any significant positive effects (Gomory, 1998). This review further suggests that the prime mechanism of PACT is coercion, backed by the biomedical model, which justifies the very high “maintenance” (common or routine) use of psychotropic medication. The coercive and biomedical characteristics of PACT are well expressed in two statements:

The program was “assertive”; if a patient did not show up for work, a staff member immediately went to the patient's home to help with any problem that was interfering. Each patient's medical status was carefully monitored and treated. Medication was routinely used for schizophrenic and manic depressive clients. (Stein & Test, 1980, p. 394)

Congruent with our conceptual model, we tell our patients that indeed we believe they are ill, otherwise we would not be prescribing medication for them. (Stein & Diamond, 1985, p. 272)

This paper will review the research findings on PACT, describe the development and utilization of coercion, and show how the medical model drives PACT. It will also provide a brief conceptual critique of why PACT is theoretically unsound as well as alternate explanations for the various phenomena PACT appears to influence. Where necessary, exemplary quotes from representative studies of PACT research (those closely replicating the PACT model as judged by the experts) will be used.

 

Reviewer’s Analytic Method

The present reviewer’s approach can best be described as the application of fallibilist criteria (Miller 1994; Popper, 1962; 1979) to research findings. This approach attempts, through stringent criticism of each study, to falsify the study’s findings. This is valuable because if such a critical effort fails, the evidence is up to the task and we may continue claiming efficacy for the treatment. If the evidence cannot withstand the criticism, then we ought to revise or abandon the non-efficacious treatment. The fallibilist approach contrasts with the justificationary approach found in typical reviews of PACT research. These appear to accept reported results as fact without close analysis (e.g., Burns & Santos, 1995; Mueser et al., 1998; Olfson, 1990; Scott & Dixon, 1995; Solomon, 1992).

Positive reviews are usually produced by experts who are themselves PACT researchers, so that the continued validation of the model strengthens the experts’ value and power. This potential conflict of interest may undermine their ability or desire to critically evaluate the PACT clinical trials. Rarely, if ever, do reviewers evaluate the methodology used in individual studies (Draine, 1997, and Marshall & Lockwood, 1998, are exceptions but their efforts are not fallibilistic enough). Mueser et al. (1998) frankly acknowledge this lack of interest:

We recognize that methods exist that would allow us to rate the methodological rigor of studies. However, such ratings are tedious to perform and difficult to interpret. For these reasons, and because of the length of our review, we chose not to formally rate the methodological adequacy of studies. (p. 44)

A serious consequence of such uncritical acceptance is the use and standardization of unreliable and invalid outcome measures. The Cochrane Collaboration’s recent PACT review states that "A striking and unexpected finding … was the extent to which inadequately validated instruments were used to measure outcome…. This finding suggests that there may be as yet some uncharted bias related to the use of outcome scales in psychiatry" (Marshall & Lockwood, 1998, p. 14).

The present author relies in this review on Test and Stein’s original construct of PACT as the exemplar, even though it is well over 25 years old. Much has since been written about PACT. Because Test and Stein’s model is still the only clearly articulated version of this treatment, researchers in recent controlled trials of PACT usually acknowledge that they are trying to “replicate” the original model (e.g., Lehman, Dixon, Kernan, DeForge, & Postrado 1997, p. 1039).

 

Strauss and Carpenter's Psychosocial Model of Mental Illness

The originators of PACT “utilize a broad biopsychosocial model of serious mental illnesses (Strauss & Carpenter, 1981) to conceptualize the treatments and services that might be helpful” (Test, 1992, pp. 156-157). They present this model as a unique and recent theoretical construct, though it is the same medical model that has been discussed since the 19th century, when alienists realized that the combination of psychosocial and biomedical explanations of bizarre behavior would be convincing and difficult to refute. These explanations encompass all potential causes, and offer the requisite “scientific” cover of medicine (Scull, 1989, p. 112; 1993, pp. 41-42). Strauss and Carpenter (1981) acknowledge this when they state that, “The introduction of … [Kraepelin’s medical model] has had a profound impact; Kraepelin’s discrimination of dementia praecox from manic depressive illness is a cornerstone of scientific psychiatry” (p. 3). Like their predecessors, Strauss & Carpenter provide no empirical evidence to support this model and acknowledge that we still know very little about schizophrenia: “Since Kraepelin and Bleuler originated the concept of schizophrenia, steady progress has been made in the acquisition of knowledge necessary for understanding this disorder. Despite this progress, the essence of the puzzle remains unsolved.” (1981, p. 7).

By using the biopsychosocial model to explain mental illness, PACT researchers are not using a scientific, but a scientistic model of explanation, not testable even in principle. By definition, this model allows any rationale for etiology: nothing is excludable (refutable) and ad hoc statements may explain away any potential falsifications. Its vague and imprecise nature provides a fertile environment for the growth of endless numbers of alleged etiological explanations. Strauss and Carpenter (1981, chapters 7 and 8) offer genetic, biochemical, psychophysiological, psychological, and social explanations for “serious mental illness”.

Further, psychiatry’s inability to demonstrate the existence of a discrete non-random syndrome of schizophrenia undermines a scientifically meaningful explanation of schizophrenia as a “real” disease (Boyle, 1990; Gomory, 1998). The failure to identify a specific biological dysfunction further impedes the likelihood of finding disease specific treatments.

 

Comprehensive PACT Services for All Client Needs?

The PACT claim that a Core Service Team can provide all the necessary services that a person may need is philosophically naïve and empirically impossible. On a societal level, this would be labeled utopian [2](Hayek, 1979; Popper, 1962). Such utopian efforts are logically untenable but may help enhance the model’s market value.

The PACT effort to meet “all” client needs appears to have more to do with what the providers define as needs than what the clients desire. The assumption of specific client “needs” must also hypothesize some “gaps” as defined by the PACT experts, in the social, environmental, or personal domains impacting clients. These gaps must be “compensated” for by providing employment training, skills training, rehabilitation, education, or environmental and behavior modification (Test, 1992, pp. 154-158). The PACT experts emphasize that “programs must provide interventions ... focusing not only on changing the person but also on changing the environment ” (pp.156-157). This agenda thus assumes some notion of necessary change; from a behavior or situation defined as unhealthy or inappropriate, to another behavior or situation presumably found to be better.

Professionally defined expectations of client change can be coercive and patronizing, and ultimately harmful. Clients expected to make such changes should therefore freely commit to them. The PACT researchers rarely state explicitly that this choice is the autonomous right of PACT clients. Who should be authorized to define appropriate change of client environment and behavior?

 
The Problem of Vanishing Treatment Effect

Ongoing assertive community treatment, wanted or unwanted by clients, is justified by the claim that when such treatment stops, the intervention effect evaporates (Test, 1992, p. 159). PACT experts admit that it is unclear why this occurs, but they hypothesize that because “the underlying psychobiological vulnerabilities and/or deficits of schizophrenia persist for many patients,” these “may need ongoing rather that time-limited special supports” (Test, Knoedler, Allness, Burke, Brown, & Wallish, 1991, p. 240).

As an alternate hypothesis, the PACT program may be confusing the workers’ effort for the clients’ effort. For example, what is really happening “when a patient did not show up for work one day, the psychiatrist accompanied the other staff members to the patient’s home and got him out of bed and off to his job” (Stein and Test, 1976, p. 268)? If PACT workers invade a reluctant client’s home and force the client to go to work they may not have accomplished their therapeutic goal. At most, they have demonstrated that force can get a client to the job site. No claim can be made about improving the client’s work effort, nothing may have been internalized independently by the client about the value of doing the coerced activity.

That clients do not attend work on their own after these PACT interventions are discontinued tends to corroborate this alternate explanation. The “effect loss” (Test, 1994, p. 156) may be an artifact of PACT workers no longer coercing the measured activity. Such program failure or “effect loss” is found in all of the PACT research. It is mistakenly explained by the alleged incurable nature of mental illness. This justifies indefinite treatment with long term PACT funding providing a steady source of income for the experts involved.

 
PACT as Coercive Intervention

What does the PACT program look like in practice? Stein (1990) explains:

The ACCT (the team) serves as a fixed point of responsibility ...

and is concerned with all aspects of their (the patients) lives that influence their functioning, including psychological health, physical health, living situation, finances, socialization, vocational activities, and recreational activities. The team sets no time limits for their involvement with patients, is assertive in keeping patients involved.…In addition to the day to day work ... the team is available 24 hours a day, seven days a week. (p. 650, emphasis added)

 

This methodology[3] appears highly intrusive. PACT activity may include such coercive moves as becoming the representative “financial payee” of the client, which provides opportunities to blackmail the clients by enforcing medication compliance or threatening to withhold monies belonging to the client (Stein & Test, 1985, pp.88-89). Forcing treatment on clients who do not want it is also used (pp. 91-92). Even bribery may be deemed appropriate in the name of PACT treatment: “it might be necessary to pay a socially withdrawn patient for going to the movies in addition to buying his ticket” (Test & Stein, 1976, p. 78).

To validate the use of assertive[4] outreach and treatment, the original PACT researchers rely on just two studies, one of which is their own (Test, 1981, p. 80). The other study is by Beard, Malamud & Rossman (1978), who describe their Fountain House outreach program as follows: “ … phone calls, letters, and home and hospital visits made by both staff and members. Through such contacts, subjects who dropped out were provided with further information…. In those ... instances when an individual requested that no further contacts be made, his wishes, of course, where respected” (p. 624, emphasis added). Respect for the wishes of people who choose not to be involved in the Fountain House program contrasts with the coercive methods used by Test and Stein (1976):

A staff person attempting to assist an ambivalent patient to a sheltered workshop in the morning is likely to receive a verbal and behavioral “no”…. If … the staff member approaches the patient with a firm, “It’s time for you to go to work; I'll wait here while you get dressed,” the likelihood of compliance increases. The latter method allows less room for the patient to “choose” passivity. (p. 77).

Two questions come to mind: why is the patient described as ambivalent, when the patient’s reported behavior indicates a resolute opposition to going to work? Second, why is the patient’s active refusal redefined into “passivity”? The disregard of patients’ expressed wishes, and the reinterpretation of their behavior to justify programmatic interventions, appear to be the outstanding characteristics of PACT-like programs. The Fountain House model, by contrast, immediately discontinues outreach efforts if asked by the dropouts. This difference leaves the PACT experts with nothing except their own research to support the effectiveness of the assertive approach they advocate.

Coercion appears to be a vital part of the PACT model, according to the candid admission of Diamond (1996), a close associate of the original PACT group in Madison:

Paternalism has been a part of assertive community treatment from its very beginning.... In the early stages of PACT, consumer empowerment was not a serious consideration…. it was designed to "do" for the client what the client could not do for himself or herself. Staff were assumed to know what the client "needed." Even the goal of getting clients paid employment was a staff driven value that was at times at odds with the client's own preferences.... A significant number of clients in community support programs … have been assigned a financial payee.... This kind of coercion can be extremely effective.... Obtaining spending money can be made … dependent on participating in other parts of treatment. A client can then be pressured by staff to take prescribed medication…. the pressure to take medication … can be enormous....While control of housing and control of money are the most common … methods of coercion in the community other kinds of control are also possible. This pressure can be almost as coercive as the hospital but with fewer safeguards. (pp. 53-58).

 

An Analysis of PACT claims

Claim - PACT significantly reduces hospitalization when compared to standard treatment. (This claim has been primarily responsible for the enthusiastic response to PACT.)

Evidence - PACT methods have no direct bearing on the reduced hospital stays found in the studies. This result is due to a fairly strict administrative rule not to admit or readmit any PACT clients for hospitalization regardless of the psychiatric symptoms and to carry out all treatment in the community, while at the same time freely readmitting any troubled client in the comparison group. The PACT originators make this explicit in their first experimental trial, where they list “virtual abstention from rehospitalizing any patients being managed in the community” (Marx, Test, & Stein, 1973, p. 506) as their second treatment guideline.

Similarly, in one of the acclaimed Australian PACT replications, “The project group patients were not admitted if this could be avoided: instead they were seen by members of the project team … who took them back to the community….” (Hoult, Reynolds, Charbonneau-Powis, Weekes, & Briggs 1983, p. 161). No effort was made to keep the control group from readmission and 96% were readmitted (p. 160). Several reviewers (Olfson, 1990; Solomon, 1992) have noticed this maneuver. According to Olfson (1990), “Restricting the clinical criteria for hospitalization is an explicit tenet of assertive community treatment. Under such conditions, reducing hospital utilization becomes more of [a] … process variable then an outcome variable” (p. c-75). In sum, any decrease in hospitalization is not intervention dependent; it results from an administrative action.

 

Claim - PACT is more cost effective than standard interventions.

Evidence - Since hospitalization is by far the more costly treatment, the cost savings are not dependent on specific PACT interventions but on keeping people away from hospitals. Cost reduction occurs as a by-product of the PACT approach. Cost reduction could occur with any other treatment rigorously pursuing the same objective of not admitting patients to hospitals.

 

Claim - PACT provides significantly greater client satisfaction.

Evidence – Client satisfaction appears to be independent of distinct PACT activity. For example, in the Australian study the claim of client satisfaction favoring the PACT methods is contradicted by the data. It appears that the greater autonomy provided by any community treatment, not the particular interventions of PACT cause this increased satisfaction. In this study the patients were surveyed at a 12-month follow-up: “The majority (80%) of experimental group patients who were not admitted to the hospital were pleased and grateful about it; only 30% of control group patients were pleased and grateful about being admitted to hospital, whereas 39% were upset and angry.” (Hoult, 1986, p. 142). Stated differently, “Treatment preference was explored by asking all patients whether they prefer admission to Macquarie Hospital or treatment at home by a community team. The majority of the project (87%) and control (61%) patients preferred community treatment” (Hoult et al., 1983, p. 163). A majority (61%) of the group that did not experience the PACT treatment still preferred community treatment rather than incarceration in an institution. In fact, the experimental group felt that the most important elements of the PACT treatment were the availability of staff for frequent caring, supportive, personal contact and the enhanced freedom, elements not specific to PACT (Hoult et al., 1983, p. 163).

Lending further support, the only published survey of “client perspectives” on PACT “ingredients” (McGrew, Wilson, & Bond, 1996) identified in order of preference “helping relationship, attributes of therapist, availability of staff, and non-specific assistance” as what clients liked most (p. 16, table 1). Again, these attributes are not PACT specific and are applicable to all forms of “helping”. The least liked of the 25 elements associated with PACT treatment was “intensity of service”. The survey's authors, themselves longtime PACT experts, admit that "Somewhat surprisingly, non-specific features of the helping relationship emerged as the aspects of [PACT] most frequently mentioned as helpful (McGrew et al. 1996, p. 190).

 

Claim – PACT significantly improves client functioning.

Evidence - No PACT specific treatment achieves significantly superior client functional or symptomatological improvement over an alternate treatment. This can best be explained by briefly reviewing the largest controlled trial (n=873), done on PACT (Rosenheck & Niele, 1997; 1998). The researchers report that at the 6 General Medical and Surgical Hospital sites (GMS) (n=528), but not at the 4 Neuro-Psychiatric Hospital sites (n=345) PACT “is associated with greater improvement in long-term (2-year) clinical outcomes and when fully implemented is cost neutral” (Rosenheck & Neale, 1998, p. 459).

Methodological difficulties

The claim of clinical effectiveness rests on putatively finding significantly higher community living skills favoring IPCC (PACT) patients “across the [4] follow-up periods” and with finding, at “the final interview” only, significantly lower symptoms, higher functioning and increased satisfaction with services (p. 459). In a non blind study such as this one, all the measurement instruments requiring observer ratings such as the Brief Psychiatric Rating Scale or the Global Rating Scale are open to observer bias. Instruments using self-report measures like the Global Severity Index of The Brief Symptom Inventory may be confounded by the effect of the environment on the patients’ responses (Gomory, 1998), potentially affecting the validity of the data gathered.

The “finding” of significantly higher community living skills across treatment periods favoring the PACT group is belied by the data. At 6 and 12 months the “community living skills competence” scores favor the control treatment. The graph in figure 3 shows that the control group outperformed the experimental group for well over 12 months, but an impressive difference favors the experimental treatment at the exit interview (Rosenheck & Neale, 1998, p. 463, table 2 and Rosenheck & Neale, 1997, figure 3). The seemingly positive result in the exit interview could have been caused by many factors including (1) relief at being free of a coercive program, (2) fear of offending a potentially dangerous authority in a coercive program, or (3) a desire to please the interviewer. Meanwhile, an expensive, long-term, and potentially abusive program should not be justified on the basis of an exit interview that contradicts data gathered during the treatment period.

Unintended research results

The researchers identified post facto, two GMS study sites (no. 2 and 5) that did not fully implement the PACT treatment: Site 5 “developed a low-intensity patient tracking program rather than [PACT] services.” (Rosenheck, Neale, Leaf, Milstein, & Frisman, 1995, p. 134); and site 2 provided substantially fewer community based services and under performed in most PACT categories when evaluated for program fidelity (Rosenheck & Neale, 1997, p. 11). Attempting to show that the increased costs of PACT were the result of these 2 sites’ ineffective PACT implementation, the researchers decided to reanalyze the data with these two sites excluded. They thus eliminated 34% of the original sample. This proved fruitful because the statistically significant difference found during the original analysis of costs was reduced to a non-significant difference, (Rosenheck & Neale, 1998, p. 463). More to the point, eliminating these two sites created an unintended experimental situation to reanalyze clinical outcomes.

If the dropped programs were less effective the reanalyzed clinical outcome measures should have increased the statistically significant impact originally found. However, after “ … excluding the 2 general medical and surgical sites that did not … implement the [PACT] program … clinical outcome results did not change” (Rosenheck & Neale, 1998, p. 463). In other words, with over a third of the original sample removed, about half of whom were essentially in a no treatment group, no change occurred in “the clinical outcome data”. Being or not being in PACT made no difference to clinical outcome. Dr. Rosenheck (personal communication, October 1997) confirmed that in the original analysis the clinical results of the two excluded sites were in the same direction and with similar significance as the results found at the other sites.

 

Claim – Occasionally, positive significant vocational effects are observed as a result of PACT (Marx et al., 1973; Stein & Test 1980).

Evidence – The latest review of the research corroborates the present author’s detailed analysis provided elsewhere (Gomory, 1998): “Examining the results of the three positive studies [the only PACT experimental trials finding positive effects] further suggests that vocational outcomes are probably not the results of the [PACT] … per se.”(Mueser et al., 1998, p. 55).

 

Possible Negative effects PACT

 

Another consistent justification for advocating the utilization of PACT, even where limited or no effectiveness can be attributed, is that it does no harm. In her review of case management models--14 out of 20 of which are PACT programs--Solomon (1992) writes that “Case management … does not appear to produce negative effects and is as effective as hospitalization and subsequent aftercare.” (p. 176-177).

In a subsequent study, Solomon and Draine found one of two key negative effects. The study was part of a larger randomized controlled trial of 200 homeless SMI's leaving an urban jail system (Solomon & Draine, 1995a) which aimed to test the effectiveness of PACT compared to individual case management and to a no-intervention control group. Solomon and Draine (1995b) noticed a high recidivism rate (56%) among the PACT group, compared to 22% among case managed individuals and 36% among the controls (p. 168). The researchers subsequently compared 22 clients in the PACT to 29 clients in individual case management in order to explain this unexpected finding. The significant findings of this second study were that clients of case managers who sought legal stipulations were more likely to return to jail, case managers were more likely to initiate a violation of probation process as an intervention strategy with clients for whom they sought legal stipulations and these clients returned to jail faster (p. 170). These were all PACT specific activities. Solomon and Draine (1995b) note that “These findings raise provocative questions regarding the possibility of deleterious consequences of intensive case management services for seriously mentally ill people” (p. 171). This study was the first to publicly acknowledge possible harmful effects of PACT and potentially serious ethical and moral difficulties inherent in PACT coercion: “ … coercive case management may defeat the goal of increased independence and is antithetical to the general principle of client self-determination” (p. 171).

In addition Solomon and Draine (1995a) found no differences in any domain between the three treatment groups. This result argues strongly for the use of no-treatment control groups in every PACT trial in order to determine whether PACT is superior to minimum or no treatment.

A second negative effect, possibly related to the coercive elements of PACT, is the increased incidence of suicide in PACT settings. Cohen, Test, and Brown (1990, p. 603) report eight clear-cut and one possible suicides among the subjects of the long-term study conducted by the PACT originators, Test, Knoedler, Allness, Burke (1985). There may have been one additional suicide in this study. Test et al. (1985) report that the subjects in the study were given the structured interview from which the baseline data was obtained after three months of participation. Reporting on clients who were excluded from this interview they state, "It was not possible to interview five subjects: one committed suicide during the first three months" (p. 854). Since Cohen et al. (1990) reported only the data collected on those suicides that were given at least one structured interview, they may have left out the one suicide that occurred in the first three months.

Another study by Hoult et al. (1983) reports that “during the eight months after presenting at Macquire Hospital 10% of the project but none of the control patients were reported by relatives as having attempted suicide. These were … project patients, who prior to and during the study period made repeated suicide attempts” (p. 165).

Another study that attempted to closely replicate the Test and Stein model (Knapp, Beecham, Koutsogeorgopoulou, Hallam, Fenyo, Marks, Connolly, Audini, & Muijen 1994; Marks, Connolly, Muijen, Audini, McNamee, & Lawrence, 1994) reports that, “In the cohort of 189 patients, five died of self-harm in the 20 month study (three [PACT], two control). As with SMI suicides in Madison [Test and Stein’s study] such deaths were unexpected and occurred despite recent contact with staff” (Marks et al., 1994, p. 187). While the result does not implicate PACT as a cause of suicidal behavior, it suggests that PACT was unable to prevent these suicides. The study’s authors spend considerable article space attempting to demonstrate that the PACT treatment was carefully and comprehensively provided to these patients. Several PACT patients were judged to be improved by the PACT experts immediately before they committed suicide. This points to the problematic nature of psychiatric evaluations. Psychiatric tools appear to be unreliable both in preventing suicides and in identifying suicidal individuals (Gomory, 1997).

Research is needed to explore the possible harmful coercive elements in assertive treatment that may contribute to both suicidal behavior and completed suicides. We should question the scientific validity and professional ethics of using any coercive methods in working with such vulnerable patients (Gomory, 1997). Marks et al. study’s PACT patients had very close attention paid to them by the assertive treatment team: “The … three [PACT] suicidal patients had had unusually persistent care … ” (Marks et al., 1994, p. 187). Can such coercive scrutiny be counter-therapeutic?

 

Conclusion

Although PACTs are packaged by institutional psychiatry and its various supporters as a discrete, well tested modality of effective treatment, a critical review of the conceptual framework and the controlled experimental research reveals negative findings as well as possible harmful effects. Why PACT remains aggressively marketed may be explained by the failure of institutional and biopsychiatric treatment efforts in general (see, generally, Breggin, 1997; Fisher & Greenberg, 1997; Valenstein, 1998). It is consistent with current trends to resort to increasingly coercive approaches.

The paradigm of mental illness as brain disease organizes and restricts the vast majority of potential research into helping interventions for seriously troubled persons to the biomedical model, the one model asserted to be “scientific” by institutional psychiatry. This contrasts with the history of the Soteria project, a well-researched non-medical, non-coercive, residential treatment program treating the same population that rarely used medication. Despite the positive results demonstrated in controlled studies of this psychosocial approach, it was defunded and rejected by organized psychiatry (Mosher, 1995).

NIMH’s nearly one billion dollar annual budget sends a powerful signal. Researchers must attempt to find solutions that support and justify mental illness as brain disorder if they expect to be funded. The PACT model fully embraces this paradigm.

PACT’s misinterpreted early results appeared to demonstrate treatment success (Gomory, 1998). By not looking critically at these studies and by reusing unreliable psychiatric measures and instruments from the earlier studies, newer research repeated the same mistakes. Once research careers are established around specific treatment paradigms the need for self-justification rarely allows admissions of error. Instead, contradictory evidence is ignored leading to ever more problematic results (Popper, 1962). PACT—a long-term, expensive, potentially abusive program—continues to be promoted despite research results that demonstrate its lack of effectiveness.


References

Beard, J. H., Malamud, T. J., & Rossman, E. (1978). Psychiatric rehabilitation and long

      term rehospitalization rates: The findings of two research studies, Schizophrenia

      Bulletin, 4(4), 622-635.

Bentall, R. P. (Ed.). (1990). Reconstructing schizophrenia. London: Routledge.

Brekke, J. S. & Test, M. A. (1992). A model for measuring the implementation of

      community support programs: Results from three sites. Community Mental Health

      Journal, 28, 227-247

Breggin, P. R. (1997). Brain disabling treatments in psychiatry: Drugs electroshock, and

      the role of the FDA. New York: Springer Publishing Co.

Boyle, M. (1990). Schizophrenia: A scientific delusion? London: Routledge.

Burns, B. J., & Santos, A. B. (1995). Assertive community treatment: An update

      of randomized trials, Psychiatric Services, 46, 669-675.

Cohen, L. J., Test, M. A. & Brown, R. L. (1990). Suicide and schizophrenia: Data from a

      prospective community treatment study. American Journal of Psychiatry, 147

      602-607.

Community Support Network News (CSNN). (1997). 11(4).

Dennis, D. L., & Monahan, J. (1996). Introduction. In D. L. Dennis & J. Monahan (Eds.),

      Coercion and aggressive community treatment. (pp. 1-9). New York: Plenum Press.

Diamond, R. J. (1996). Coercion and tenacious treatment in the community.

      In D.L. Dennis & J. Monahan (Eds.), Coercion and aggressive community

      treatment.(pp. 51-72). New York: Plenum Press.

Draine, J. (1997). A critical review of randomized field trials of case management

      for individuals with serious and persistent mental illness. Research on Social

      Work Practice, 7, 32-52.

Fisher, S., & Greenberg, R. P. (Eds.). (1997). From placebo to panacea: Putting

      psychiatric drugs to the test. New York: John Wiley & Sons, Inc.

Gambrill, E. (1995). Assertion skills training. In W. O'Donohue & L. Krasner (Eds.),

      Handbook of psychological skills training: Clinical techniques and applications

     (pp. 81-118). Boston: Allyn and Bacon.

Gomory, T. (1997). Does the goal of preventing suicide justify placing suicidal clients in

      care? No. In E. Gambrill & R. Pruger (Eds.), Controversial issues in social work

      ethics, values, and obligations (pp. 63-75).

                   (1998). Coercion justified? – Evaluating the training in community

      living model: A conceptual and empirical critique. Unpublished doctoral dissertation.

      University of California, Berkeley.

Hayek, F. A. (1979). The counter-revolution of science. Indianapolis: Libertypress.

Hoult, J. (1986). Community care of the acutely mentally ill. British Journal of

      Psychiatry, 149, 137-144.

Hoult, J., & Reynolds, I. (1984). Schizophrenia, Acta Psychiatrica, 69, 359-372.

Hoult, J., Reynolds, I., Charbonneau-Powis, M., Weekes, P., & Briggs, J. (1983).

      Psychiatric hospital versus community treatment: The result of a randomized trial.

      Australian and New Zealand Journal of Psychiatry, 17, 160-167.

Knapp, M., Beecham, J., Koutsogeorgopoulou, A., Hallam, A., Fenyo, A., Marks, I. M.,

      Connolly, J., Audini, B. & Muijen, M. (1994). Service use and costs of home-based

      versus hospital-based care for people with serious mental illness, British Journal of

      Psychiatry, 165, 195-203.

Lehman, A. F., Dixon, L. B., Kernan, E. DeForge, B. R., & Postrado, L. T. (1997).
      A randomized trial of assertive community treatment for homeless persons with

      severe mental illness. Archives of General Psychiatry, 54, 1038-1043.

Magee, B. (1997). Confessions of a philosopher. New York: Random House.

Marks, I. M., Connolly, J., Muijen, M., Audini, B., McNamee, G., & Lawrence, R .E.

      (1994). Home-based versus hospital-based care for people with serious mental illness.

      British Journal of Psychiatry, 165, 179-194.

Marshall, M. & Lockwood, A. (1998). Assertive community treatment for people with

      severe mental disorders. The Cochrane Library, 2, 1-30.

Marx, A. J., Test, M. A., & Stein, L. I. (1973). Extrohospital management of severe

      mental illness. Archives of General Psychiatry, 29, 505-511.

McGrew, J. H., Wilson, R. G., & Bond, G. R. (1996). Client perspectives on helpful

      ingredients of assertive community treatment. Psychiatric Rehabilitation Journal,

      19, 13-21.

Miller, D. (1994). Critical rationalism: A restatement and defence. Chicago: Open Court.

Mosher, R. L. (1995). The Soteria project: The first generation American alternative to

      psychiatric hospitalization. In R. Warner (Ed.), Alternatives to the hospital for acute

      psychiatric treatment (111-129). Washington, DC: American Psychiatric Press, Inc.

Mueser, K. T., Bond, G. R., Drake, R. E., & Resnick, S. G. (1998). Models of

      Community care for severe mental illness: A review of research on case management.

      Schizophrenia Bulletin, 24, 37-74.

Olfson, M. (1990). The efficacy of Assertive Community Treatment for the severely

      mentally ill. Draft prepared for the Research Resources Panel National Plan of

      Research to Improve Care for Severe Mental Disorders, National Institute of Mental

      Health, Appendix 2.

Popper, K. R. (1962). Conjectures and refutations: The growth of scientific knowledge.

      New York: Basic Books.

                       (1979). Objective knowledge: An evolutionary approach. Oxford: Claredon

      Press.

Rosenheck, R. A. & Neale, M. S (1998). Cost-effectiveness of intensive psychiatric

      community care for high users of impatient services, Archives of General Psychiatry,

      55, 459-466.

Rosenheck, R. A. & Neale, M. S. (1997). A multi-site cost-effectiveness study of

      intensive psychiatric community care. Manuscript submitted for publication.

Rosenheck, R. A., Neale, M. S., Leaf, P., Milstein, R. & Frisman, L. (1995). Multisite

      experimental cost study of intensive psychiatric community care, Schizophrenia

      Bulletin, 21, 129-140.

Scull, A. (1989). Social order/mental disorder: Anglo-american psychiatry in historical

      perspectives. Berkeley: University of California Press.

               (1993). The most solitary of afflictions: Madness and society in Britain 1700

      1900. New Haven: Yale University Press.

Scott, J. E. & Dixon, L. B. (1995). Assertive case management for schizophrenia,

      Schizophrenia Bulletin, 21, 657-668.

Solomon, P. (1992). The efficacy of case management services for severely mentally

      disabled clients, Community Mental Health Journal, 28, 163-180.

Solomon, P., & Draine J. (1995a). One-year outcomes of a randomized trial of case

      management with seriously mentally ill clients leaving jail, Evaluation Review, 19,

      256-273.

Solomon, P., & Draine J. (1995b). Jail recidivism in a forensic case management

      program, Health & Social Work, 20, 167-172.

Stein, L. I. (1990). Comments by Leonard Stein. Hospital and Community Psychiatry,

      41, 649-651.

Stein, L. I. & Diamond, R. J. (1985). The chronic mentally ill and the criminal justice

      system: when to call the police, Hospital and Community Psychiatry, 36, 271-274.

Stein, L. I., & Test, M. A. (1976). Retraining hospital staff for work in a community

      program in wisconsin, Hospital & community Psychiatry, 27, 266-268.

                                           (1980). Alternative to mental hospital treatment: 1 conceptual

      model, treatment program, and clinical evaluation. Archives of General Psychiatry,

      37,392-397.

                                           (1985). The training in community living model: A decade in

      experience. San Francisco: Jossey – Bass.

Strauss, J. S. & Carpenter, W. T. (1981). Schizophrenia. New York: Plenum Press.

Szasz, T. (1976). Schizophrenia: The sacred symbol of psychiatry. New York: Basic

      Books.

                (1987). Insanity: The idea and its consequences. New York: John Wiley &

      Sons.

Test, M. A. (1992). Training in Community Living. In R. P. Liberman (Ed.), Handbook

      of psychiatric rehabilitation (pp. 153-170). New York: Macmillan Publishing.

Test, M. A. & Stein, L. I. (1976). Practical guidelines for the community treatment of

      markedly impaired patients. Community Mental Health Journal, 12, 72-82.

Test, M. A. & Stein, L. I. (Eds.). (1978). Alternatives to mental hospital treatment.

      New York: Plenum Press.

Test, M. A., Knoedler, W. H., Allness, D. J., & Burke, S. S. (1985). Characteristics of

      young adults with schizophrenic disorders treated in the community. Hospital and

      Community Psychiatry, 36, 853-858.

Test, M. A., Knoedler, W. H., Allness, D. J., Burke, S. S., Brown, R. L., & Wallisch,

      L. S. (1991). Long-term community care through an assertive continuous treatment

      team. In C. A. Tamminga & S. C. Schulz (Eds.), Advances in neuropsychiatry and

      psychopharmacology, volume 1: schizophrenia research (239-246).

Valenstein, E. S. (1998). Blaming the brain: The truth about drugs and mental health.

      New York: The Free Press.


NOTES



[1] For purposes of clarity we use the acronym PACT throughout, although PACT-like programs described in the studies here reviewed receive various other acronyms, such as TCL, ACT, IPCC, etc.

[2] Popper (1962) criticizes utopian (holistic) social intervention on the grounds of logical impossibility (pp.70-93). It is not possible to identify all needs a person may have, even at a specific point in time. Different people may identify different needs depending on their perspective. Some needs are social constructions, like a need for social skills, while others are objectively definable necessities such as food and clothing. The nature of the client’s social and material environment will dictate the kind of “skills” required. Consequently, there is no way to train a team of experts to provide the virtually innumerable interventions potentially needed for the satisfaction of all the possible needs covered by this claim. We are here even excluding services for needs resulting from the iatrogenic effects of the interventions themselves, such as services needed to cope with tardive dyskinesia and sexual dysfunction caused by psychotropic medication, for example (see, generally, Breggin, 1997).

[3] Descriptions of PACT technology are vague. The voluminous writings of the PACT inventors do not include a single (as far as the present author has been able to determine) detailed case example of the methodology at work. In a “case example” Stein and Test describe the first meeting with a client thus: “It was soon evident that John was in the midst, of a schizophrenic episode, but was not immediately suicidal” (1978, p. 50). How this was assessed or what interventions helped in John’s dramatic clinical improvement “within a week” are not provided (p. 51). Test offers the following methodological description for “Direct Assistance with Symptom Management”: “Specific interventions employed ... include medication ... 24- hour crisis availability, and occasional brief hospitalization. Additionally, we provide each patient with a long-term one-to-one relationship aimed at problem solving, at assisting them to learn about their illness, and at enhancing their own coping strategies for dealing with serious symptoms” (1992, p. 157). Dispensing medication and brief hospitalization are concrete interventions the others are vague and do not describe what PACT services do. PACT spends 21.4% of its contacts with patients medicating them, taking up the second greatest number of worker contacts with clients. One to one support (24.9%), largely spent convincing the clients that they are mentally ill and in need of psychotropic medication is first in worker contacts (p. 157). PACT, spending 21.4% dispensing medication, and 24.9% in one to one support appears to be spending 46.3% of total client contacts dispensing psychotropic medications and related management compared with 10.9% on vocational issues, 2.5% on their living situation, .2% on physical health, 12.1% on social recreation, 11.3% on psychotherapy/case monitoring, and 9.2% on activities of daily living (for service contact breakdown, see Brekke and Test, 1992, p. 240).

[4] The concept “assertive” as used by PACT differs from how the research literature usually defines this concept. The field of behavior therapy has for a long time been interested in assertion training. Assertive behavior is defined in that literature for example as, “ effective social influence skills that are acquired through learning.”(Gambrill, 1995). And, as opposed to the PACT approach (as demonstrated in the present paper), “Fundamental to the concept of assertion is a concern with basic human rights.” (p. 82). Assertive and aggressive behaviors are carefully distinguished both by their form and their effect (p. 85). PACT theorists do not differentiate “assertive” from “aggressive” behavior. They appear to be interchangeable in PACT (Dennis & Monahan, 1996, p 3).