Introduction

Nearly 27 million adult Americans have osteoarthritis (OA) (Lawrence et al. 2008), which involves the degeneration of the joint components and surfaces, and is frequently associated with pain, inflammation, and decreased range of motion in the joint. Adult onset rheumatoid arthritis (RA) is a systemic inflammatory autoimmune disease affecting joints that often causes stiffness, swelling, pain, and loss of joint function. Arthritis pain is associated with psychological and psychosocial distress (Benka et al. 2012; Nicassio et al. 2011; Somers et al. 2009) which may result in depression and fatigue from a lack of control over daily living (Simpson et al. 2005). Additionally, anxiety and depression can exacerbate the experience and perception of pain (Smith and Zautra 2008).

Self-management programs targeting pain and pain-related distress generally apply principles of Cognitive Behavioral Therapy (CBT), which focuses on changing thoughts and behaviors, or self-efficacy. Self-efficacy, derived from Social Cognitive Theory (SCT; Bandura 1977, 1997) is a prominent theoretical model in the arthritis literature and has been proposed as an organizing concept for self-management in other chronic diseases (Marks et al. 2005). Improving self-efficacy, which involves developing task-specific knowledge and skills, as well as confidence in one’s ability to accomplish the task in a specific environment (Marks 2001), has been a focus for change in studies of arthritis pain. Self-efficacy beliefs, learned through personal experience, are specific for each self-management behavior (e.g., exercising, relaxation, positive self-statements, avoidance of catastrophizing; Jensen et al. 2003).

There is evidence that participation in self-management programs is beneficial; for example, studies of in-person CBT pain management programs show positive effects on pain, catastrophizing, coping, disability and patient functioning (Burns et al. 2003; Molton et al. 2007; Smeets et al. 2006; Williams et al. 2012). Self-management programs for arthritis and chronic disease that have been conducted face-to-face have shown the following outcomes in randomized controlled trials (RCTs): increased pain self-efficacy, decreased depression, anxiety, and/or pain (see meta-analysis by Dixon et al. 2007) and increased health behaviors (Lorig et al. 2001). Online self-management programs have the potential to overcome some of the limitations of face-to-face self-management programs such as inaccessibility, lack of trained personnel and a group-format delivery (Bodenheimer et al. 2002; Newman et al. 2004). Additionally, the Internet is increasingly accessible and is used often for obtaining health information (Fox 2007). A Cochrane Collaboration review of computer-delivered interventions for people with a wide variety of chronic diseases found improvements in knowledge, perceived social support, health behaviors, and clinical outcomes (Murray et al. 2005).

There are few empirically-based arthritis-specific online sites focused on arthritis self-management. In randomized controlled trials (RCTs) of adults, Lorig et al. (2008) found improvement in health distress, activity limitation, global health, and self-efficacy. A pilot RCT of an internet-based self management program for adolescents with arthritis found that participants in the experimental condition reported lower pain intensity at post treatment follow up compared to participants in the attention control condition (Stinson et al. 2010).

painACTION is an online self-management program that seeks to assist adults who have various types of chronic pain, including back pain, cancer pain, neuropathic pain, migraine pain, and arthritis pain by increasing coping, self-management, and communication skills using the principles of CBT and based on SCT (Bandura 1977, 1997). Each module of the program includes content specific to that type of pain plus shared tools (e.g., a pain tracker) and has undergone independent efficacy testing: back pain (Chiauzzi et al. 2010), migraine pain (Bromberg et al. 2011), and neuropathic pain (DasMahapatra et al. 2013). These RCTs have found that use of painACTION is associated with: (a) decreased negative symptoms associated with chronic pain, e.g., stress, anxiety, depression, and pain levels, and (b) increased positive affect, coping skills, and self-efficacy among patients who are self-managing pain.

Prior to developing the arthritis module for painACTION, we conducted a qualitative assessment of the needs of 32 people with arthritis and 12 practitioners to learn what was important to include in an online self-management program (Trudeau et al. 2010). Concept Mapping of qualitative data revealed that the information about self-management and chronic pain in the literature and in the other modules on painACTION was desired by this audience. When development of the arthritis module was complete, we conducted a randomized controlled trial to test the efficacy of this program for people with arthritis pain. It was hypothesized that participants randomized to the painACTION intervention would report: increased positive cognitions (i.e., pain self-efficacy and pain awareness), reduced negative cognitions (i.e., pain catastrophizing); increased frequency of self-management behaviors (i.e., exercise, cognitive symptom management, communication with physicians); and reduced pain and improved functioning compared to those in a wait-list control condition.

In addition to testing the primary hypotheses, several secondary analyses were conducted. Secondary outcomes pertaining to affect, coping skills, well-being, and global impression of change were explored. As recommended by Turner et al. (2007), we conducted exploratory analyses of potential moderators to see if this intervention was particularly helpful to patients with certain demographic or patient characteristics because they may experience pain and pain management differently. For example, research has indicated that fatigue had a greater impact on pain in patients with RA and fibromyalgia syndrome compared to patients with OA (Zautra et al. 2007). We also looked at level of user engagement because, in the painACTION study with adults with migraine headaches (Bromberg et al. 2011), the high-dose group reported significantly increased self-efficacy at post-intervention compared to the low-dose group.

Materials and methods

The study protocol and all recruitment materials were reviewed and approved on August 26, 2011 by an independent institutional review board (New England Institutional Review Board, Newton, MA). Participant recruitment began on September 8, 2011, and the collection of follow-up data ended on November 11, 2012. [ClinicalTrials.gov Identifier: NCT01463189].

Participants

Participants were recruited through IRB-approved recruitment flyers distributed to doctors’ offices, senior citizen service organizations, and events conducted by the Arthritis Foundation—Massachusetts Chapter. An electronic version of the IRB-approved flyer was also disseminated on the Internet through a variety of methods: (1) email announcements and web postings through the American Chronic Pain Association and the Alliance of State Pain Initiatives to their respective membership (ASPI); (2) advertising targeted to search terms using Google Adwords; (3) listing the study with ClinicalTrials.gov; (4) message boards such as Facebook and craigslist; and (5) distribution of study information to health professionals involved in pain management who are registered at PainEDU.org (an educational website for health care professionals site run by Inflexxion) through the newsletter.

Inclusion criteria for study participants were as follows: (1) at least 18 years of age; (2) able to read and speak English; (3) able to provide informed consent; (4) reliable Internet and email access; (5) a self-reported doctor diagnosis of arthritis such as osteoarthritis (OA), rheumatoid arthritis (RA), ankylosing spondylitis (AS), or other arthritic conditions (e.g., psoriatic arthritis); and (6) pain intensity or impaired functioning of 4 or higher on the 0–10 Numeric Rating Scale (McCaffery and Beebe 1993), because a score of 4 or higher generally is associated with a moderate or high level of pain. Exclusion criteria were: (1) participation in another Inflexxion pain management study; (2) participation in an online research study related to arthritis in the past year; (3) currently in pain from a recent injury; and (4) hospitalization for reasons related to mental health in the past year.

Data were collected via the online data collection software Vovici 6 Enterprise Edition (Vovici Corporation 2012) and stored in a secure database. Participants completed the online assessments at a location of their convenience; they were encouraged to help protect their confidentiality by completing the online questionnaire on their own personal computer and in a private place. They were compensated a total of $250 for completing all assessments.

Procedures

The study is a parallel group design with two conditions. Participants who met the eligibility criteria, completed the online consent form, and were reached for the enrollment confirmation call were randomized to either the experimental condition (eight site visits over 4 weeks, plus one visit per month for 5 months) or the wait-list control condition. We used stratified block randomization (Kernan et al. 1999) to decrease the likelihood of imbalance between conditions. The randomization factors were: (1) gender and (2) type of arthritis. A random sequence was computer-generated for 2 (male, female) × 2 (OA only, RA and/or other) = 4 strata with block size of 4 and equal allocation to each of the two conditions. The random allocation sequence was generated by the study data manager; the research coordinator (RW) enrolled and assigned participants to conditions. There was no blinding after assignment to condition because all measures are self-report.

Experimental condition

Participants in this condition were given access to painACTION.com, a web-based patient education intervention whose development was guided by principles of CBT. All content in painACTION.com is expert-reviewed and approved. Content delivery is multi-faceted. Major areas of content matter are: informational articles designed to enhance both knowledge and patient-provider communication; self-check assessments that give chronic pain patients the ability to help determine confidence and awareness about self-efficacy; lessons that deal with specific issues that face chronic pain patients and how to better navigate those hurdles; personal stories that allow for sharing of thoughts, feelings, and anecdotal solutions from other patients suffering with similar conditions; and, tools that can help provide chronic pain patients with skill sets to help navigate their chronic pain experiences and interactions with healthcare providers.

Participants in the experimental condition were provided with a username and password to access the painACTION site, and asked to complete a minimum of two 20-min sessions on the site per week for 4 weeks (eight sessions in total), plus a minimum of five 20-min follow-up sessions (one per month for 5 months). Specific tasks per session were recommended based on the hypothesized outcomes. For example, content intended to increase positive cognitions (e.g., pain self-efficacy) included “Arthritis-friendly tips and tools for easier living” and “Setting goals to improve your quality of life.” Articles selected to help reduce negative cognitions (e.g., pain catastrophizing) included “When your brain helps the pain: Cognitive therapy in action” and “What’s the worst that could happen?” Tools recommended to increase frequency of self-management behaviors included “Fun ways to be physically active when you have arthritis,” “Chair yoga,” and “Patient-doctor talk.” Please go to www.painACTION.com to see these examples.

Each participant logged in with a personal identification code; therefore it was possible to track each user’s session dates and session times (minutes spent) on the website through usage information on the server. Participant site usage was closely monitored by the research coordinator (RW), and weekly reminders were sent to participants to complete the required sessions. Participants who missed sessions or spent insufficient time were sent email reminders. Phone calls were made to participants who were not using the site to ascertain if inactivity was due to technical problems accessing the site versus lack of interest or engagement.

Control condition

Participants in the control condition were assigned to a waiting list and provided access to the intervention after they completed the final study assessments.

Via informed consent, participants in both conditions were encouraged to continue whatever medical treatment they have been receiving as this study was not a replacement treatment. In addition, they were welcome to seek additional medical treatment during the study.

Measures

Demographic Questionnaire

Participants were asked to indicate their age, gender, race, ethnicity, marital status, level of education, current employment status, and annual household income. This information was gathered at baseline and was used to describe the study participants, as well as to explore potential covariates in outcome analyses.

Primary outcomes

Cognitions

The Arthritis Self-Efficacy Scale (Lorig et al. 1989) is an 8-item questionnaire that assesses a patient’s level of confidence to manage arthritis pain. This scale is rated on a 1–10 scale ranging from 1 = very uncertain to 10 = very certain. This questionnaire has demonstrated internal reliability with an alpha coefficient of 0.92.

The Pain Catastrophizing Scale (PCS) (Sullivan et al. 1995) is an empirically validated (D’Eon et al. 2004; Osman et al. 2000) 13-item scale that measures three elements of catastrophizing (i.e., rumination, magnification, and helplessness) and provides a catastrophizing total score. Items are rated from 0 to 4 (0 = not at all, 4 = all the time).

The Pain Awareness Questionnaire (Berman et al. 2009) is a 7-item questionnaire that assesses a patient’s awareness of their current pain. It is on a 0–4 scale: 0 = not sure to 4 = most of the time. The internal consistency was between 0.68 for baseline, 0.58 for follow up, and 0.81 for data combined from both time points.

Self-management behaviors

Exercise Behaviors (Lorig et al. 1996) is a 6-item questionnaire assessing the total time a patient had participated in various forms of exercise. This scale is rated on a 0–4 scale: 0 = none to 4 = more than 3 h per week. It has demonstrated test retest reliability in two domains: strengthening (Cronbach’s α = 0.56) and aerobic exercise (Cronbach’s α = 0.72).

Cognitive Symptom Management (Lorig et al. 1996) is a 6-item questionnaire assessing a patient’s ability to manage their symptoms. This scale is rated on a 0–5 scale: 0 = never to 5 = always. The questionnaire has demonstrated test–retest reliability with an alpha coefficient of 0.83 and internal consistency reliability with an alpha coefficient of 0.75.

Communication with Physicians (Lorig et al. 1996) is a 3-item scale assessing a patient’s communication with their physicians. This scale is rated on a 0–5 scale: 0 = never to 5 = always. The questionnaire has demonstrated test retest reliability with an alpha coefficient of 0.89 and internal consistency with an alpha coefficient of 0.73.

Pain

Brief Pain Inventory—Short Form (BPI-SF) (Cleeland and Ryan 1994) uses a 0–10 numeric rating scale to obtain information on the intensity of pain, the degree to which pain interferes with function, pain relief, pain quality, and the patient’s perception of the cause of pain. It has two subscales: (1) The Pain Severity Score has four items (worst, least, average and current pain) that measure the average level of pain intensity for the patient. (2) The Pain Interference Score has seven items that measure how much pain interferes with daily life, such as general activities, mood, walking, work, relationships, sleep and enjoyment of life. The BPI’s reliability and validity were originally established with samples of cancer pain patients, but have now been found for chronic non-cancer pain, including arthritis (Keller et al. 2004; Mendoza et al. 2006).

Secondary outcomes

The Depression Anxiety Stress Scales (DASS-21, Lovibond and Lovibond 1995) is a 21-item questionnaire with three subscales: depression, anxiety, and stress. This scale has consistently good psychometric properties (Antony et al. 1998; Crawford and Henry 2003) with various populations, including older primary care patients specifically (Gloster et al. 2008).

The Chronic Pain Coping Inventory (CPCI-42) (Romano et al. 2003) is an empirically validated, abbreviated version of the original CPCI (Jensen et al. 1995). The individual is asked to indicate the frequency of use of behavioral and cognitive coping strategies to cope with pain on 42 items including eight subscales: Guarding, Resting, Asking for Assistance, Relaxation, Task Persistence, Exercise/Stretching, Seeking Social Support, and Coping Self-Statements.

The Arthritis Impact Measurement Scale-2-SF (Guillemin et al. 1999) is a 26-item scale that measures five domains of health status (i.e., Physical, Symptom, Affect, Social Interaction, Role) on a 5-point Likert scale during the previous 4 weeks for persons with arthritis. It has been found to be reliable and valid for persons with RA (Guillemin et al. 1999; ten Klooster et al. 2008) and OA (Ren et al. 1999).

Patient Global Impression of Change Scale (Guy 1976) is an outcome measure of the patient’s impression of improvement with treatment and consists of a single-item self-rating (7-point scale, “very much improved” to “very much worse”) of a participant’s perceived response to an intervention. Specifically, participants were asked about how much improvement they experienced with pain treatment during the study. Improvement in PGIC is related to reduced chronic pain intensity (Farrar et al. 2001).

Data for the number of minutes spent on the website and pages viewed were collected for participants in the experimental condition.

Statistical analysis

The study design was a parallel group RCT comparing two conditions (experimental vs. control) over 4 time points (baseline, 1 month follow up, 3 month follow up, and 6 month follow up). We used linear mixed model (LMM) approach to test differences between conditions for each outcome. Advantages of using LMM are: (a) LMM automatically handles missing data by maximum likelihood (Allison 2012) and (b) LMM accounts for covariance among repeated measures.

Descriptive statistics (mean, standard deviation, frequency, etc.) were computed for demographic variables for the entire study sample and stratified by conditions. Next, we tested for mean differences between conditions (experimental vs. control) over time on each outcome. Each model included the following fixed effects: (1) condition (experimental vs. control), (2) time (baseline, 1 month follow up, 3 month follow up and 6 month follow up), and (3) condition-BY-time interaction. The model treated time as a repeated measures variable to allow for covariation across time points. Statistical focus of these analyses was the interaction effect, condition-BY-time, as this effect tests differences between conditions over time.

Exploratory analyses were conducted to test for moderation (effect modification), i.e., we tested whether the magnitude of intervention effects were different for certain covariates, namely gender (male vs. female), age (≤50 vs. >50 years), race (white vs. non-white), baseline pain intensity (average baseline pain ≤6 vs. >6), and Arthritis type (OA vs. RA and other). Exploratory models were constructed by adding the putative moderator (e.g., gender) as a main effect and all possible two-way and three-way interaction terms (e.g., gender-BY-time, gender-BY-condition, gender-BY-condition-BY-time). Post-hoc analyses were conducted in the presence of a significant three-way interaction.

Finally, we performed exploratory analyses to test the effect of user engagement on outcomes. This was done by testing the condition-BY-time effect for each outcome using a new condition variable with three levels: control, low engagement, high engagement. Low engagement and high engagement levels were derived from the total number of minutes spent on painACTION website. A median split (median = 204.5 min) was done to categorize experimental participants into low engagement and high engagement levels because the total number of minutes on the site variable (M = 288.4, SD = 356.5, Range = 0 through 2,746.5) included measurement error caused by individuals not actively closing out of a specific page.

The study was originally powered to control for Type I error with respect to the primary analyses. As recommended by Turner et al. (2007), the authors performed exploratory analyses to evaluate the possibility of moderating effects. Since the sample size necessary to adequately power these supplemental analyses was not part of the original study design, the authors performed these analyses without controlling for Type I error, as this would likely result in a concomitant inflation of Type II error. Therefore, the level of significance was set at α = 0.05 for each secondary analysis of the data. However, it should be noted that within each secondary analysis, post hoc tests were adjusted for Type I error by applying a well-established simulation method, considered superior to the Bonferroni correction (Westfall et al. 2011). All analyses were performed using the GLIMMIX procedure in SAS, version 9.3 (SAS Institute 2011; Schabenberger 2005).

Results

Participant selection

Four hundred and six (406) participants were assessed for eligibility, of which 335 participants met the inclusion criteria. Eight participants were registered users of the painACTION website and hence excluded from the study. Of the remaining 327 participants, 245 consented to participate and were randomized into either the experimental or control condition. After randomization, 16 participants did not complete baseline (i.e., dropped out) and one participant was terminated from the study for attempting to enroll in the study multiple times, resulting in the final sample of 228 allocated to experimental (n = 113) and control (n = 115) conditions. In the experimental condition, the attrition rate at 1 month follow up, 3 month follow up and 6 month follow up was 6.2, 10.6 and 14.2 % respectively. Among participants assigned to the control condition, the attrition rate at 1 month follow up, 3 month follow up and 6 month follow up was 2.6, 8.7 and 6.8 % respectively. In accordance with the Consolidated Standards of Reporting Trials group (www.consort-statement.org), participant enrollment and follow-up through the study is documented in Fig. 1. Because the study was designed with an intent-to-treat approach, the goal was to follow as many participants as possible, regardless of their completion of intervention. The majority of the participants completed all the follow up assessments (n = 195) resulting in an overall retention rate greater than 85 %.

Fig. 1
figure 1

Consolidated standards of reporting trials flow diagram

Participant characteristics

Baseline descriptive characteristics of the study sample are presented in Table 1. There were no differences in demographic characteristics of the participants by condition.

Table 1 Baseline characteristics of the study participants

Treatment effects

Primary outcomes

Linear mixed models (LMM) were run to ascertain whether the participants in the experimental condition, as compared to participants in the control condition, evidenced a significantly greater mean change over time on these primary outcomes: cognitions (self-efficacy; awareness of pain; pain catastrophizing), self-management behaviors (exercise behaviors; cognitive symptom management; communication with physician) and pain (pain intensity; pain interference) (see results in Table 2).

Table 2 Least square means and standard errors for all outcome measures

Significant condition-BY-time effect was noted for self-efficacy and pain catastrophizing but not for confidence in ability to manage pain and awareness of responses to pain. Specifically, a significant overall effect of condition-BY-time was noted for arthritis self-efficacy (F3, 226 = 3.05, p = 0.0293) as measured by ASEQ. Post hoc comparisons revealed that the participants in the experimental condition reported a greater increase in ASEQ mean score from baseline to 1 month follow up (ES = 0.53, t = 2.64, p = 0.0222), and baseline to 6 month follow up assessment (ES = 0.66, t = 2.75, p = 0.0164), as compared to the control participants. Further, a significant condition-BY-time effect was found for pain catastrophizing as measured by PCS for total score (F3, 226 = 4.32, p = 0.0055); as well as the subscales: rumination (F3, 226 = 4.41 p = 0.0049), magnification (F3, 226 = 3.87, p = 0.0100), and helplessness (F3, 226 = 2.72, p = 0.0453). Post hoc tests revealed that the experimental condition reported a greater decrease in total score from baseline to 6 month follow up (ES = −4.22, t = −3.53, p = 0.0013); a greater decrease in rumination from baseline to 3 month follow up (ES = −1.16, t = −2.55, p = 0.0304) and baseline to 6 month follow up (ES = −1.87, t = −3.56, p = 0.0012); a greater decrease in magnification from baseline to 6 month follow up assessment (ES = −1.09, t = −3.26, p = 0.0037); and, a greater decrease in helplessness from baseline to 6 month follow up (ES = −1.5, t = −2.63, p = 0.0238), as compared to the control condition.

LMMs did not reveal any condition-BY-time effect for the self-management behavior variables: amount of time spent in the past week doing exercise behaviors, the use of cognitive stress reduction (pain reduction) techniques, or reported communication with physicians.

There were also no statistically significant condition-BY-time effects for pain intensity and physical functioning as measured by BPI.

Secondary outcomes

Differential effects of the experimental (website intervention) and the control condition over time was measured using LMMs on the following secondary outcomes pertaining to affect, coping skills, well-being, global impression of change, and user engagement.

LMMs run on each of the three subscales of the DASS did not reveal any significant effect of condition-BY-time on the depression, anxiety and stress subscales of the DASS. It should be noted that for the depression subscale the overall condition-BY-time effect yielded a p value of 0.0577; post hoc planned comparisons showed that the experimental condition participants evidenced greater reduction in depression from baseline to 6 month follow-up compared to the control condition participants (ES = −2.78, t = −2.50, p = 0.0333).

A significant condition-BY-time effect was noted for the relaxation subscale of the CPCI (F3, 226 = 3.07, p = 0.0287). Post hoc tests revealed that the experimental condition reported a greater increase in relaxation from baseline to 3 month follow-up assessment (t = 2.99, p = 0.0083), as compared to the control condition.

LMMs did not reveal any condition-BY-time effect for AIMS, i.e., no significant change was noted for daily life activities during the past month between the two conditions.

Significant effects were found for treatment (F1,220 = 20.0, p < 0.0001) on participants’ global impression of change. Compared to the control group, website participants reported a more improved average impression of change at the follow up assessments for 1 month (ES = −0.44, t = 3.83, p = 0.0025), 3 month (ES = −0.44, t = 3.06, p = 0.0368), and 6 month (ES = −0.61, t = 4.18, p < 0.0001).

Moderation analyses

Arthritis type (OA vs. RA and other) was identified as a moderator of intervention effects on the outcomes. Notably, significant three way-interactions were evidenced for the Pain Catastrophizing total score (F3,223 = 2.80, p = 0.0411) and the magnification subscale (F3,223 = 2.84, p = 0.039). Post-hoc comparisons revealed that participants in the experimental condition with Osteoarthritis only showed a reduction in the Pain Catastrophizing total score (t = −2.82, p = 0.0282) and magnification subscale (t = −2.91, p = 0.0222) from baseline to 6 month follow up; whereas no such change was noted for other types of Arthritis (RA and others). Gender, age, race, and baseline pain intensity did not moderate intervention effects on the outcomes.

User engagement analyses

Participants in the experimental condition were asked to complete a minimum of 20 min on the site two times per week for 4 weeks which equals a total use of 160 min; 57.5 % used the site for at least 160 min during the study. A review of page view data indicated that of the 44,682 pages viewed in the study. 8.6 % were completing assessments (e.g., Daily Pain Tracker); 27.8 % were accessing content (via the personalized recommendation page [“My Page”] or the pain-specific libraries); and 59.1 % were reviewing program content (e.g., articles, lesson pages, tools). The other 4.4 % of the pages viewed were administrative activities, including logging in (n = 1,357, 3 %). See Fig. 2. NOTE: Only three participants in the intervention did not use the website.

Fig. 2
figure 2

User engagement: number and percentage of page views per task type (total page views in study = 44,682)

User engagement (low engagement versus high engagement using median minutes used) was significantly associated with improved outcomes between baseline and 6 month follow up.

Pain-catastrophizing

Results from LMM revealed a significant engagement-BY-time effect for the Pain-Catastrophizing total score (F6, 225 = 2.77, p = 0.0129) as well as the rumination (F6, 225 = 2.40, p = 0.0287) and magnification (F6, 225 = 2.58, p = 0.0196) subscales. Compared with controls, participants who used the site the most reported a significant decrease in total score (t = −3.49, p = 0.0050), rumination (t = −3.41, p = 0.0068), and magnification (t = −2.94, p = 0.0272) from baseline to 6 month assessment, whereas no significant change was noted in the low engagement group relative to the control condition.

Cognitive symptom management

Results from LMM revealed a significant engagement-BY-time effect for Cognitive Symptom Management (F6, 225 = 3.58, p = 0.0021). Compared with controls, participants who used the site the most reported greater increases in Cognitive Symptom Management from baseline to 3 month assessment (t = 3.64, p = 0.0029) and baseline to 6 month assessment (t = 3.05, p = 0.0188); whereas no significant change was noted in the low engagement group relative to the control condition. When comparing the low and high engagement group, it was noted that high engagement participants reported significantly greater increases in Cognitive Symptom Management compared with low engagement participants, from baseline to 3 month follow up (t = 2.89, p = 0.0300) and baseline to 6 month follow up (t = 2.93, p = 0.0270).

Communication with physician

Results from LMM revealed a significant engagement-BY-time effect for Communication with Physician scale (F 6, 225 = 2.43, p = 0.0271). When comparing the low and high engagers, it was noted that high engagers reported significantly greater increases in Communication with Physician compared with low engagers, from baseline to 6 month follow up (t = 2.75, p = 0.0448).

Discussion

The original goal of this study was to expand painACTION’s relevance and reach to people with arthritis pain. This activity extended previous work on painACTION with other pain patient populations: back pain (Chiauzzi et al. 2010), migraine pain (Bromberg et al. 2011), and neuropathic pain (DasMahapatra et al. 2013). Unlike other studies of painACTION, we did not find that arthritis pain participants in the experimental condition had significantly greater change over time in worst pain (Chiauzzi et al. 2010; DasMahapatra et al. 2013), pain severity (DasMahapatra et al. 2013), pain interference (DasMahapatra et al. 2013), stress (Bromberg et al. 2011; Chiauzzi et al. 2010), and depression (Bromberg et al. 2011; DasMahapatra et al. 2013) than those in the control condition. Like these other studies, arthritis pain participants in the experimental condition had significantly greater change over time in self-efficacy to manage pain (Bromberg et al. 2011; DasMahapatra et al. 2013), global impression of change (Chiauzzi et al. 2010), pain catastrophizing (Bromberg et al. 2011), and use of the coping strategies of coping self-statements (Chiauzzi et al. 2010) and relaxation (Bromberg et al. 2011) than those in the control condition. Differences between painACTION—Arthritis and other pain modules on the site were somewhat expected given the different populations but the lack of changes in health outcomes in the arthritis pain sample is disappointing.

Changes were only found between conditions for two of the primary outcomes in this study: self-efficacy and catastrophizing. Self-efficacy, or the confidence one has in the ability to manage arthritis pain, is a primary outcome of a well-studied self-management program for arthritis delivered in groups (Lorig et al. 2005) and has been described as the goal of self-management education programs (Bodenheimer et al. 2002). Lorig et al. (2008) found increases in self-efficacy in the online intervention group at 6 month follow-up compared to the treatment-as-usual group; these findings were maintained at 1 year.

Pain catastrophizing is described as negative emotional and cognitive processes (Edwards et al. 2006) and has been associated with a variety of negative health outcomes, which include increases in pain severity, affective distress, muscle and joint tenderness, and pain-related disability (see review by Edwards et al. 2006). Catastrophizing has been proposed as an important variable for understanding osteoarthritis and rheumatologic pain conditions (Edwards et al. 2006; Somers et al. 2009). Our intervention showed decreases in pain catastrophizing between the intervention and control groups. Interestingly, participants in the experimental condition with OA showed significantly greater reductions in pain catastrophizing from baseline to 6 months compared to individuals with RA or another arthritic condition. The manner in which catastrophizing is related to outcomes remains uncertain. Catastrophizing has been proposed as a mediator of depression and treatment outcome of CBT (Smeets et al. 2006), and a mediator or moderator of treatment in rheumatologic disease (Edwards et al. 2010).

Other important hypothesized outcomes were not significant in our study, including pain intensity, arthritis-related well-being, health behaviors, and pain awareness. Nonsignificant findings in terms of pain intensity are similar to other trials, where only small changes or no changes in pain are found (Macea et al. 2010).

Individuals in the intervention group with high engagement (i.e., more than 205 min on the site) showed greater improvement in pain catastrophizing, cognitive symptom management and communication with physicians than did individuals who spent less time on the site. As a subsequent review of the painACTION page view data indicated active user interaction with the content pages (e.g., articles, lessons, tools), perhaps requiring more than 160 min of initial program exposure (i.e., two times per week for 20 min for 4 weeks) might have resulted in additional significant outcomes.

Another possible explanation for the absence of results related to pain and health behaviors is that the required activities on the site were more focused toward the outcomes that were significant than those that were not. Our measure of self-efficacy was a broad measure developed for arthritis, so self-efficacy for pain and functioning—the intended targets of the experimental intervention—were only parts of that measure. In addition, measures that were used to test the Arthritis Self-Management Program (ASMP; e.g., Lorig et al. 2008) were chosen for this study to be consistent with published literature. Of note, the ASMP focuses on making weekly action plans with weekly accountability to peers and peer-leaders. A recent qualitative analysis of a similar program with 277 individuals with chronic disease showed action plans focused primarily on health behaviors (exercise 59 %; healthy eating/weight loss 32 %; Lorig et al. 2014). This is a much more intensive intervention than the independent (i.e., no interaction with peers or peer-leaders) online patient education experience provided by painACTION which appears to have been helpful only in changing cognitive factors.

Exploratory analyses of potential moderators were also not significant. This lack of significant results for demographic variables as moderators is consistent with previous work on CBT interventions (McCracken and Turk 2002), including a recently published secondary analysis of the collective data from painACTION studies (DasMahapatra et al. 2014).

Limitations of this study include the following: recruitment from primarily online sources, reliance on a self-reported doctor diagnosis of arthritis, the lack of cultural diversity in the participant population, the potential influence of unmeasured variables on use of the intervention, and differential results for some outcomes across time. Because differences were found in a previous painACTION study between online recruits and those from a pain center (Chiauzzi et al. 2010), our primarily online sample may not be generalizable to a sample recruited from a clinical practice. Reliance on a self-reported doctor diagnosis of arthritis was a compromise in rigor motivated by the feasibility of collecting national data with a limited timeframe and budget. We included moderate level of pain as an inclusion criteria and reviewed reports of website use by the intervention group to confirm that intervention group participants were using the site. Additionally, our sample was primarily educated, white women who have a high SES, similar to other studies in arthritis pain (Bruce et al. 2007). The website is publically available but it is important to reach individuals beyond this specific cohort to increase use of self-management strategies for pain.

Given these limitations, the other significant secondary outcomes that were found are interpreted with caution. There were significant increases in coping through relaxation and impression of global change between the intervention and control groups. Relaxation has been shown to be helpful in changing pain for individuals with RA when compared to CBT over 12 months (Barsky et al. 2010). The directed portion of our intervention included multimedia presentations of relaxation, a guided imagery tool, and chair yoga, which may have increased the use of this strategy in the intervention group over the 3 months. However, use of this strategy did not persist to the 6-month follow-up. Additionally, the reported use of other coping strategies was not significantly different between the intervention and control groups. A recent review suggests that when considered longitudinally, the evidence for coping strategies predicting psychological distress in RA is weak (Vriezekolk et al. 2011). Clearly the impact of coping strategies was small in our study for unknown reasons. It could be that the study attracted individuals who coped in an action-oriented manner as manifested by their willingness to participate in the study and/or that the content was not delivered in a manner that promoted knowledge of coping versus the development of coping skills. Further research is needed to clarify coping outcomes from CBT-guided self management delivered in an online educational format. Interestingly, participants’ impression of global change was different in the intervention group compared to the control group at all follow-up periods suggesting that use of painACTION had a positive impact.

The question remains open about how participation in independent (i.e., no active peer or peer leader support) online self-management programs impacts living with arthritis pain. In this sample of adults with arthritis pain, we observed changes in self-efficacy and catastrophizing, but not in the level of worst pain as found in painACTION studies of adults with back pain (Chiauzzi et al. 2010) and adults with neuropathic pain (DasMahapatra et al. 2013). Perhaps those with arthritis pain who receive an independent online self-management intervention require more than 6 months’ time for cognitive changes in self-efficacy and catastrophizing to impact reported pain level; studies with longer follow up periods would be required to test this hypothesis. Additionally, future investigations of online interventions with this population could emphasize setting specific personal health behavior goals that are tracked and monitored over time to help maximize the potential impact on pain.