- Research article
- Open Access
- Open Peer Review
Veteran-centered barriers to VA mental healthcare services use
BMC Health Services Researchvolume 18, Article number: 591 (2018)
Some veterans face multiple barriers to VA mental healthcare service use. However, there is limited understanding of how veterans’ experiences and meaning systems shape their perceptions of barriers to VA mental health service use. In 2015, a participatory, mixed-methods project was initiated to elicit veteran-centered barriers to using mental healthcare services among a diverse sample of US rural and urban veterans. We sought to identify veteran-centric barriers to mental healthcare to increase initial engagement and continuation with VA mental healthcare services.
Cultural Domain Analysis, incorporated in a mixed methods approach, generated a cognitive map of veterans’ barriers to care. The method involved: 1) free lists of barriers categorized through participant pile sorting; 2) multi-dimensional scaling and cluster analysis for item clusters in spatial dimensions; and 3) participant review, explanation, and interpretation for dimensions of the cultural domain. Item relations were synthesized within and across domain dimensions to contextualize mental health help-seeking behavior.
Participants determined five dimensions of barriers to VA mental healthcare services: concern about what others think; financial, personal, and physical obstacles; confidence in the VA healthcare system; navigating VA benefits and healthcare services; and privacy, security, and abuse of services.
These findings demonstrate the value of participatory methods in eliciting meaningful cultural insight into barriers of mental health utilization informed by military veteran culture. They also reinforce the importance of collaborations between the VA and Department of Defense to address the role of military institutional norms and stigmatizing attitudes in veterans’ mental health-seeking behaviors.
Some veterans using healthcare services at the Department of Veterans Affairs (VA), face multiple potential barriers to VA healthcare services, particularly mental healthcare [1, 2]. Previous research has examined the barriers faced by veterans obtaining needed VA mental healthcare services [3,4,5,6,7,8,9]. Limited attention has been paid to the influence of veterans’ experiences (e.g., prior military service, day-to-day struggles) and meaning systems on their perception of barriers to VA mental healthcare services.
Patients, physicians, and researchers who have different life experiences and backgrounds may use different paradigms and language—that is, different cultural frameworks when thinking about healthcare or engaging with healthcare systems [10,11,12]. For example, veterans’ military history greatly influence their understanding of mental health and the language used to describe those experiences , while physicians’ and researchers’ biomedical and scientific research training shapes their understanding of health and use of language to describe patient experiences . The VA has made important strides toward veteran-centric care that places the voice of veterans and their unique needs at the center of healthcare. Recently, the VA has implemented and funded a number of initiatives (e.g., Center for Compassionate Innovation, MyVA, Whole Health Initiative), as well as research, trainings, and quality improvement projects to facilitate this culture shift [15,16,17].
In this era of greater emphasis on patient-centered care approaches, where researchers are encouraged to meaningfully collaborate with populations they study , one critical care need is to understand the barriers to care grounded in veterans’ frameworks for thinking about health. Veterans with mental health problems tend to perceive more barriers to mental health treatment than veterans without similar problems [18,19,20,21]. By understanding veteran-centric barriers to mental healthcare, we can better understand how to increase initiation and engagement with VA mental healthcare services, as well as adherence to mental health treatments.
In this paper, we report on the use of cultural domain analysis (CDA), a method common in ethnographic research , to elicit veteran-centered concepts of barriers to VA mental healthcare services use. We selected this approach over quantitative methods such as survey questions because it allows veterans to define barriers to care that they themselves experience, and to talk about how their experiences influence their mental health service use. Using a series of elicitation and interpretation interviews, we elicited veteran-centered barriers to care and then asked veterans to explain the meaning of these barriers in their own VA healthcare experiences. CDA methods elicit an “emic” perspective (the perspective of the participant), rather than an “etic” perspective (the perspective of the researcher) [23, 24]. This analysis is the initial phase of a sequential mixed-methods study designed to develop and validate a perceived access measurement tool. The first phase of the larger study involved qualitative semi-structured interviews with veterans, of whom a subsample participated in the CDA and domain interpretation interviews. This paper reports on these findings.
We used standard CDA procedures to elicit veteran-centered barriers to mental healthcare and to create a cognitive map [25, 26]. We followed up with qualitative, semi-structured interviews that were conducted during one-hour interview sessions to understand the meaning of these barriers in veterans’ healthcare experiences. For all interviews, participants completed a brief quantitative sociodemographic survey and reported on their current mental health symptoms severity for depression, post-traumatic stress disorder (PTSD), and alcohol use. Depression severity was measured using the Patient Health Questionnaire nine-item depression module (PHQ-9) from the PRIME-MD [27,28,29]; PTSD symptom severity was measured using the PTSD Checklist Civilian version (PCL-C) . At-risk drinking was assessed using the AUDIT-C . All participants provided written informed consent and were remunerated for their study participation. Prior to the start of the research, the VA’s Central Institutional Review Board approved all study procedures.
This study was conducted at ten sites in three geographically distinct VA administrations areas called Veterans Integrated Service Networks (VISNs): VISN 1 included one urban and two rural CBOCs in Maine serving primarily white veterans; VISN 16 included one urban health clinic and two rural CBOCs in Arkansas serving a largely white and African American veteran population; and VISN 21 included one urban and three rural CBOCs in Northern California serving a racially and ethnically diverse group of veterans. Table 1 shows the rural, urban, and ethnic/racial breakdown across sites.
We recruited veterans who used VA healthcare and had behavioral health concerns, but who did not necessarily use specialty mental health services. Eligible participants included veterans between 18 to 70 years old who screened positive for at least one behavioral health problem, including depression, PTSD, or at-risk alcohol use during a routine VA primary care appointment within the past year. We used opt-out letters, a proven strategy for gaining veterans’ participation in health services research [32,33,34], to recruit a diverse sample of veterans across the three states.
As described in detail elsewhere [35, 36], we sent opt-out letters to anywhere from 30 to 60 eligible veterans within each of the three VISNs repeating this procedure in three successive waves. Opt-out letters were sent to 585 veterans across all three sites. Eligible veterans received a letter describing the study and the opt-out process that involved returning a self-addressed, stamped, “do not call” form or calling a 1–800 number to opt-out. A total of 89 veterans opted out of the study. Within two weeks of receiving the letter, study staff called the remaining 496 veterans who did not opt-out. Veterans who had access to a telephone and had experienced mental health problems related to PTSD, depression, or alcohol use were invited to participate in the study. An additional eight veterans had already been recruited into the study during a pilot phase to assess the study design. We called to confirm eligibility and discuss study participation; 258 veterans were reached and 72 participated in the study. The final study sample included 80 veterans.
Based on preliminary analyses and review of our recruitment log, we then purposively identified certain subpopulations of veterans (e.g., rural veterans, Iraq and Afghanistan veterans, women veterans) to recruit, ultimately diversifying our sample. In wave 1, we recruited veterans of differing service eras obtaining representation of older and younger veterans (e.g., Vietnam veterans, Iraq and Afghanistan veterans); in waves 2 and 3 we recruited veterans based on race and ethnicity. For all waves, we recruited veterans from both rural and urban contexts and over-recruited women veterans, an underrepresented veteran subpopulation.
Of the 80 veterans in the sample, 66 veterans participated in the cultural domain analysis and interpretation interview. As described below, this method requires a relatively small sample size. Therefore, we recruited participants into the CDA phase until agreement was reached (n = 52) and into the domain interpretation task until saturation was reached (n = 14).
Cultural domain analysis and interpretation interview
Cultural Domain Analysis (CDA) examines how members of a group who share a culture characterize aspects of that culture through a cognitive domain, referred to as a cultural domain in CDA, defined by a set of words, phrases, or concepts that collectively symbolize a single idea . The CDA method elicits participants’ words and brief phrases that constitute a domain, analyzes its structure, and assigns those structures into one or more dimension. CDA is a multi-step, iterative mixed-methods approach that intersperses data collection with analysis. Analysis of each step systematically informs the next step to ensure a comprehensive interpretation. Sample size determination for the CDA steps is based on inter-correlations among participants about domain items and requires very small sample size; and high domain agreement can be reached with as few as 15 participants per step [38, 39]. We added a final phase of qualitative interviews to validate domain dimensions and elicit veterans’ understandings of the meanings of identified barriers in veterans’ healthcare experiences . We describe each step of the CDA process below.
Free list exercise. We started with a free list exercise, an unstructured, open-ended task used to elicit the words and brief phrases that inductively characterize a domain. During data collection, each participant was asked to “list all the things that you think can make it more difficult for veterans to get help for stress-related and emotional health problems (see Additional file 1 for a copy of the guide). Participants listed as many items as they could in response to the verbal prompt. To elicit additional items, interviewers used common free list probing techniques, including non-specific prompts, such as “What other kinds of things make it more difficult to get help?”; reading back free lists to check for accuracy, followed by non-specific prompts; and semantic cues, such as “What about [transportation], can you think of anything else that is similar to this item?” . A total of 23 veterans across the three VISNs participated in the free list task.
Participants’ responses included a total of 238 unique single-word items and brief phrases. The qualitative team reviewed the items, eliminated duplicates, and combined similar items to reduce the list; calculated the frequency of items; and selected items with a frequency ≥ 5 and items with lower frequency but high importance based on qualitative analyses of interview data . Table 1 shows the master list of 46 unique items generated by this data reduction process and used in the subsequent pile sort activity.
Pile sort activity
After compiling the free lists, we asked a new set of participants to conduct a pile sort activity in which participants organize or sort a finite number of discrete words and phrases into categories according to whatever criteria they see fit. The 46 items generated in the free list exercise were placed on index cards and assigned a unique number. Interviewers asked participants to “place all the items you think are similar into piles,” using as many or as few piles as necessary. Finally, participants were asked to review and label each pile with a descriptive title. A total of 29 veterans across the three states participated in the pile sort activity.
Pile sort data were entered into a database keyed on index card label and unique number and were imported into Anthropac, an analytic program designed to collect and analyze cultural domain data by identifying underlying relations between items and meaningful group clustering . Pile sort data were analyzed using the Anthropac multidimensional scaling (MDS) tool to identify each statement as a separate point on a two-dimensional map, which provides a visual representation of participants’ sorting data as illustrated in Fig. 1 . MDS graphs prioritize meaning through spatial proximity (i.e., items appearing closer together are more conceptually similar; items appearing farther apart are more conceptually distinct). MDS calculates a stress value, a diagnostic statistic measuring the overall fit of the map (i.e., goodness-of-fit indicator). Lower stress values more accurately reflect congruence between the raw data and the computed distance matrix. For example, 0.0represents perfect congruence between the raw data and the distance matrix whereas ˃0.2 represents poorer congruence and goodness of fit . The average estimated stress value for similar studies using MDS to analyze pile sort data is .280 . We obtained a stress value of .181, representing a good fit of the map to the data. Finally, we conducted a cluster analysis of the MDS to identify meaningful groupings of items across participants as shown in Fig. 2 .
Domain interpretation task
Finally, after generating MDS and cluster analyses, we asked a third set of participants to examine the results as a means to validate the domain and its dimensions and understand the meaning of the dimensions and constituent items in veterans’ VA healthcare experiences. We asked participants to explain why items clustered together and their relationship to veterans’ healthcare experiences. We then asked veterans to label each pile with a unique descriptive title they created to characterize the pile. This resulted in different descriptive titles from the pile sort exercise. A total of 14 veterans across the three VISNs participated in this phase.
Participants’ responses during the interpretation task were audio-recorded, professionally transcribed, and imported into qualitative data management software . Following the analytic process described by Ryan and Bernard , the first author read the transcribed text line-by-line to identity themes, writing memos throughout. A coding schema was developed with code definitions, and thematic codes were applied to narrative text . Axial coding was used to make comparisons across transcripts and to understand the relations among themes within and across transcripts . The qualitative team reviewed the resulting analysis, and the full qualitative team contributed to and decided on final cluster names through an iterative process.
Sixty-six unique veterans between the ages of 20 to 70 (average 44.0) years participated in one of the three CDA phases (See Table 1). Most participants were male (n = 50), white (n = 40), and had prior specialty mental health visits (n = 40); 24 screened positive for PTSD, 28 for depression, and 40 for at-risk drinking. All had experience using the VA healthcare system; consequently, their understanding of barriers to care was grounded in their experiences.
The cultural domain is presented in Fig. 2. Numbers denote the items in the domain dimensions corresponding to the item numbers in Table 2. In MDS, items closer together are more closely related to one another; and in hierarchical cluster analysis, clusters of items are placed together to represent dimensions of the larger cultural domain.
The CDA procedures resulted in five dimensions of barriers to care: worry and concerns about what others think; personal, financial, and physical obstacles; confidence in the VA healthcare system; navigating VA benefits and healthcare services; and, privacy, security, and abuse of services. (These labels represent the most common words and phrases veterans used to label each dimension.) Figure 2 provides a visual representation of domain dimensions and Table 3 provides narrative text to further explicate the meaning of domain items to veterans’ healthcare experiences.
Dimension 1: Worry and concern about what others think
Veterans’ discussion of this dimension grouped around stigma, vulnerability, and trust as barriers to VA mental health services use. Veterans expressed concern over stigmatizing labels such as “crazy” and “mental health patients” as well as military attitudes (e.g., “suck it up”) fostering feelings of weakness and failure. Such attitudes contributed to veterans’ anxiety and alcohol and drug use and impeded mental healthcare services use. Veterans also indicated a lack of trust in the clinical encounter (e.g., interactions with non-military healthcare providers with limited understanding of veterans’ military experiences) decreased their motivation to remain in care.
Dimension 2: Financial, personal, and physical obstacles
Discussions centered on personal life struggles (e.g., poor health, legal and financial issues, and homelessness) constraining on veterans’ daily lives and ability to meet responsibilities—including healthcare services use. Travel distance to VA facilities and lack of transportation or gas money also represented barriers to VA care within this dimension.
Dimension 3: Confidence in the VA healthcare system
Veterans’ discussions of this dimension indicated system-wide problems with VA processes of care and expressed their lack of confidence (e.g., availability of timely visits, follow-up care). Appointment problems, staffing issues, limited follow-up from VA healthcare providers and staff, and prioritization of some veterans over others impeded access to care. Long wait times between appointments, slow clinic response, and challenges to scheduling appointments (e.g., being passed from clinic to clinic) created barriers to timely and appropriate care. Staff issues, especially lack of available providers and high provider turnover, limited veterans’ access to care and provider continuity over time. Veterans also indicated that limited or no access to specialized care resulted in veterans’ disengagement with care. Furthermore, the appearance that services are prioritized to address the needs of younger veterans limits available services for older veterans and diminishes the importance of older veterans’ health and wellbeing.
Dimension 4: Navigating VA benefits and healthcare services
Veterans’ discussions highlighted the challenges of navigating VA benefits and healthcare services, which are connected to lack of understanding or misunderstanding of VA benefits and mental healthcare services. Veterans reported being unaware of VA benefits prior to leaving military service, having limited knowledge of the processes required to obtain benefits (e.g., necessary paperwork) once eligible, and struggling to understand the use of their benefits as veterans. This knowledge gap impeded initial enrollment into the VA healthcare system. Once veterans entered the system, they still struggled with a lack of awareness of available mental healthcare services. Veterans stressed the need for both the military and the VA to disseminate benefit material more effectively to service members prior to military exit.
Dimension 5: Privacy, security, and abuse of services
Veterans’ discussions of this dimension revealed concerns regarding healthcare privacy and misuse of the VA healthcare system by other veterans. Veterans discussed military policy denying security clearances for service members known to seek mental healthcare and this fear influencing veterans’ decisions to seek specialty care within the VA healthcare system. Some also expressed a fear of their confidential information being shared and sensitive information (e.g., actions in combat, mental health diagnoses) disclosed, which could have profound negative consequences on veterans’ lives (e.g., incarceration, loss of security clearance). Both older (Vietnam era) and younger (Iraq and Afghanistan era) veterans’ expressed distrust of the VA healthcare system as a government institution and fear of digital communications (e.g., tele-psychiatry). Last, misuse of VA services by some veterans for disability payments and pain medication, while perceived by veterans as rare, had a negative effect on the VA care experience of other veterans. Specifically, misuse of the system influences how society and some providers view veterans who use VA healthcare for certain treatments (e.g., pain medication and mental health treatment).
This mixed-methods CDA analysis generated veteran-centered perspectives of barriers to VA mental healthcare services use grounded in veterans’ lives and during clinical interactions that add depth, breadth, and complexity to understanding barriers to care. This approach contributes to better understanding of veteran-derived perspectives on barriers to mental healthcare services use. The findings are intended to inform patient-centered care  and conceptual models, such as the SOTA Access Model , and measurement tools .
Our interpretation of veterans’ perceptions of barriers to VA service use demonstrates that historical, socio-cultural, and psychological factors inform veterans’ decisions to engage with VA mental healthcare services. Their perceptions highlight how military socialization, command structure influences, and institutional attitudes (e.g., “suck it up” mentality) reinforce attitudes around help-seeking as weakness, which significantly informs veterans’ post-military service healthcare experiences [7, 53]. The findings suggest veterans and active duty service members experience similar system-level and socio-cultural barriers to use of government mental healthcare services. In their study of barriers to engaging service members in the Department of Defense (DoD) mental healthcare services, Tanielian et al.  found concerns over military healthcare system capacity and processes of care (e.g., limited providers, problems scheduling appointments) and the military ethos of “toughing it out” greatly influenced active duty services members engagement with military mental healthcare services.
In addition, our findings show how institutional betrayal, or as veterans explained, distrust of the VA as a government institution, influences their VA mental healthcare services use. Desai et al.  found negative perceptions of social and governmental institutions created barriers to seeking VA mental healthcare services among Vietnam-era veterans. Similarly, veterans in our study, who represented Vietnam, Persian Gulf, and Iraq and Afghanistan service eras, distrusted providers’ use of computers to document personal and sensitive information, questioned the security of digital communications (e.g., video-conferencing), and feared hacking of electronic medical records.
This study also provides insight into ways veterans perceive misuse or abuse of the VA healthcare system. The VA is well aware of potential abuse of its healthcare services. For instance, the VA Office of Community Care has a webpage with frequently asked questions about fraud, waste, or abuse of VA healthcare services (https://www.va.gov/COMMUNITYCARE/about_us/POI/poi_faq.asp). Veterans’ abuse of VA healthcare was present in our study—in the case of a participant retelling how veterans scheme VA doctors to obtain pain medication only to misuse their prescription. Whereas fraud was present in the case of a participant explaining that some veterans manipulate the system to obtain a PTSD diagnosis. Though veterans described them as rare, these practices can shape veterans’ and providers’ attitudes and impede development of a trusting therapeutic alliance between providers and veterans utilizing VA healthcare services.
Our findings provide an evidence base for DoD and VA health policy. We found that norms and values embedded within the military perpetuate stigmatizing attitudes around mental health treatment seeking and continue to influence veterans’ healthcare utilization decisions post military service, and that veterans need support transitioning from the DoD to VA healthcare system. This finding reinforces the need for ongoing collaborations between the VA and DoD to critically address military institutional norms and attitudes stigmatizing service member’s mental health-seeking behaviors and facilitate care coordination as active-duty service members transition to veterans.
Policy to reduce stigmatizing attitudes about mental health and treatment seeking in the military and healthcare transition processes that link service members to VA care prior to leaving the service would be ideal. The VA/DoD “One Mission- One Policy- One Plan” (a community of practice) facilitating service member and veteran care coordination is a step towards reducing barriers to care for younger veterans . Similar communities of practice, such as VA and community-based organizations serving veterans, for older generations of veterans who are not using VA benefits and healthcare services are needed .
Furthermore, our findings regarding veterans’ confidence in the VA healthcare system points to service members and veterans’ mistrust in government healthcare. Both VA and DoD should work together to address veterans’ mistrust of the VA healthcare system, which reflects both current public relation issues and the historical treatment of veterans of different service eras (e.g., Vietnam veterans vs Iraq and Afghanistan veterans) within the VA healthcare system [57, 58]. Furthermore, as the use of electronic medical records, digital communications (e.g., tele-psychiatry, secure doctor-patient messaging), and smartphone applications evolves through the twenty-first century, veterans’ distrust of the VA healthcare system as a government institution may impede use of technology which is important issue to address for some veterans.
Several limitations should be considered when interpreting the findings. Our findings reflect insight from veterans enrolled in VA healthcare services and may not reflect the experiences of veterans who have not used VA benefits and services. While we had much success recruiting participants from both rural and urban settings across the three sites (Arkansas, California, and Maine), we enrolled a relatively small number of racial/ethnic diverse and women veterans into the study. The general trend of racial/ethnic diversity in our sample, including representation of Asian identity in North California, Black and White identity in Arkansas, and White identity in Maine and Northern California, corresponds with the demographic characteristics of the veteran population in these geographic regions [59,60,61]. Additionally, we purposively sampled across VISNs and combined data across sites; therefore, our sample size is not sufficient to conduct meaningful cross-site comparisons limiting our understanding of potential geographic and racial/ethnic variation.
We oversampled women veterans and enrolled a fair number of women (n = 16) into the study. However, our analysis could have been qualitatively more nuanced and rich if more women had participated in the study and shared their experiences and perspectives. Historically, servicewomen and women veterans have been underrepresented in research examining VA or DoD healthcare use [62, 63]. Women veterans are the fasted growing segment of VA healthcare users ; yet, they represent a small population of VA patients and are often underrepresented and potentially excluded from analysis . Use of a context-specific or gender-sensitive sampling approach may have increased women’s participation in our study . Women veterans differ from men in healthcare utilization, how their VA care is organized (e.g., concentrated care in women only clinics), and gender-specific demands (e.g., primary caregivers), thus a one-size fits all approach to recruitment may limit women’s research participation. Future research should engage women’s health program leaders such as medical directors and program managers to identify recruitment strategies that are context-specific and therefore identify how and where women access healthcare and characterize their healthcare utilization patterns, as well as are sensitive to the unique demographics and healthcare experiences of women veterans. Such an approach would likely result in a gender-specific rather than gender-neutral recruitment approach and potentially two or more distinct recruitment strategies.
Finally, some veterans struggled to understand the purpose of the interpretation task and found it challenging to provide explanations for the clustering of items within the five dimensions of the shared cultural domain. After adjusting the instructions to include a brief hypothetical example, veterans more readily understood the task and offered important insight into how barriers within dimensions played out in their or other veterans’ healthcare experiences. Therefore, concrete instructions and an initial example are needed to successfully employ these methods.
Our study findings reinforce the value of eliciting veteran’s perspectives on barriers to VA healthcare service use. By using participatory methods to elicit participants’ perspectives, we obtained veteran-centric barriers to care that are embedded in VA healthcare experiences and offer insight on how to decrease barriers to VA mental healthcare services use. The CDA approach outlined in this paper places patients at the forefront of data generation, analysis, and interpretation, which results in a shared understanding of barriers to care grounded in veterans’ experiences. Empirical, patient-centered data are critical to informing healthcare policy as well as developing valid measurement tools to accurately measure veterans’ experiences of barriers to care; these data can inform instrument domains and provide vocabulary, idiomatic expressions, and scenarios shared among patient populations .
Community-Based Outpatient Clinic
Cultural Domain Analysis
Department of Defense
Post-traumatic Stress Disorder
State of the Art
Veterans Integrated Service Network
McCarthy JF, Blow FC, Valenstein M, Fischer EP, Owen RR, Barry KL, Hudson TJ, Ignacio RV. Veterans affairs health system and mental health treatment retention among patients with serious mental illness: evaluating accessibility and availability barriers. Health Serv Res. 2007;42:1042–60.
Panangala SV. Veterans medical care: FY 2016 appropriations. In: Congressional Research Service, vol. 39; 2015.
Garcia HA, Finley EP, Ketchum N, Jakupcak M, Dassori A, Reyes SC. A survey of perceived barriers and attitudes toward mental health care among OEF/OIF veterans at VA outpatient mental health clinics. Mil Med. 2014;179(3):273–8.
Wierwille JL, Pukay-Martin ND, Chard KM, Klump MC. Effectiveness of PTSD telehealth treatment in a VA clinical sample. Psychol Serv. 2016;13(4):373–9.
Desai MU, Pavlo AJ, Davidson L, Harpaz-Rotem I, Rosenheck R. "I want to come home": Vietnam-era veterans' presenting for mental health care, roughly 40 years after Vietnam. Psychiatr Q. 2016;87(2):229–39.
Sayer NA, Friedemann-Sanchez G, Spoont M, Murdoch M, Parker LE, Chiros C, Rosenheck R. A qualitative study of determinants of PTSD treatment initiation in veterans. Psychiatry. 2009;72(3):238–55.
Abraham T, Cheney AM, Curran GM. A Bourdieusian analysis of U.S. military culture ground in the mental help-seeking literature. Am J Mens Health. 2015;11(5):1358–65. https://doi.org/10.1177/1557988315596037.
Hoge CW, Castro CA, Messer SC, McGurk D, Cotting DI, Koffman RL. Combat duty in Iraq and Afghanistan, mental health problems and barriers to care. US Army Med Dep J. 2008;351(1):7–17.
Fischer EP, McSweeney JC, Wright P, Cheney A, Curran GM, Henderson K, Fortney JC. Overcoming barriers to sustained engagement in mental health care: perspectives of rural veterans and providers. J Rural Health. 2016;32(4):429–38. https://doi.org/10.1111/jrh.12203.
Tai-Seale M, Sullivan G, Cheney A, Thomas K, Frosch D. The language of engagement: "Aha!" moments from engaging patients and community partners in two pilot projects of the Patient-Centered Outcomes Research Institute. Perm J. 2016;20(2):89–92.
Gerteis M. Picker/commonwealth program for patient-centered care. Through the patient's eyes : understanding and promoting patient-centered care, 1st edn. San Francisco: Jossey-Bass; 1993.
Bardes CL. Defining "patient-centered medicine". N Engl J Med. 2012;366(9):782–3.
Smith RT, True G. Warring identities: identity conflict and the mental distress of American veterans of the wars in Iraq and Afghanistan. Soc Ment Health. 2014;4(2):147–61.
Putsch RW III, Joyce M. Dealing with patients from other cultures. In: Walker HK, Hall WD, Hurst JW, editors. Clinical Methods: The History, Physical, and Laboratory Examinations. Boston: Butterworths; 2011.
Tave TT, Wyers DR, Schreiber-Jones C, Fogger SA, McGuinness TM. Improving quality outcomes in veteran-centric care. J Psychosoc Nurs Ment Health Serv. 2017;55(1):37–44.
York J, Sternke LM, Myrick DH, Lauerer J, Hair C. Development of veteran-centric competency domains for psychiatric-mental health nurse practitioner residents. J Psychosoc Nurs Ment Health Serv. 2016;54(11):31–6.
Sestito SF, Rodriguez KL, Saba SK, Conley JW, Mitchell MA, Gordon AJ. Homeless Veterans' experiences with substance use, recovery, and treatment through photo elicitation. Subst Abus. 2017;38(4):422–31. https://doi.org/10.1080/08897077.2017.1356422.
Bauer MS, Williford WO, McBride L, McBride K, Shea NM. Perceived barriers to health care access in a treated population. Int J Psychiatry Med. 2005;35(1):13–26.
Kilbourne AM, McCarthy JF, Post EP, Welsh D, Pincus HA, Bauer MS, Blow FC. Access to and satisfaction with care comparing patients with and without serious mental illness. Int J Psychiatry Med. 2006;36(4):383–99.
Hoge CW, Castro CA, Messer SC, McGurk D, Cotting DI, Koffman RL. Combat duty in Iraq and Afghanistan, mental health problems, and barriers to care. N Engl J Med. 2004;351(1):13–22.
Kim PY, Britt TW, Klocko RP, Riviere LA, Adler AB. Stigma, negative attitudes about treatment, and utilization of mental health care among soldiers. Mil Psychol. 2011;23(1):65–81.
Schensul JJ, LeCompte MD. Specialized ethnographic methods : a mixed methods approach. Lanham: AltaMira Press; 2013.
Dressler WW, Oths KS. Social survey methods. In: Bernard HR, Gravlee CC, editors. Handbook of Methods in Cultural Anthropology. 2nd ed. Lanham: AltaMira Press; 2014. p. 497–515.
Bernard HR. Research methods in anthropology : qualitative and quantitative approaches. Lanham: AltaMira Press; 2011.
Borgatti S. Elicitation techniques for cultural domain analysis. In: Schensul JJ, LeCompte MD, Alfred Hess Jr G, Nastasi BK, Berg MJ, Williamson L, editors. The Ethnographer's Toolkit. Walnut Creek: AltaMira Press; 1998.
Borgatti S. Cultural domain analysis. J Quant Anthropol. 1994;4:261–78.
Kroenke K, Spitzer RL. The PHQ-9: a new depression diagnostic and severity measure. Psychiatr Ann. 2002;32(9):509–15.
Kroenke K, Spitzer RL, Williams JB. The PHQ-9: validity of a brief depression severity measure. J Gen Intern Med. 2001;16(9):606–13.
Spitzer RL, Kroenke K, Williams JB. Validation and utility of a self-report version of PRIME-MD: the PHQ primary care study. Primary care evaluation of mental disorders. Patient health questionnaire. JAMA. 1999;282(18):1737–44.
Keen SM, Kutter CJ, Niles BL, Krinsley KE. Psychometric properties of PTSD checklist in sample of male veterans. J Rehabil Res Dev. 2008;45(3):465–74.
Bradley KA, DeBenedetti AF, Volk RJ, Williams EC, Frank D, Kivlahan DR. AUDIT-C as a brief screen for alcohol misuse in primary care. Alcohol Clin Exp Res. 2007;31(7):1208–17.
Patton MQ. Qualitative research and evaluation methods. 2nd ed. Thousand Oaks: Sage Publications; 2001.
Treweek S, Shaun T, Elizabeth M, Marie P, Jonathan C, Monica K, Taina T, Marit J, Frank S, Sue W, et al. Strategies to improve recruitment to randomised controlled trials. In: Protocols; 2010.
Junghans C, Feder G, Hemingway H, Timmis A, Jones M. Recruiting patients to medical research: double blind randomised trial of "opt-in" versus "opt-out" strategies. BMJ. 2005;331(7522):940.
Hunt KJ, Shlomo N, Addington-Hall J. Participant recruitment in sensitive surveys: a comparative trial of 'opt in' versus 'opt out' approaches. BMC Med Res Methodol. 2013;13:3.
Palinkas LA, Horwitz SM, Green CA, Wisdom JP, Duan N, Hoagwood K. Purposeful sampling for qualitative data collection and analysis in mixed method implementation research. Admin Pol Ment Health. 2015;42(5):533–44.
Romney AK, Weller SC, Batchelder WH. Culture as consensus: a theory of culture and informant accuracy. Am Anthropol. 1986;88(2):313–38.
Weller SC. Shared knowledge, intracultural variation, and knowledge aggregation. Am Behav Sci. 1987;31(2):178–93.
Weller SC, Romney AK. Systematic data collection. Thousand Oaks: Sage; 1988.
Burke JG, O'Campo P, Peak GL, Gielen AC, McDonnell KA, Trochim WMK. An introduction to concept mapping as a participatory public health research method. Qual Health Res. 2005;15(10):1392–410.
Brewer DD. Supplementary interviewing techniques to maximize output in free listing tasks. Field Methods. 2002;14(1):108–18.
Dressler W, Borges C, Balieiro M, dos Santos J. Measuring cultural consonance: examples with special reference to measurement theory in anthropology. Field Methods. 2005;17(4):331–55.
Analytic Technologies: Anthropac. http://www.analytictech.com/anthropac/anthropac.htm. Accessed 19 July 2018.
Davison ML. Multidimensional scaling. Santa Monica: Krieger Publishing Company; 1983.
Kruskal JB. Multidimensional-scaling by optimizing goodness of fit to a nonmetric hypothesis. Psychometrika. 1964;29(1):1–27.
Rosas SR, Kane M. Quality and rigor of the concept mapping methodology: a pooled study analysis. Eval Program Plann. 2012;35(2):236–45.
Hout MC, Papesh MH, Goldinger SD. Multidimensional scaling. Wiley Interdiscip Rev Cogn Sci. 2013;4(1):93–103.
Verbi Software-Consult: MAXQDA software for qualitative data analysis, 1989–2016. In.; 2016.
Ryan G, Bernard H. Techniques to identify themes. Field Methods. 2003;15(1):85–109.
Corbin JM, Strauss AL. Basics of qualitative research: techniques and procedures for developing grounded theory. Santa Monica: Sage Publications, Inc.; 2008.
Kleinpell R, Buchman TG. The value and future of patient-centered outcomes research. In: Critical Connections vol 2014; 2014.
Fortney JC, Burgess JF Jr, Bosworth HB, Booth BM, Kaboli PJ. A re-conceptualization of access for 21st century healthcare. J Gen Intern Med. 2011;26(Suppl 2):639–47.
Koenig CJ, Maguen S, Monroy JD, Mayott L, Seal KH. Facilitating culture-centered communication between health care providers and veterans transitioning from military deployment to civilian life. Patient Educ Couns. 2014;95(3):414–20.
Tanielian T, Woldetsadik MA, Jaycox LH, Batka C, Moen S, Farmer C, Engel CC. Barriers to engaging service members in mental health care within the U.S. military health system. Psychiatr Serv. 2016;67(7):718–27.
Interagency Care Coordination Commitee (IC3). http://www.moaa.org/uploadedFiles/Content/Take_Action/Warrior_Family_Roundtable/IC3_One_Pager.pdf. Accessed 19 July 2018.
Tanielian T, Hansen ML, Martin LT, Grimm G, Ogletree C. Supporting the mental health needs of veterans in the metro Detroit area. Santa Monica: RAND Corporation; 2016.
Isaacs AR. Vietnam shadows : the war, its ghosts, and its legacy. Baltimore: Johns Hopkins University Press; 1997.
Finley EP. Fields of combat : understanding PTSD among veterans of Iraq and Afghanistan. Ithaca: ILR Press; 2011.
VETPOP2016: Living Veterans by State, Race/Ethnicity, Gender, 2015-2045. https://www.va.gov/vetdata/veteran_population.asp. Accessed 19 July 2018.
QuickFacts: Mendocino County, California; Humboldt County, California. https://www.census.gov/quickfacts/fact/table/mendocinocountycalifornia,humboldtcountycalifornia/RHI125216#viewtop. Accessed 19 July 2018.
California Veterans, By The Numbers. http://www.trbas.com/media/media/acrobat/2008-11/43592321.pdf. Accessed 19 July 2018.
Bean-Mayberry B, Goldzweig C, Washington DL, Yano E, Batuman F, Huang C, Miake-Lye I, Shekelle P. Updated systematic review of the literature on women Veteran's health. J Gen Intern Med. 2011;26:S296–7.
Goldzweig CL, Balekian TM, Rolon C, Yano EM, Shekelle PG. The state of women veterans' health research. J Gen Intern Med. 2006;21:S82–92.
Yano EM, Bastian LA, Frayne SM, Howell AL, Lipson LR, McGlynn G, Schnurr PP, Seaver MR, Spungen AM, Fihn SD. Toward a VA Women's Health Research agenda: setting evidence-based priorities to improve the health and health care of women veterans. J Gen Intern Med. 2006;21(Suppl 3):S93–101.
Yano EM, Hayes P, Wright S, Schnurr PP, Lipson L, Bean-Mayberry B, Washington DL. Integration of women veterans into VA quality improvement research efforts: what researchers need to know. J Gen Intern Med. 2010;25(Suppl 1):56–61.
Penn Handwerker W. Quick ethnography. Santa Monica: Rowman Altamira; 2001.
We would like to thank Jo Gerrard at the University of California, Riverside School of Medicine for her editorial support.
This project was supported by VA HSR&D grant (CRE 12–300) to Jeffrey Pyne. At the time of the study, Ann Cheney was a Scholar with the HIV/AIDS, Substance Abuse, and Trauma Training Program (HA-STTP), at the University of California, Los Angeles; supported through an award from the National Institute on Drug Abuse (R25 DA035692). This material is based upon work supported by the Department of Veterans Affairs, Veterans Health Administration, Office of Research and Development, Health Services Research and Development Service. The contents of this presentation do not represent the views of the Department of Veterans Affairs or the United States Government.
Availability of data and materials
The datasets used and/or analyzed during the current study are available from the corresponding author on reasonable request.
Ethics approval and consent to participate
All research was approved prior to the start of research by the Veteran Healthcare Administration Central Institutional Review Board, Washington, D.C., United States. The IRB approval reference number is 13–29. All participants provided written informed consent and were remunerated for their study participation.
Consent for publication
The authors declare that they have no competing interests.
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Free list activity interview guide. This interview guide elicits free list items within a cultural domain. The task takes about 10 min to complete. The guide includes a prompt that asks participants to list all the things they think of when they hear the prompt. The goal is to elicit words and brief phrases related to the prompt question, which then began items for further analysis. (DOCX 14 kb)