Acessibilidade / Reportar erro

Adolescent Friendly Services: quality assessment with simulated users

ABSTRACT

OBJECTIVE

To assess the quality of adolescent friendly health services.

METHODS

Qualitative assessment using the simulated user technique in first level clinics of Health Services of Morelos, Mexico, during 2018. Ten out of 17 facilities with non-exclusive adolescent friendly services were randomly selected. An additional facility with exclusive adolescent friendly services was included as an intensive subsample. Four adolescents served as simulated users interpreting different cases in the clinics. The total of 43 semi-structured exit interviews were conducted, and two nominal groups were made to assess the perceived quality from the adolescents’ perception of friendliness and experience. Thematic analysis of the data obtained was performed.

RESULTS

Staff attitude was highlighted as a key element in the adolescents’ experience. Failures were found, such as the existence of bureaucratic barriers to access, lack of signage in clinics, lack of privacy and confidentiality, failure of physical examination during the appointment and lack of monitoring of the reasons for appointment. The exclusive clinic for adolescents offered more appropriate friendly services compared with nonexclusive clinics.

CONCLUSION

Although the service is accessible in most of the clinics visited, it is still far from being friendly according to international recommendations. The exclusive clinic for adolescents stood out for having better structured mechanisms that can be implemented in nonexclusive clinics to improve the care process.

Qualitative research; sexual and reproductive health; Adolescent health; Patient Simulation

RESUMEN

OBJETIVO

Evaluar la calidad de los servicios de salud amigables para adolescentes.

MÉTODOS

Evaluación cualitativa utilizando la técnica de usuario simulado en clínicas de primer nivel de los Servicios de Salud de Morelos, México durante 2018. Se seleccionaron aleatoriamente 10 de 17 establecimientos con servicios amigables no exclusivos para adolescentes. Se incluyó adicionalmente un centro con servicios amigables exclusivo para adolescentes como submuestra de tipo intensivo. Cuatro adolescentes fungieron como usuarios simulados interpretando diferentes casos de consulta en las clínicas. Se realizaron 43 entrevistas semiestructuradas de salida y se hicieron dos grupos nominales para evaluar la calidad percibida a partir de la percepción de amigabilidad y la experiencia de los adolescentes. Se realizó análisis temático de los datos obtenidos.

RESULTADOS

La actitud del personal destacó como un elemento clave para la experiencia de los adolescentes. Se encontraron fallas como la existencia de barreras burocráticas para el acceso, falta de señalamientos en las clínicas, falta de privacidad y confidencialidad, fallas en la exploración física durante la consulta y falta de seguimiento de los motivos de consulta. La clínica exclusiva para adolescentes ofreció servicios amigables más adecuados en comparación con las clínicas no exclusivas.

CONCLUSIÓN

Aunque en la mayoría de los establecimientos visitados el servicio es accesible, aun distan de cumplir con las características de amigabilidad de acuerdo con las recomendaciones internacionales. La clínica exclusiva para adolescentes destacó al contar con mecanismos mejor estructurados que pueden ser implementados en clínicas no exclusivas para mejorar el proceso de atención.

Investigación cualitativa; salud sexual y reproductiva; Salud de los adolescentes; Paciente simulado

INTRODUCTION

Globally, adolescents face problems such as pregnancy, early sexual activity, lack of knowledge and use of contraceptive methods, as well as an increased incidence of sexually transmitted infections (STI) that affect their well-being 11. Greifinger R , Ramsey M . Cómo hacer para que sus servicios de salud sean amigables para los jóvenes: una guía para los planificadores e implementadores del programa . Washington, DC : Population Services Internacional ; 2014 . . In Mexico, where 18.4% of the population is made up of adolescents 22. Instituto Nacional de Estadística y Geografía , Dirección General de Estadísticas Sociodemográficas , Dirección General Adjunta del Censo de Población y Vivienda . Encuesta Intercensal 2015 . Aguascalientes (MEX) : INEGI ; 2015 . , it is essential to address the sexual and reproductive health (SRH) needs of this population group.

Prevention of teenage pregnancy is central, because during this stage the likelihood of dying from obstetric events increases 33. Vallejo Barón J . Embarazo en adolescentes: complicaciones . Rev Med Costa Rica Cent Am . 2013 ; 70 ( 605 ): 65 - 9 . . Adolescent pregnancy is associated with school dropout, few job opportunities, early marriage, predisposition to poverty and can place young people in situations of insecurity and abuse. These conditions limit their personal, occupational and social development 44. Grupo Interinstitucional para la Prevención del Embarazo en Adolescentes . Estrategia Nacional para la Prevención del Embarazo en Adolescentes . México, DF : GIPEA ; 2015 . . Although the problem of adolescent reproductive health affects both women and men in this age group, the consequences of adolescent pregnancy and the experience of the phenomenon itself are differentiated according to genre. Maternity has a disproportionate and very negative impact on adolescent women, which is directly related to gender inequalities and socio-cultural factors 55. Sadler Spencer M , Obach King A , Luengo Charat MX , Biggs MA . Estudio barreras de acceso a los servicios de salud para la prevención del embarazo adolescente en Chile . Santiago (CIL) : Ministerio de Salud ; 2010 . .

In Mexico, although 98.2% of adolescents between the ages of 15 and 19 reported knowing some contraceptive methods, 69.2% of women who began sexual life before the age of 20 did not use any contraceptive method in their first intercourse 66. Instituto Nacional de Estadística y Geografía . La anticoncepción: Implicaciones en el embarazo adolescente, fecundidad y salud reproductiva en México. Encuesta Nacional de la Dinámica Demográfica 2014 – ENADID . Águascalientes (MEX) : INEGI ; c2017 . . The adolescent fertility rate in 2016 was 61 births per 1,000 adolescents from 15 to 19 years old, ranking first among countries of the Organization for Economic Cooperation and Development (OECD) 77. Banco Mundial ; División de Población de las Naciones Unidas . Perspectivas de la Población Mundial: tasa de fertilidad en adolescentes 2018 . Washington, DC ; c2019 . . In addition, the incidence rate of STI among adolescents increased between 2006 and 2012: Human Papilloma Virus (HPV) (from 5.01 to 7.97); HIV (from 0.76 to 1.63) and herpes (from 0.56 to 1.03) 88. Secretaria de Salud (MEX) , Centro Nacional de Equidad de Género y Salud Reproductiva . Modelo de Atención Integral en Salud Sexual y Reproductiva para Adolescentes . México, DF : CNEGSR ; 2015 . .

Adolescents have been considered a healthy subset of the population. However, the increase in sexual and reproductive problems in this population has shown the need to provide adolescents with effective, appropriate and quality health services to assert their sexual and reproductive rights 99. Organización Mundial de la Salud . Competencias básicas en materia de salud y desarrollo de los adolescentes para los proveedores de atención primaria . Ginebra : OMS ; 2015 . , 1010. Organización Panamericana de la Salud . Estrategia y plan de acción regional sobre los adolescentes y jóvenes 2010-2018 . Washington, DC : OPS ; 2010 . . The World Health Organization (WHO) proposes the adolescent friendly health service (AFHS) model, which provides a space where adolescents feel safe and confident to come for advice and care, primarily in the area of sexual and reproductive health (SRH) 1111. Moreno López DJ . Estándares de calidad: servicios de salud sexual y reproductiva para adolescentes en Latinoamérica y el Caribe: diagnóstico de situación de la implementación . Bogotá (COL) : UNFPA ; 2014 . . This space should have empathetic staff trained in SRH and adolescent development issues 11. Greifinger R , Ramsey M . Cómo hacer para que sus servicios de salud sean amigables para los jóvenes: una guía para los planificadores e implementadores del programa . Washington, DC : Population Services Internacional ; 2014 . , 99. Organización Mundial de la Salud . Competencias básicas en materia de salud y desarrollo de los adolescentes para los proveedores de atención primaria . Ginebra : OMS ; 2015 . , 1212. Ministério de la Protección Social (COL) ; Fondo de Población de las Naciones Unidas . Servicios de salud amigables para adolescentes y jóvenes: un modelo para adecuar las respuestas de los servicios de salud a las necesidades de los adolescentes y jóvenes de Colombia . Bogotá (COL) : UNFPA , 2008 . . Following these recommendations and given the importance of adolescent health, the AFHS model was adopted in Mexico in 2000. In 2017, there were 1,494 units with AFHS in the Ministry of Health (MH) nationwide, while in the state of Morelos there were 17 1313. Secretaria de Salud (MEX) , Centro Nacional de Equidad de Género y Salud Reproductiva . Servicios amigables para adolescentes: salud sexual y reproductiva para adolescentes . México, DF : CNEGSR ; 2018 . . Despite the implementation of AFHS, the health indicators for this population group lead us to consider their effectiveness, since they do not meet the needs of the target population 66. Instituto Nacional de Estadística y Geografía . La anticoncepción: Implicaciones en el embarazo adolescente, fecundidad y salud reproductiva en México. Encuesta Nacional de la Dinámica Demográfica 2014 – ENADID . Águascalientes (MEX) : INEGI ; c2017 .

7. Banco Mundial ; División de Población de las Naciones Unidas . Perspectivas de la Población Mundial: tasa de fertilidad en adolescentes 2018 . Washington, DC ; c2019 .
- 88. Secretaria de Salud (MEX) , Centro Nacional de Equidad de Género y Salud Reproductiva . Modelo de Atención Integral en Salud Sexual y Reproductiva para Adolescentes . México, DF : CNEGSR ; 2015 . . Programs that promote access and acceptance of SRH services for adolescents are more effective when the friendly approach is combined with their needs and expectations 1414. Denno DM , Hoopes AJ , Chandra-Mouli V . Effective strategies to provide adolescent sexual and reproductive health services and to increase demand and community support . J Adolesc Health . 2015 ; 56 ( 1 Suppl ): S22 - 41 . https://doi.org/10.1016/j.jadohealth.2014.09.012 .
https://doi.org/10.1016/j.jadohealth.201...
. Strategies are needed to bridge the gap between the adolescent population and the health system, especially by making the male adolescent visible. Health programs are mainly focused on women in relation to reproductive issues 1515. Obach A , Sadler M , Aguayo F , Bernales M . Salud sexual y reproductiva de hombres jóvenes en Chile: resultados de un estudio cualitativo . Rev Panam Salud Publica . 2018 ; 42 : e124 . https://doi.org/10.26633/RPSP.2018.124
https://doi.org/10.26633/RPSP.2018.124...
.

To assess the implementation of AFHS is relevant and necessary for measuring quality and establishing the impact on adolescent health 88. Secretaria de Salud (MEX) , Centro Nacional de Equidad de Género y Salud Reproductiva . Modelo de Atención Integral en Salud Sexual y Reproductiva para Adolescentes . México, DF : CNEGSR ; 2015 . . Few studies assess these services 1616. Mchome Z , Richards E , Nnko S , Dusabe J , Mapella E , Obasi A . A ‘mystery client’ evaluation of adolescent sexual and reproductive health services in health facilities from two regions in Tanzania . PLoS One . 2015 ; 10 ( 3 ): e0120822 . https://doi.org/10.1371/journal.pone.0120822
https://doi.org/10.1371/journal.pone.012...

17. Sykes S , O’Sullivan K . A ‘mystery shopper’ project to evaluate sexual health and contraceptive services for young people in Croydon . J Fam Plann Reprod Health Care . 2006 ; 32 ( 1 ): 25 - 6 . https://doi.org/10.1783/147118906775275334
https://doi.org/10.1783/1471189067752753...

18. Geary RS , Webb EL , Clarke L , Norris SA . Evaluating youth-friendly health services: young people’s perspectives from a simulated client study in urban South Africa . Glob Health Action . 2015 ; 8 . https://doi.org/10.3402/gha.v8.26080
https://doi.org/10.3402/gha.v8.26080...
- 1919. De Castro F , Barrientos-Gutierrez T , Braverman-Bronstein A , Santelli J , Place JM , Eternod-Arámburu M , et al . Adolescent access to information on contraceptives: a mystery client study in Mexico . J Adolesc Health . 2018 ; 62 ( 3 ): 265 - 72 . https://doi.org/10.1016/j.jadohealth.2017.08.001
https://doi.org/10.1016/j.jadohealth.201...
, as most are quantitative and were conducted from the perspective of providers. Therefore, a qualitative assessment, from the adolescents’ perspective, would allow us to understand their experience and identify barriers in the access, use and supply of services. However, adolescents are not always informed about the quality standards in AFHS.

There are various approaches to measure the quality of health services. The Figure shows the approaches outlined in the literature, as well as the dimensions used to measure the quality of the AFHS used in this study. This assessment proposes the use of simulated user methodology to assess the quality of AFHS by trained adolescents, making simulated visits, while health care providers are unable to change their behavior when they know they are being observed 2020. Ulin PR , Robinson ET , Tolley EE . Investigación aplicada en salud pública: métodos cualitativos . Washington, DC : Organización Panamericana de la Salud ; 2006 . ( Publicación Científica y Técnica, 614 ). . The objective of the study was to assess the quality of AFHS based on the dimensions of accessibility, opportunity, acceptability/adaptability, safety and continuity.

Figure
Dimensions to assess the quality of care of Friendly Services from different perspectives, Mexico 2018.

1. Saturno Hernández PJ. Métodos y herramientas para la realización de ciclos de mejora de la calidad de los servicios de salud. Cuernavaca, Morelos: Instituto Nacional de Salud Pública, 2015.

2. Fondo de Población de las Naciones Unidas. Servicios de salud amigables para adolescentes y jóvenes.: Un modelo para adecuar las respuestas de los servicios de salud a las necesidades de adolescentes y jóvenes de Colombia. Segunda. Bogotá: UNFPA, 2008.

3. Landini F, González-Cowes V, D’Amore E. Hacia un marco conceptual para repensar la accesibilidad cultural. Cadernos de saude publica 2014; 30(2):231–44.

4. Delgado-Bernal M, Márquez-Villarreal H, Santacruz-Varela J. La calidad de la atención a la salud en México a través de sus instituciones: 12 años de experiencia. La seguridad del paciente: eje toral de la calidad de la atención. Primera. México, D.F.: Secretaria de salud; 2012.

5. Organización Mundial de la Salud. Salud y derechos humanos. 2017. Available from: http://www.who.int/es/news-room/fact-sheets/detail/human-rights-and-health.

AFHS: Adolescent Friendly Health Services


METHODS

Qualitative assessment using simulated user methodology. The study scope was health centers located in Morelos, Mexico, that offered the AFHS model. Ten of the 17 MH clinics with AFHS in 2017 were randomly selected. The selection of nonexclusive centers for adolescents was adjusted by unit size, geographic location and volume of services in the last year. The Center for Comprehensive Adolescent Health Care (CAISA – Centro de Atención Integral a la Salud del Adolescente ), a clinic dedicated to serving the adolescent population exclusively and considered standard in AFHS, was included as an intensive type subsample 2121. Teddlie C , Yu F . Mixed methods sampling: a typology with examples . J Mix Methods Res . 2017 ; 1 ( 1 ): 77 - 100 . https://doi.org/10.1177/1558689806292430
https://doi.org/10.1177/1558689806292430...
. A total sample of 11 clinics was obtained.

The technique of the simulated user is a form of participant and hidden observation that allows information to be obtained from the user experience and is an approach to the perceived satisfaction of the service 2020. Ulin PR , Robinson ET , Tolley EE . Investigación aplicada en salud pública: métodos cualitativos . Washington, DC : Organización Panamericana de la Salud ; 2006 . ( Publicación Científica y Técnica, 614 ). . It enable us to identify factors that make users decide to return to a health facility or not, due to the perceived quality of the service received 2020. Ulin PR , Robinson ET , Tolley EE . Investigación aplicada en salud pública: métodos cualitativos . Washington, DC : Organización Panamericana de la Salud ; 2006 . ( Publicación Científica y Técnica, 614 ). . This study assessed perceived quality in five dimensions of service friendliness: accessibility, opportunity, safety, acceptability/adaptability, and continuity ( Figure ).

Four profiles were created, one for each simulated user, which would be systematically interpreted during clinic visits. The profiles defined each adolescent’s history and the purpose of the appointment. Half of the profiles corresponded to females and half to males, and they were uniformly distributed between minors and adults (Supplementary material). To achieve theoretical data saturation 2222. Guest G , Bunce A , Johnson L . How many interviews are enough? An experiment with data saturation and variability . Field Methods . 2016 ; 18 ( 1 ): 59 - 82 . https://doi.org/10.1177/1525822X05279903
https://doi.org/10.1177/1525822X05279903...
, each simulated user visited the 11 clinics in the sample, completing 44 visits in total. However, one user was denied care at one of the clinics.

Four adolescents aged 18 were selected and trained. They were chosen in late adolescence because they should have reached the legal age in order to obtain a paid job in the research project. The following criteria were considered for selection: ease of speech, good memory, ability to improvise and adapt to unexpected situations, that none of them had children, nor had used the AFHS before, seeking to create a homogeneous group and minimizing bias due to previous experience in the AFHS.

The training lasted 16 hours, addressing technical and ethical aspects of the study, additionally offering information about SRH in order to provide the four simulated users with homogeneous knowledge to assess the quality of the information offered in the clinics.

The semi-structured exit interview (SSI) was used to collect the data. The interview guide explored the dimensions of friendliness and contained specific case questions at the end. Interviews were conducted after each clinic visit and were carried out via telephone. They lasted approximately 30 minutes, were audiotaped and conducted by a member of the research team.

Two nominal groups 2323. Olaz-Capitán AJ . La técnica de grupo nominal como herramienta de innovación docente . RASE Rev Sociol Educ . 2013 ; 6 ( 1 ): 114 - 21 . were formed with the simulated users as a mechanism for rigor and data quality, as well as to involve adolescents in the data analysis process. The groups were moderated, and audios were recorded by members of the research team.

The information collected via SSI and the nominal groups was transcribed verbatim (that is word for word). Thematic analysis was done 2424. Fereday J , Muir-Cochrane E . Demonstrating rigor using thematic analysis: a hybrid approach of inductive and deductive coding and theme development . Int J Qual Methods . 2006 ; 5 ( 1 ): 80 - 92 . https://doi.org/10.1177/160940690600500107
https://doi.org/10.1177/1609406906005001...
. We looked for themes, within the categories of analysis that allowed us to understand the phenomenon studied and that contained detailed and articulated explanations to the research questions.

The research protocol was approved by the ethics and research committee of the National Institute of Public Health, Mexico. Informed consent form was obtained from health authorities and health care providers. The study was totally anonymous, the names assigned were fictitious to protect confidentiality.

Psychological support was provided to adolescents to minimize the potential for emotional bias resulting from the development of their role and to minimize any unintended consequences of their participation.

RESULTS

The total of 43 exit SSI were collected, the results found are presented in the five dimensions analyzed, the central findings with theoretical saturation and the exceptional or deviant ones are pointed out. Table 1 shows the testimonies that illustrate the results and those identified with codes that indicate the characteristics of origin and context of the testimony.

Table 1
Testimonies by dimension and type of finding, Mexico 2018.

Accessibility

In general, easy access was reported due to the geographical location and wide availability of public transport with access to the units. Clinics with adequate internal signage made it easy to locate the service. This was perceived as pleasant since they did not have to ask the staff about the service, while safeguarding the confidentiality of the visit. In most facilities, free care was provided only for the AFHS (Testimonies A1 and A2, Table 1 ).

When units are inadequate or do not have signposting, they have to ask for service information. But instructions were sometimes unclear, resulting in appointment delays. In a minority of cases, there were administrative barriers to receiving care: appointments were conditioned on affiliation to health insurance and fees were charged per appointment or contraceptive method (Testimonies A3 and A4).

Opportunity

The waiting time was less than 30 minutes in most units. Despite this, a clinic was found where they waited approximately four hours for care. One participant pointed out that she only waited because she was playing the role of a simulated user, making it clear that she would have left otherwise (Testimonies O1, O2 and O4).

Most units did not have a mechanism for appointments or rescheduling, leaving open the possibility of treatment when they require the service, but not guaranteeing assistance when they return (Testimony O5).

The staff tried to find a way to provide care or information that would solve the adolescent’s problem. Inadequate practices in detecting risky sexual behavior were recorded. Simulated users found that questioning was incomplete and observed that some providers were not comfortable interrogating adolescents about their sexual behavior (Testimony O3).

Although a minority, there were clinics where care was not provided for reasons such as: unavailability of AFHS, service saturation, lack of professionals, inadequate hours, or it was simply alleged that care could not be provided, suggesting patients to return another day (Testimony O5).

The exclusive center for adolescents had extended opening hours (morning and afternoon). In addition, they had mechanisms for scheduling and controlling appointments, different from the nonexclusive centers, where the service was offered only in the morning, with no appointment control.

Acceptability/adaptability

All the services had clinics that provided care to adolescents (Testimony B2). Most of the simulated users were treated in a clinic, but they were not always exclusive to AFHS, or provided a privacy environment (Testimony B1).

The attitude of the staff was considered central to the care process. A good attitude was defined as friendly, respectful, trustworthy, smiling, listening without interruption and showing interest. These elements generated trust and confidence in the adolescents, who stated they would recommend the service. A bad attitude was defined as unfriendly, rude, uncouth gestures, uncomfortable looks or judgments about the users’ sexual practices, making they feel reprehended, misunderstood and therefore not willing to return.

The confidentiality policy was presented to teenagers in an exceptional way (Testimony B3). However, the adolescents expressed the belief that when staff showed a good attitude, their information would be protected, or threatened when staff showed a bad attitude. Both privacy and confidentiality were violated by waiting room care, simultaneous care of patients in the same office, interruptions during appointment, and leaving the door open during care (Testimony B1).

At the exclusive center, the confidentiality policy was regularly mentioned, it was explained that information would only be revealed in cases in which their lives were at risk. Their sexual rights were also discussed; in nonexclusive services it did not happen.

Security

The training of the users allowed them to identify errors or omissions in the information provided, which was not always truthful, useful or timely (Testimonials S4 and S5). There was variability according to the topic consulted, with contraceptive method and condom use being best explained, while STI/HIV counseling was the worst (Testimony S1). The use of didactic material such as models, audiovisual material and plastic models was perceived as positive, since it facilitated learning.

The offer of diagnostic studies depended on the case of appointment, mainly on the case of suspected HIV, in which rapid tests were more frequently offered. The information provided about diagnostic studies was unclear and confusing. Physical examination was an unusual practice (Testimony S2). In cases when it was done, it consisted of weight, height and blood pressure measurements. On rare occasions, ears and eyes were checked. The physical examination was more complete in the center exclusive for adolescents.

Health care providers, regardless of the reason for appointment, emphasized condom use with the partner as the only method that prevents unwanted pregnancy and STI/HIV (Testimony S3).

Continuity

There was no continuity in the reason for appointment via follow-up appointments, although the opportunity was left open to return when they needed care (Testimony C1). Clinics did not offer services in addition to SRH, and few of them invited users to attend SRH talks or workshops. At the exclusive center, monitoring was provided and services such as nutrition and dental care were offered.

There were two exceptional cases in which providers, concerned about the health of users, provided a personal telephone number or information about their working hours to follow the case. This element was highly appreciated by the adolescents (Testimony C2).

The continuity dimension presented one of the important differences between nonexclusive and exclusive clinics for adolescents. In the exclusive clinics, the supply of other services in the health unit was consistently observed (Testimony C3). Table 2 summarizes the main findings, as well as the differences between exclusive and non-exclusive services found by the simulated users.

Table 2
Summary of key findings and differences between clinics with exclusive and nonexclusive services, Mexico 2018

DISCUSSION

There are areas for improvement to ensure that the quality of care in AFHS is optimal and effective, particularly in nonexclusive AFHS. Based on the experience of simulated users, services are geographically accessible. However, our study does not present disaggregations by type of locality, so it differs from other studies that point to difficult access in rural areas, as noted by Regmi et al. 2525. Regmi PR , Teijlingen E , Simkhada P , Acharya DR . Barriers to sexual health services for young people in Nepal . J Health Popul Nutr , 2010 ; 28 ( 6 ): 619 - 27 . https://doi.org/10.3329/jhpn.v28i6.6611
https://doi.org/10.3329/jhpn.v28i6.6611...
. Most units do not have signs with schedules, days, cost of service, or signage of the service, resulting in users receiving indications from staff, in line with other studies that report lack of signage and unclear indications from staff 1616. Mchome Z , Richards E , Nnko S , Dusabe J , Mapella E , Obasi A . A ‘mystery client’ evaluation of adolescent sexual and reproductive health services in health facilities from two regions in Tanzania . PLoS One . 2015 ; 10 ( 3 ): e0120822 . https://doi.org/10.1371/journal.pone.0120822
https://doi.org/10.1371/journal.pone.012...
, 1717. Sykes S , O’Sullivan K . A ‘mystery shopper’ project to evaluate sexual health and contraceptive services for young people in Croydon . J Fam Plann Reprod Health Care . 2006 ; 32 ( 1 ): 25 - 6 . https://doi.org/10.1783/147118906775275334
https://doi.org/10.1783/1471189067752753...
.

In Mexico, the friendly service is free. However, there were cases in which procedures such as charging and health insurance requirements were a barrier. Charging for the service is a significant and documented barrier to accessing health services 1616. Mchome Z , Richards E , Nnko S , Dusabe J , Mapella E , Obasi A . A ‘mystery client’ evaluation of adolescent sexual and reproductive health services in health facilities from two regions in Tanzania . PLoS One . 2015 ; 10 ( 3 ): e0120822 . https://doi.org/10.1371/journal.pone.0120822
https://doi.org/10.1371/journal.pone.012...
. If adolescents incur costs for using services, this reduces the chances of them returning to use the service or applying for contraception. In addition, adolescents avoid services using family health insurance for fear that their parents will find out 55. Sadler Spencer M , Obach King A , Luengo Charat MX , Biggs MA . Estudio barreras de acceso a los servicios de salud para la prevención del embarazo adolescente en Chile . Santiago (CIL) : Ministerio de Salud ; 2010 . .

Waiting time was not a barrier for most clinics. However, there were exceptions that caused adolescents to want to leave and not return to a clinic. Schriver points out that waiting time needs to be optimized because it is one of the main constraints on attending services 2626. Schriver B , Meagley K , Norris S , Geary R , Stein AD . Young people’s perceptions of youth-oriented health services in urban Soweto, South Africa: a qualitative investigation . BMC Health Serv Res . 2014 ; 14 : 625 . https://doi.org/10.1186/s12913-014-0625-y
https://doi.org/10.1186/s12913-014-0625-...
, a barrier that may be even more critical for male adolescents, for whom the need for quick and direct service is important 2727. Pearson S . Promoting sexual health services to young men: findings from focus group discussions . J Fam Plann Reprod Health Care . 2003 ; 29 ( 4 ): 194 - 8 . https://doi.org/10.1783/147118903101198079
https://doi.org/10.1783/1471189031011980...
. There were few cases when care was denied, as found by De Castro et al. and Sykes, who point out that professionals denied care to adolescents and invited them to return another day 1717. Sykes S , O’Sullivan K . A ‘mystery shopper’ project to evaluate sexual health and contraceptive services for young people in Croydon . J Fam Plann Reprod Health Care . 2006 ; 32 ( 1 ): 25 - 6 . https://doi.org/10.1783/147118906775275334
https://doi.org/10.1783/1471189067752753...
, 2828. De Castro F , Place JM , Allen-Leigh B , Barrientos-Gutierrez T , Dues K , Eternod-Arámburu M , et al . Perceptions of adolescent ‘simulated clients’ on barriers to seeking contraceptive services in health centers and pharmacies in Mexico . Sex Reprod Health . 2018 ; 16 : 118 - 23 . https://doi.org/10.1016/j.srhc.2018.03.003
https://doi.org/10.1016/j.srhc.2018.03.0...
. The clinics do not have clear mechanisms for scheduling visits, which is a central problem for continuity. Inviting adolescents to return does not guarantee that they will be assisted when they return, further wasting the opportunity to provide information and meet the health needs of adolescents.

Lack of privacy is the main barrier users faced when they use the services. The units have spaces designed to provide care, but the infrastructure is not always optimal to guarantee privacy 1616. Mchome Z , Richards E , Nnko S , Dusabe J , Mapella E , Obasi A . A ‘mystery client’ evaluation of adolescent sexual and reproductive health services in health facilities from two regions in Tanzania . PLoS One . 2015 ; 10 ( 3 ): e0120822 . https://doi.org/10.1371/journal.pone.0120822
https://doi.org/10.1371/journal.pone.012...
, 1717. Sykes S , O’Sullivan K . A ‘mystery shopper’ project to evaluate sexual health and contraceptive services for young people in Croydon . J Fam Plann Reprod Health Care . 2006 ; 32 ( 1 ): 25 - 6 . https://doi.org/10.1783/147118906775275334
https://doi.org/10.1783/1471189067752753...
, 2929. Amuchástegui A , Parrini RJ . Para construir servicios amigables de salud sexual y reproductiva para adolescentes: experiencias y percepciones de las/os adolescentes en los servicios de salud para adolescentes de Campeche, Chiapas, Oaxaca, Tabasco y Veracruz . México, DF : Católicas por el Derecho a Decidir A.C. ; 2009 .

30. Kennedy EC , Bulu S , Harris J , Humphreys D , Malverus J , Gray NJ . “Be kind to young people so they feel at home”: a qualitative study of adolescents’ and service providers’ perceptions of youth-friendly sexual and reproductive health services in Vanuatu . BMC Health Serv Res . 2013 ; 13 : 455 . https://doi.org/10.1186/1472-6963-13-455
https://doi.org/10.1186/1472-6963-13-455...
- 3131. Mbeba RM , Mkuye MS , Magembe GE , Yotham WL , Mellah AO , Mkuwa SB . Barriers to sexual reproductive health services and rights among young people in Mtwara district, Tanzania: a qualitative study . Pan Afr Med J . 2012 ; 13 Suppl 1 : 13 . . Users prefer units with an exclusive space for adolescents, but most clinics do not have it. Villalobos et al. specify that 78.3% of the clinics do not have exclusive spaces, and this element is registered in the literature as central 1616. Mchome Z , Richards E , Nnko S , Dusabe J , Mapella E , Obasi A . A ‘mystery client’ evaluation of adolescent sexual and reproductive health services in health facilities from two regions in Tanzania . PLoS One . 2015 ; 10 ( 3 ): e0120822 . https://doi.org/10.1371/journal.pone.0120822
https://doi.org/10.1371/journal.pone.012...
, 1717. Sykes S , O’Sullivan K . A ‘mystery shopper’ project to evaluate sexual health and contraceptive services for young people in Croydon . J Fam Plann Reprod Health Care . 2006 ; 32 ( 1 ): 25 - 6 . https://doi.org/10.1783/147118906775275334
https://doi.org/10.1783/1471189067752753...
, 2929. Amuchástegui A , Parrini RJ . Para construir servicios amigables de salud sexual y reproductiva para adolescentes: experiencias y percepciones de las/os adolescentes en los servicios de salud para adolescentes de Campeche, Chiapas, Oaxaca, Tabasco y Veracruz . México, DF : Católicas por el Derecho a Decidir A.C. ; 2009 .

30. Kennedy EC , Bulu S , Harris J , Humphreys D , Malverus J , Gray NJ . “Be kind to young people so they feel at home”: a qualitative study of adolescents’ and service providers’ perceptions of youth-friendly sexual and reproductive health services in Vanuatu . BMC Health Serv Res . 2013 ; 13 : 455 . https://doi.org/10.1186/1472-6963-13-455
https://doi.org/10.1186/1472-6963-13-455...

31. Mbeba RM , Mkuye MS , Magembe GE , Yotham WL , Mellah AO , Mkuwa SB . Barriers to sexual reproductive health services and rights among young people in Mtwara district, Tanzania: a qualitative study . Pan Afr Med J . 2012 ; 13 Suppl 1 : 13 .
- 3232. Villalobos A , Allen-Leigh B , Salazar-Alberto J , Castro F , Barrientos-Gutiérrez T , Leyva-López A , et al . Quality of reproductive healthcare for adolescents: a nationally representative survey of providers in Mexico . PLoS One . 2017 ; 12 ( 3 ): e0173342 . https://doi.org/10.1371/journal.pone.0173342
https://doi.org/10.1371/journal.pone.017...
, especially for males, who fear their masculinity will be impaired by being exposed to their community, because of SRH care 55. Sadler Spencer M , Obach King A , Luengo Charat MX , Biggs MA . Estudio barreras de acceso a los servicios de salud para la prevención del embarazo adolescente en Chile . Santiago (CIL) : Ministerio de Salud ; 2010 . .

Privacy and confidentiality are key to avoid that users feel embarrassed or unmotivated to express their doubts 2828. De Castro F , Place JM , Allen-Leigh B , Barrientos-Gutierrez T , Dues K , Eternod-Arámburu M , et al . Perceptions of adolescent ‘simulated clients’ on barriers to seeking contraceptive services in health centers and pharmacies in Mexico . Sex Reprod Health . 2018 ; 16 : 118 - 23 . https://doi.org/10.1016/j.srhc.2018.03.003
https://doi.org/10.1016/j.srhc.2018.03.0...
. Therefore, they constitute crucial elements in the satisfaction perceived by adolescents, since an atmosphere of distrust is generated when these characteristics are not present.

Physical examination is not a common practice, an element that diminishes the quality of AFHS, which must provide comprehensive care and systematize clinical examination during counseling 99. Organización Mundial de la Salud . Competencias básicas en materia de salud y desarrollo de los adolescentes para los proveedores de atención primaria . Ginebra : OMS ; 2015 . .

Users point the need to provide clear, truthful and specific information, as found in a previous study 2828. De Castro F , Place JM , Allen-Leigh B , Barrientos-Gutierrez T , Dues K , Eternod-Arámburu M , et al . Perceptions of adolescent ‘simulated clients’ on barriers to seeking contraceptive services in health centers and pharmacies in Mexico . Sex Reprod Health . 2018 ; 16 : 118 - 23 . https://doi.org/10.1016/j.srhc.2018.03.003
https://doi.org/10.1016/j.srhc.2018.03.0...
. The importance given by staff to condom use as a method of preventing STI and unplanned pregnancies and the use of educational materials were important for counseling. This favored a dynamic appointment and facilitated the understanding of adolescents as pointed out by De Castro 2828. De Castro F , Place JM , Allen-Leigh B , Barrientos-Gutierrez T , Dues K , Eternod-Arámburu M , et al . Perceptions of adolescent ‘simulated clients’ on barriers to seeking contraceptive services in health centers and pharmacies in Mexico . Sex Reprod Health . 2018 ; 16 : 118 - 23 . https://doi.org/10.1016/j.srhc.2018.03.003
https://doi.org/10.1016/j.srhc.2018.03.0...
.

There was no monitoring after appointments in most units, even when diagnostic tests for STI/HIV were required, although the user was invited to return when needed. With the exception of the exclusive center, the rest of the facilities do not promote complementary services among users.

A key finding for the quality perceived by adolescents is the staff’s attitude. Most had a respectful attitude, but we found cases when staff were critical, made moral judgments or showed an unprofessional behavior. Negative staff attitudes have been identified as one of the main barriers to service quality 1616. Mchome Z , Richards E , Nnko S , Dusabe J , Mapella E , Obasi A . A ‘mystery client’ evaluation of adolescent sexual and reproductive health services in health facilities from two regions in Tanzania . PLoS One . 2015 ; 10 ( 3 ): e0120822 . https://doi.org/10.1371/journal.pone.0120822
https://doi.org/10.1371/journal.pone.012...
, 1717. Sykes S , O’Sullivan K . A ‘mystery shopper’ project to evaluate sexual health and contraceptive services for young people in Croydon . J Fam Plann Reprod Health Care . 2006 ; 32 ( 1 ): 25 - 6 . https://doi.org/10.1783/147118906775275334
https://doi.org/10.1783/1471189067752753...
, 3030. Kennedy EC , Bulu S , Harris J , Humphreys D , Malverus J , Gray NJ . “Be kind to young people so they feel at home”: a qualitative study of adolescents’ and service providers’ perceptions of youth-friendly sexual and reproductive health services in Vanuatu . BMC Health Serv Res . 2013 ; 13 : 455 . https://doi.org/10.1186/1472-6963-13-455
https://doi.org/10.1186/1472-6963-13-455...
, 3131. Mbeba RM , Mkuye MS , Magembe GE , Yotham WL , Mellah AO , Mkuwa SB . Barriers to sexual reproductive health services and rights among young people in Mtwara district, Tanzania: a qualitative study . Pan Afr Med J . 2012 ; 13 Suppl 1 : 13 . .

Although the exclusive services were perceived as successful, by providing friendly care, infrastructure and resource requirements limit their replication in a general way. Friendly services in public clinics to people without social security are the predominant model in the state. The findings of this study point out areas of opportunity for these adolescents and document good care practices, according to the resources available in each clinic.

In this study, the simulated user methodology enabled us to obtain objective information from a trained and standardized fictitious client 2020. Ulin PR , Robinson ET , Tolley EE . Investigación aplicada en salud pública: métodos cualitativos . Washington, DC : Organización Panamericana de la Salud ; 2006 . ( Publicación Científica y Técnica, 614 ). , 3333. Hernando P , Lechuga FJ , Ávila A . La utilización del cliente simulado en la evaluación de los servicios de atención al cliente . Rev Calid Asist . 2007 ; 22 ( 2 ): 78 - 84 . https://doi.org/10.1016/S1134-282X(07)71197-1
https://doi.org/10.1016/S1134-282X(07)71...
. The experiences of the simulated users during the search and obtaining of health services generated evaluative data, the result of a comparison and contrast exercise that can be differentiated from the poor knowledge about quality standards of real users. This generates valuable evidence for the discussion of quality studies from the perspective of the users 3434. Cheng SH , Song HY . Physician performance information and consumer choice: a survey of subjects with the freedom to choose between doctors . BMJ Qual Saf . 2004 ; 13 ( 2 ): 98 - 101 . https://doi.org/10.1136/qshc.2003.006981http://dx.doi.org/10.1136/qshc.2003.006981
https://doi.org/10.1136/qshc.2003.006981...
.

Our findings and the analyses presented are observational and do not seek to identify causality among the phenomena studied. The methodology carried out a critical assessment and facilitated observation without altering the behavior of the service provider when being examined 3535. Rhodes KV , Miller FG . Simulated patient studies: an ethical analysis . Milbank Q . 2012 ; 90 ( 4 ): 706 - 24 . https://doi.org/10.1111/j.1468-0009.2012.00680.x
https://doi.org/10.1111/j.1468-0009.2012...
.

No differentiation was made between urban and rural areas, due to the geographical location of the centers, and all possible cases of appointment were not addressed. Although there were two male and two female simulated users, no specific attempt was made to understand differences related to sex or sexual preference of users, but to the dimensions of the quality of the service. This study contributed by identifying findings that may go unnoticed by a common user, due to lack of knowledge about the topic consulted.

CONCLUSION

Although most of the establishments visited by the simulated users refer to having a friendly service, they are still far from meeting the characteristics of friendliness according to international recommendations. This study reports important findings about quality during the care process. Services do not always provide integral care to adolescents, forgetting prevention and continuity of care once the immediate reason for appointment is addressed. In addition, although there were few cases, care is still conditioned on payment for services. Due to the evidence in the literature about disparities in the experiences and consequences of adolescent pregnancy, it is necessary for services to incorporate a gender focus that allows the active use of sexual and reproductive health services by males.

Differences were found between adolescent-only and non-exclusive clinic-based facilities. The perception of the simulated users showed that the care in the exclusive centers is better and more complete, offering various services, regardless of the reason for appointment. Although it is not possible for the health system to have exclusive friendly services in all cases, adaptations are necessary to allow current services to adopt strategies that make it possible for nonexclusive services to provide a service comparable to that of the exclusive center. It was best evaluated by the adolescents when indicated that they could return if they required care. It is a fact that the number of clinics providing adolescent health services has increased, but improvements are needed to achieve quality care.

Strategies are needed to improve good practices and quality of health care for adolescents, including the development of activities in communities, involving schools and parents, to attract and engage adolescents before they become sexually active. In addition, awareness raising and training for administrators and health personnel in the care of adolescents are essential, so that prejudices and social norms do not permeate the care offered to this population.

REFERENCES

  • 1
    Greifinger R , Ramsey M . Cómo hacer para que sus servicios de salud sean amigables para los jóvenes: una guía para los planificadores e implementadores del programa . Washington, DC : Population Services Internacional ; 2014 .
  • 2
    Instituto Nacional de Estadística y Geografía , Dirección General de Estadísticas Sociodemográficas , Dirección General Adjunta del Censo de Población y Vivienda . Encuesta Intercensal 2015 . Aguascalientes (MEX) : INEGI ; 2015 .
  • 3
    Vallejo Barón J . Embarazo en adolescentes: complicaciones . Rev Med Costa Rica Cent Am . 2013 ; 70 ( 605 ): 65 - 9 .
  • 4
    Grupo Interinstitucional para la Prevención del Embarazo en Adolescentes . Estrategia Nacional para la Prevención del Embarazo en Adolescentes . México, DF : GIPEA ; 2015 .
  • 5
    Sadler Spencer M , Obach King A , Luengo Charat MX , Biggs MA . Estudio barreras de acceso a los servicios de salud para la prevención del embarazo adolescente en Chile . Santiago (CIL) : Ministerio de Salud ; 2010 .
  • 6
    Instituto Nacional de Estadística y Geografía . La anticoncepción: Implicaciones en el embarazo adolescente, fecundidad y salud reproductiva en México. Encuesta Nacional de la Dinámica Demográfica 2014 – ENADID . Águascalientes (MEX) : INEGI ; c2017 .
  • 7
    Banco Mundial ; División de Población de las Naciones Unidas . Perspectivas de la Población Mundial: tasa de fertilidad en adolescentes 2018 . Washington, DC ; c2019 .
  • 8
    Secretaria de Salud (MEX) , Centro Nacional de Equidad de Género y Salud Reproductiva . Modelo de Atención Integral en Salud Sexual y Reproductiva para Adolescentes . México, DF : CNEGSR ; 2015 .
  • 9
    Organización Mundial de la Salud . Competencias básicas en materia de salud y desarrollo de los adolescentes para los proveedores de atención primaria . Ginebra : OMS ; 2015 .
  • 10
    Organización Panamericana de la Salud . Estrategia y plan de acción regional sobre los adolescentes y jóvenes 2010-2018 . Washington, DC : OPS ; 2010 .
  • 11
    Moreno López DJ . Estándares de calidad: servicios de salud sexual y reproductiva para adolescentes en Latinoamérica y el Caribe: diagnóstico de situación de la implementación . Bogotá (COL) : UNFPA ; 2014 .
  • 12
    Ministério de la Protección Social (COL) ; Fondo de Población de las Naciones Unidas . Servicios de salud amigables para adolescentes y jóvenes: un modelo para adecuar las respuestas de los servicios de salud a las necesidades de los adolescentes y jóvenes de Colombia . Bogotá (COL) : UNFPA , 2008 .
  • 13
    Secretaria de Salud (MEX) , Centro Nacional de Equidad de Género y Salud Reproductiva . Servicios amigables para adolescentes: salud sexual y reproductiva para adolescentes . México, DF : CNEGSR ; 2018 .
  • 14
    Denno DM , Hoopes AJ , Chandra-Mouli V . Effective strategies to provide adolescent sexual and reproductive health services and to increase demand and community support . J Adolesc Health . 2015 ; 56 ( 1 Suppl ): S22 - 41 . https://doi.org/10.1016/j.jadohealth.2014.09.012 .
    » https://doi.org/10.1016/j.jadohealth.2014.09.012
  • 15
    Obach A , Sadler M , Aguayo F , Bernales M . Salud sexual y reproductiva de hombres jóvenes en Chile: resultados de un estudio cualitativo . Rev Panam Salud Publica . 2018 ; 42 : e124 . https://doi.org/10.26633/RPSP.2018.124
    » https://doi.org/10.26633/RPSP.2018.124
  • 16
    Mchome Z , Richards E , Nnko S , Dusabe J , Mapella E , Obasi A . A ‘mystery client’ evaluation of adolescent sexual and reproductive health services in health facilities from two regions in Tanzania . PLoS One . 2015 ; 10 ( 3 ): e0120822 . https://doi.org/10.1371/journal.pone.0120822
    » https://doi.org/10.1371/journal.pone.0120822
  • 17
    Sykes S , O’Sullivan K . A ‘mystery shopper’ project to evaluate sexual health and contraceptive services for young people in Croydon . J Fam Plann Reprod Health Care . 2006 ; 32 ( 1 ): 25 - 6 . https://doi.org/10.1783/147118906775275334
    » https://doi.org/10.1783/147118906775275334
  • 18
    Geary RS , Webb EL , Clarke L , Norris SA . Evaluating youth-friendly health services: young people’s perspectives from a simulated client study in urban South Africa . Glob Health Action . 2015 ; 8 . https://doi.org/10.3402/gha.v8.26080
    » https://doi.org/10.3402/gha.v8.26080
  • 19
    De Castro F , Barrientos-Gutierrez T , Braverman-Bronstein A , Santelli J , Place JM , Eternod-Arámburu M , et al . Adolescent access to information on contraceptives: a mystery client study in Mexico . J Adolesc Health . 2018 ; 62 ( 3 ): 265 - 72 . https://doi.org/10.1016/j.jadohealth.2017.08.001
    » https://doi.org/10.1016/j.jadohealth.2017.08.001
  • 20
    Ulin PR , Robinson ET , Tolley EE . Investigación aplicada en salud pública: métodos cualitativos . Washington, DC : Organización Panamericana de la Salud ; 2006 . ( Publicación Científica y Técnica, 614 ).
  • 21
    Teddlie C , Yu F . Mixed methods sampling: a typology with examples . J Mix Methods Res . 2017 ; 1 ( 1 ): 77 - 100 . https://doi.org/10.1177/1558689806292430
    » https://doi.org/10.1177/1558689806292430
  • 22
    Guest G , Bunce A , Johnson L . How many interviews are enough? An experiment with data saturation and variability . Field Methods . 2016 ; 18 ( 1 ): 59 - 82 . https://doi.org/10.1177/1525822X05279903
    » https://doi.org/10.1177/1525822X05279903
  • 23
    Olaz-Capitán AJ . La técnica de grupo nominal como herramienta de innovación docente . RASE Rev Sociol Educ . 2013 ; 6 ( 1 ): 114 - 21 .
  • 24
    Fereday J , Muir-Cochrane E . Demonstrating rigor using thematic analysis: a hybrid approach of inductive and deductive coding and theme development . Int J Qual Methods . 2006 ; 5 ( 1 ): 80 - 92 . https://doi.org/10.1177/160940690600500107
    » https://doi.org/10.1177/160940690600500107
  • 25
    Regmi PR , Teijlingen E , Simkhada P , Acharya DR . Barriers to sexual health services for young people in Nepal . J Health Popul Nutr , 2010 ; 28 ( 6 ): 619 - 27 . https://doi.org/10.3329/jhpn.v28i6.6611
    » https://doi.org/10.3329/jhpn.v28i6.6611
  • 26
    Schriver B , Meagley K , Norris S , Geary R , Stein AD . Young people’s perceptions of youth-oriented health services in urban Soweto, South Africa: a qualitative investigation . BMC Health Serv Res . 2014 ; 14 : 625 . https://doi.org/10.1186/s12913-014-0625-y
    » https://doi.org/10.1186/s12913-014-0625-y
  • 27
    Pearson S . Promoting sexual health services to young men: findings from focus group discussions . J Fam Plann Reprod Health Care . 2003 ; 29 ( 4 ): 194 - 8 . https://doi.org/10.1783/147118903101198079
    » https://doi.org/10.1783/147118903101198079
  • 28
    De Castro F , Place JM , Allen-Leigh B , Barrientos-Gutierrez T , Dues K , Eternod-Arámburu M , et al . Perceptions of adolescent ‘simulated clients’ on barriers to seeking contraceptive services in health centers and pharmacies in Mexico . Sex Reprod Health . 2018 ; 16 : 118 - 23 . https://doi.org/10.1016/j.srhc.2018.03.003
    » https://doi.org/10.1016/j.srhc.2018.03.003
  • 29
    Amuchástegui A , Parrini RJ . Para construir servicios amigables de salud sexual y reproductiva para adolescentes: experiencias y percepciones de las/os adolescentes en los servicios de salud para adolescentes de Campeche, Chiapas, Oaxaca, Tabasco y Veracruz . México, DF : Católicas por el Derecho a Decidir A.C. ; 2009 .
  • 30
    Kennedy EC , Bulu S , Harris J , Humphreys D , Malverus J , Gray NJ . “Be kind to young people so they feel at home”: a qualitative study of adolescents’ and service providers’ perceptions of youth-friendly sexual and reproductive health services in Vanuatu . BMC Health Serv Res . 2013 ; 13 : 455 . https://doi.org/10.1186/1472-6963-13-455
    » https://doi.org/10.1186/1472-6963-13-455
  • 31
    Mbeba RM , Mkuye MS , Magembe GE , Yotham WL , Mellah AO , Mkuwa SB . Barriers to sexual reproductive health services and rights among young people in Mtwara district, Tanzania: a qualitative study . Pan Afr Med J . 2012 ; 13 Suppl 1 : 13 .
  • 32
    Villalobos A , Allen-Leigh B , Salazar-Alberto J , Castro F , Barrientos-Gutiérrez T , Leyva-López A , et al . Quality of reproductive healthcare for adolescents: a nationally representative survey of providers in Mexico . PLoS One . 2017 ; 12 ( 3 ): e0173342 . https://doi.org/10.1371/journal.pone.0173342
    » https://doi.org/10.1371/journal.pone.0173342
  • 33
    Hernando P , Lechuga FJ , Ávila A . La utilización del cliente simulado en la evaluación de los servicios de atención al cliente . Rev Calid Asist . 2007 ; 22 ( 2 ): 78 - 84 . https://doi.org/10.1016/S1134-282X(07)71197-1
    » https://doi.org/10.1016/S1134-282X(07)71197-1
  • 34
    Cheng SH , Song HY . Physician performance information and consumer choice: a survey of subjects with the freedom to choose between doctors . BMJ Qual Saf . 2004 ; 13 ( 2 ): 98 - 101 . https://doi.org/10.1136/qshc.2003.006981http://dx.doi.org/10.1136/qshc.2003.006981
    » https://doi.org/10.1136/qshc.2003.006981http://dx.doi.org/10.1136/qshc.2003.006981
  • 35
    Rhodes KV , Miller FG . Simulated patient studies: an ethical analysis . Milbank Q . 2012 ; 90 ( 4 ): 706 - 24 . https://doi.org/10.1111/j.1468-0009.2012.00680.x
    » https://doi.org/10.1111/j.1468-0009.2012.00680.x
  • Funding
    The project Evaluación integral de desempeño de los servicios de salud sexual y reproductiva, orientados a adolescentes, en unidades de los Servicios de Salud de Morelos (Comprehensive assessment of sexual and reproductive health services, focused on adolescents, in units of the Health Services of Morelos), from which this article is derived, was funded by the Consejo Nacional de Ciencia y Tecnología de México (CONACyT) (FOSISS/SALUD 2015-1-261230).

Publication Dates

  • Publication in this collection
    06 Apr 2020
  • Date of issue
    2020

History

  • Received
    07 June 2019
  • Accepted
    15 Aug 2019
Faculdade de Saúde Pública da Universidade de São Paulo Avenida Dr. Arnaldo, 715, 01246-904 São Paulo SP Brazil, Tel./Fax: +55 11 3061-7985 - São Paulo - SP - Brazil
E-mail: revsp@usp.br