SciELO - Scientific Electronic Library Online

vol.22 issue3Preceptorship in Family and Community Medicine: challenges and achievements in a Primary Health Care in progressFamily Health Teams workers in Rio de Janeiro: leadership aspects in a study on organizational climate author indexsubject indexarticles search
Home Pagealphabetic serial listing  

Services on Demand




Related links


Ciência & Saúde Coletiva

Print version ISSN 1413-8123On-line version ISSN 1678-4561

Ciênc. saúde coletiva vol.22 no.3 Rio de Janeiro Mar. 2017 


The voice of Primary Care patients in the Lisbon and Tagus Valley region of Portugal

Pedro Lopes Ferreira1 

Vítor M. Raposo1 

Luis Pisco2 

1 Centro de Estudos e Investigação em Saúde, Faculdade de Economia, Universidade de Coimbra. Av. Dr. Dias da Silva 165. 3004-512 Coimbra Portugal.

2 Administração Regional de Saúde de Lisboa e Vale do Tejo. Lisboa Portugal.


This article was the result of a study aimed at determining the degree of user satisfaction with the care provided in the 125 Family Health Units (Unidades de Saúde Familiar - USF) and in some of the 127 Personalized Health Care Units (Unidades de Cuidados de Saúde Personalizados - UCSP) of the Region of Lisbon and Tagus Valley (LVT). A total of 20,118 questionnaires were distributed and 16,965 received (89.0% response rate). The data collection instrument used was the Europep questionnaire, essentially measuring four dimensions: medical care, non-medical care, organization of care and quality of premises. 65.3% of the respondents were women, the average age was 50.8 years, 35% had a maximum of six years of schooling, and to 5.2% this had been their first contact. There was an overall average satisfaction of 77.4%, higher in what regards the care and attention provided by professionals. Women had slightly lower satisfaction than men, the same as for the younger compared to the older ones. Those with less literacy were the ones that presented better satisfaction rates. USF had always more satisfaction than the UCSP, and models B a satisfaction greater than models A. Users penalize units with more than 12 GP and there was a great regional disparity.

Key words: Satisfaction; Primary Health Care


Primary health care aims at being the first and the main contact of citizens with the health system. In line with this assumption, the ongoing primary care reform pointed out the need for a deep organizational change.

On the other hand, the role of health care providing services in meeting the needs and expectations of their users is acknowledged, both in what regards the technical and the interpersonal aspects of care1,2. Furthermore, in the presence of great changes in the knowledge-based society, of health spending increases and major budgetary constraints, it is increasingly important that provision of care satisfies the subjective needs of patients. Therefore, the assessment of user satisfaction is nowadays recognized as an added value to other measures of outcome as the health state or the quality of life3,4 and is already considered an indispensable component for the evaluation of quality of care; also, there is evidence of its correlation with the health outcomes. On the other hand, every organization is inserted in an environment with which it interacts continually, promoting constant exchanges of goods and services. In public utility services, such as social, health and education institutions, this exchange should still be more pronounced as a result of strong pressure and growing demand for participation by civil society.

Satisfaction data are typically used for two purposes. First of all, to evaluate the care provided and, in addition, to predict the «consumers’» behaviors, namely by determining whether they recommend health units that they normally attend or whether they would return, if necessary, to the same health units5.

This need for information also encompasses the concept of transparency – one of the cornerstones of good governance6-9 of any health system – and the concept of participation that, on the other hand, includes the possibility of a complaint, the right to be heard regarding their opinion about the health system or the impact of their experience with this system10,11. It also includes the possibility of being involved in decision-making at various levels of the system, from the level of the direct provision of care up to the level of planning, priority setting and policy decision making12.

The Portuguese experience

In 2005, with the beginning of a new political cycle, the Mission for Primary Health Care was created, aiming to put into practice the primary health care reform. The starting point for reform was based on the low level of satisfaction of citizens, professionals and policy makers, determined by low accessibility, inefficiency, bureaucratic barriers and lack of incentives to improve productivity and quality13. The priority action of the primary health care reform was the launch and implementation of Family Health Units (Unidades de Saúde Familiar - USF), models A and B, thus starting to reconfigure the Health Centers, with the ultimate goal of thoroughly reforming the PHC (Primary Health Care). In the Health Region of Lisbon and Tagus Valley (LVT), as well as in all the country, issues such as patient safety, citizens’ rights, good practices, ethical behavior, complaints handling, and evaluation of users’ satisfaction became intuitive and a goal shared by the entire health team.

The Europep questionnaire

The Portuguese version of the European Europep questionnaire was tested and validated in Portugal and developed by the Centre for Health Studies and Research of the University of Coimbra (CEISUC). The Europep project was launched in 1994 by a group of European researchers under the leadership of Richard Grol, from the Centre for Quality of Care Research (WOK), Faculty of Medical Sciences of the University of Nijmegen, The Netherlands, in the framework of a Biomed project funded by the European Union. It was aimed at creating a measuring instrument to assess the satisfaction of primary health care users and involved the initial participation of eight countries: Denmark, Germany, Israel, Norway, Portugal, Sweden, The Netherlands, and United Kingdom. When this project ended in 1999, the Europep questionnaire was thoroughly validated in 15 languages and was recognized by WONCA14, after having been validated in various international contexts of general medicine15,16.

It should be noted that in Portugal, as early as in 2000, it was administered to users of all 86 Health Centers of LVT17; 3,969 responses were obtained, corresponding to a response rate of 40.5%. Then, the following year, the study was expanded to the users of 194 Health Centers (54% of the universe), a total of 4,714 individuals. The call was then made to the coordinators of the Health Sub-Regions and the sampling error amounted to 1.4%.

Then, within a study of a project led by the Portuguese Institute for Quality in Health (IQS) funded by the European Program Health XXI and managed by the Ministry of Health, all the by then existing 365 health centers were studied. 11,166 responses were obtained, representative of the population by gender, age group and sub-region18,19.

When the first USF appeared, it was decided to assess again the satisfaction of the users of these units, and this was immediately endorsed by the Mission for Primary Health Care of the Ministry of Health20. A one-day census was applied to the users of the 146 USF so far constituted and 12,713 answers were received, corresponding to a final response rate of 75.8% and to a maximum error of 0.4% for a confidence interval of 95.

In Brazil there is also evidence of the use of this measurement instrument21.


This observational study, descriptive and cross-sectional and at the national level was developed in June 2015 in order to determine the degree of user satisfaction with the care provided in all USF, as determined in Ordinance No. 301/2008, of April 18, and in a few randomly selected UCSP in the Region LVT. It was also intended to perform a comparative analysis between health units with the same organizational model and health units with different models22.

Conceptual model of analysis

This study assumes the conceptual model in Figure 1. To measure user satisfaction of USF and UCSP it was assumed that there are determinants for this satisfaction and that these determinants are somehow grouped by sociodemographic and unit characteristics, in addition to the user own experience. The sociodemographic data measured in this study included gender, age, family situation, employment status and level of education. The unit characteristics encompassed its social, economic and demographic contexts, as well as its organizational model. Finally, experience was measured by the number of visits to the health unit in the previous 12 months.

Figure 1 Conceptual Model. 

Satisfaction was measured through the dimensions called ‘medical care’, ‘non-medical care’, ‘organization of care’ and ‘quality of amenities. ‘Medical care‘ includes both interpersonal and technical components of general practitioners (GP) and in ‘non-medical care’ dimension are covered nursing care and attention provided by clinical secretaries. Finally, in ‘organization of care’, access and overall services provided are examined. Chart 1 presents the dimensions, sub-dimensions and questions of the questionnaire used. Each question was supposed to be answered in a 5-point Likert scale, from excellent to poor.

Chart 1 Questionnaire dimensions, subdimensions and questions. 

Dimensions Subdimensions Questions
Medical care Interpersonal component 02 - Consultation time with GP
03 - Professionals showed interest
04 – Felt at ease with the general practitioner
05 – Involvement in decisions about medical care
06 – How the general practitioner listened to you
07 – Keeping your records and data confidential
08 – Providing quick relief of your symptoms
09 – Helping you to perform your normal daily activities
10 – Attention received
Technical component 11 – Examination made by the GP
12 – Offering you services for preventing diseases
13 – Explaining purpose of examinations, tests and treatments
14 – Information about symptoms and disease
15 – Help to deal with problems
16 – Help to follow GP’s advice
17 – Knowledge about previous contacts in the practice
18 – Preparing you for what to expect from specialists
23 – Competence, courtesy and kindness of GPs
Non-medical care Nurses 19 – Time devoted by nurses
20 – Explanations by nurses
24 – Competence, courtesy and kindness of nurses
Clinical secretariat 21 – Administrative service
22 – Explanations by clinical secretariat
25 – Competence, courtesy and kindness of staff
Organization of care Access 27 – Ease of scheduling appointment
28 – Getting through to the practice on telephone
29 – Being able to talk to the GP on the telephone
31 – Waiting time in the waiting room
Services provided 26 – The helpfulness of the practice staff
30 – Opening hours of the unit
32 – Respect with which was treated
33 – Freedom of choice
34 – Speed in attendance
37 – Domestic care services
38 – General organization of the services
Quality of amenities 35 – General comfort of facilities
36 – Cleanliness of facilities

These dimensions and sub-dimensions have been statistically obtained with factor analysis by the method of principal components after a varimax rotation and, more recently, reconfirmed in23. Previously, the values of the measure of sampling adequacy of Kaiser-Meyer-Olkin and significance values associated with Bartlett’s sphericity test assured the feasibility of this analysis24. The four main dimensions are associated with 75.3% of all the explained variance.

Finally, it is expected that user satisfaction has an impact on the opinions and attitudes of users. Thus, this conceptual model provides for an evaluation of the overall organization of the services, possible recommendation of the health unit to family and friends if they need health care, the willingness not to move to another health unit, and the presentation of suggestions for improvement of the care provided by the unit.


The LVT region had 127 UCSP, 69 USF-A and 56 USF-B, a total of 252 functional units. As regards the existing UCSP, units with less than 3 GP and with more than 20% of users without GP were excluded from the analysis. The purpose of this restriction was to allow a comparison between realities that, in a way, are thus more comparable to each other. With the application of this criterion, only 15 UCSP under these conditions were obtained.

All resulting 140 functional units were then categorized according to their size, taking into account the number of GP, in small, medium, large and very large. These units received a number of questionnaires according to their size. Thus, small units (with 3 to 5 GP) received 80 questionnaires, medium units (6 to 8 GP) received 140 questionnaires, large units (9 to 11 GP) received 200 questionnaires, and the very large units (12 to 16 GP) received 240 questionnaires. Thus, the 140 functional units of LVT region received a total of 20,118 questionnaires.

Each Citizen Office was responsible for delivering the questionnaires to all users of 16 or more years of age who went to the health unit. They were asked to answer to the questionnaire in the premises and to put it in a box placed in a strategic health unit location.

As soon as the delivery of the questionnaires was complete, these were sent to CEISUC, where they were processed through optical reading and entered in a computer database, after performing random quality tests. In addition to the quantitative part, the comments that users had written, either on the slot of the open question designed for this purpose and/or on the remaining parts of the questionnaire, were separately typed.

Data analysis

The values of questions, sub-dimensions and dimensions were estimated using a weighted sum in which the values were previously converted, divided by the total number of valid responses, i.e., excluding the answers ‘does not apply’. This conversion was the result of a linear transformation of scale from 1 (bad) to 5 (excellent) in a range of 0% to 100%.

Dissemination of obtained information

The main results of the study were published in CEISUC institutional webpage. Throughout the study information about the methodology was being published, as well as the name of the units under analysis and, in the end, the national results as well, these latter in free access (without access by keyword), as well as the results of each health unit, with access by means of a keyword for health unit. Using this methodology, CEISUC only had to give the keywords to the coordinators of the corresponding health units.


The main results of this study, limited to the LVT Region, will now be reported, including the characteristics of the received sample, the respective responses rates and the values corresponding to the CEISUC satisfaction index. Will also be presented results obtained from comparative analyses, taking into account the sociodemographic data of the respondents, their experience with the health unit, the characteristics of these units and their geographical location.

Responses received

20,118 questionnaires were sent to the of Citizens Offices of the 15 Health Centers Clusters (ACeS) of the LVT Region. Of these, 16,965 questionnaires were received and 1,054 were not delivered to users and were therefore considered “leftovers”. Thus, the overall response rate was 89.0%, with only 20% of ACeS with a response rate between 60% and 80%. After five weeks, 97% of the questionnaires had already been received.

Demographic characterization of the sample

The sample of respondents is mostly composed by (65.3%) women (n = 10,697; 65.3%) and with a mean age of 50.8 ± 17.1 years, with users’ age ranging from 16 to 98 years. Most of them (10,581; 64.9%) were married or living in partnership.

On the other hand, nearly 35% (4,014; 34.6%) had an education lower than or equal to the second cycle of basic education, i.e., a total of six years of schooling, of which 4% (655) did not have any formal qualification. At the other end, 3,078 (18.8%) of the respondents had a higher education degree (university or polytechnic). As regards the employment status, almost half (7,508; 47.2%) was employed and 2,550 (16.5%) were unemployed.

Experience with the health unit

The previous experience was measured by asking if this was his/her first contact with that health unit. If there was a previous contact, he/she was asked to indicate how many more times he/she had visited the GP in the previous 12 months. The answer to the first question revealed that, for 4.0% (638) of users, this was their first visit and that, for the remaining, one-quarter (2,174) had visited the unit 1 to 2 times, the average of visits stood at 5.1 and a large percentage (almost one fifth) had gone more than six times to the health unit in the previous 12 months, that is, at least, an average of once every two months.

CEISUC satisfaction index

CEISUC user satisfaction index of USF and UCSP in this sample has reached the average value of 77.1%, with a standard deviation of 17.5 (median 78.5%). However, its distribution is strongly skewed to the left, with almost half (48.3%) of the users evaluating their satisfaction with the health unit in the last quintile and only less than 3% situating on the first two quintiles.

As we can see in Table 1, the four main dimensions of this index show a greater satisfaction of users with regard to care provided, either by doctors (80.8%) or by non-medical staff (82.2%).

Table 1 Satisfaction with the units of the LVT region. 

Dimension Sub-dimension Average Standard Deviation
Medical care 80,8% 18,7%
Interpersonal component 82,1% 18,8%
Technical component 79,4% 19,7%
Non-medical care 78,8% 19,8%
Nurses 82,2% 19,3%
Clinical secretariat 76,3% 23,1%
Organization of care Access 69,6% 21,3%
Services provided 61,9% 26,1%
74,5% 20,1%
Quality of amenities 74,8% 22,1%

The organization of care was the dimension on which the worse relative satisfaction was obtained. The satisfaction in each of the sub-dimensions of the index is presented below.

• Satisfaction with medical care

Medical care obtained an average of 80.8% ± 18.7%, with evidence of more users situating in the fifth quintile. Its two sub-dimensions show relative higher user satisfaction with regard to interpersonal (82.1%) and technical (79.4%) components of medical care. About half of them assessed interpersonal component of care as excellent.

Now, looking closer to the answers to these two sub-dimensions, we found (data not shown in table) that in relation to interpersonal aspects users are more satisfied with: the guarantee that their records and data would be kept confidential (87.2%); how the GP listened to them (84.3%); and the ease with which they felt free to tell him their problems (83.5%). The interest shown in their personal situation (82.7%), the attention paid to their problems (81.8%) and how they were involved in decisions regarding the care provided by the GP (81.2%) were aspects that also obtained very positive values on the part of users.

In relation to the responses associated with the more technical component of care provided by the GP, users notoriously recognize their competence, courtesy and kindness (83.1%), value the explanation provided about the purpose of examinations, tests and treatments (81.8), the physical examination carried out by the GP (81.1%) and provision of services for preventing illness (e.g. screening, health checks and immunisations) (80.4%). Relatively less well evaluated was preparation for what to expect from specialists, hospital care, or other care providers (74.3%).

• Satisfaction with non-medical care

Non-medical care obtained an average satisfaction of 78.8% ± 19.8%, with evidence, again, of more users (51.5%) situating in the fifth quintile. Its two sub-dimensions show greater satisfaction in relation to nursing (82.2%) and clinical secretariat (76.3%). It is interesting to note the proportion (43.9%) who rate nursing care as excellent.

In what concerns this kind of care, users do not reveal significant variations in their extremely positive evaluation, be it the time devoted to them by professionals (81.9%), the explanations they provided on procedures and care (82.4%) or their competence, courtesy and kindness (83.1%).

As of the service provided by the clinical Secretariat, it was evaluated slightly lower. However, the questions of this sub-dimension didn’t reveal great variability as well, be it the time to be served (75.8%), how users were informed when information was requested (76.3%) or the competence, courtesy and kindness of the clinical secretaries (77.2%).

• Satisfaction with the organization of care

The organization of care was, as we saw earlier, the dimension that has obtained the lowest satisfaction average (69.6% ± 21.3%). This is visible in the decrease of the percentage of those who scored their satisfaction in the last quintile (30.8%), to the detriment of all others. On the other hand, the satisfaction of 12.1% of the respondents situated in the first two quartiles.

In this dimension, two sub-dimensions were also analyzed and access is visibly the more penalized sub-dimension, with 61.9%. Only 25.8% of respondents considered access as excellent, and about 21% of them considered it bad or fair.

Still with regard to access, the most penalized was the possibility of getting through by telephone either to the unit (57.3%) or to the GP himself (59.6%). Another aspect in which some dissatisfaction was also shown was the time they waited in the waiting room (61.1%).

With regard to services provided, was highly valued the respect that users feel because of how they are treated and their privacy is maintained (80.2%). Least satisfied are in relation to the opening hours of the unit (72.1%), the provision of quick services for urgent health problems (72.9%) and the freedom to choose the health professional and to have a second opinion (72.0%).

• Satisfaction with the quality of amenities

The dimension concerning the quality of amenities had an average satisfaction of 74.8% with a standard deviation of 22.1%. The general comfort of units, including temperature, environment, noise, lighting and facilities was the dimension that obtained the least satisfaction from users of this study (71.3%).

Satisfaction of special needs

Users were asked if their health unit responded to the needs felt for example, by children, the elderly and disabled people. More than 81% of users gave an affirmative answer to the question put. For each user who considers that his/her unit does not respond to these needs, there are eight users who consider the opposite.

Recommendation of health unit to friends

Users were then questioned about the possibility of strongly recommending their unit to friends, if medical care was needed. From the responses obtained, it follows that 87.5% of users responded affirmatively to the question. For each user who does not strongly recommend his/her health unit to friends, there are 10 users who consider the opposite.

Reasons not to move to another health unit

Users were asked if they saw any reason not to move to another health unit. Of the questions corresponding to the overall satisfaction, this one presented the least negative responses (7.4%) resulting from possible dissatisfaction. For every individual who sees reasons to move to another health unit, there are 12 who consider the opposite.

Asymmetry of satisfaction vis a vis sociodemographic and unit characteristics

The asymmetry of satisfaction was analyzed taking into account gender, age, family situation, education, employment status, experience with the health unit, and type and size of the unit. Table 2 presents the results.

Table 2 Asymmetry of satisfaction of CEISUC index of satisfaction. 

Variable n dp |t| or F p-value
Gender Women 10.641 76,5% 17,4% 5,3 < 0,001
Men 5.633 78,0% 17,2%
Age (years) 16 – 34 1.966 74,1% 17,9% 25,7 < 0,001
35 – 54 3.728 74,1% 17.9%
55 – 74 3.399 76,5% 17,9%
≥ 75 919 78,9% 17,4%
Family status Married/partnership 10.529 77,2% 17,1% 9,4 < 0,001
Single 2.719 75,4% 17,7%
Widower 1.273 78,7% 17,8%
Divorced 1.442 76,7% 17,8%
Separated 237 76,0% 17,2%
Education < basic 652 78,2% 17,7% 13,2 < 0,001
Basic 4.494 75,9% 17,9%
Secundary 3.934 75,4% 16,7%
Middle/higher 3.811 77,5% 16,7%
Professional status Activ 7.460 76,2% 17,2% 40,7 < 0,001
Retired 4.781 79,2% 17,2%
Unemployed 2.534 75,3% 18,2%
Student 612 75,7% 17,0%
Experience with health unit 1st visit 565 78,4% 18,1% 1,9 0,057
Other visits 15.289 76,9% 17,4%
Type of functional unit UCSP 1.840 72,2% 20,2% 111,3 < 0,001
USF-A 7.539 76,6% 17,8%
USF-B 7.402 78,8% 16,2%
Unit dimension (number of GP) 3 - 5 2.304 77,3% 18,0% 3,5 0,018
6 - 8 8.324 77,3% 17,3%
9 - 11 5.305 76,8% 17,1%
12 - 16 848 75,5% 19,4%

X̄ : average; sd: standard deviation; |t|: absolute value of Student’s t-test (2 alternatives); F: Fisher F value (more than 2 alternatives); p-value: significance.

As can be seen in this table, men are slightly more satisfied than women with primary care provided. Furthermore, the creation of the age groups allowed for the statement that age also has an influence on the evaluation of satisfaction, i.e. as age advances, the higher is satisfaction rating. A possible explanation may be the decrease of expectations or better attention devoted to the elderly. This difference in satisfaction is not visible between the first two age groups studied.

In relation to family status, statistically significant differences were also found, and many of these differences were influenced by gender and by age of the respondent. The education also shows some influence on satisfaction. In fact, people less educated are those who reveal best satisfaction ratings. On the other hand, it turns out that retired persons (older) are the ones that, again, have highest rates of satisfaction. Students (younger) are those who most penalize the way they were treated by primary care.

The experience with the health unit was analyzed from an item that questioned if this was his/her first contact with the unit. In the case of a negative answer, was also asked how many more times he/she had visited the unit. For 825 users this has been their first contact with this health unit. The remaining 94.8% of the respondents had visited the unit one to four more times, in the previous 12 months. Not found any statistically significant difference between these two groups.

One of the most challenging points of this study was to check whether user satisfaction is sensitive to the organization and management model of care. That is, whether we should expect that the UCSP units have the same level of satisfaction than the USF model A and the latter the same level of satisfaction than model B. Evidence showed greater satisfaction of users of USF model B vis a vis the USF model A and of these vis a vis users of UCSP.

The size of the functional units was also examined and it was clear that the scale of the health unit has some impact on user satisfaction with regard to the various levels of satisfaction, in particular when we isolate the very large units. In general, these feature statistically lower values of satisfaction than the other.

When all these determinants are analyzed, now from a multivariate perspective, the results previously presented in a univariate form are confirmed (Table 3).

Table 3 Determinants of satisfaction. 

Determinant of satisfaction b t p-value
Women -,021 -4,753 ,000
Young adult (35 to 54 years of age) -,029 -5,483 ,000
Adult (55 a 74 years of age) ,055 10,551 ,000
Elderly (75 or more years of age) ,055 11,473 ,000
Married or living in partnership ,025 5,307 ,000
Education ≤ basic -,025 -5,667 ,000
Professionally active -,026 -5,361 ,000
First visit to health unit ,004 ,785 ,432
USF model A ,124 16,015 ,000
USF model B ,214 27,499 ,000
Medium-sized unit (6 to 8 GP) -,035 -5,898 ,000
Large unit (9 to 11 GP) -,047 -7,912 ,000
Very large unit (more than 12 GP) -,016 -3,388 ,001

β: regression coefficient; p-value: significance.

In fact, we observed the lowest satisfaction among women and among young people and greater satisfaction in adults and the elderly. We noted also that the user in active professional situation, regardless of the other determinants, reveals lower satisfaction with the care provided and that, again, to be enrolled in a USF is associated with greater satisfaction. Finally, we noted that the dimension of the health unit makes a negative difference in terms of satisfaction.

Regional asymmetry

The null hypothesis of no regional asymmetry was also tested, that is, the variability of the satisfaction ratings among the units of the ACeS of the LVT Region. In general, we found large asymmetries (F = 60.2; p < 0.001), with the satisfaction among the ACeS ranging from 68.2% to 85.0.

Comparison of the results with those obtained in 2009

Finally, one of the objectives initially set for this study was the comparison, as far as possible, between the results obtained with the USF in 2009 and those found in 2015. In fact, in 2009, the 42 USF then existing in the region showed an average satisfaction of 73.3% ± 4.1%, while the same in 2015 showed an average of 78.7% ± 5.4%. This difference is statistically significant (|t|=5.99; p < 0.001).


Included users of all USF and a selected sample of the UCSP then existing in the LVT Region. For the sake of viability of comparison between USF and UCSP, were only considered eligible for selection those UCSP that were as similar as possible to the USF, that is, with at least three GPs and a percentage of users without family doctor of less than 20%.

The questionnaire used followed the conceptual model of the Europep questionnaire with four main dimensions: medical care, non-medical care, organization of care and quality of amenities. The first dimension includes the sub-dimensions ‘interpersonal component’ and ‘technical component’; the second dimension, the sub-dimensions ‘nurses’ and ‘clinical Secretariat’; and the third dimension, the sub-dimensions ‘access’ and ‘services provided’.

20,118 questionnaires were delivered to users by the Citizen Offices of the ACeS. Of these, were completed and received: 7,640 from the 69 USF model A; 7,464 from the 56 USF model B; and 1,861 from the 15 UCSP, that is, a total of 16,965 responses from 140 primary health care functional units of the LVT region. This corresponded to a general rate of responses of 89.0% from users of USF and 90.1% from users of UCSP.

Regarding the characteristics of the sample, we can state that 65.3% of the respondents were female, with an average age of 50.8 years, 35% had an educational level less than or equal to the second cycle of basic education and, to 5.2% this had been their first contact.

In what concerns satisfaction, we can say that the CEISUC satisfaction index showed an average value of 77.4% with a standard deviation of 17.4%. As with other authors, we found a satisfaction with a strongly left skewed distribution20,21. The dimensions in which users were most satisfied were those relating to the care and attention provided by doctors (81.0%), by nurses (82.5%) and by the clinical secretariat staff (76.4%). In the global, 81.2% of users would recommend the health unit to friends, especially in the USF model B (91.7%), when compared to the USF model A (86.4%) and the UCSP (75.5%). On the other hand, 89.5% of users did not see reasons to move to another unit, mainly, and again, users of the USF model B (92.4%), when compared with the USF model A (89.2%) and the UCSP (79.4%).

Women showed a slightly lower satisfaction than men (77.1% vs. 78.4%); the young people from 16 to 34 years of age also showed a satisfaction lower than elderly with 75 years of age or older (75.3% vs. 81.0%). In fact, this was an a priori expected result, given the similar results previously obtained by us and by other studies of satisfaction17,19,20,25,26. People with education lesser than the basic education showed the best satisfaction ratings (79.5%); retired people, possibly due to their age, were those who showed the highest satisfaction (80.6); a larger experience makes users increasingly satisfied, especially with the interpersonal component of medical care (first visit: 80.5%; more visits: 82.0%) and nursing care (1st visit: 81.5%; more visits: 83.3%); users of USF showed higher levels of satisfaction than those of UCSP (72.7%) and, within the USF, model B (79.5%) presented better satisfaction than model A (76.8%); the larger units are those which reveal worse levels of satisfaction, no matter the management model followed; and significant asymmetry in satisfaction was detected among the LVT Region’s ACeS.

Furthermore, based on the values of satisfaction obtained in 2009 in the USF then evaluated in the region, when levels of satisfaction are compared with the values now found, there are statistically significant increases.

Finally, by looking at the results of this study, we can see that we have achieved a very high response rate, which minimizes the risk of selection bias due to withdrawals, and hardly does change the factorial structure of the questionnaire, as well as it leads to very small confidence intervals for the results.


The main objective of this study was to determine the degree of user satisfaction, object of contracting of USF and UCSP, as provided in Ordinance No. 301/2008 of 18 April. It was also intended to perform a comparative analysis within the framework of primary health care, among health units with the same organizational model and among health units with different models.

The use of indicators of satisfaction in health governance plays an important role in the continuous improvement of quality, innovation, dissemination of best practices, and transparency and accountability/responsibility10,19. As suggested in previous works, this evaluation based on satisfaction indicators should also include other indicators in areas such as availability, access, productivity, continuity, effectiveness and efficiency for exemple27 to support the decision-making of the decision-makers involved.

In the light of the results obtained, it is considered absolutely necessary, from a perspective of continuous quality improvement, and taking into account previous studies10,19, to set a system of incentives and interventions to reward those with better results and support those with less good results, so that they improve. This approach should absolutely take into account the model under consideration (USF and UCSP) and be supported and actively pursued by the upper instances of the Ministry of Health – macro health governance – and by Regional Health Authorities and by the ACeS – meso health governance – so that effective transformations occur at the level of organizations – organizational governance.

A poor score of a health unit in consequence of the application of this classification system does not necessarily mean that we’re looking at a health unit that does not practice acceptable levels of medical care. This means only that the user experience is poor and, as a consequence, the evaluation they do is penalizing. These interventions may range from the assignment of greater autonomy and control to the highest classified units, up to financial aid and external assistance for the most poorly classified, not leaving out the clear need, taking into account the results obtained, of achieving the transition from the UCSP model to the USF model.

Patients, users and the general public have a right to have information about the performance of healthcare organizations. Each organization also needs to know its position with regard to the others, so that its successes are shared and its weaknesses identified, in such a way that they represent an opportunity and a starting point for new interventions for change.

Once again is demonstrated that the Portuguese version of Europep is a valid and easy to use instrument to obtain information about patients’ experience with the evaluation of primary health care.


1. Campbell SM, Roland MO, Buetow SA. Defining quality of care. Soc Sci Med 2000; 51(11):1611-1625. [ Links ]

2. Donabedian A. The quality of care. How can it be assessed? JAMA 1988; 260(12):1743-1748. [ Links ]

3. Grol R, Wensing M, Mainz J, Jung HP, Ferreira PL, Hearnshaw H, Hjortdahl P, Olesen F, Reis S, Ribacke M, Szecsenyi J. Patients in Europe evaluate general practice care: an international comparison. Br J Gen Pract 2000; 50(460):882-887. [ Links ]

4. Debono D, Travaglia J. Complaints and patient satisfaction: a comprehensive review of the literature. Sydney: University of New South Wales; 2009. [ Links ]

5. Ware J, Davies-Avery A, Stewart A. The Measurement and Management of Patient Satisfaction: A Review of the Literature. Santa Monica: Rand Corporation; 1977. [ Links ]

6. Barbazza E, Tello JE. A review of health governance: Definitions, dimensions and tools to govern. Health Policy 2014; 16(1):1-11. [ Links ]

7. Dodgson R, Lee K, Drager N. Global Health Governance: a Conceitual Review. London: Dept of Health & Development World Health Organization, Centre on Global Change & Health London School of Hygiene & Tropical Medicine; 2002. [ Links ]

8. Grahan J, Amos B, Plumptre T. Principles for Good Governance in the 21st Century. Ottawa: Institute on Governance; 2003. Policy Brief nº 15. [ Links ]

9. United Nations Development Programme (UNDP). Reconceitualising Governance. New York: UNDP; 1997. [ Links ]

10. Ferreira PL, Raposo V. A governação em saúde e a utilização de indicadores de satisfação. Revista Portuguesa de Clínica Geral 2006; 22:285-296. [ Links ]

11. Sakellarides C, coordenador. Conhecer os caminhos da saúde. Relatório de Primavera 2001. Lisboa: Observatório Português dos Sistemas de Saúde (OPSS); 2001. [ Links ]

12. Serapioni M, Ferreira PL, Antunes P. Participação em Saúde: Conceitos e conteúdos. Notas Económicas 2014; 40:26-40. [ Links ]

13. Pisco L. Reforma da Atenção Primária em Portugal em duplo movimento: unidades assistenciais autónomas de saúde familiar e gestão em agrupamentos de Centros de Saúde. Cien Saude Colet 2011; 16(6):2841-2852. [ Links ]

14. Ferreira PL. A voz dos doentes: satisfação com a medicina geral e familiar. In: Ferreira PL. Portugal. Instrumentos para a melhoria contínua da qualidade. Lisboa: Direcção Geral da Saúde; 1999. p. 1-57. [ Links ]

15. Grol R, Wensing M, Mainz J, Ferreira PL, Hearnshaw H, Hjortdahl P, Olesen F, Ribacke M, Spenser T, Szecsenyi, J. Patients’ priorities with respect to general practice care: an international comparison. Fam Pract 1999; 16(1):4-11. [ Links ]

16. Hearnshaw H, Wensing M, Mainz J, Grol R, Ferreira PL, Helin-Salmivaara A, Hjordahl P, Olesen F, Ribacke M, Szecsenyi J. The effects of interactions between patient characteristics on patients´ opinions of general practice in eight European countries. Primary Health Care Research and Development 2002; 3:231-237. [ Links ]

17. Ferreira PL, Luz A, Valente S, Raposo V, Godinho P, Felício ED. Determinantes da satisfação dos utentes dos cuidados primários: o caso de Lisboa e Vale do Tejo. Revista Portuguesa de Saúde Pública 2001; 2:53-61. [ Links ]

18. Ferreira PL. Avaliação dos doentes de cuidados primários. Aspetos da clínica geral mais importantes para os doentes. Revista Portuguesa de Clínica Geral 2001; 17:15-45. [ Links ]

19. Ferreira PL, Raposo V, Godinho P. A voz dos utilizadores dos centros de saúde. Lisboa: Instituto da Qualidade em Saúde; 2005. [ Links ]

20. Ferreira PL, Antunes P, Portugal S. O valor dos cuidados primários: Perspectiva dos utilizadores das USF. Lisboa: Ministério da Saúde; 2010. [ Links ]

21. Brandão AS, Giovanella L, Campos CA. Avaliação da atenção básica pela perspectiva dos usuários: adaptação do instrumento EUROPEP para grandes centros urbanos brasileiros. Cien Saude Colet 2013; 18(1):103-114. [ Links ]

22. Ferreira PL, Raposo V. Monitorização da satisfação dos utilizadores das USF e de uma amostra de UCSP. Relatório de projeto. Coimbra: Centro de Estudos e Investigação em Saúde da Universidade de Coimbra; 2015. [ Links ]

23. Roque H, Veloso A, Ferreira PL. Versão portuguesa do questionário EUROPEP: contributos para a validação psicométrica. Rev Saude Publica 2016; 50:61. [ Links ]

24. Lisboa JV, Augusto MG, Ferreira PL. Estatística aplicada à gestão. Porto: Vida Económica; 2012. [ Links ]

25. Milano M, Mola E, Collecchia G, Carlo AD, Giancane R, Visentin G, Nicolucci A. Validation of the Italian version of the EUROPEP instrument for patient evaluation of general practice care. Eur J Gen Pract 2007; 13(2):92-94. [ Links ]

26. Bjertnaes OA, Lyngstad I, Malterud K, Garratt A. The Norwegian EUROPEP questionnaire for patient evaluation of general practice: data quality, reliability and construct validity. Fam Pract 2011; 28(3):342-349. [ Links ]

27. Marshall M, Campbell S, Hacker J, Roland M, editors. Quality indicators for general practice: a practical guide for health professionals and managers. London: Royal Society of Medicine Press Ltd; 2002. [ Links ]

Received: November 15, 2016; Revised: December 05, 2016; Accepted: December 07, 2016


PL Ferreira, VM Raposo and L Pisco participated equally in all stages of preparation of the article.

Creative Commons License  This is an Open Access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.