Impact evaluation for University-Business Cooperation and Technology Transfer in higher education systems : cluster analysis

Higher education systems evolved in recent decades. Universities must not only provide society with capable professionals but also act in the market for technologies, knowledge, and ideas to promote technological development. This paper discusses the motivational performance evaluation system for technology transfer process, specifically the patterns’ evaluation of academic units considering micro-cultures and idiosyncrasies’ analysis, in the academic context of autonomy. Based on action research, the existing performance evaluation system was assessed, and multivariate cluster analysis was proposed and tested as a method to enable micro cultures’ identification and evaluation. The analysis proposed enabled a tool for reflexive discussion regarding the effectiveness of the institutional innovation system in academic units and Engineering Education, and its implications for social and technological development of industry and society enabled action proposals for improvement in the university’s technology transfer management process.


Introduction
Higher education systems have evolved in the last decades.Universities not only provide society with qualified professionals but must also play a role in the market for technology, knowledge, and ideas to promote technological development.Technology transfer (TT) from universities comprises the main mechanism for regional development.Practical action such as regulations and legislation is observed in several countries, in so-called Bayh-Dole-like acts (Argyres & Liebeskind, 1998;Etzkowitz & Leydesdorff, 2000;Grimaldi et al., 2011;Nārāyaṇan & O'Connor, 2010;Niosi, 1999;Shane, 2004;Wright et al., 2004).
The TT public policy perspective has been largely discussed (Bozeman, 2000).Contemporary public management view considers all stakeholders, researchers, managers, and employees as active agents, with a role in social and technological development (Wieczorek & Hekkert, 2012).Effective technological development will not occur unless research institutions and its administrative and academic units have been structured for effective TT.
The TT process and its complexity must be understood and monitored aiming adaptation to technology related dynamic environments.Although largely used (Bubela & Caulfield, 2010), performance assessment (PA) based purely on the amount of generated patents, spin-offs, and TT projects is limited (Agrawal & Henderson, 2002).They are macro and aggregated indicators, and, although they enable comparison between institutions, are not effective to reveal researchers' interaction with industry and its impact on research output (Perkmann & Walsh, 2009).This work discusses data analysis methods for monitoring the technology transfer (TT) process, rescuing decision theories and performance management systems (PMS), related the discussion to evaluate the applicability of multivariate methods (specifically cluster analysis).

Literature
This work is based on PMS and strategic decision, contextualized in the TT and Institutional Innovation systems.These topics are discussed shortly as follows.
PMS are used to enable companies and organizations to learn, evolve and grow.However, new organizational forms, which involve a network and virtual connections, co-development, open innovation (OI), corporate or academic spin-offs, joint-venture, present less routinized or foreseeable processes and systems, as R&D processes.Traditional managerial models and PMS are not well-suited for this context (Chiesa & Frattini, 2009;Kerssens-van Drongelen & Cook, 1997;Lehtinen & Ahola, 2010;Phusavat et al., 2009;Pillai et al., 2002).
The literature argues that especially in a context where the staff presents freedom to translate organizational inputs into output, organizational performance evaluation must not only count on the basis of programs' outcomes but also on the adequacy level of management structures (Selden & Sowa, 2004).Academic discussions since 2000 improve the comprehension of the PMS development process as a cognitive process (Taticchi et al., 2010), comprising not just controlling process, but also learning, decision making, and motivation processes (Kerssens-van Drongelen & Cook, 1997).
These discussions focus on the effectiveness of the existing motivational mechanisms, considering organizational and decision theories.The complex processes related PMS comprise strategic decisions, defined as a wicked problem.Decision process design view enables the flexibility needed for an evolving system and considers the organizational bounded rationality (behavioral theory for organizations and decisions), human behavior, memory, experience, group related issues, incentives, authority, organizational influence, and identity.In this context, the decision is based on collection and consolidation of individuals' perception.The genuine decision for wicked problems comprises new knowledge discovery.Several information sources, both qualitative and quantitative data, are required.No optimal solution is possible, and reality representation models and visualization tools enable discussions and the search for a satisfactory solution (Ackermann & Eden, 2010;Ackoff, 1979Ackoff, , 1981;;Byström & Järvelin, 1995;Checkland, 2000;Keller & Tergan, 2005;Lurie & Mason, 2007;Mintzberg & Lampel, 1999;Pidd, 2008Pidd, , 2010;;Power, 2008;Simon, 1979Simon, , 1997;;Tergan et al., 2006).
In the practical domain, some considerations regard evidence collection and use for evidence-based PM and managerial learning (Rousseau, 2006).In complex processes and phenomena, univariate controls become useless.The use of available data collection and multivariate methods for data analysis and knowledge discovery is discussed as an interesting tool for organizational intelligence for strategical definitions and business development (Adams et al., 2000;Meisel & Mattfeld, 2010;O'Keefe & Preece, 1996).

Motivation and performance in Technology transfer
Motivation drivers influence the occurrence of different TT mechanisms in the University.Although the beneficial feedback loops between technology commercialization and scientific research performance are discussed, this is not a consensus.The literature warns about entrepreneurial university promotion intended undifferentiated public policy definitions, because putting a high value on IP protection, technology commercialization, and goals focused on income maximizing, can demote learning promotion objectives.The IP licensing cases are usually modest, and there is evidence that collaborative R&D projects with industries are more consistent with both scientific and technology development and commercialization.The human behavior comprises different motivational issues, such as reputation, monetary profit, the possibility of acquisition of additional research funds, learning from industry, access to in-kind resources (Agrawal & Henderson, 2002;D'Este & Perkmann, 2011).

The context
Brazilian universities, as other universities from other countries, have multiple and imprecise objectives.Although research is one of the objectives, no staff members are hired exclusively as a researcher.They are hired as tenured professors (Leitão, 1987) to conduct teaching activities in a specific academic unit, which is a formal and permanent subdivision of the studied University.The professionals' autonomous engagement in multiple academic units, participating in multidisciplinary centers or graduate programs, is essentially a concession from their original academic unit.Furthermore, they are free to decide (i) if they engage in research, (ii) in which research lines to invest, (iii) if this research is conducted with or without interaction with the productive sector, (iv) if the resulting intellectual property will be protected.
In the last decades, universities' management and performance management discussions inducted more consistent strategic planning tools (Segenreich, 2005).Although it has still to improve, it shows a more proactive view of modern public management (Azevedo, 1992;Fortis, 2010;Hood, 1995;Matus, 2006).But, actually, undergraduate courses are evaluated, not universities (Barreyro & Rothen, 2008).Technology generation is complementary data in this evaluation, and commercialization is not specifically evaluated.As in other countries, TT metrics for universities and research institutes comprise filed patents amount.

Case for Analysis
The study was applied to a traditional Brazilian public University with relevant research history.The university presented 2081 hired professors, 322 registered patents and an average of 509 contracts per year in the last years.The Institutional Development Plan (PDI) led each academic unit and managerial department to develop their own indicators.Usually, managerial departments (including TTO) report their own activities and results, although some global results are also included.The indicators for whole system output, when existent, are just informative.These global indicators do not deliver actions for improvement because they are established for each department, not for a process, and usually, the original department does not have the power to impose actions for other organisms and academic units.
In Brazil, usually discussions regarding university improvements and evaluation mention university autonomy (Barreyro & Rothen, 2008;Leitão, 1987;Zainko, 2008).It is a consensus that professors value autonomy and dislike bureaucratic authority (Leitão, 1987).The TT is not a compulsory activity, and there are researchers that even consider it inappropriate.
We included patent generation in the PMS as a type of output-based quality measure for research, enabling comparison between institutions by public agencies.But in the broader context of TT and commercialization, it is just an intermediate, not revealing how researchers interact with industry and its impact on research output (Perkmann & Walsh, 2009).The real performance and outcome of this process would be observable only in the long term, with regional or national technological development, which is difficult to evaluate.
The financial perspective is very hard to measure in the complex and variable system comprising the University.Because of process complexity and variability, it is not possible to define a plausible efficiency measure.Although the described scenario indicates that it is yet in a state of transition and the University has much to learn and innovate in its processes and systems, this innovativeness and learning is not specifically measured.The evaluation of federal university's courses inspires learning by self-evaluation, but the organizational learning processes are not effectively measured.
Regarding the PMS system classification, the patent and publication amount focus aims goal alignment and communication, which characterizes soft objectives (Chiesa & Frattini, 2009).The opportunity to earn royalties through technology licensing may be analyzed as a kind of reward, what would comprise a hard objective.However, licensing is not so common and not granted for all registered IP.Hence, a direct monetary reward is practically absent, but this also comprises one of the criteria for career progression, that could be characterized as a hard objective of PMS.
Registered IP amount represents object control based on output because it is quantitatively measurable.Regarding control type, this measure has the objective of feedback control, aiming to explore the real performance measures and objectives comparison (Kerssens-van Drongelen & Bilderbeek, 1999), using bibliometrics and IP register data.However, as previously mentioned, considering the context of TT only as an intermediate for the regional and national technological development process, they are not the real PA.

Definition of PMS goals and configuration
The main premises and observations and considered implementation issues are presented in the Table 1.The diagnosis showed the loss of systemic view, a classic problem in large and complex organizations (Burbidge, 1995;Voss, 2005).Although the PDI was elaborated deploying organizational objectives, the absence of the systematic, process or value chain view does not enable a full use of the potential of established PMS, specifically, to enable feedback for process improvement.

Premise and/or observation implementation issue
Incipiency and low managerial maturity Need for flexibility in the system and learning objective -knowledge discovery Complexity and uncertainty of the innovation system, its scattered and intangible nature, Absence of authority to charge people, as they consider themselves autonomous and the TT engagement an elective activity PMS with a motivational objective The absence of effectively institutionalized control system regarding TT engagement Difference between departments and academic units because their knowledge domain and related industry issues Measurement objective-identification of microcultures or idiosyncrasies, and their impacts on the process Observation: focus on subgroups comprised by academic units of the institution, because decision making usually occurs in this level

Monitoring unit-subgroups comprised by academic units of the institution
The motivational objective is adequate for the analyzed context, as PMS can provide diagnosis and further discussions for improvement.The monitoring unit comprises the subgroups comprised by academic units, because decision making usually occurs at this level.The measurement objective comprises the identification of microcultures or idiosyncrasies and their impacts on the process.The proposition was applied in the case's originated data, in the following.

Data treatment and mining on TTO available data
The data covered 1032 knowledge transfer university-company interaction projects (contracts) and 121 patents' registration processed by the TTO from January 2009 to October 2012.The database considered only cooperative projects with some kind of technological transfer.The data were treated to obtain evaluation indexes considering the performance constructs presented in the Table 2.
The cluster analysis was considered adequate, considering the micro-cultures and idiosyncrasies identification premise.The variation of academic units in size and number of researchers were accounted by relativizing the variables to enable comparison.For multivariate cluster analysis application, care was taken to assure a similar amount of variables for every conjoint, aiming to avoid dominance of one theme in the clusters establishment.The set of variables (described in Appendix A) presents an apparent redundancy because the complementarities needed for construct assessment.
The variables also estimate the effectiveness in patents generated related to a number of project categories, and the involvement of productive and public sectors.A refinement comprised by commercialization potential of patents is also presented, as related to joint ownership with the productive sector indicative of the likelihood of alignment with market needs, or multidisciplinarity represented by patents registered with the involvement of at least one other academic unit.
Cluster analysis was conducted using Ward method and squared Euclidian distance as a similarity measure.Considering the difference regarding a number of projects and registered patents of the academic units, all variables were defined as percentages, and also standardized by Z-score, to enable comparability of the variables.Figure 1 presents the dendrogram with the clustering pattern of academic units.Table 3 describes the obtained clusters.The description is based on the significant indexes defined by Kruskal-Wallis independent test in the appendix section (with descriptive graphs).Comparison of clusters description, the grouping pattern discussion, and other complementary data or information enabled the knowledge discovery.They were useful for managerial considerations, comprising some hypothesis for further investigation regarding current managerial practices and public policies.Table 4 presents the main observations described in following.

Cluster Description
Knowledge transfer by teaching activities cluster (C1) The lacks patent registration and interaction culture with public or productive sectors.
Multidisciplinary cluster (C2) Some generation of patents, with emphasis to multidisciplinary patents.high generation of patents (C3) Stands out in R&D projects and patent generation Extension cluster (C4) High knowledge transfer, but with an inexpressive number of registered patents; Knowledge transfer projects are focused on teaching and extension (significantly lower occurrence of R&D projects) and present insignificant interaction with the public and productive sectors influenced by the public sector (C5) emphasis on R&D projects, and apparently has significant influence of the public sector to establish these projects

Unidimensional and transformed dimensions analyses
Although unidimensional and multidimensional evaluations proved to be useful, because of the complexity dealing potential, the useful indexes were the already transformed ones, derived from at least two original indexes.They are described in following as "Partnership profile & Project engagement pattern" and "TT System Effectiveness, Quality and Impact evaluation".
Partnership profile construct, defined as an inclination to interact with productive and public sectors, was evaluated considering the P.ProdPublProj (projects with involvement of both public and productive sector) and P.ProdProj (projects with productive sector involvement only) indexes, but a new index derived from both was more elucidative.
Cluster 3 also presents the high influence of public sector, although not clearly evidenced by other indexes.This new evaluated simultaneous involvement of public and productive sector in the projects, to enable evaluation of the influence of public sector to promote interaction of the university with the productive sector.Clusters 3 and 4 present high public influence in stimulating TT projects with productive sector.Main managerial, strategic and public policy implications comprise the need for long-term strategies and actions to promote the evolution of the TT process in academic units for a more autonomous partnership, that occur without public incentive.
The institutional innovation system effectiveness construct was also better described one-dimensional by other derived indexes: (i) the amount of registered patents/Amount of R&D Project (Patent_RDproj); (ii) patents, including multidisciplinary patents, with joint ownership with the productive sector/ amount of patents (P.JOPatent); and (iii) Amount of patents registered with involvement of at least one other academic unit (P.MDiscPatent).They evaluated results and innovation system output, quantifying patent generation, and enabled estimating its quality advocated by the current innovation system.One of them, the patent/R&D project (Patent_RDProj) ratio bigger than one (1) called the attention and is presented in Figure 3.
This figure uses the academic units' global data (total patent amount/total R&D project involving knowledge transfer).Patents could be generated by R&D projects without interaction with the external community (as purely academic thesis, dissertations, and undergraduate courses).Hence, this index was very useful to estimate the patents that are purely academic research projects that do not present knowledge transfer to the productive sector or public institutions.
One researcher affirmed, regarding the patenting initiatives: "there are people that register intellectual property because they obtain points (for career progression): they are not real innovations, nor present commercial potential".This is a testimonial about an undesired and opportunistic reaction to the established indicators.Literature refers to the creation of both beneficial and deleterious informal mechanisms as an answer to established indicators and legal dispositions (such as the Bayh-Dole Act).The reasons were not mentioned, but considering the literature, it can have two mechanisms: the engagement of inexperienced academics in patenting results with no commercial value and decline of patent quality even for experienced academics (Czarnitzki, Hussinger, & Schneider, 2011;Grimpe & Fier, 2009).An in-depth analysis showed that undergraduate discipline related patents were present in the database.This reinforces the need for several actions such as conduction of "competitive intelligence studies" preconized by recently updated Brazilian innovation law (Marco legal da Inovação) (Brasil, 2016).
The indexes considering joint ownership with the productive sector (JOPatent_ProjProdS) and multidisciplinarity represented by patents registered with the involvement of at least one other academic unit (P.MDiscPatent) was elucidative as indicative of the likelihood of alignment with market needs and patents' commercialization potential.The measures enabled identification of clusters that require attention and investigation regarding the patents without market relevance (Clusters 3 and 4).Patents with joint ownership with the productive sector, especially when maintained by the company, demonstrate the real applicability and effective knowledge and TT.The associated analysis of indexes enabled the identification of a hypothesis regarding the existence of informal mechanisms developed as an answer to established indicators, including deleterious ones, usually unexpected by the national innovation system when laws to promote innovation and technological interaction between universities and the productive sector were defined.

Evaluation of microculture and idiosyncrasies
The microculture and idiosyncrasies were evaluated by multidimensional evaluation, considering cluster composition and comparison.
In the Knowledge transfer by teaching activities cluster (C1), low patent generation and interaction with the productive sector of both Food Science and Technology Institute and Veterinary Medicine was intriguing because of their applied nature, and also because they are related to regionally outstanding productive areas (food and agribusiness sector).The patent data (World Intellectual Property Organization, 2013) shows that related global industry demands new technological knowledge in a global context.This observation claims for the following discussions: (i) these productive sectors are not demanding new technological knowledge in this country, or (ii) the academic units are less inclined to interact with the productive sector.TTO officers affirm that the Food Science and Technology Institute has been very active in the past when the unit's business incubator was still active.The involvement of undergraduate students in incubated companies and a culture of interaction with companies were observed.
The multidisciplinary nature of these two knowledge areas (food and veterinary) would be expected.For example, the Veterinary unit has no registered intellectual property, although the Biotechnology department (Life Sciences unit) has registered related intellectual property.Hence, the promotion of interaction between Veterinary, Food Science and Technology, and Biotechnology units would be desired, because new technologies related to veterinary knowledge may originate using biotechnology.TTO officers perceive that companies usually guide multidisciplinary projects; thus, it seldom occurs by the initiative of academic units.The general perception is that research groups are closed, preferring to work autonomously rather than interacting with other units.The TTO officers, on various occasions, suggested researchers that they interact with other units to complement their knowledge to better develop the technology.Normally, the perception is that researchers are little receptive to this idea, or have difficulties in establishing this kind of partnership.Due to this aversion to interaction, these researchers end up wasting considerably more time and resources than if they counted on the partnership of another researcher in a related knowledge area, who could more rapidly propose a solution to the problem.
Multidisciplinarity cluster (C2) members present some generation of patents, with emphasis to multidisciplinary patents.The patent generation amount of academic units appears to follow the national tendency.This cluster distinguishes itself from the others by its multi-or interdisciplinary behavior, which is related to improved chances of commercial applicability.
C3 cluster (high generation of patents) stands out in R&D projects and patent generation.The amount of conjoint ownership patent generation with productive sector of the Engineering Academic Unit (11% of registered patents) is lower than the other members of the cluster (Life Sciences 29%; Pharmacy 43%; Chemistry 44%).This observation is important, especially if we consider that there are less pharmaceutical and biotech companies in Brazil than engineering companies.And also is accepted that research in engineering may be more directly applicable to firms than is the case in other disciplines (Bourelos et al., 2012).
It is possible to enquiry the occurrence of at least one of the following reasons: (i) the low applicability of conducted R&D projects; (ii) the low interest of local industry for technological innovation; (iii) or low conscience of local industries about university as a source of knowledge or technology (OI practices and market for know-how and technology absence or incipiency).
These cluster members present high interaction with the productive sector, but apparently by the influence of the public sector inducing interaction with the productive sector: interaction with the productive sector is low where public sector involvement is absent.Long-term policies and strategies must deal with the evolution for a more autonomous relation, which may occur even when the public incentive is absent.
Another discussion regards lower multidisciplinarity (although higher when considering joint ownership with the productive sector), which calls attention to the possible existence of a sense of self-sufficiency, because of the multidisciplinary, applied nature of their discipline.
The Extension cluster (C4) presents high knowledge transfer, but with an inexpressive number of registered patents.The applied nature of knowledge produced by Dentistry course would be expected to generate research fields useful for the development of dental products.Its extension activities essentially comprise providing services to the community, using established techniques.This faculty has a strong patient-focused vision, which could be also useful in developing applied products, even when they are not very innovative in terms of technology.Such developments could be patented.However, the importance of interacting with other fields of knowledge, as chemistry and engineering, in multidisciplinary projects is highlighted.
The cluster influenced by the public sector (C5) presents an emphasis on R&D projects and apparently has a significant influence of the public sector to establish these projects.Public sector influence is occurring in two ways: (i) specific public departments, such as Sanitation and Energy demand specific knowledge from the university, and (ii) public institutions (or public companies) demand projects that require joint activity with a company from the productive sector.The latter do not include interaction with or promoted by government funding agencies (funding calls).These units have had a significant number of cooperation projects with public departments, although the demanded knowledge, by international scientific standards, is not absolutely state-of-the-art, but necessary for regional technological development.
The low patent generation of some members of this cluster indicates low innovativeness, or a low tendency to protect IP, even with high innovativeness.Specifically, more significant patent registration was expected by the Informatics Institute, because the following related technology categories present significant patent registration in countries as United States, Japan and China: Digital Communication (2 nd in China), Computer technology (3 rd in China, and 4 th in India and Japan), Semiconductors (5 th in Japan), IT methods for management (9 th in India), for example.The Hydraulic Research Institute's closest related technologies are Environmental Technology and Civil Engineering.The former does not present a significant amount of patent registration in Brazil, but the latter is 8 th in patent registration.

Limitations and requirements for PMS improvement
Regarding data used to conduct the analysis, it comprised unstructured TTO databases, and, hence, the analysis reflects these restrictions.Because of the unavailability of data regarding the amount of faculty actually acting as researchers, several indexes were relativized.The following variables are desirable for improved analysis: (i) faculty research engagement rate; (ii) researcher's productivity per academic unit, (iii) spin-off generation.The range of time for each must be defined for monitoring.Other limitations of the study include the infeasibility to analyze direct causal relationships between each project and patents because there was no structured database connecting projects with generated patents.These connections exist, but will always be incomplete, because projects usually generate results at their end, and patents may be registered after a period of time.
The employed method does not evaluate the influence of modifications of behaviors and research related decisions on time, that deliberate modification in cluster formation.Each analysis will be independent of the previous one.Other methods may be explored to enable easy detection of change.
Another limitation is the use of secondary and formal data (TTO records).The analyzed process and system present complexity beyond formal, contractual, and patent filing data.Unfortunately, regardless the potentiality of a multivariate approach to depicting cultural elements, the data do not enable the consideration of factors as leadership and other intangible values and partners' localization, for example.Previous studies mention the relevance of geographical location (De Fuentes & Dutrénit, 2016), corporate value (Ab Hamid, 2015), and other possible links with industrial partners (such as informal and human resource links) (Vedovello, 1997).Etzkowitz (1998) also indicates the influence of interaction modes in the way researchers interpret their role (and science's role), and hence, direct their actions and contributions.Future studies may use other data sources to complement the analysis.For example, coauthorship in bibliographical publications, social media data (Research Gate, Linked In or even Facebook, for example), opinions, and sentiment analysis could enable more informative data to deal with the complexity of the process.Some may argue that using academic departments as analysis units for TT culture evaluation may have undesired effects, as the avoidance of highly innovative multidisciplinary collaboration.However, faculty hiring processes in Brazilian public universities are based on academic departments, with low mobility, as these are permanent, and research groups and labs function as temporary aggregating units with a common objective.The multidisciplinary-related indexes were considered relevant for analysis and appear to be effective.

Final considerations
This paper discusses improvement in TT process management while referring to process monitoring.In spite of regulations created to clarify the role of universities in national technological development and innovation, there are several pieces of evidence of outdated practices, behaviors, and values.Moreover, direct strategy deployment is not viable in the analyzed context, while management may act mainly as a motivator of engagement practices, without authority to compel faculty members.
Notwithstanding methodological limitations, joining quantitative analysis with the perception of TTO officers complemented by external data consideration was useful to gain in-depth knowledge about the process and to identify micro cultures.Informal TT mechanisms are not analyzable using data (or variables) available in common databases.Although efforts to integrate this information are important, to formalize all kinds of TT mechanisms is not necessarily effective.Perceptions of faculty members and TTO staff must be used to complement formal data, incorporating more complex and human interactive analysis procedures, to define specific policies and actions to obtain effective decision making.This paper describes cluster analysis as a tool to structure the monitoring system.Although individual indexes enabled the analysis of project engagement patterns, similarity patterns between academic units (clustering and its composition analysis) and comparison between the adequacy of patent generation rate, and TT project engagement patterns have shown a more elucidative method.Considering that companies' participation is essential for the development of market-directed projects, the results enabled discussions about the adequacy of both university and companies' culture from specific local, regional, and national industries.
In some knowledge areas, interaction seems to be mainly induced by the public sector (mainly public funding).The creation of proactive mechanisms seems to be necessary to stimulate interaction culture between academic units and the productive sector, evolving from public funding oriented UI interaction to more refined partnerships.
A hypothesis regarding the existence of informal and deleterious mechanisms, developed as an answer to established indicators, was generated.Managers may question the advantage of investing in registration or maintenance of IP (patents) that do not result from interaction with the productive sector, without at least conducting IP related competitive intelligence studies, due to a lower probability of market alignment.
The literature argues that IP management should be different according to the product life cycle stage.In some stages, more openness is needed, whereas, in others, IP protection plays a major role.Considering this, literature starts to show that Bay-Dole Act-like laws stimuli of patenting activities in universities may hinder the dissemination of useful basic research related knowledge.To create IP markets and to effectively promote Open Innovation philosophy, universities should not advocate the exacerbated IP protection philosophy associated with the traditional approach of capturing value by the right to exclude other parties.However, a clear understanding of some level of "openness" must be disseminated to effectively facilitate knowledge sharing among stakeholders.
Universities must also consider the risk of patent trolls as side effects of IP markets (Carraz et al., 2014).With the local efficiency view and goal in rising indicators, the real effectiveness in a global sense is absent.The following discussions are needed: Are the licensing partners adequate?Is the exacerbated IP protection philosophy beneficial for local and national industry (especially because this protection occurs at the national level, usually not in other countries)?
Universities and research institutes must implement monitoring systems to enable diagnosis and discussion of prevailing micro-cultures, adjusting institutional and cultural elements.As the obtained clusters are time restricted, their evolution would allow for cultural variation monitoring discussions.During the implementation of the monitoring system, exploring other data mining approaches may be considered with greater potential to elucidate the phenomena.Other multivariate methods, such as factorial analysis and structural equation analysis, may also be useful to evaluate the influence and dependency of factors, for example.
Our analysis proposed a tool for conducting a reflexive discussion about Higher Education, considering the effectiveness of the institutional innovation system in academic units, and its implications for the social and technological development of industry and society.

Figure 1 .
Figure 1.Dendrogram with clusters of academic units, using Ward Linkage.

C2 profile x
Expected profile: generation of patents, with emphasis to multidisciplinary patents Patent registration data -in Brazil Apparently a benchmark group in the institution Premise of Relevance of Multidisciplinarity for TT efficiency Composition of C1 & Comparison of C1 and C2 profiles: expected to be included in the cluster 2: Food Science and Technology and Veterinary Medicine -low patent generation Patent registration data -new technologies are developed in this knowledge area in a global context These productive sectors are not demanding new technological knowledge?or the academic units are less inclined to interact with the productive sector? TTOs experience and perception regarding local reality Insufficient multidisciplinarity -especially with biotechnology department C3 profile analysis & Comparison with expected profile: Lifesciences, engineering, physics, chemistry, and pharmacy -high patent generation National Patent registration data -Pharmaceuticals, Organic Fine Chemistry and Basic Materials Chemistry are the most significant technology areas Patent registering stimuli is making results C3 profile analysis x expected profile: Lower amount of conjoint patent ownership with productive sector of the Engineering; R&D projects with community are slightly lower than C5 Bourelos et al. (2012) -research in engineering more directly applicable to firms than is the case in other disciplines; less pharmaceutical and biotech companies in Brazil than engineering companies Low applicability of conducted R&D projects?low interest of local industry for technological innovation? or low conscience of local industries about the university as a source of knowledge or technology?C3 profile, Isolated P.ProdPublProj: P.ProdProj ratio graph (Figure 2): interaction with the productive sector is low if the public sector is absent.Public policy is acting to stimulate TT process.The long-term policies and strategies must deal about the evolution of a relation more autonomous, that occur even without public incentive Composition of C3 & Comparison of C3 and C2 profiles: It was expected a more multidisciplinary behavior the following academic units The applied nature of the Engineering and Pharmacy academic units are inducing a sense of self-efficiency?C4 profile and composition x expected profile: Dentistry -inexpressive number of registered patents; extension activities to provide services to the community applied nature of knowledge produced by Dentistry course would be expected to generate research fields useful for development of dental products that could be patented Lower culture for technological transference, with emphasis on extension activities to deliver established techniques for the community.Claims for managerial attention.C5 composition and profile x Expected patent generation amount: low patent generation of informatics and Hydraulic Research Institute Patent registration data -higher patent registration Digital Communication, Computer technology, Semiconductors, IT Methods for management); Civil Engineering Low tendency to protect IP, even with high innovativeness?Or Low innovativeness?C5 composition and profile x expected profile Isolated P.ProdPublProj: P.ProdProj ratio graph (Figure 2): interaction with the productive sector is low if the public sector is absent.Project short description (public departments, such as Sanitation and Energy, and public institutions are main partners) Public policy is acting to stimulate TT process.The long-term policies and strategies must deal about the evolution of a relation more autonomous, that occur even without public incentive C1 -Knowledge transfer by teaching activities cluster; C2 -multidisciplinary cluster; C3 -high generation of patents cluster; C4 -Extension cluster; C5 -cluster influenced by public sector.Production, 27(spe), e20162203, 2017 | DOI: 10.1590/0103-6513.2203167/15

Figure 2 .
Figure 2. Influence of public sector in stimulating interaction with productive sector.

Figure 3 .
Figure 3. Analysis of the ratio of registered patents X registered research and development projects.

Table 1 .
Premise, observations, and defined PMS implementation issues.

Table 4 .
Main observations and knowledge discovered.