Abstract:
Abstract
Purpose
This paper aims to analyze how decision support systems manage Big data to obtain value.
Design/methodology/approach
A systematic literature review was performed with screening and analysis of 72 articles published between 2012 and 2019.
Findings
The findings reveal that techniques of big data analytics, machine learning algorithms and technologies predominantly related to computer science and cloud computing are used on decision support systems. Another finding was that the main areas that these techniques and technologies are been applied are logistic, traffic, health, business and market. This article also allows authors to understand the relationship in which descriptive, predictive and prescriptive analyses are used according to an inverse relationship of complexity in data analysis and the need for human decision-making.
Originality/value
As it is an emerging theme, this study seeks to present an overview of the techniques and technologies that are being discussed in the literature to solve problems in their respective areas, as a form of theoretical contribution. The authors also understand that there is a practical contribution to the maturity of the discussion and with reflections even presented as suggestions for future research, such as the ethical discussion. This study’s descriptive classification can also serve as a guide for new researchers who seek to understand the research involving decision support systems and big data to gain value in our society.
Keywords: · Decision support systems · Big data · Machine learning · Analytics · Cloud computing · Algorithm.
1. Introduction
While Big Data can be used as a powerful tool to treat various social diseases, offering the potential for new insights into areas such as medical research, counterterrorism and climate change, its use also allows invasions of privacy, diminished civil liberties and increased state and corporate control (Boyd & Crawford, 2012). There is a big challenge in managing Big data due to the increasing and cheap volume of data storage (Demirkan & Delen, 2013).
Most data sets from which scientists and researchers have been able to extract real meaning are still very small compared to the proportion of data that can be captured (Dobre & Xhafa, 2014). Big data analysis should include the phases of data generation, acquisition, storage and analysis and can provide useful values at each stage through judgments, suggestions, support or decisions (Chen, Mao & Liu, 2014a). Some authors point out that advances in analytical techniques, especially machine learning, have been a major facilitator for dealing with large data set analysis (Murdoch & Detsky, 2013).
Big data are defined as a large set of data that are difficult to store, process analyze and understand using traditional database processing tools (Huang & Chaovalitwongse, 2015), Big data emerge as a paradigm shift in how organizations make decisions (Mortenson, Doherty & Robinson, 2015). Therefore, through decision support systems (DSS), it is possible to process large volumes of data using output models with accessible interfaces (Constantiou & Kallinikos, 2014). Research in big data and DSS has presented technological aspects and big data design challenges as the main focus (Chen, Mao, Zhang & Leung, 2014b).
We, therefore, have the opportunity to propose an in-depth analysis of how DSS manages big data to obtain value. In this context, we performed a systematic literature review (SLR) of the use of big data in DSS. To achieve this goal, we propose to answer two questions: DSS manages big data to obtain value which techniques and technologies? And, DSS has been applied to solve what types of problems? To answer the research questions, we conducted an SLR with research in the academic databases Scopus and Web of Science (WoS), in August 2019.
As a contribution of our study, we show that DSS is used for the management of big data mainly through techniques such as big data analytics (BDA), machine learning algorithms and technologies such as cloud computing. The main areas in which these techniques and technologies are applied are logistics, traffic, health, organization and market.
This article is structured as follows: In addition to this Introduction section, we present in Section 2 the methodological procedures applied in the research, the results are presented in Section 3, discussions in Section 4 and in Section 5, we present the conclusion of our study.
2. Methodology
We performed the SLR based on the guidelines suggested by Petticrew & Roberts (2006) to understand the use of big data in DSS. We have chosen to develop an SLR because of the rigor of the research methodology that involves systematic data collection procedures, descriptive and qualitative data analysis techniques.
2.1 Data collection
First, we start with the identification phase with the application of a search string, initially based on preliminary searches. Then, we apply the string to the database search tools in order to identify other ways in which the searched terms are referenced (Petticrew & Roberts, 2006). Thus, after a few rounds of searching, new terms were identified and added to the initial string to obtain a corpus of analysis. Therefore, the first stage of the SLR consisted of searching the Scopus and WoS databases, using the following Boolean terms: “Big Data” AND (“Decision Theory” or “decision support system*” or “decision-support system*”). The use of the asterisk (*) in the search string serves to obtain variations of words in their plural form.
The second stage of the SLR had as criteria the filter by areas. The Scopus database was restricted to the following areas: business, management and accounting; decision sciences; social sciences. The WoS base was restricted to the following areas: business, management and social science interdisciplinary.
The third stage of the SLR consisted of filtering the databases keeping only articles, thereby excluding books, reviews, etc. The fourth step of SRL consisted of checking the availability of downloadable articles. The fifth stage of the SLR was reading the articles and checking their alignment with the research objective; articles without objective strongly dealing with the subject were considered inappropriate for the analysis, and therefore, they were excluded from the sample. The sixth stage of the SLR consisted of identifying repeated articles and consequently reducing duplication. Finally, the seventh stage of SLR was the consolidation of the two bases for an in-depth analysis of the articles. The exclusion flow of articles is presented in Table 1.
The initial search totaled 1,427 documents contained in both databases, and at the end of the seven steps, 5% of the sample, 72 articles, were considered adequate for full reading and analysis.
2.2 Data analysis
We performed the SLR of the 72 selected articles, of which 63 were empirical and 9 were theoretical. The articles were read in full and classified in a spreadsheet according to relationships identified throughout the analysis and that met the research questions. We note that the first record refers to the year 2012, and until 2018, there is a growth in the number of publications. The year 2019 had eight publications, but due to the date of the search in the databases, it was not possible to account for the total number of publications in the year (Table 2).
Regarding the analysis process, after selecting and collecting the database, the researchers started categorizing the contents from a qualitative perspective (Petticrew & Roberts, 2008). A recursive process was applied based on reflective critical reading and classification of the content according to its adherence to the themes proposed in this research. The process of an SLR must allow its transparency and replicability as pointed out by Tranfield, Denyer & Smart (2003). The following are the results of this study and their respective analyzes.
3. Results
To answer the first research question, we classified the articles into two groups: The first group deals with techniques, and the second group with technologies. There is a wide variety of techniques and technologies for capturing, selecting, analyzing and visualizing big data, and these tools focus on three classes: batch processing, flow processing and interactive analysis tools (Chen & Zhang, 2014).
3.1 Techniques applied in big data
The items presented here are related to the application of data analysis techniques to obtain value from big data.
3.1.1 Machine learning technique with supervised learning algorithm
Classification algorithms from this group were used, for example, as a management tool for the creation of a DSS that enabled credit risk assessment in the financial market (Hayashi, 2016), for building modernization assessment allowing the decision-maker to select the best alternatives in terms of energy consumption and installation cost (Rasiulis, Ustinovichius, Vilutiene & Popov, 2016), to deal with business data heterogeneity and multidimensionality (Nimmagadda, Reiners & Wood, 2018). We also found application in route optimization models through DSS to view traffic volume and weather interactions applicable to transport planners, traffic control rooms and urban infrastructure DSS (Sathiaraj, Punkasem, Wang & Seedah, 2018) and through an online route generation system with Dijkstra algorithm, which resulted in changes of route paradigms that were determined together (Rönnqvist, Svenson, Flisberg & Jö). Finally, we found an application for the purpose of identifying and predicting social issues through online news analytics (Suh, 2019).
Other findings were with vector machine for decision-making optimization through patient similarity (Tashkandi, Wiese & Wiese, 2018) and in optimizing data collection for cancer classification and online critic sentiments (Ghaddar & Naoum-Sawaya, 2018), the fuzzy rule to determine the health status of cattle to predict nutritional intake (Sivamani, Choi & Cho, 2018), Mehrabian–Russell model for forecasting consumer purchases using climate parameters (Tian, Zhang & Zhang, 2018), the use of a set of attribute reduction and data set analysis in information systems (Li, Yang, Jin & Guo, 2017) and rapid safety feedback used to identify child maltreatment (Gillingham, 2019a).
We have identified that techniques applied in the above studies were for predictive data analysis, which helps anticipate changes based on understanding patterns and anomalies within a database (Hurwitz & Kirsch, 2018).
The second group of articles in our technique analysis was linear regression that has been observed in stock market index prediction studies (Khan et al., 2018), in DSS for collaborative logistics networks (Ilie-Zudor et al., 2015) and in predicting fuel consumption based on driving behaviors (Hsu, Lim & Yang, 2017). The least absolute shrinkage operator regression was used to estimate risk-adjusted performance in hospitals (Feuerriegel, 2016), for forecasting electricity prices based on historical data and analysis of weather conditions (Ludwig, Feuerriegel & Neumann, 2015) and for predicting population health indices from social media data to improve predictive performance (Nguyen et al., 2017).
Regression of neural networks was applied to estimate rail integrity conditions to assist in maintenance control (Jamshidi et al., 2018), through regression for multipurpose utility analysis, a methodology was developed to analyze resource scarcity problems in rural transport management (Chen, Achtari, Majkut & Sheu, 2017), and a regression tree model was used to quantify and optimize leak detection on the shop floor (Stein, Meller & Flath, 2018).
In this group of articles, we note the predominance of predictive data analysis. However, one article analyzed data also with prescriptive analysis (Stein et al., 2018), and in which case, the results obtained by prescriptive analysis stood out in relation to predictive results. Prescriptive analyses are required to determine and evaluate alternative decisions involving objectives and requirements characterized by high volume and complexity (Wang, Gunasekaran, Ngai & Papadopoulos, 2016).
Based on these studies and on the condition of predicting situations, the value built from the use of big data in decision-making is the ability of decision-makers to allocate resources, make adjustments in their process or even to direct assertive actions to deal with child abuse as in case of Gillingham's (2019a) study. The ability to relate several factors from the big data analysis allows improving decision-making considerably; in this group, the gains also come from saving resources that can be applied in certain activities, for example, in the measurement of risks.
3.1.2 Machine learning technique with unsupervised learning algorithm
We have identified the application of cluster learning with image-based information visualization technique for analyzing emerging data sets from the air traffic control domain (Hurter, Conversy, Gianazza & Telea, 2014), and hierarchical clustering technique used as DSS to identify near real-time industrial clusters (Papagiannidis, See-To, Assimakopoulos & Yang, 2018).
We also identified articles developed through the diffuse adaptive minimum spanning tree method that offered opportunities for the development of intelligent tourism DSS for government policymaking (Gao, Zhang, Lu, Wu & Du, 2018), P-DBSCAN algorithm that identifies areas of high photographic activity, using the information on the number of tourists providing photos and the number of photos sent to find groups at popular tourist sites (Miah, Vu, Gammack & McGrath, 2017) and user behavior map analysis through image recognition algorithms that enable tourism scenario formulation conditions for marketing strategies (Giglio, Bertacchini, Bilotta & Pantano, 2019).
In this group, again predictive analyzes formed the majority of articles, however, Hurter et al. (2014) conducted a study through descriptive data analysis. Descriptive analyses help to understand the historical data set and then to understand the current reality (Hurwitz & Kirsch, 2018).
Another identified group was unsupervised association learning. We have found the use of transmissible comorbidity map for patient monitoring according to risk profiles (Capobianco & Liò, 2015) and the use of sentiment analysis mechanisms that benefit from grammar-based linguistic analysis to predict stock market index trends (Chan & Chong, 2017). Both articles appropriated the decision tree as a technique and treated the data for predictive analysis.
This group of techniques and applications allows for real-time monitoring, which brings benefits and diagnostic capacity. Based on this application, decision-makers can have more agility in raising problems and opportunities organically and evolutionarily.
3.1.3 Machine learning technique with semi-supervised learning algorithm
We have only identified one article that used semi-supervised classification learning as a technique to address a Twitter user opinion rating issue in discussions from other people's retweets, using the label propagation technique for predictive analytics (Li, Li & Zhu, 2016).
3.1.4 Machine learning techniques with reinforcement learning algorithms
Studies classified as reinforcement learning have in common the traffic optimization ratio to avoid congestion during the journey. A car tracking model based on approximate set theory data was used to consider the hidden information in a field data set (Hao, Yang & Shi, 2018), and a proactive method of controlling traffic congestion with the use of deep belief network has been applied to eliminate unwanted future states (Wang, Geng & Gao, 2018b). Both studies presented a predictive analysis of data.
3.1.5 Data mining techniques
The articles emphasized the added value resulting from the use of big data in the treatment of heterogeneous data sources accessed by crisis management frameworks (Drosio & Stanek, 2016). The perception of the use of data mining techniques as a strategic management tool in the banking sector from an accounting and financial perspective was also explored (Al Chahadah, El Refae & Qasim, 2018). A co-word analysis framework model has been proposed that encompasses and synthesizes unstructured textual data from web sources to improve decision-making processes to gain and maintain competitive advantage (Sasson, Ravid & Pliskin, 2015).
In the area of health, barriers to DSS adopted by dentists were identified due to their perceived lack of utility, difficulties arising from social and economic factors and in interpreting information from the used systems (Goh, Tao, Zhang & Yong, 2016). In the construction industry sector, it was discussed how the key challenges of data mining from the nature of fragmented data require cultural change and more structured collection systems (Ahmed, Aziz, Tezel & Riaz, 2018).
Data mining techniques using the Bresenham algorithm was used to identify the impact of weather conditions on a given travel route, focusing on fuel cost savings (Lee, Aydin, Choi, Lekhavat & Irani, 2018). And a combination of flow mining algorithms and online discovery of declaration models, and a model of declarative processes for the transmission of event-producing data was applied in an academic hospital to cancer patients diagnosed by updated images as behavior runtime (Burattin, Cimitile, Maggi & Sperduti, 2015).
The use of data from different sources and in different types is a great challenge for decision-makers. In this research, we can perceive possibilities such as those mentioned above that allow considerable gains for public and private agents in the process of diagnosis and construction of strategies to deal with problems. Thus, when compiling the data in a single system, after collection and treatment, professionals who work with big data can provide inputs for various activities in society.
3.1.6 Big data analytics (BDA) techniques
The health area has been a fertile field for the application of big data (Ashrafi, Kuilboer, Joshi, Ran & Pande, 2014). And the healthcare industry has yet to fully understand the benefits of using BDA (Wang, Kung & Byrd, 2018a). There are still challenges in the adoption of DSS, such as data protection, prejudice and the probability of manipulation in the area of social work (Schneider & Seelmeyer, 2019).
In the governmental field, a paradoxical situation has been identified because on the one hand, we realize the creation of information and knowledge from big data analysis and its use as DSS support in organizations improving the quality and reliability of decisions (Fredriksson, 2018). On the other hand, the monopoly of government control of large amounts of data can have a dangerous influence on citizens for security reasons and/or unreasonable access (Power, 2016).
The use of big data mediated by data diagnosis did not significantly affect the quality of decisions in business studies (Ghasemaghaei & Calic, 2019). However, evidence-based decision-making must address a wide range of issues such as knowledge, belief, social factors and technical capabilities (Power, Cyphert & Roth, 2019). Therefore, we need to understand and present the data source and journey through the right visualization technologies and intuitive platforms for delivering successful messages (Moore, 2017), as the use of unstructured external data challenges companies as to the information accuracy mainly concerning performance measurements (Mello & Martins, 2019).
We highlight the limited availability of tools to provide decision support to improve service management processes (Shrestha, Cater-Steel & Toleman, 2016). However, methodologies and frameworks (Vera-Baquero, Colomo-Palacios, Molloy & Elbattah, 2015), integrated structures of data-driven computational experiments (Long, 2017) and multiagent technologies (Giannakis & Louis, 2016) are proposed to condition scalability and big data processing power. These technologies present themselves as promising alternatives to meet the needs of modern supply chain management at a level of collaboration between organizations and decentralizing operations.
Big Data have been widely applied in logistics, service, planning and manufacturing processes; however, supply chain executives still seem to have a slow adoption in relation to the real potential (Brinch, Stentoft, Jensen & Rajkumar, 2018). Note that when automating business processes, business agility should be considered especially about how the automated process will respond situations where market assumptions may be violated (Groves, Collins, Gini & Ketter, 2014). In general, articles using BDA techniques seek to provide solutions in complex, turbulent environments that often lack a centralized, standardized information collection framework, making it even more difficult for managers to manage data (Osuszek, Stanek & Twardowski, 2016).
3.2 Technologies for big data
The items presented here are related to the application of data analysis technologies to obtain value from big data.
3.2.1 Cloud computing technology
We identified articles that were rated for using cloud computing technology. In order to benefit from the use of big data, companies can instead look for cloud computing for technical flexibility (Boutkhoum, Hanine, Agouti & Tikniouine, 2016); economies of scale, scope and speed in service analysis (Demirkan & Delen, 2013) and further reduce uncertainty and ambiguity in the classification of decision-makers (Boutkhoum, Hanine, Agouti & Tikniouine, 2017). A big data logistics business platform for supply chain network management services has been proposed as a way to modernize logistics services (Neaga, Liu, Xu, Chen & Hao, 2015). In healthcare, an intelligent cloud-based electronic health record system has been developed to improve the privacy and security of electronic records, and it has enabled this application to reduce medical errors and improve patients' quality of life, as well as reducing costs and increasing productivity of health organizations (Khansa, Forcade, Nambari, Parasuraman & Cox, 2012). Finally, the term Climate Analytics-as-a-Service has been presented as a form of business where cloud computing plays an important role as it provides a mobility-driven way of working (Schnase et al., 2017).
3.2.2 Technologies for business intelligence (BI)
In our analysis, only two articles were identified with BI technology. The first study highlighted the importance of BI-based decision-making and how its use is critical to ensuring competitiveness and sustainable growth in enterprises (Jin & Kim, 2018). The second presented a prescriptive framework for prioritizing items in business analysis and applying them to the business environment (Pape, 2016).
3.2.3 Technologies for data warehouse
Janković, Mladenović, Mladenović, Vesković & Glavić (2018) present a flexible integration approach from heterogeneous external sources. Big data analysis has enabled integration into big data applications based on batch-oriented processing, as well as flexibility, reuse of raw data and query of various data types and repositories at once. Jukic, Jukic, Sharma, Nestorov & Arnold (2017) describe improvements in tactical decision-making quality that have also been found by providing critical information through analytical databases that combined columnar database technology with an approach based on denormalization of data tables for analysis and decision support. Almeida, Bernardino & Furtado (2015) performed the evaluation of - structured query language (SQL) and no structured query language (NoSQL) scalability platforms, where they concluded that the mechanism was considered more appropriate in transactional systems.
3.2.4 Systems technology
The last group of articles classified in this study was that with those papers that developed or used some information system as a technology application. Baechle, Agarwal & Zhu (2017) described the benefits of improved accuracy of services provided over the short term by applying large dictionaries of chronic obstructive pulmonary disease–related terms. Gillingham (2019b) presents through the principles of algorithmic responsibility, and combination with ethical codes of social work, the possibility for social workers to identify when wrong or biased recommendations are made by the deployed DSS and thereby develop defense strategies for social service users.
Pettit et al. (2018) present a tool called planning support system (PSS) used in a study related to smart cities, which assisted in the execution of the main tasks associated with the urban planning process, besides allowing better coordination between the planning and infrastructure agencies of the city, state and the country. Semanjski, Bellens, Gautama & Witlox (2016) demonstrate a case with the applicability of a big data integration approach to the smart city planning process, where the observed benefits were higher data punctuality, shorter cycle time and more informed and agile decision-making for both citizens and city planners. Deal, Pan, Pallathucheril & Fulton (2017) explored the potential of a new generation of conscious PSSs and the challenges of achieving big data.
We can point out from the analysis that as much as DSS are sophisticated tools used to optimize decision-making processes when used in high-pressure and turbulent environments, they can have negative consequences (Aversa, Cabantous & Haefliger, 2018). Therefore, the use of techniques such as the diffuse analytical hierarchy process (Lan, Zhang, Zhong & Huang, 2016) ends up being a way to optimize the decision-making process in a system.
4. Discussion
Table 3 was structured to answer the first research question of this study. Thus, the application of big data and DSS is applied through techniques and technologies. We can infer that among the identified techniques, the use of BDA was the most, with 16 articles, representing 22% of the sample, followed by supervised classification learning, with 12 articles, which represented 17% of the entire sample analyzed. Regarding technologies, systems had the highest frequency, with seven articles, representing 10% of the sample, followed by cloud computing, with six articles, representing 8% of the sample.
We highlight that the articles in the years 2012 and 2013 used only technologies, and only from 2014, articles using big data analysis techniques were recorded in our sample. We also note that the growth in technology use occurred until 2016, with a decrease in subsequent years. As for the techniques, since the registration of the first article (2014), its use has grown steadily, thus characterizing the increasing applicability of techniques for this purpose. For this finding, we disregard the year 2019 since it was not a complete year for the collection of articles.
BDA techniques have been widely used as a form of data analysis to interpret past behaviors and relationships. The amount of work using this technique shows us the importance and relevance that BDA has in environments that want to analyze large data sets, mainly for metrics management. Another technique that stood out for the high number of articles in our sample was supervised learning, specifically by classification and regression. Supervised learning techniques seek to define a function that can predict unknown labels from a previously labeled data set.
The low frequency recorded in techniques such as reinforced learning and semi-supervised learning does not necessarily indicate low interest in these applications by researchers. Reinforced learning, for example, has a very fertile field for applications where it is desired to have the least possible decision-making requirement of a person; with this, we understand that they are still new techniques but that have a great potential to be more and more used in our life.
Table 4 was organized to answer the second research question of this study. We note that the issue of scalability in the use of decision systems based on big data is a major challenge. Otherwise, advances make it possible to perceive gains in areas such as healthcare, logistics and supply chain as can be seen in Table 4.
When analyzing the percentage of each field, we noticed that articles directed to the logistics and traffic area had the highest rate, representing 19%; these studies had a predominant focus on the use of algorithms to optimize routes to reduce costs and improve performance. Health, the second group with the most articles (17%), had a predominant focus with studies of disease prediction through diagnoses and support in diagnoses. Business and market also representing 17% of the sample; they presented studies aimed at better decisions for business and social relations. Consideration should also be given to the predominance of studies directed to predictive analysis, that is, an analysis technique that helps to anticipate changes based on understanding patterns and anomalies within data (Hurwitz & Kirsch, 2018).
In line with the findings of Li, Xu, Tang, Wang & Li (2018), we reinforce the relationship between tourism and big data as users are sources of data generation mainly due to devices that allow the collection and interpretation of their movement. In our study, this was evident through the use of social media. We still evidence the impact that big data management has on the market and the business world; Seles, Jabbour, Jabbour, Fiorini, Mohd-Yusoff & Thome (2018) showed the positive effect from an environmental, operational and economic perspective. Convergent also to the study by Rialti, Marzi, Ciappei, & Busso (2019), we highlight the need for big data management in organizations increasingly focused on strategies for decision-making and knowledge management. These data-driven decisions, therefore, are evidence based and stand out when compared to intuition-based decisions (McAfee & Brynjolfsson, 2012).
The verification of the types of problems involved in these applications reflects the capabilities of the professionals involved in this context. The use of big data in DSS, in addition to knowledge in data collection, storage and processing technologies and data analysis techniques, requires professionals to be able to identify specific complex problems, and this requires a profound knowledge of these professionals about these application areas of big data.
We note an inverse relationship in the complexity of the form of data analysis concerning the need for intuition-based human decision-making. For example, Vera-Baquero et al. (2015) using descriptive analysis used event correlation mechanisms to monitor instances and processes to assist analysts in their decision-making. Miah et al. (2017) through predictive algorithmic analysis identified areas of high photographic activity to find groups at popular tourist sites. And Pape (2016) presented a prescriptive analysis framework for prioritizing items in business analysis and applying them in a business environment.
In this study, the articles had predominance in predictive analysis, thus suggesting an intermediate position of the intensity of complexity in data analysis and the need for human decision-making (Figure 1).
We can infer based on the analyzed information that, in the coming years, there should be an increase in the number of works with prescriptive analyzes approaching, given the increase in applications, for example, in studies with autonomous cars and route optimization.
In general, the types of analysis are defined according to the understanding of the problem, so that for data analysis of past events, BDA techniques are used for descriptive analysis, and for inference and prediction problems, in which it seeks to identify possible results and probabilities of an event, machine learning has been used.
Although they have been presented separately, the relationship between the types of problems, techniques and technologies is used to ensure DSS is used as a way to solve complex problems, given the human limitation to identify relationships in large data sets. This requires the help of technologies and techniques, which provide mechanisms for obtaining insights that help decision-making.
The value generated by big data in DSS, therefore, occurs when there is better decision-making. For this, techniques and technologies support applications in the most different areas as previously presented. However, the quality of decision-making depends not only on big data but also on the ability to manage the big data chain, from data collection to final insight.
4.1 Research agenda
Analyses of the big data literature have been carried out in some areas; Seles et al. (2018), for example, argued that big data management means a major opportunity in corporate sustainability, due to its potential to generate a better understanding of the opportunities and challenges of climate change. Li et al. (2018) argued about some disadvantages of using big data in tourism-related situations, due to data quality, data cost and privacy issues. And Bhardwaj, Wodajo, Spano, Neal & Coustasse (2018), when investigating the application of big data analyses in the health area, identified benefits in several phases of the management of chronic diseases and could help to reduce the burden of chronic diseases in patients.
As it is still a new area, research on big data is very recent and, at the same time, there are still many research opportunities to investigate this environment, its challenges and advances obtained over the last few years. With that, we proposed to carry out this comprehensive research, so that it was possible to register areas that the application of big data has been used to solve real problems and also the types of techniques and technologies used more recurrently.
With this, some research opportunities emerge from our results, such as, for example, investigations on the behavioral profile of professionals involved with the development of DSS, which capabilities stand out for certain areas. Another point underexplored and that deserves more attention is related to the ethical issues involved in this type of context, and then it could be researched how ethics is being discussed when developing DSS for decision-making involving civil control with freedom restrictions, incentive consumption and automatic judgments based on the previous decisions.
Another point that could be explored as an extension to this study would be a research on articles that discuss big data as a source of information for decision-making, without necessarily referring to DSS. The reason for this is that DSS is a terminology that cannot be used by all those who discuss the use of Big Data as a support for decision-making.
5. Concluding remarks
As a result of our study, we note the use of techniques such as BDA, data mining and machine learning algorithms, which were classified into supervised, semi-supervised, unsupervised and reinforcement learning. We also highlight the use of technologies such as BI to report, analyze and present data; cloud computing as a distributed data system provided as a service via the network; data warehouse as a specialized and optimized reporting database, often used to store large amounts of structured data, and information systems. We believe that this is the main contribution to theory.
Through the emerging and incipient subject that the article addresses, we seek to present an overview of the techniques and technologies that are being used to solve problems in their respective areas, as a form of theoretical contribution. This understanding contributes as a way to fill a research gap involving an increasingly important issue for the whole of society.
We have also identified several application areas, such as logistics and traffic for route optimization and operational cost reduction, health for disease detection and treatment guidance, business and market-driven decision-making for competitive advantage and areas with lower application rates in our analyzes as a government in social control and smart cities, in support of urban planning. Within this context of technique or technology applied in some areas, we note the inverse relationship between the complexity of data processing and the need for human decision-making, which results in the form of analysis, which may be descriptive, predictive or prescriptive. In our opinion, this is the main practical contribution of the study.
We also understand that there is a practical contribution to the maturation of the discussion and with reflections even presented as suggestions for future research, such as, for example, the ethical discussion. Our descriptive classification can also serve as a guide for new researchers who seek to understand the research environment involving DSS and big data to obtain value; we believe that this contribution is the most important for society.
We observed that articles related to the theme have increased in number over the years. The ease of access to components that enable data collection and analysis explains the better portability, remote transfer and access of scanned data from one context to another and interconnectivity, the possibility of synthesizing big data and finding connections from the interaction between human and algorithmic intelligence (Günther, Mehrizi, Huysman & Feldberg, 2017), made it possible to improve capturing data and increase the value of big data.
We conclude that the value obtained from big data through DSS occurs with the use of techniques and technologies, which may or not be used together, and that help decision-makers. These insights would not be obtained without using the techniques and technologies in question, given the large volume of data that would make it impossible for a person to collect, store, process and analyze without the aid of DSS.
Acknowledgements
This study was financed in part by the Coordenação de AperfeiÇoamento de Pessoal de Nível Superior - Brasil (CAPES).
References
Ahmed, V., Aziz, Z., Tezel, A., & Riaz, Z. (2018). Challenges and drivers for data mining in the AEC sector. Engineering, Construction and Architectural Management, 25(11), 1436–1453, doi: 10.1108/ECAM-01-2018-0035.
Al Chahadah, A.R., El Refae, G.A., & Qasim, A. (2018). The use of data mining techniques in accounting and finance as a corporate strategic tool: An empirical investigation on banks operating in emerging economies. International Journal of Economics and Business Research, 15(4), 442–452, doi: 10.1504/IJEBR.2018.092149.
Almeida, R., Bernardino, J., & Furtado, P. (2015). Testing SQL and NoSQL approaches for big data warehouse systems. International Journal of Business Process Integration and Management, 7(4), 322–334, doi: 10.1504/IJBPIM.2015.073656.
Ashrafi, N., Kuilboer, J.P., Joshi, C., Ran, I., & Pande, P. (2014). Health informatics in the classroom: An empirical study to investigate higher education's response to healthcare transformation. Journal of Information Systems Education, 25(4), 305–315.
Aversa, P., Cabantous, L., & Haefliger, S. (2018). When decision support systems fail: Insights for strategic information systems from Formula 1. Journal of Strategic Information Systems, 27(3), 221–236, doi: 10.1016/j.jsis.2018.03.002.
Baechle, C., Agarwal, A., & Zhu, X. (2017). Big Data driven co-occurring evidence discovery in chronic obstructive pulmonary disease patients. Journal of Big Data, 4(1), doi: 10.1186/s40537-017-0067-6.
Bhardwaj, N., Wodajo, B., Spano, A., Neal, S., & Coustasse, A. (2018). The impact of big data on chronic disease management. Health Care Manager, 37(1), 90–98, doi: 10.1097/HCM.0000000000000194.
Boutkhoum, O., Hanine, M., Agouti, T., & Tikniouine, A. (2016). Selection problem of cloud solution for big data accessing: Fuzzy AHP-PROMETHEE as a proposed methodology. Journal of Digital Information Management, 14(6), 368–382.
Boutkhoum, O., Hanine, M., Agouti, T., & Tikniouine, A. (2017). A decision-making approach based on fuzzy AHP-TOPSIS methodology for selecting the appropriate cloud solution to manage big data projects. International Journal of Systems Assurance Engineering and Management, 8, 1237–1253, doi: 10.1007/s13198-017-0592-x.
Boyd, D., & Crawford, K. (2012). Critical questions for Big Data: Provocations for a cultural, technological, and scholarly phenomenon. Information Communication and Society, 15(5), 662–679, doi: 10.1080/1369118X.2012.678878.
Brinch, M., Stentoft, J., Jensen, J.K., & Rajkumar, C. (2018). Practitioners understanding of big data and its applications in supply chain management. International Journal of Logistics Management, 29(2), 555–574, doi: 10.1108/IJLM-05-2017-0115.
Burattin, A., Cimitile, M., Maggi, F.M., & Sperduti, A. (2015). Online discovery of declarative process models from event streams. IEEE Transactions on Services Computing, 8(6), 833–846, doi: 10.1109/TSC.2015.2459703.
Capobianco, E., & Liò, P. (2015). Comorbidity networks: beyond disease correlations. Journal of Complex Networks, 3(3), 319–332, doi: 10.1093/comnet/cnu048.
Chan, S.W.K., & Chong, M.W.C. (2017). Sentiment analysis in financial texts. Decision Support Systems, 94, 53–64, doi: 10.1016/j.dss.2016.10.006.
Chen, C.L.P., & Zhang, C.Y. (2014). Data-intensive applications, challenges, techniques and technologies: A survey on big data. Information Sciences, 275, 314–347, doi: 10.1016/j.ins.2014.01.015.
Chen, M., Mao, S., & Liu, Y. (2014a). Big data: A survey. Mobile Networks and Applications, 19(2), 171–209, doi: 10.1007/s11036-013-0489-0.
Chen, M., Mao, S., Zhang, Y., Leung, V.C. (2014). Big data: Related technologies, challenges and future prospects. Heidelberg: Springer.
Chen, C., Achtari, G., Majkut, K., & Sheu, J.B. (2017). Balancing equity and cost in rural transportation management with multi-objective utility analysis and data envelopment analysis: A case of quinte west. Transportation Research Part A: Policy and Practice, 95, 148–165, doi: 10.1016/j.tra.2016.10.015.
Constantiou, I.D., & Kallinikos, J. (2014). New games, new rules: Big Data and the changing context of strategy. Journal of Information Technology, 30(1), 44–57, doi: 10.1057/jit.2014.17.
Deal, B., Pan, H., Pallathucheril, V., & Fulton, G. (2017). Urban resilience and planning support systems: The need for sentience. Journal of Urban Technology, 24(1), 29–45, doi: 10.1080/10630732.2017.1285018.
Demirkan, H., & Delen, D. (2013). Leveraging the capabilities of service-oriented decision support systems: Putting analytics and Big Data in cloud. Decision Support Systems, 55(1), 412–421, doi: 10.1016/j.dss.2012.05.048.
Dobre, C., & Xhafa, F. (2014). Intelligent services for big data science. Future Generation Computer Systems, 37, 267–281, doi: 10.1016/j.future.2013.07.014.
Drosio, S., & Stanek, S. (2016). The Big Data concept as a contributor of added value to crisis decision support systems. Journal of Decision Systems, 25(June), 228–239, doi: 10.1080/12460125.2016.1187404.
Feuerriegel, S. (2016). Decision support in healthcare: Determining provider influence on treatment outcomes with robust risk adjustment. Journal of Decision Systems, 25(4), 371–390, doi: 10.1080/12460125.2016.1187553.
Fredriksson, C. (2018). Big data creating new knowledge as support in decision-making: Practical examples of big data use and consequences of using big data as decision support. Journal of Decision Systems, 27(1), 1–18, doi: 10.1080/12460125.2018.1459068.
Gao, W., Zhang, Q., Lu, Z., Wu, D., & Du, X. (2018). Modelling and application of fuzzy adaptive minimum spanning tree in tourism agglomeration area division. Knowledge-Based Systems, 143, 317–326, doi: 10.1016/j.knosys.2017.06.007.
Ghaddar, B., & Naoum-Sawaya, J. (2018). High dimensional data classification and feature selection using support vector machines. European Journal of Operational Research, 265(3), 993–1004, doi: 10.1016/j.ejor.2017.08.040.
Ghasemaghaei, M., & Calic, G. (2019). Can big data improve firm decision quality? The role of data quality and data diagnosticity. Decision Support Systems, 120, 38–49, doi: 10.1016/j.dss.2019.03.008.
Giannakis, M., & Louis, M. (2016). Journal of enterprise information management article information: A multi-agent based system with big data processing for enhanced supply chain agility. Journal of Enterprise Information Management, 29(5), 706–727.
Giglio, S., Bertacchini, F., Bilotta, E., & Pantano, P. (2019). Using social media to identify tourism attractiveness in six Italian cities. Tourism Management, 72(January 2018), 306–312, doi: 10.1016/j.tourman.2018.12.007.
Gillingham, P. (2019a). Can predictive algorithms assist decision‐making in social work with children and families? Child Abuse Review, 28(March), 114–126, doi: 10.1002/car.2547.
Gillingham, P. (2019b). Decision support systems, social justice and algorithmic accountability in social work: A new challenge. Practice, 31(4), 277–290, doi: 10.1080/09503153.2019.1575954.
Goh, W.P., Tao, X., Zhang, J., & Yong, J. (2016). Decision support systems for adoption in dental clinics: A survey. Knowledge-Based Systems, 104, 195–206, doi: 10.1016/j.knosys.2016.04.022.
Groves, W., Collins, J., Gini, M., & Ketter, W. (2014). Agent-assisted supply chain management: Analysis and lessons learned. Decision Support Systems, 57(1), 274–284, doi: 10.1016/j.dss.2013.09.006.
Günther, W.A., Rezazade Mehrizi, M.H., Huysman, M., & Feldberg, F. (2017). Debating big data: A literature review on realizing value from big data. Journal of Strategic Information Systems, 26(3), 191–209, doi: 10.1016/j.jsis.2017.07.003.
Hao, S., Yang, L., & Shi, Y. (2018). Data-driven car-following model based on rough set theory. IET Intelligent Transport Systems, 12(1), 49–57, doi: 10.1049/iet-its.2017.0006.
Hayashi, Y. (2016). Application of a rule extraction algorithm family based on the Re-RX algorithm to financial credit risk assessment from a Pareto optimal perspective. Operations Research Perspectives, 3, 32–42, doi: 10.1016/j.orp.2016.08.001.
Hsu, C.Y., Lim, S.S., & Yang, C.S. (2017). Data mining for enhanced driving effectiveness: An eco-driving behaviour analysis model for better driving decisions. International Journal of Production Research, 55(23), 7096–7109, doi: 10.1080/00207543.2017.1349946.
Huang, S., & Chaovalitwongse, W.A. (2015). Computational optimization and statistical methods for big data analytics: Applications in neuroimaging. The Operations Research Revolution, 71–88, doi: 10.1287/educ.2015.0135.
Hurter, C., Conversy, S., Gianazza, D., & Telea, A.C. (2014). Interactive image-based information visualization for aircraft trajectory analysis. Transportation Research Part C: Emerging Technologies, 47(P2), 207–227, doi: 10.1016/j.trc.2014.03.005.
Hurwitz, J., & Kirsch, D. (2018). Machine Learning for Dummies. New York, NY: John Wiley & Sons.
Ilie-Zudor, E., Ekárt, A., Kemeny, Z., Buckingham, C., Welch, P., & Monostori, L. (2015). Advanced predictive-analysis-based decision support for collaborative logistics networks. Supply Chain Management, 20(4), 369–388, doi: 10.1108/SCM-10-2014-0323.
Jamshidi, A., Hajizadeh, S., Su, Z., Naeimi, M., Núñez, A., Dollevoet, R., Schutter, B.D., & Li, Z. (2018). A decision support approach for condition-based maintenance of rails based on big data analysis. Transportation Research Part C: Emerging Technologies, 95(June), 185–206, doi: 10.1016/j.trc.2018.07.007.
Janković, S., Mladenović, S., Mladenović, D., Vesković, S., & Glavić, D. (2018). Schema on read modeling approach as a basis of Big Data analytics integration in EIS. Enterprise Information Systems, 12(8–9), 1180–1201, doi: 10.1080/17517575.2018.1462404.
Jin, D.H., & Kim, H.J. (2018). Integrated understanding of big data, big data analysis, and business intelligence: A case study of logistics. Sustainability (Switzerland), 10(10), doi: 10.3390/su10103778.
Jukic, N., Jukic, B., Sharma, A., Nestorov, S., & Korallus Arnold, B. (2017). Expediting analytical databases with columnar approach. Decision Support Systems, 95, 61–81, doi: 10.1016/j.dss.2016.12.002.
Khan, U., Aadil, F., Ghazanfar, M.A., Khan, S., Metawa, N., Muhammad, K., Mehmood, I., & Nam, Y. (2018). A robust regression-based stock exchange forecasting and determination of correlation between stock markets. Sustainability (Switzerland), 10(10), 1–20, doi: 10.3390/su10103702.
Khansa, L., Forcade, J., Nambari, G., Parasuraman, S., & Cox, P. (2012). Proposing an intelligent cloud-based electronic health record system. International Journal of Business Data Communications and Networking, 8(3), 57–71, doi: 10.4018/jbdcn.2012070104.
Lan, S., Zhang, H., Zhong, R.Y., & Huang, G.Q. (2016). A customer satisfaction evaluation model for logistics services using fuzzy analytic hierarchy process. Industrial Management & Data Systems, 116(5), 1024–1042, doi: 10.1108/IMDS-09-2015-0389.
Lee, H., Aydin, N., Choi, Y., Lekhavat, S., & Irani, Z. (2018). A decision support system for vessel speed decision in maritime logistics using weather archive big data. Computers and Operations Research, 98, 330–342, doi: 10.1016/j.cor.2017.06.005.
Li, J., Li, X., & Zhu, B. (2016). User opinion classification in social media: A global consistency maximization approach. Information and Management, 53(8), 987–996, doi: 10.1016/j.im.2016.06.004.
Li, F., Yang, J., Jin, C., & Guo, C. (2017). A new effect-based roughness measure for attribute reduction in information system. Information Sciences, 378, 348–362, doi: 10.1016/j.ins.2016.08.056.
Li, J., Xu, L., Tang, L., Wang, S., & Li, L. (2018). Big data in tourism research: A literature review. Tourism Management, 68, 301–323, doi: 10.1016/j.tourman.2018.03.009.
Long, Q. (2017). A framework for data-driven computational experiments of inter-organizational collaborations in supply chain networks. Information Sciences, 399, 43–63, doi: 10.1016/j.ins.2017.03.008.
Ludwig, N., Feuerriegel, S., & Neumann, D. (2015). Putting Big Data analytics to work: Feature selection for forecasting electricity prices using the LASSO and random forests. Journal of Decision Systems, 24(1), 19–36, doi: 10.1080/12460125.2015.994290.
McAfee, A., & Brynjolfsson, E. (2012). Big data: The management revolution. Harvard Business Review, 90(10), 60-68.
Mello, R., & Martins, R.A. (2019). Can big data analytics enhance performance measurement systems?, IEEE Engineering Management Review, 47(1), 52–57, doi: 10.1109/EMR.2019.2900645.
Miah, S.J., Vu, H.Q., Gammack, J., & McGrath, M. (2017). A big data analytics method for tourist behaviour analysis. Information and Management, 54(6), 771–785, doi: 10.1016/j.im.2016.11.011.
Moore, J. (2017). Data Visualization in support of executive decision making. Journal of Information, Knowledge, and Management, 12, 125–138.
Mortenson, M.J., Doherty, N.F. & Robinson, S. (2015), Operational research from taylorism to terabytes: A research agenda for the analytics age. European Journal of Operational Research, 241(3), 583–595.
Murdoch, T.B., & Detsky, A.S. (2013). The inevitable application of big data to health care. JAMA - Journal of the American Medical Association, 309(13), 1351–1352, doi: 10.1001/jama.2013.393.
Neaga, I., Liu, S., Xu, L., Chen, H., & Hao, Y. (2015). Cloud enabled big data business platform for logistics services: A research and development agenda. Lecture Notes in Business Information Processing, 216, 22–33, doi: 10.1007/978-3-319-18533-0.
Nguyen, T., Larsen, M.E., O'Dea, B., Nguyen, D.T., Yearwood, J., Phung, D., Venkatesh, S., & Christensen, H. (2017). Kernel-based features for predicting population health indices from geocoded social media data. Decision Support Systems, 102, 22–31, doi: 10.1016/j.dss.2017.06.010.
Nimmagadda, S.L., Reiners, T., & Wood, L.C. (2018). On big data-guided upstream business research and its knowledge management. Journal of Business Research, 89(September 2016), 143–158, doi: 10.1016/j.jbusres.2018.04.029.
Osuszek, L., Stanek, S., & Twardowski, Z. (2016). Leverage big data analytics for dynamic informed decisions with advanced case management. Journal of Decision Systems, 25(June), 436–449, doi: 10.1080/12460125.2016.1187401.
Papagiannidis, S., See-To, E.W.K., Assimakopoulos, D.G., & Yang, Y. (2018). Identifying industrial clusters with a novel big-data methodology: Are SIC codes (not) fit for purpose in the Internet age?. Computers and Operations Research, 98, 355–366, doi: 10.1016/j.cor.2017.06.010.
Pape, T. (2016). Prioritising data items for business analytics: Framework and application to human resources. European Journal of Operational Research, 252(2), 687–698, doi: 10.1016/j.ejor.2016.01.052.
Petticrew, M., & Roberts, H. (2006). Systematic reviews in the social sciences: A practical guide. Malden, MA: Blackwell.
Petticrew, M., & Roberts, H. (2008). Systematic Reviews in the Social Sciences: A Practical Guide. John Wiley and Sons.
Pettit, C., Bakelmun, A., Lieske, S.N., Glackin, S., Hargroves, K.‘C.,' Thomson, G., Shearer, H., Dia, H., & Newman, P. (2018). Planning support systems for smart cities. City, Culture and Society, 12(October), 13–24, doi: 10.1016/j.ccs.2017.10.002.
Power, D.J. (2016). “Big Brother” can watch us. Journal of Decision Systems, 25, 578–588, doi: 10.1080/12460125.2016.1187420.
Power, D.J., Cyphert, D., & Roth, R.M. (2019). Analytics, bias, and evidence: The quest for rational decision making. Special issue on cognitive bias. Journal of Decision Systems, 28, 1–18, doi: 10.1080/12460125.2019.1623534.
Rasiulis, R., Ustinovichius, L., Vilutiene, T., & Popov, V. (2016). Decision model for selection of modernization measures: Public building case. Journal of Civil Engineering and Management, 22(1), 124–133, doi: 10.3846/13923730.2015.1117018.
Rialti, R., Marzi, G., Ciappei, C., & Busso, D. (2019). Big data and dynamic capabilities: a bibliometric analysis and systematic literature review. Management Decision. doi: 10.1108/md-07-2018-0821.
Rönnqvist, M., Svenson, G., Flisberg, P., & Jönsson, L.E. (2017). Calibrated route finder: Improving the safety, environmental consciousness, and cost effectiveness of truck routing in Sweden. Interfaces, 47(5), 372–395, doi: 10.1287/inte.2017.0906.
Sasson, E., Ravid, G., & Pliskin, N. (2015). Improving similarity measures of relatedness proximity: Toward augmented concept maps. Journal of Informetrics, 9(3), 618–628, doi: 10.1016/j.joi.2015.06.003.
Sathiaraj, D., Punkasem, T., Wang, F., & Seedah, D.P.K. (2018). Data-driven analysis on the effects of extreme weather elements on traffic volume in Atlanta, GA, USA. Computers, Environment and Urban Systems, 72(June), 212–220, doi: 10.1016/j.compenvurbsys.2018.06.012.
Schnase, J.L., Duffy, D.Q., Tamkin, G.S., Nadeau, D., Thompson, J.H., Grieg, C.M., McInerney, M.A., & Webster, W.P. (2017). MERRA analytic services: Meeting the big data challenges of climate science through cloud-enabled climate analytics-as-a-service. Computers, Environment and Urban Systems, 61, 198–211, doi: 10.1016/j.compenvurbsys.2013.12.003.
Schneider, D., & Seelmeyer, U. (2019). Challenges in using big data to develop decision support systems for social work in Germany. Journal of Technology in Human Services, 37(2–3), 113–128, doi: 10.1080/15228835.2019.1614513.
Seles, B.M.R.P., Jabbour, A.B.L.D.S., Jabbour, C.J.C., Fiorini, P.D.C., Mohd-Yusoff, Y., & Thomé, A.M.T. (2018). Business opportunities and challenges as the two sides of the climate change: Corporate responses and potential implications for Big Data management towards a low carbon society. Journal of Cleaner Production, 189, 763–774, doi: 10.1016/j.jclepro.2018.04.113.
Semanjski, I., Bellens, R., Gautama, S., & Witlox, F. (2016). Integrating big data into a sustainable mobility policy 2.0 planning support system. Sustainability (Switzerland), 8(11), 1–19, doi: 10.3390/su8111142.
Shrestha, A., Cater-Steel, A., & Toleman, M. (2016). Innovative decision support for IT service management. Journal of Decision Systems, 25(June), 486–499, doi: 10.1080/12460125.2016.1187424.
Sivamani, S., Choi, J., & Cho, Y. (2018). A service model for nutrition supplement prediction based on Fuzzy Bayes model using bigdata in livestock. Annals of Operations Research, 265(2), 257–268, doi: 10.1007/s10479-017-2490-7.
Stein, N., Meller, J., & Flath, C.M. (2018). Big data on the shop-floor: Sensor-based decision-support for manual processes. Journal of Business Economics, 88(5), 593–616, doi: 10.1007/s11573-017-0890-4.
Suh, J.H. (2019). SocialTERM-Extractor: Identifying and predicting social-problem-specific key noun terms from a large number of online news articles using text mining and machine learning techniques. Sustainability (Switzerland), 11(1), doi: 10.3390/su11010196.
Tashkandi, A., Wiese, I., & Wiese, L. (2018). Efficient in-database patient similarity analysis for personalized medical decision support systems. Big Data Research, 13(May), 52–64, doi: 10.1016/j.bdr.2018.05.001.
Tian, J., Zhang, Y., & Zhang, C. (2018). Predicting consumer variety-seeking through weather data analytics. Electronic Commerce Research and Applications, 28, 194–207, doi: 10.1016/j.elerap.2018.02.001.
Tranfield, D., Denyer, D., & Smart, P. (2003). Towards a methodology for developing evidence‐informed management knowledge by means of systematic review. British Journal of Management, 14(3), 207-222.
Vera-Baquero, A., Colomo-Palacios, R., Molloy, O., & Elbattah, M. (2015). Business process improvement by means of big data based decision support systems: A case study on call centers. International Journal of Information Systems and Project Management, 3(1), 5–26, doi: 10.12821/ijispm030101.
Wang, G., Gunasekaran, A., Ngai, E.W.T., & Papadopoulos, T. (2016). Big Data analytics in logistics and supply chain management: Certain investigations for research and applications. International Journal of Production Economics, 176, 98–110, doi: 10.1016/j.ijpe.2016.03.014.
Wang, Y., Kung, L.A., & Byrd, T.A. (2018a). Big Data analytics: Understanding its capabilities and potential benefits for healthcare organizations. Technological Forecasting and Social Change, 126, 3–13, doi: 10.1016/j.techfore.2015.12.019.
Wang, Y., Geng, S., & Gao, H. (2018b). A proactive decision support method based on deep reinforcement learning and state partition. Knowledge-Based Systems, 143, 248–258, doi: 10.1016/j.knosys.2017.11.005.
