The explosive growing number of data from mobile devices, social media, Internet of Things and other applications has highlighted the emergence of big data. This paper aims to determine the worldwide research trends on the field of big data and its most relevant research areas. A bibliometric approach was performed to analyse a total of 6572 papers including 28 highly cited papers and only papers that were published in the Web of ScienceTM Core Collection database from 1980 to 19 March 2015 were selected. The results were refined by all relevant Web of Science categories to computer science, and then the bibliometric information for all the papers was obtained. Microsoft Excel version 2013 was used for analyzing the general concentration, dispersion and movement of the pool of data from the papers. The t test and ANOVA were used to prove the hypothesis statistically and characterize the relationship among the variables. A comprehensive analysis of the publication trends is provided by document type and language, year of publication, contribution of countries, analysis of journals, analysis of research areas, analysis of web of science categories, analysis of authors, analysis of author keyword and keyword plus. In addition, the novelty of this study is that it provides a formula from multi-regression analysis for citation analysis based on the number of authors, number of pages and number of references.
The online version of this article (doi:10.1186/s40537-017-0088-1) contains supplementary material, which is available to authorized users.
Introduction
The age of big data has arrived, which has a significant role in the current Information Technology (IT) environment [1]. In 2015, there were over 3 billion Internet users around the world [2]. Accordingly, data have become more complex due to the increasing volume of structured and unstructured data with a growing number of various applications produced by the social media, Internet of Things (IoT), and multimedia, and etc. [3, 4]. Commonly scientists have introduced four V’s for big data as: volume, velocity, variety and veracity. Meanwhile there is another study by [5] that presented three more V’s for big data as: validity, volatility and the special V for value. Researchers have highlighted that the needs for big data are increasing, which will have a powerful impact on computer science, healthcare, society, educational systems, social media, government, economic systems and Islamic studies [6‐10]. In [11], the state of the art of big data indexing using intelligent and non-intelligent approaches are investigated in order to show the strength of machine learning techniques in big data.
To identify the gaps on big data research trends in different fields, researchers have to investigate or review the comprehensive sources and databases about the papers published in the field. We found that Web of Science (WoS) is the most completed and well-known online scientific citation search that is provided by Thomson Reuters [12, 13]. Hence, it is a valuable reference for researchers to find and publish the latest technology, trends, enhancements, experimental, challenges and opportunities in research. In 1955, Garfield, E. wrote a paper entitled “Citation index for science: a new dimension in documentation through association of ideas” that introduced contemporary scientometrics. However, the Science Citation Index (SCI) has been used in indexing as a principal tool from 1964 [14‐16].
Advertisement
Bibliometric is defined as the application of mathematical and statistical methods to papers, books and other means of communication that are used in the analysis of science publications [17]. To recognize the research trends, bibliometric methods are usually used to evaluate scientific manuscripts [18, 19]. Bibliometric methods have been used to measure scientific progress in many disciplines of science and engineering, and are a common research instrument for the systematic analysis of publications [20‐24]. In this research, bibliometric analysis is employed in the field of “big data”.
Highly cited papers have a greater chance of visibility, thus attracting greater attention among researchers [25]. Evaluating the top cited publications content is very useful for obtaining information about the trends of specific fields in the perspective of research progress [26]. It can reveal to researchers how they can find the best field or best journal to succeed in their publication. Although, the citation is not a scientific tool to assess the publication, it is a valuable metric that recognizes research parameters [27]. The citation index, as a type of bibliometric method, shows the number of times an article has been used by other papers [28]. Hence, citation analysis helps researchers to obtain a preliminary idea about the articles and research that has an impact in a particular field of interest and it deals with the examination of the documents cited by scholarly works [29, 30]. In addition, there are various bibliometric studies has been evaluated based on different metrics and applications such as forecasting emerging technologies by using bibliometric and patent analysis [31], multiple regression analysis for Japanese patent case [32], medical innovation using medical subject headings [33], based on region or countries [34‐36], number of authors [37, 38] and a bibliometric analysis based on number publications and cited references [39].
In this study, bibliometric tools have been selected to determine the major and essential research trends in the field of big data research, and the most relevant research areas upon which big data has a significant impact. The Thomson Reuters’ Web of Science (WoS) database is used to extract the bibliometric information for “big data”. The WoS is a structured database that indexes selected top publications that, covering the majority of significant scientific results [13]. A total of 6572 papers were collected from WoS and the aim of this research is to provide a comprehensive analysis and evaluate the latest research trends followed by the Document Type and Language, Publication output, Contribution of Countries, Top WoS Categories and Journals, Top Authors, Top Research Areas and Analysis of Author Keywords and Keyword Plus related to the field of big data and its most relevant research areas. In addition, this paper analyzes the number of citation based on the impact of multiple factors of research paper as number of authors, number of pages and number of references. Therefore, our analysis makes an important contribution to researchers interested in the field of big data because we outline, research trends and identify the most relevant research areas to be taken into consideration when conducting future research on big data. We also provide a wide-ranging analysis on the relevant research areas that is mostly used in the field of big data with emerging research streams. Thus, this study will be useful for researchers to determine the relevant area of research in big data that has been broadly focused on along with the gaps that should be addressed. The rest of this paper is organized as follow: “Methodology" section discusses proposed methodology. “Results and discussion” section provides the results and following by discussions. “Conclusion” section concludes this work.
Methodology
The methodology is based on bibliometric techniques which permit a robust analysis of “Big Data Research” publications at different levels. The proposed methodology depends on the quantity analysis of all publications in the field that were selected based on keywords search in the title of papers. In order to define initial keywords, 30 documents from various sources relevant to the topic of “big data” were reviewed. Based on the interview with experts in the related field, the keywords were modified. The comments and suggestions from the interviewees were used to finalize the keyword list.
Advertisement
To achieve a complete set of keywords, an online questionnaire design and was distributed to about 400 people through posting in “big data” community groups on different social media platforms such as Facebook and LinkedIn. In addition, several questionnaires were sent by email to those authors whose papers were reviewed. The purpose of the survey was to obtain the participants’ comments and then analyze the collected data to illustrate the percentage of correct keywords that had been chosen and other relevant keywords that might be used for this study. The details of the data collection process are illustrated in Figs. 1 and 2, showing the results obtained from the survey analysis of which a total of 142 responses were received. After comparing with the results of the survey, the final relevant research keywords to the field of big data are shown in Table 1.
Fig. 1
Data collection processes
Fig. 2
Survey results (number of responses)
Table 1
Most relevant research keywords for “Big Data”
Selected keywords
Data analytics
Hadoop
Machine learning
MapReduce
Large dataset
Big data
Data warehouse
Predictive analytics
NoSQL
Unstructured data
Data science
Sentiment analysis
Data center
×
×
The data for this paper were derived from the online version of the Web of ScienceTM (WoS) Core Collection database, which consists of Science Citation Index Expanded (SCI), Social Science Citation Index (SSCI), and Arts & Humanities Citation Index (A&HCI) from 1980 to 19 March 2015, and Conference Proceeding Citation Index-Science (COCI-S), and Conference Proceedings Citation Index—Social Science & Humanities (CPCI-SSH) from 2004 to 19 March 2015. To ensure that the article was relevant to the research topic, the title of the published papers in WoS were scrutinized for the list of keywords in Table 2. Wildcard (*) and Boolean operator (OR) with a combination of keywords was used to purify the results. The preliminary results included 11,307 papers. The results were refined by all relevant WoS categories to computer science and then the bibliometric information for all the papers was obtained (Additional file 1). The final result consists of data for 6572 papers, which were downloaded into a Microsoft Excel spreadsheet. There are different ways of calculating author-level impact: number of article citations, number of publications, or combine the publication and citation counts to create a “hybrid indicator” [13]. In this study, the citation counts were selected for evaluation. Following which, 28 highly cited papers were selected according to the Essential Science IndicatorsSM (ESI) provided by Thomson Reuters [40]. Since the citation rates vary by field and older papers are cited more than recent papers, the selection of highly cited papers is an important issue [41]. The procedure for selection is summarized in (Additional file 1), and the illustration for the citation report of the highly cited and all papers is shown in Table 3. In summary, highly cited papers are the ones that ranked within the top 1% over the past 10 years [42, 43].
Table 2
Keywords phrase and search results
Keyword in title
Search term
Example
Results
Data analytics
"Data* Analytic*"
Data Analytic/s, Data-analytical, DATABASE ANALYTICS
Besides the highly cited papers, which were reported by ESI, the citations per year were calculated as a division of the total citations by life year of the article. The citations per year are more accurate and more scientific than the total citations to identify the top cited papers [44, 45]. Citation statistics produced for a period of less than 3 years may not be sufficiently stable [46, 47]. Therefore, we only select the papers published up to 19 March 2015 for citation analysis. The rest of the analyses were based on the whole dataset. The emphasis of the research was to describe trends in physical activity and ageing research from the following five aspects:
Trend of publications during 1980–2015
Analysis of distribution of author keywords
Analysis of distribution of KeyWords Plus
Comparison of papers citation based on author keywords with the KeyWords Plus
Citation analysis of the research output
The research will provide a guideline based on the publication trend and impact for future research. After classifying and extracting the data, the process of analyzing was started and the observations include statistical analysis, statistical descriptions, statistical tests, ANOVA, and regression analysis of some of the factors chosen. The ANOVA table was constructed using Microsoft Excel version 2013 [48], which can be used to show the statistical relationship between two variables. In addition, a free version of StatPlanet Plus [49] software was used in this study for creating the interactive world map to visualize the distribution of all papers among different countries.
The four relationships among two variables were observed in this study. The first observation was the relationship between the number of publications of each country in all papers and the impact in a highly cited paper. The second observation was the relationship between the number of the author’s publications in all the papers and the impact in highly cited papers. The third observation was the relationship between the number of publication of journals in all papers and the impact in highly cited papers. Microsoft Excel 2013 was used in constructing the ANOVA table and to conclude this two-factor relationship. The fourth observation was the relationship between the author keyword and keyword plus in all and the impact in highly cited papers.
The last part of the analysis focused on the multiple regressions of three factors concerning the number of citations. The three independent variables in this regression were number of authors, number of pages and number of references, form each of the 6572 papers, and the dependent variable was the number of citations of each paper (out of 6572). By using Microsoft Excel 2013, the t-test was constructed to analyze how strongly these three factors contribute to the number of citations. At the end of this analysis, this study produced a multiple regression equation, which could be used to forecast the number of citations giving the number of pages, authors and references.
Results and discussion
As discussed above, the total of 6572 papers was refined by all WoS categories relevant to computer science (Additional file 1). Hence, various bibliometric tools to evaluate the different metrics were selected to determine the research trends based on the two groups that extracted from WoS: All Papers (6572) and Highly Cited Papers (28) groups. In addition, we have not discounted double counting in papers co-authored from multi countries; therefore, the results shown below or in other tables might be counted more than the real data as 28 papers for highly cited papers and 6572 papers for all papers.
Table 4 shows the highly cited papers sorted by publication year, which was used to analyze and compare with the total number of publications (all papers group).
NR Cited reference count, TC Web of science core collection times cited count, Refs References
Document type and language
Table 5 illustrates the main distribution of document types in both groups (all and highly cited papers). In the all papers group, proceeding papers (62.73%) and articles (38.61%) are the main contributors, whereas in the highly cited papers, articles (89.28%) is only the highest contributor. We found that English was the dominant language with 6549 records (99.65%). Other less significant outputs for all papers were editorial material, review, meeting abstract, news item, book review, letter, correction, software review, book chapter, item about an individual, note, and reprint; for highly cited papers it was the same with lower significant percentages for review and proceeding paper (Table 5).
Table 5
Distribution of document type
Document types in general
Percentage (out of 6572)
Document types for highly cited papers
Percentage (out of 28)
Proceedings paper
62.73
Article
89.28
Article
38.61
Review
10.71
Editorial material
3.97
Proceedings paper
10.71
Review
1.01
–
Meeting abstract
0.27
–
News item
0.27
–
Book review
0.24
–
Letter
0.16
–
Correction
0.12
–
Software review
0.07
–
Book chapter
0.06
–
Item about an individual
0.06
–
Note
0.03
–
Reprint
0.01
–
Even though, proceeding paper and article were the most used document types, we also considered all the document types, as shown in Table 5. We believe that each document type has its own intrinsic value and would provide insight on the research trend.
Publication trends: annually, regions/countries, contribution of countries
Publication output
The recent research concentration is reflected in its publication output [76, 77]. Figure 3 shows the number of published items spanning 36 years from 1980 to 19 March 2015. In general, the number of publications increased over the period studies. A huge positive jump from 1 year to another can be seen from 2012 to 2013, with a difference of 395 publications. If the last three recent years is excluded from the observation, the highest drop can be observed between 2009 and 2010, the published items dropped by 146 items. In the first 16 years in Fig. 3, the count movement of publications steadily increased but with a very small increment. It can be clearly seen from the trend of the graph that there is a sudden jump in the initial period after a long steady movement, which was between 1993 and 1994. On average, the number of papers published every year was 182.56 with a standard deviation of 280.03. It can be concluded that, the shape of the graph is skewed to the right, which consistently agrees with the huge value for standard deviation generated from Excel.
Fig. 3
Number of published items from 1980 to 19 March 2015 (citation statistics produced for a period of less than 3 years may not be sufficiently stable, as indicated in blue color bars)
×
In general, the number of publications is increasing over the years considered. But, in 2009, 2012 and 2013 we observed sudden spikes in the number of publications. Further analysis we found, there were more research activities reporting on proceeding papers in those years compared to their previous year. For instance, there were 556 proceeding papers in 2012 and 260 proceeding papers in 2011.
Contribution of regions/countries
It has been reported that, “Each author of an article has made an independent contribution to the manuscript and therefore the institution and country the author affiliated could be considered the important contributors for the evaluation of research” [78, 79]. Consequently, the number of publication counts for each country were used to evaluate the research contribution of any region/country in the related field.
Figure 4 shows the geographical distribution of the published papers in the world relevant to the field of big data. As shown in Fig. 4, the USA (1852) was the most productive country with the largest number of publications regardless of the participation of international collaborators, followed by China (1059), Germany (303), England (285), Spain (282), Canada (255), India (253), France (226), Italy (198) and Australia (193).
Fig. 4
Distribution of all papers in the world
×
The geographical world map shows that there has been a gradual increase in the number of publications in North and South America, and that it has a higher impact in the world. We found that among the 196 countries in the world, 96 countries such as South Africa and a few countries in the Middle East have no publications. The present results show that big data is a growing area of research in most countries.
Analysis of countries between all and highly cited papers
The comparison of the top ten countries with the highest publications for all and highly cited papers are shown in (Additional file 1). The top three countries for both groups were the USA, China and Germany with the combined total numbering over 3000 publications produced. Over 36 years, the average for the USA was 51.44 meaning that there were more than 51 publications. In other words, this was over 22 publications (22.02) higher than China for each year. Our analysis shows that there was huge positive correlation between the number of publications by country in all and highly cited papers. The coefficient of determination between these two groups was 0.90. The ANOVA table, which was extracted from Excel, is shown in (Additional file 1). The F-value retrieved from the ANOVA table was 10.54; this was higher than its F-crit. (3.88), which was set at the 5% level of significance. Based on the result obtained from the ANOVA test, the null hypothesis was rejected and there was strong evidence to show that the number of publications for each country for all papers had an impact on the number of publications of the country in highly cited papers.
Analysis of web of science categories and journals between all and highly cited papers
The comparison the top ten WoS categories based on the total number of publications in all and highly cited papers are shown in (Additional file 1). In total, there were 96 WoS categories for which the Computer Science Theory Methods (2624) had the highest number of publications in the all papers group, while, in the highly cited group, the first category of WoS was Computer Science Artificial Intelligence (10). It is evident that computer science categories and related subjects are the leading fields in big data research.
According to Garfield, E. [80], “Journal impact factors generally involve relatively large populations of articles and citations”. Among the most key striking metric that can evaluate the contribution of a journal is the Journal Impact Factor [81].
Table 6 depicts the top 10 Journals between all and highly cited papers by their impact factor for 2012 and 2013. Commonly, researchers believe that the high journal impact factor shows the high value of the journals. But, we found that there were some journals with a lower impact factor that contained the highly cited papers.
Table 6
Comparison of top 10 journals in all and highly cited papers
Top 10 journals in highly cited papers
Impact factor
Top 10 journals in all papers
Impact factor
2012
2013
2012
2013
Bioinformatics
5.323
4.621
Lecture notes in computera science
N/A
N/A
Communications of the Acm
2.511
2.863
Lecture notes in artificial intelligencea
N/A
N/A
ACM sigcomm computer communication review
N/A
1.102
Expert systems with applications
1.854
1.965
Future generation computer systems the international journal of grid computing and escience
1.864
2.639
Bioinformatics
5.323
4.621
IEEE communications surveys and tutorials
4.818
6.490
Journal of the american medical information association
3.571
3.932
International journal of approximate reasoning
1.729
1.977
Decision support systems
2.201
2.036
Computational linguistics
0.940
1.468
Communications of the ACM
2.511
2.863
Computational statistics & data analysis
1.304
1.151
ACM sigcomm computer communication review
N/A
1.102
Computer speech and language
1.463
1.812
Neurocomputing
1.634
2.005
IEEE intelligent systems
1.930
1.920
Machine learning
1.454
1.689
aThe top 2 journals in all papers group is not applicable for year 2012, 2013
Overall, there were 2866 source titles including Journals and Conferences. The average of every source title was 2.29, showing that there were more than 2 papers published for each source title. The coefficient of determination (r-squared) of these two groups was 0.21 and these two groups (all and highly cited papers) had a weak linear relationship. The constructed ANOVA table was observed and analyzed to show how these two arrays of data are related. Table 7 highlights the results of ANOVA, which was set at the 5% significant level. It is obvious that the null hypothesis is rejected as the F value equals 790.75, which is far greater than F-crit. (3.84). The result shows that there is strong evidence to show that the number of publications of source tittles in all papers has an impact on the number of publications in highly cited papers.
Table 7
The Result of ANOVA test for the effect of the number of publications in all and highly cited source titles
Source of variation
Sum of square
Degree of freedom
Mean square
F value
Pr(> F)
Between groups
13,988.33
1
13,988.33
106.98
7.39E−25
Within groups
751,787.8
5750
130.74
Total
765,776.2
5751
(F-crit = 3.84)
Analysis of authors between all and highly cited papers
The comparison of the top ten authors with the highest number of publications from the all and highly cited papers groups are shown in (Additional file 1). In total, there were 14,949 authors in all papers and the average was 2.27, meaning that there were more than 2 authors for each paper (1.45 papers for each author with a standard deviation of 1.45). There were five authors with two publications in the highly cited group and 105 authors with one publication. The coefficient of determination (r2) for these two groups was 0.02, implying that these two data have a close to zero linear relationship. For further analysis of this case, the ANOVA table was constructed to observe the relationship between the all and highly cited papers. The results of ANOVA, which was set at the 5% significant level is shown in (Additional file 1). It is obvious that the null hypothesis is rejected, as the F value is equal to 14,909.21, which is far greater than F-crit. (3.84). From the observation of ANOVA (Additional file 1), the null hypothesis was rejected and there was strong evidence to show that the number of publications of authors for the all papers had an impact on the number of publications of authors in highly cited papers.
Analysis of research areas between all and highly cited papers
This section provides the research areas between all and highly cited papers, which were sorted by the number of records based on the total publications. Overall, there were 54 research areas for the all papers group and 11 research areas for the highly cited group. As shown in (Additional file 1), the top two research areas for both groups were Computer Science and Engineering, with the highest number of records and the respective number of publications in other research areas showing that there are slightly different research areas compared to each group. The result shows that the most relevant research areas were in Computer Science with the highest number of publications. However, there were other important research areas with a lower number of records. For instance, in the research areas for the all papers group, this was followed by “Telecommunications” (527), “Operations Research Management Science” (194), “Medical Informatics” (184) and for the highly cited group it was followed by “Mathematics” (4), “Biochemistry Molecular Biology” (3), and “Biotechnology Applied Microbiology” (3).
Analysis of author keywords and KeyWords plus
Author keyword is one of the essential types of information about the research trends from the view of researchers and has been proven to be important for monitoring the development of science [82‐84].
In this study, 10,002 author keywords were used for the analysis from 1980 to 19 March 2015. Table 8 depicts the top 20 frequency for the author keywords used in all papers. The author keywords were compared by the total number of records for three different periods. The distribution of each keyword would assist the researchers to identify the importance of each author keyword used in different years or decades. Accordingly, the result shows that among the top 20 frequency for author keywords, only a few keywords were used between 1980 and 1999. These included “machine learning”, “data warehouse”, “data mining”, “classification”, “neural networks” and “clustering”. However, over the past 15 years the number of keywords increased. For instance, the frequency of use of “machine learning” was only 6% between 1980 and 1999 and from 2000 to 2009 it was 40%, but, 53% of total publications were used between 2010 and 2015. This means that more focus was given for each keyword from 2000 to 2015. In addition, machine learning was used as the highest frequency of author keywords which has added a big value to big data. The main objective of machine learning is to learn from data in order to make a suitable decision. The mean of data in term of “big data” refers to complex data which are not easy to process in a single machine learning platform. Therefore, the need of a platform such as Hadoop to run machine learning for big data is essential [85].
Table 8
Top 20 highest frequency of author keywords used (from 1980 to 2015)
Author keyword
1980–2015 TP
1980–1999 TP (%)
2000–2009 TP (%)
2010–2015 TP (%)
Machine learning
757
48 (0.06)
304 (0.40)
405 (0.53)
MapReduce
514
N/A
24 (0.04)
490 (0.95)
Data warehouse(s)/warehousing
353
11 (0.03)
215 (0.60)
127 (0.35)
Big data
292
N/A
N/A
292 (1)
Hadoop
236
N/A
5 (0.02)
231 (0.97)
Cloud computing
232
N/A
4 (0.01)
228 (0.98)
Data center(s)
232
N/A
40 (0.17)
192 (0.82)
Data mining
181
4 (0.02)
80 (0.44)
97 (0.53)
Support vector machine(s)
180
N/A
64 (0.35)
116 (0.64)
Sentiment analysis
147
N/A
6 (0.04)
141 (0.95)
Classification(s)/classifier(s)
112
4 (0.03)
53 (0.47)
55 (0.49)
Neural network(s)
85
9 (0.10)
41 (0.48)
35 (0.41)
Performance
84
N/A
14 (0.16)
70 (0.83)
Energy efficiency
84
N/A
4 (0.04)
80 (0.95)
Online analytic(al) processing (OLAP)
77
N/A
47 (0.61)
30 (0.38)
Virtualization
64
N/A
14 (0.21)
50 (0.78)
Feature selection
57
N/A
28 (0.49)
29 (0.50)
Cluster/clustering
54
2 (0.03)
16 (0.29)
36 (0.66)
Opinion mining
59
N/A
5 (0.10)
44 (0.89)
Scheduling
47
N/A
5 (0.10)
42 (0.89)
TP: total number of publications, %: the percentage of keywords over total number of records
In another example, the keyword of “big data” itself was used from 2010 to 2015. On the other hand, Table 8 reveals that there was a pivotal role for the top frequent author keywords from 2000 to 2015. Thus, researchers are able to evaluate the latest trends of the research based on the top frequent author keywords relevant to the field in any particular decade to see the efficiency of any keyword that might be used to extend the research study. In addition, “mapreduce”, “data warehouse”, “big data”, “hadoop” and “cloud computing” had high growth in the ranking of author keyword frequency.
Furthermore, another metric was used to evaluate the publications based on the title which is known as KeyWords Plus. It has been proven that [86, 87], “KeyWords plus, which provides search terms extracted from the titles of papers cited in each new article in the ISI database, is an independent supplement for title-words and author keywords”.
Figure 5 provides the top 10 most frequently used terms from KeyWords Plus used over the total number of 3750 keywords. Based on Table 8 and Fig. 5, the most similar keywords among the most frequently used terms from author keyword and KeyWord Plus were “classification(s)/classifier(s)”, “neural network(s)”, “support vector machine(s)”, “Performance” and “mapreduce”, which played a pivotal role over all keywords. In addition, there were also other keywords with a significant growth in percentage, which were not in the list of both author keyword and KeyWord Plus. This means that several types of analysis were used in big data.
Fig. 5
Top 10 most frequently used terms of KeyWords plus (from 1980 to 2015)
×
Moreover, the ANOVA test was used to provide the analysis between the author keywords and KeyWords Plus. As mentioned above, there were 10,002 author keywords and 3750 KeyWords Plus in all papers (6572). From the total of author keywords, the average of a single author keyword was 1.84 (with a standard deviation of 8.35), meaning that there was more than one author keyword for each paper. The high value of standard deviation contributed from the wide range of frequency of data, or, in other words the frequency distribution was widely spread. In addition, from the total of KeyWords Plus, the average for a single KeyWords Plus was 2.16 (with a standard deviation of 5.93), showing that there were more than two KeyWords Plus for each paper. The reason for the standard deviation of KeyWords Plus being lower compared to the author keywords’ standard deviation is that the distribution of KeyWords Plus was more condensed and concentrated. The coefficient of determination (r-squared) for these two groups, as retrieved from Excel was 0.012, which indicates that the two sets of data had a very low linear relationship. Table 9 shows the ANOVA table of KeyWords Plus and author keywords data set with 5% significant level. From the outcome of the ANOVA table, the null hypothesis is rejected as F value equals 121.97, which is greater than F-crit. (3.84). As a summary, there is strong evidence to shows that the frequency of author keywords had an impact on the KeyWords Plus in the total number of publications.
Table 9
Results of ANOVA test for effect of author keyword and KeyWords plus
Source of variation
Sum of square
Degree of freedom
Mean square
F value
Pr(> F)
Between groups
3956.402
1
3956.40
121.97
2.69E−28
Within groups
852,197.5
26,274
32.43
Total
856,153.9
26,275
(F-crit = 3.84)
Multi-regression analysis
Three factors were used to observe the multiple regression for each paper that is, the number of pages (NP), the number of references (NR) and the number of authors (NA). Microsoft Excel version 2013 was used for the regression analysis to analyze the effect of these factors on the Number of Citation (NC) over the total number of papers. The result obtained from the analysis is shown in Table 10, to determine how each single factor contributes to the value of the dependent variable. The coefficient column in Table 10 shows the value of the percentage of effect of each factor on the number of citations. Below is a multiple regression equation produced from Excel, which correlates to the number of citation formula:
Table 10
Result of t-test for the effect of the number of publications in all and highly cited papers
If we are given the number of authors, number of pages and number of references, then the number of citations can be predicted using this multiple regression. The t-test for each of the coefficient is displayed in Table 10. For the number of pages and number of references the P-values are very small and acceptable for factors in the multiple regression equation. For the number of authors the coefficient at the 10% significant level was rejected (but it was not rejected at the 5% significant level). Consequently, for this given multiple regression, all the mentioned factors were acceptable to determine the number of citations with the above given weightage. Therefore, all of the factors had a very small P-value except the number of pages factor which needed a smaller significant level to not be rejected.
Conclusion
The bibliometric analysis of the big data revealed that the worldwide research trends and performance in the subject areas. So far, there are significant gaps in current research about the bibliometric analysis of the big data. In this study, selected keywords were used to extract the most relevant papers from the Web of ScienceTM (WoS) Core Collection database, which consists of Science Citation Index Expanded (SCI), Social Science Citation Index (SSCI), and Arts & Humanities Citation Index (A&HCI) from 1980 to 19 March 2015, and Conference Proceeding Citation Index-Science (COCI-S), and Conference Proceedings Citation Index—Social Science & Humanities (CPCI-SSH) from 2004 to 19 March 2015. In total, 6572 papers (including 28 highly cited papers reported by ESI) were refined by all relevant WoS categories to computer science and then the bibliometric information of all the papers was obtained. In total, 2866 source tittles including journals and conferences were listed in 96 web of science categories with the 14 different document types. English was the dominant language with 6549 records (99.65%) and the five most popular trends areas were Computer Science, Engineering, Telecommunications, Operations Research Management Science, and Medical Informatics. The findings showed that the USA, China and Germany were the most productive countries that played a predominant role in this study with the highest number of published papers in the world. However, other top countries as mentioned above, made a significant contribution to the field. In contrast, there is an essential lack of research to the field of big data in 96 countries with no publications.
The analysis of authors among the all and highly cited papers showed that there were 14,949 authors in all papers, and the average was 2.27, meaning that there were more than two authors for each paper. In addition, there were five authors with two publications and 105 authors with one publication in the highly cited group. In addition, the analysis of the author keywords showed that among the top 20 most frequent keywords there were fewer records from 1980–1999. However, the most keywords were used from 2000 to 2015. The results obtained from the analysis of KeyWords Plus revealed that similar keywords were “classification(s)/classifier(s)”, “neural network(s)”, “support vector machine(s)”, “performance”, and “mapreduce” which played a pivotal role over all keywords. The analysis of top 20 highest frequency of author keywords used from 1980–2015, shows that all to 20 fields are increasing and none of them declining during the mentioned period. Moreover, the multi-regression analysis of the number of pages, number of references and number of authors compared to the number of citations were analyzed and the correlation formula is provided in this study.
The findings of this study provide relevant researchers with a panorama of worldwide big data research and the established direction for further study to the field and most relevant research areas.
Authors’ contributions
All authors contributed equally to this work. All authors read and approved the final manuscript.
Authors’ information
Not applicable.
Competing interests
The authors declare that they have no competing interests.
Availability of data and materials
Not applicable.
Consent for publication
Not applicable.
Ethics approval and consent to participate
Not applicable.
Funding
Not applicable.
Publisher’s Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 4.0 International License (http://creativecommons.org/licenses/by/4.0/), which permits unrestricted use, distribution, and reproduction in any medium, provided you give appropriate credit to the original author(s) and the source, provide a link to the Creative Commons license, and indicate if changes were made.
