Skip to main content
Erschienen in: EPJ Data Science 1/2012

Open Access 01.12.2012 | Regular article

Long trend dynamics in social media

verfasst von: Chunyan Wang, Bernardo A Huberman

Erschienen in: EPJ Data Science | Ausgabe 1/2012

Aktivieren Sie unsere intelligente Suche, um passende Fachinhalte oder Patente zu finden.

search-config
download
DOWNLOAD
print
DRUCKEN
insite
SUCHEN
loading …

Abstract

A main characteristic of social media is that its diverse content, copiously generated by both standard outlets and general users, constantly competes for the scarce attention of large audiences. Out of this flood of information some topics manage to get enough attention to become the most popular ones and thus to be prominently displayed as trends. Equally important, some of these trends persist long enough so as to shape part of the social agenda. How this happens is the focus of this paper. By introducing a stochastic dynamical model that takes into account the user’s repeated involvement with given topics, we can predict the distribution of trend durations as well as the thresholds in popularity that lead to their emergence within social media. Detailed measurements of datasets from Twitter confirm the validity of the model and its predictions.
Hinweise

Electronic supplementary material

The online version of this article (doi:10.​1140/​epjds2) contains supplementary material, which is available to authorized users.

Competing interests

The authors declare that they have no competing interests.

1 Introduction

The past decade has witnessed an explosive growth of social media, creating a competitive environment where topics compete for the attention of users [1, 2]. A main characteristic of social media is that both users and standard media outlets generate content at the same time in the form of news, videos and stories, leading to a flood of information from which it is hard for users to sort out the relevant pieces to concentrate on [3, 4]. User attention is critical for the understand of how problems in culture, decision making and opinion formation evolve [57]. Several studies have shown that attention allocated to on-line content is distributed in a highly skewed fashion [811]. While most documents receive a negligible amount of attention, a few items become extremely popular and persist as public trends for long a period of time [1214]. Recent studies have focused on the dynamical growth of attention on different kinds of social media, including Digg [1517], Youtube [18], Wikipedia [1921] and Twitter [14, 2224]. The time-scale over which content persists as a topic in these media also varies on a scale from hours to years. In the case of news and stories, content spreads on the social network until its novelty decays [15]. In information networks like Wikipedia, where a document remains alive for months and even years, popularity is governed by bursts of sudden events and is explained by the rank shift model [19].
While previous work has successfully addressed the growth and decay of news and topics in general, a remaining problem is why some of the topics stay popular for longer periods of time than others and thus contribute to the social agenda. In this paper, we focus on the dynamics of long trends and their persistence within social media. We first introduce a dynamic model of attention growth and derive the distribution of trend durations for all topics. By analyzing the resonating nature of the content within the community, we provide a threshold criterion that successfully predicts the long term persistence of social trends. The predictions of the model are then compared with measurements taken from Twitter, which as we show provides a validation of the proposed dynamics.
This paper is structured as follows. In Section 2 we describe our model for attention growth and the persistence of trends. Section 3 describes the data-set and the collection strategies used in the study, whereas Section 4 discusses the measurements made on data-sets from Twitter and compares them with the predictions of the model. Section 5 concludes with a summary of our findings and future directions.

2 Model

On-line micro-blogging and social service websites enable users to read and send text-based messages to certain topics of interest. The popularity of these topics is commonly measured by the number of postings about these topics [15, 19]. For instance on Twitter, Digg and Youtube, users post their thoughts on topics of interest in the form of tweets and comments. One special characteristic of social media that has been ignored so far is that users can contribute to the popularity of a topic more than once. We take this into account by denoting first posts on a certain topic from a certain user by the variable First Time Post (FTP). If the same user posts on the topic more than once, we call it a Repeated Post (RP). In what follows, we first look at the growth dynamics of FTP.
When a topic first catches people’s attention, a few people may further pass it on to others in the community. If we denote the cumulative number of FTP mentioning the topic at time t by N t , the growth of attention can be described by N t = ( 1 + χ t ) N t 1 , where the χ t are assumed to be small, positive, independent and identically distributed random variables with mean μ and variance σ 2 . For small χ s , the equation can be approximated as:
N t s = 1 t e χ s N 0 = e s = 1 t χ s N 0 .
(1)
Taking logarithms on both sides, we obtain log N t N 0 = s = 1 t χ s . Applying the central limit theorem to the sum, it follows that the cumulative count of FTP should obey a log-normal distribution.
We now consider the persistence of social trends. We use the variable vitality, ϕ t = N t N t 1 , as a measurement of popularity, and assume that if the vitality of a topic falls below a certain threshold θ 1 , the topic stops trending. Thus
log ϕ t = log N t N t 1 = log N t N 0 log N t 1 N 0 χ t .
(2)
The probability of ceasing to trend at the time interval s is equal to the probability that ϕ s is lower than a threshold value θ 1 , which can be written as:
p = Pr ( ϕ s < θ 1 ) = Pr ( log ϕ s < log ( θ 1 ) ) = Pr ( χ s < log ( θ 1 ) ) = F ( log ( θ 1 ) ) ,
(3)
where F ( x ) is the cumulative distribution function of the random variable χ. We are thus able to determine the threshold value from θ 1 = e F 1 ( p ) if we know the distribution of the random variable χ. Notice that if χ is independent and identically distributed, it follows that the distribution of trending durations is given by a geometric distribution with Pr ( L = k ) = ( 1 p ) k p . The expected trending duration of a topic, E ( L ) , is therefore given by
E ( L ) = 0 ( 1 p ) k p k = 1 p 1 = 1 F ( log ( θ 1 ) ) 1 .
(4)
Thus far we have only considered the impact of FTP on social trends by treating all topics as identical to each other. To account for the resonance between users and specific topics we now include the RP into the dynamics. We define the instantaneous number of FTP posted in the time interval t as FTP t , and the repeated posts, RP, in the time interval t as RP t . Similarly we denote the cumulative number of all posts-including both FTP and RP-as S t . The resonance level of fans with a given topic is measured by μ t = FTP t + RP t FTP t , and we define the expected value of μ t , E ( μ t ) as the active-ratio a q .
We can simplify the dynamics by assuming that μ t is independent and uniformly distributed on the interval [ 1 , 2 a q 1 ] . It then follows that the increment of S t is given by the sum of FTP t and RP t . We thus have
S t S t 1 = FTP t + RP t = μ t F T P t = μ t ( N t N t 1 ) = μ t χ t N t 1 .
(5)
And also
E μ ( S t ) = E μ ( S t 1 ) + a q ( N t N t 1 ) = E μ ( S t 2 ) + a q ( N t N t 2 ) = = E μ ( S 0 ) + a q ( N t N 0 ) = a q N t .
(6)
We approximate S t 1 by μ t N t 1 . Going back to Equation 5, we have
S t μ t ( χ t + 1 ) N t 1 μ t e χ t N t 1 .
(7)
From this, it follows that the dynamics of the full attention process is determined by the two independent random variables, μ and χ. Similarly to the derivation of Equation 3, the topic is assumed to stop trending if the value of either one of the random variables governing the process falls below the thresholds θ 1 and θ 2 , respectively. One point worth mentioning here is that, θ 1 and θ 2 are system parameters, i.e. not dependent on the topic, but only on the studied medium. The probability of ceasing to trend, defined as p , is now given by
p = Pr ( χ t < log ( θ 1 ) ) Pr ( μ t < θ 2 ) = θ 2 1 2 ( a q 1 ) p ,
(8)
p = F ( log ( θ 1 ) )
. The expected value of L q for any topic q is given by
E ( L q ) = 2 ( a q 1 ) F ( log θ 1 ) ( θ 2 1 ) 1 .
(9)
Which states that the persistent duration of trends associated with given topics is expected to scale linearly with the topic users’ active-ratio. From this result it follows that one can predict the trend duration for any topic by measuring its user active-ratio after the values of θ 1 and θ 2 are determined from empirical observations.

3 Data

To test the predictions of our dynamic model, we analyzed data from Twitter, an extremely popular social network website used by over 200 million users around the world. Its interface of allows users to post short messages, known as tweets, that can be read and retweeted by other Twitter users. Users declare the people they follow, and they get notified when there is a new post from any of these people. A user can also forward the original post of another user to his followers by the re-tweet mechanism.
In our study, the cumulative count of tweets and re-tweets that are related to a certain topic was used as a proxy for the popularity of the topic. On the front page of Twitter there is also a column named trends that presents the few keywords or sentences that are most frequently mentioned in Twitter at a given moment. The list of popular topics in the trends column is updated every few minutes as new topics become popular. We collected the topics in the trends column by performing an API query every 20 minutes. For each of the topics in the trending column, we used the Search API function to collect the full list of tweets and re-tweets related to the topic over the past 20 minutes. We also collected information about the author of the post, identified by a unique user-id, the text of the post and the time of its posting. We thus obtained a dataset of 16.32 million posts on 3361 different topics. The longest trending topic we observed had a length of 14.7 days. We found that of all the posts in our dataset, 17% belonged to the RP category.

4 Results

We start by analyzing the distribution of N from our data-set. We found out that N 10 follows a log-normal distribution, as can be seen from Figure 1. The Q-Q plot in Figure 1 follows a straight line. Different values of t yield similar results. The Kolmogorov-Smirnov normality test of log ( N 10 ) with mean 3.5577 and standard deviation 0.3266 yields a p-value of 0.0838. At a significance level of 0.05, the test fails to reject the null hypothesis that log ( N 10 ) follows normal distribution, a result which is consistent with Equation 1.
We also measured the distribution of χ from χ t = N t N t 1 1 . We found that log ( χ ) follows a normal distribution with mean equal to −1.4522 and a standard deviation value of 0.6715, as shown in Figure 2. The Kolmogorov-Smirnov normality test statistic gives a high p-value of 0.5346. The mean value of χ is 0.0353, which is small for the approximations in Equation 1 and Equation 7 to be valid. We also examined the record breaking values of vitality, ϕ t = χ t + 1 , which signal the behavior of the longest lasting trends. From the theory of records, if the values ϕ t come from an independent and identical distribution, the number of records that have occurred up to time t, defined as R n ( t ) , should scale linearly with log ( t ) [26, 27]. As is customary, we say that a new record has been established if the vitality of the trend at the moment is longer than all of the previous observations. As shown in Figure 3, there is a linear scaling relationship between log ( t ) and R n ( t ) for a sample topic “Kim Chul Hee”. The topic kept trending for 14 days on Twitter in September 2010. Similar observations are repeated for other different topics on Twitter. One implication of this observation is that confirms the validity of our assumption that the values of χ 1 , χ 2 , , χ t are independent and identically distributed.
Next we turn our attention to the distribution of durations of long trends. As shown in Figure 4 and Figure 5, a linear fit of trend duration as a function of density in a logarithmic scale suggests an exponential family, which is consistent with Equation 4. The red line in Figure 4 gives a linear fitting with R-square 0.9112. From the log-log scale plot in Figure 5, we observe that the distribution deviates from a power law, which is a characteristic of social trends that originate from news on social media [25]. From the distribution of trending times, p is estimated to have a value of 0.12. Together with the measured distribution of χ and Equation 3, we can estimate the value of θ to be 1.0132.
We can also determine the expected duration of trend times stemming from the impact of active-ratio. The frequency count of active-ratios over different topics is shown in Figure 6, with a peak at a q = 1.2 . This observation suggests that while the ratio is centered around 1.2 for the majority of topics, there are a few topics obtain large amount of repeated attention. This observation may shadow light on existing observations about the highly skewed distribution in attention dynamic studies. As can be seen in Figure 7, the trend duration of different topics scales linearly with the active-ratio, which is consistent with the prediction of Equation 9. The R-square of the linear fitting has a value of 0.98664. From the slope of the linear fit and θ 1 = 1.0132 , and Equation 9 we obtain a value for θ 2 = 1.153 . With the value of θ 1 and θ 2 , we are able to predict the expected trend duration of any given topic based on measurements of its active-ratio.

5 Discussion and conclusion

In this paper we investigated the persistence dynamics of trends in social media. By introducing a stochastic dynamic model that takes into account the user’s repeated involvement with given topics, we are able to predict the distribution of trend durations as well as the thresholds in popularity that lead to the emergence of given topics as trends within social media. The predictions of our mode were confirmed by a careful analysis of a data from Twitter. Furthermore, a linear relationship between the resonance level of users with given topics, and the trending duration of a topic was derived. The proposed model provides a deeper understanding the popularity of on-line contents. Parameters θ 1 and θ 2 in our model are system specific and could be calculated from hidden algorithms when applying our model to other on-line social media websites. Possible refinements may include the effect of competition between topics, sudden burst of events, the effect of marketing campaigns and the actively censoring of specific topics [28]. In closing, we note that although the focus in this paper has been on trend dynamics that are featured on social media websites, the framework and model may be suitable to other types of content and off-line trends. The issue raised - that is, trending phenomenon under the impact of user’s repeated involvement - is therefore a general one and should provide ample opportunities for future work.

Author contributions

B.H. and C.W. designed the study and performed research. C.W. and B.H. wrote the paper. All authors read and approved the final manuscript.

Acknowledgements

We acknowledge useful discussions with S. Asur and G. Szabo. C.W. would like to thank HP Labs for financial support.
Open AccessThis article is distributed under the terms of the Creative Commons Attribution 2.0 International License (https://​creativecommons.​org/​licenses/​by/​2.​0), which permits unrestricted use, distribution, and reproduction in any medium, provided the original work is properly cited.

Competing interests

The authors declare that they have no competing interests.
Literatur
1.
Zurück zum Zitat McCombs ME, Shaw DL: The evolution of agenda setting research: twenty five years in the marketplace of ideas. Journal of Communication 1993,43(2):68–84. 10.1111/j.1460-2466.1993.tb01263.xCrossRef McCombs ME, Shaw DL: The evolution of agenda setting research: twenty five years in the marketplace of ideas. Journal of Communication 1993,43(2):68–84. 10.1111/j.1460-2466.1993.tb01263.xCrossRef
2.
Zurück zum Zitat Falkinger J: Limited attention as a scarce resource in information-rich economies. Econ J (Lond) 2008,118(532):1596–1620.CrossRef Falkinger J: Limited attention as a scarce resource in information-rich economies. Econ J (Lond) 2008,118(532):1596–1620.CrossRef
3.
Zurück zum Zitat Agichtein E, Castillo C, Donato D, Gionis A, Mishne G: Finding high-quality content in social media. Proceedings of the international conference on Web search and web data mining (WSDM) 2008. Agichtein E, Castillo C, Donato D, Gionis A, Mishne G: Finding high-quality content in social media. Proceedings of the international conference on Web search and web data mining (WSDM) 2008.
4.
Zurück zum Zitat Kaplan AM, Haenlein M: Users of the world, unite! The challenges and opportunities of Social Media. Bus Horiz 2010,53(1):59–68. 10.1016/j.bushor.2009.09.003CrossRef Kaplan AM, Haenlein M: Users of the world, unite! The challenges and opportunities of Social Media. Bus Horiz 2010,53(1):59–68. 10.1016/j.bushor.2009.09.003CrossRef
5.
Zurück zum Zitat Zhu J-H: Issue competition and attention distraction: a zero-sum theory of agenda setting. Journal Q 1992, 69: 825–836. 10.1177/107769909206900403CrossRef Zhu J-H: Issue competition and attention distraction: a zero-sum theory of agenda setting. Journal Q 1992, 69: 825–836. 10.1177/107769909206900403CrossRef
6.
Zurück zum Zitat Wuchty S, Jones BF, Uzzi B: The increasing dominance of teams in production of knowledge. Science 2007,316(5827):1036–1039. 10.1126/science.1136099CrossRef Wuchty S, Jones BF, Uzzi B: The increasing dominance of teams in production of knowledge. Science 2007,316(5827):1036–1039. 10.1126/science.1136099CrossRef
7.
Zurück zum Zitat Guimerà R, Uzzi B, Spiro J, Amaral LAN: Team assembly mechanisms determine collaboration network structure and team performance. Science 2005,308(5722):697–702. 10.1126/science.1106340CrossRef Guimerà R, Uzzi B, Spiro J, Amaral LAN: Team assembly mechanisms determine collaboration network structure and team performance. Science 2005,308(5722):697–702. 10.1126/science.1106340CrossRef
8.
Zurück zum Zitat Huberman BA, Pirolli PLT, Pitkow JE, Lukose RM: Strong regularities in world wide web surfing. Science 1998,280(5360):95–97. 10.1126/science.280.5360.95CrossRef Huberman BA, Pirolli PLT, Pitkow JE, Lukose RM: Strong regularities in world wide web surfing. Science 1998,280(5360):95–97. 10.1126/science.280.5360.95CrossRef
9.
Zurück zum Zitat Johansen A, Sornette D: Download relaxation dynamics on the WWW following newspaper publication of URL. Physica A 2000,276(1–2):338–345. 10.1016/S0378-4371(99)00468-9MathSciNetCrossRef Johansen A, Sornette D: Download relaxation dynamics on the WWW following newspaper publication of URL. Physica A 2000,276(1–2):338–345. 10.1016/S0378-4371(99)00468-9MathSciNetCrossRef
10.
Zurück zum Zitat Huberman BA: The laws of the web: patterns in the ecology of information. MIT Press, Massachusetts; 2001. Huberman BA: The laws of the web: patterns in the ecology of information. MIT Press, Massachusetts; 2001.
11.
Zurück zum Zitat Vázquez A, et al.: Modeling bursts and heavy tails in human dynamics. Phys Rev E 2006., 73: Vázquez A, et al.: Modeling bursts and heavy tails in human dynamics. Phys Rev E 2006., 73:
12.
Zurück zum Zitat Neuman WR: The threshold of public attention. Public Opin Q 1990, 54: 159–176. 10.1086/269194CrossRef Neuman WR: The threshold of public attention. Public Opin Q 1990, 54: 159–176. 10.1086/269194CrossRef
13.
Zurück zum Zitat Klamer A, Van Dalen HP: Attention and the art of scientific publishing. J Econ Methodol 2002,9(3):289–315. 10.1080/1350178022000015104CrossRef Klamer A, Van Dalen HP: Attention and the art of scientific publishing. J Econ Methodol 2002,9(3):289–315. 10.1080/1350178022000015104CrossRef
14.
Zurück zum Zitat Becker H, Naaman M, Gravano L: Beyond trending topics: real-world event identification on Twitter. Proceedings of 15th international conference on Weblogs and Social Media (ICWSM) 2011. Becker H, Naaman M, Gravano L: Beyond trending topics: real-world event identification on Twitter. Proceedings of 15th international conference on Weblogs and Social Media (ICWSM) 2011.
15.
Zurück zum Zitat Wu F, Huberman BA: Novelty and collective attention. Proc Natl Acad Sci USA 2007, 105: 17599.CrossRef Wu F, Huberman BA: Novelty and collective attention. Proc Natl Acad Sci USA 2007, 105: 17599.CrossRef
16.
Zurück zum Zitat Leskovec J, Backstrom L, Kleinberg J (2009) Meme-tracking and the dynamics of the news cycle. International conference on knowledge discovery and data mining (KDD) Leskovec J, Backstrom L, Kleinberg J (2009) Meme-tracking and the dynamics of the news cycle. International conference on knowledge discovery and data mining (KDD)
17.
Zurück zum Zitat Lerman K, Hogg T: Using a model of social dynamics to predict popularity of news. Proceedings of 19th international World Wide Web conference (WWW) 2010. Lerman K, Hogg T: Using a model of social dynamics to predict popularity of news. Proceedings of 19th international World Wide Web conference (WWW) 2010.
18.
Zurück zum Zitat Crane R, Sornette D: Robust dynamic classes revealed by measuring the response function of a social system. Proc Natl Acad Sci USA 2008, 105: 15649. 10.1073/pnas.0803685105CrossRef Crane R, Sornette D: Robust dynamic classes revealed by measuring the response function of a social system. Proc Natl Acad Sci USA 2008, 105: 15649. 10.1073/pnas.0803685105CrossRef
19.
Zurück zum Zitat Ratkiewicz J, Fortunato S, Flammini A, Menczer F, Vespignani A: Characterizing and modeling the dynamics of online popularity. Phys Rev Lett 2010., 105: Ratkiewicz J, Fortunato S, Flammini A, Menczer F, Vespignani A: Characterizing and modeling the dynamics of online popularity. Phys Rev Lett 2010., 105:
20.
Zurück zum Zitat Capocci A, Servedio VDP, Colaiori F, Buriol LS, Donato D, Leonardi S, Caldarelli G: Preferential attachment in the growth of social networks: the Internet encyclopedia Wikipedia. Phys Rev E 2006., 74: Capocci A, Servedio VDP, Colaiori F, Buriol LS, Donato D, Leonardi S, Caldarelli G: Preferential attachment in the growth of social networks: the Internet encyclopedia Wikipedia. Phys Rev E 2006., 74:
21.
Zurück zum Zitat Zlatic V, Bozicevic M, Stefancic H, Domazetl M: Wikipedias: collaborative web-based encyclopedias as complex networks. Phys Rev E 2006., 74: Zlatic V, Bozicevic M, Stefancic H, Domazetl M: Wikipedias: collaborative web-based encyclopedias as complex networks. Phys Rev E 2006., 74:
22.
Zurück zum Zitat Jansen BJ, Zhang M, Sobel K, Chowdhury A: Twitter power: tweets as electronic word of mouth. J Am Soc Inf Sci 2009,60(11):2169–2188. 10.1002/asi.21149CrossRef Jansen BJ, Zhang M, Sobel K, Chowdhury A: Twitter power: tweets as electronic word of mouth. J Am Soc Inf Sci 2009,60(11):2169–2188. 10.1002/asi.21149CrossRef
23.
Zurück zum Zitat Lee K, Palsetia D, Narayanan R, Patwary MMA, Agrawal A, Choudhary A (2011) Twitter trending topic classification. 11th IEEE international conference on data mining workshops (ICDMW)CrossRef Lee K, Palsetia D, Narayanan R, Patwary MMA, Agrawal A, Choudhary A (2011) Twitter trending topic classification. 11th IEEE international conference on data mining workshops (ICDMW)CrossRef
24.
Zurück zum Zitat Gonçalves B, Perra N, Vespignani A: Modeling users’ activity on Twitter networks: validation of Dunbar’s number. PLoS ONE 2011.,6(8):CrossRef Gonçalves B, Perra N, Vespignani A: Modeling users’ activity on Twitter networks: validation of Dunbar’s number. PLoS ONE 2011.,6(8):CrossRef
25.
Zurück zum Zitat Sitaram A, Huberman BA, Szabo G, Wang C: Trends in Social Media: persistence and decay. Proceedings of 15th international conference on Weblogs and Social Media (ICWSM) 2011. Sitaram A, Huberman BA, Szabo G, Wang C: Trends in Social Media: persistence and decay. Proceedings of 15th international conference on Weblogs and Social Media (ICWSM) 2011.
26.
Zurück zum Zitat Redner S, Petersen MR: Role of global warming on the statistics of record-breaking temperatures. Phys Rev E 2006., 74: Redner S, Petersen MR: Role of global warming on the statistics of record-breaking temperatures. Phys Rev E 2006., 74:
27.
Zurück zum Zitat Krug J (2007) Records in a changing world. J Stat Mech. doi:10.1088/1742-5468/2007/07/P07001 07001 Krug J (2007) Records in a changing world. J Stat Mech. doi:10.1088/1742-5468/2007/07/P07001 07001
28.
Zurück zum Zitat Sydell L (2011) How Twitter’s trending algorithm picks its topics. http://www.npr.org/2011/12/07/143013503/how-twitters-trending-algorithm-picks-its-topicsCrossRef Sydell L (2011) How Twitter’s trending algorithm picks its topics. http://​www.​npr.​org/​2011/​12/​07/​143013503/​how-twitters-trending-algorithm-picks-its-topicsCrossRef
Metadaten
Titel
Long trend dynamics in social media
verfasst von
Chunyan Wang
Bernardo A Huberman
Publikationsdatum
01.12.2012
Verlag
Springer Berlin Heidelberg
Erschienen in
EPJ Data Science / Ausgabe 1/2012
Elektronische ISSN: 2193-1127
DOI
https://doi.org/10.1140/epjds2

Weitere Artikel der Ausgabe 1/2012

EPJ Data Science 1/2012 Zur Ausgabe

Editorial

Editorial

Premium Partner