Figures
Abstract
One of the best known claims about human communication is that people's behaviour and language use converge during conversation. It has been proposed that these patterns can be explained by automatic, cross-person priming. A key test case is structural priming: does exposure to one syntactic structure, in production or comprehension, make reuse of that structure (by the same or another speaker) more likely? It has been claimed that syntactic repetition caused by structural priming is ubiquitous in conversation. However, previous work has not tested for general syntactic repetition effects in ordinary conversation independently of lexical repetition. Here we analyse patterns of syntactic repetition in two large corpora of unscripted everyday conversations. Our results show that when lexical repetition is taken into account there is no general tendency for people to repeat their own syntactic constructions. More importantly, people repeat each other's syntactic constructions less than would be expected by chance; i.e., people systematically diverge from one another in their use of syntactic constructions. We conclude that in ordinary conversation the structural priming effects described in the literature are overwhelmed by the need to actively engage with our conversational partners and respond productively to what they say.
Citation: Healey PGT, Purver M, Howes C (2014) Divergence in Dialogue. PLoS ONE 9(6): e98598. https://doi.org/10.1371/journal.pone.0098598
Editor: Kevin Paterson, University of Leicester, United Kingdom
Received: August 22, 2013; Accepted: May 2, 2014; Published: June 11, 2014
Copyright: © 2014 Healey et al. This is an open-access article distributed under the terms of the Creative Commons Attribution License, which permits unrestricted use, distribution, and reproduction in any medium, provided the original author and source are credited.
Funding: This work was supported by the Economic and Social Research Council (ESRC; http://www.esrc.ac.uk/) through the DynDial project (Dynamics of Conversational Dialogue, RES-062-23-0962) and the Engineering and Physical Sciences Research Council (EPSRC; http://www.epsrc.ac.uk/) through the RISER project (Robust Incremental Semantic Resources for Dialogue, EP/J010383/1). The funders had no role in study design, data collection and analysis, decision to publish, or preparation of the manuscript.
Competing interests: During the conduct of this study, Healey and Purver were funded at various times by grants from the Engineering and Physical Sciences Research Council, Economic and Social Research Council, and Howes completed a PhD, funded by the Engineering and Physical Sciences Research Council. Purver has also received funding from the Technology Strategy Board, CreativeWorks London and the European Union Framework Programme 7. He is a Director of Chatterbox Labs Limited, a commercial company which supplies a software service for social media analysis. Healey has also received funding from AHRC, DSTL, Leverhulme and The Wellcome Trust. This does not alter the authors' adherence to all the PLOS ONE policies on sharing data and materials.
Introduction
It is widely reported that people's behaviour tends to converge during conversation; amongst other things body posture, movements, speech rhythm, speech rate, accent and facial expressions all tend to become more similar [1]–[3]. Early accounts of these phenomena emphasised the role of strategic social processes in promoting convergence [2]. However, more recent theories have proposed that convergence can be explained in terms of automatic, cross-person priming mechanisms [4]–[6]. The advantage of a priming account is that it promises a relatively simple, computationally inexpensive explanation of the basic mechanisms underpinning communication that is compatible with implementation by the human ‘mirror neuron’ system [6]–[9].
Recently, the reliability of some cross-person ‘social’ priming effects has been called into question [10], [11]. One source of concern is that, unlike conventional priming effects, social priming often appeals to activation of high level mental representations and involves effects that persist over relatively long time-scales and across different contexts e.g. reading words associated with being old as a prime for ‘older’ patterns of walking several minutes later.
Structural priming, which plays an important role in priming-based accounts of communication, is less vulnerable to these concerns. It involves low-level structural representations and priming over short intervals between instances of language comprehension and production in the same modality. Structural priming is also insulated to some extent from conscious or strategic social goals. People are not normally aware of the syntactic structures they use in conversation nor whether they are matching each other's syntax [12]. This makes syntax a good candidate for automatic, cross-person priming processes. Partly because of this it has been accorded a key role in helping to drive the alignment of higher level cognitive representations during communication including the co-ordination of semantic content and situation models [5], [6]. It thus constitutes an important test case for priming-based models of communication.
Most of the psycholinguistic evidence for structural priming is drawn from experimental studies of self-repetition in which people process sequences of written or spoken sentences in isolation (see [13], [14] for reviews). Fewer studies have directly investigated whether people tend to repeat each other's syntax in conversational contexts.
The empirical evidence for structural priming in conversation comes from corpus analyses of syntactic repetition and from experimental studies of task-oriented dialogue. Here we argue that the patterns of other-repetition reported in these studies do not generalise to ordinary conversation. We present a new analysis of two corpora of ordinary spoken dialogues which shows that when we take patterns of lexical repetition into account people do not repeat their own syntax more than would be expected by chance. Moreover, people systematically diverge from one-another in their use of syntactic structures. These results are incompatible with the predictions of automatic priming-based models of communication and therefore undermine the claim that priming is the basic mechanism underpinning successful human interaction.
We argue that priming, and the patterns of repetition it predicts, provides a conservative model of communication that is unable to address how we engage productively with our conversational partners. Although the coherence of conversation depends on repeating some of each other's words this is not a ‘blind’, automatic process. Rather, successful communication seems to depend on the ability to selectively repeat some of our conversational partner's words in different syntactic contexts in order to produce the contrasts, elaborations and corrections that move a conversation forward.
Corpus Evidence for Structural Convergence in Dialogue
Relatively few corpus studies of repetition address the specific question of whether people show a general tendency to repeat each other's syntax in conversation. Some use small sample sizes that don't generalise well (e.g. [15], eight conversations; [16] three conversations) or focus their analysis on particular subsets of syntactic structures [13], [17], [18]. The data sets also sometimes include non-conversational elements such as written and spoken monologue [13], [16], [18], [19] or include different genres of spoken data such as lectures, speeches and interviews [13], [16], [18].
Three studies that focus directly on other-repetition in spoken dialogue have produced inconclusive results. Reitter et al [20] find other-repetition of all syntactic structures is above chance in a face-to-face route description task but below chance in telephone conversations involving the alternating discussion of predefined topics. In contrast to this, a study focussing on five target syntactic constructions using the same telephone corpus finds other-repetition is above chance for three out of five constructions [19]. Gries [13] finds patterns of other-repetition above chance for two constructions: the prepositional object-direct object (or PO-DO) alternation and verb-particle placement. However this corpus includes written and spoken monologue and context specific situations such as legal cross-examinations and broadcast interviews. Re-analysis using only the unstructured dialogues from this data set, i.e. formal and informal face-to-face conversations and telephone calls, finds no effect of other-repetition [21].
Experimental Evidence for Structural Convergence in Dialogue
The first experimental study of cross-person repetition in dialogue is provided by Levelt and Kelter [22], however this investigates word repetition not structural repetition. The strongest experimental evidence for cross-person structural repetition comes from Branigan and colleagues [23], [24]. Subjects are presented with a pictorial scene with a verb printed below, e.g. ‘give’. The picture can be equally well described by, for example,“The girl giving the book to the boy” (a Prepositional Object or PO structure) or “The girl giving the boy the book” (a Double Object or DO structure). If an experimental confederate and a naïve subject alternate in producing descriptions of a sequence of such scenes, the choice of one structure by the confederate systematically increases the likelihood that the naïve subject will choose the same structure for the next item they describe. Importantly, this effect is independent of lexical repetition as it is present even when the target verb is not repeated between the prime picture and the subsequent target picture [23]. Cleland and Pickering [25] also manipulate noun phrase structures (pre-nominal vs relative clause) as primes instead of verb phrases but find a less consistent structural priming effect.
For practical reasons experimental studies are only able to test a relatively small number of syntactic constructions. The need for experimental control also inevitably limits the naturalness of the interaction. Confederates in these studies follow a script and the naïve participants are instructed that they can only describe an item or say “Please repeat” which considerably restricts the dialogue.
In summary, the strongest evidence in support of structural priming effects is based on task-oriented dialogues, gathered in controlled environments and for a limited number of syntactic structures. Consequently, the prediction that structural priming should lead to general convergence in ordinary conversation has not been directly tested. To address this we analyse patterns of syntactic repetition across all syntactic structures in two large corpora of unscripted, open-ended conversations gathered in a variety of everyday contexts.
Correlations Between Syntactic and Lexical Repetition
The topical coherence of conversation depends on recurrent references to people, places, activities or events [15], [16] and these repetitions automatically increase the likelihood of syntactic repetition. For example, if a verb of a particular syntactic type (e.g. transitive or ditransitive) is repeated this also constrains the syntactic structure of the repetition. As a result, tests for independent effects of syntactic repetition need to correct for the correlation between word repetition and syntactic repetition [13], referred to in experimental studies as the ‘lexical boost’ effect [14], [26]. Existing studies do not directly correct for this correlation in their estimates of syntactic repetition effects [19], [20], [22], [27] although some studies mitigate it by excluding verbatim repetition of phrases [20]. To address this we include word repetition directly as a covariate in our analysis of syntactic repetition.
Hypotheses
Priming-based models of communication predict that there should be a general tendency for different linguistic structures to repeat across turns in conversation. This is expected to occur at multiple levels of linguistic representation such as phonetics, phonology, words, syntax, semantics and situation models and priming at one level is expected to facilitate priming at other levels through a process referred to as percolation [5], [6]. This helps alignment at one level of representation promote alignment at another. Priming effects are expected to be strongest immediately after a representation has been activated but then decay as the distance from the prime, measured in time or intervening words or turns increases. This leads to three key predictions about structural priming:
- Repetition: people should repeat their own and each other's syntactic structures more often than chance,
- Percolation: priming at one level (e.g. syntax) should facilitate priming at another (e.g. words) and
- Decay: the likelihood of repetition of a syntactic structure should decrease with distance from a prime.
Methods
To test these predictions we analyse the levels of syntactic and lexical repetition over sequences of turns in spoken face-to-face conversation and compare these with the levels of repetition that would be expected by chance.
Materials and Design
We use two published corpora: the Diachronic Corpus of Present-Day Spoken English [28] and the British National Corpus [29] – Table 1 shows a summary of the data used. Both corpora contain transcriptions of spontaneous conversations based on mobile tape recordings collected by people sampled from different age groups, locations and social classes in the UK. Two corpora are used to ensure sufficient statistical power and as a cross-check on the possible influence of different parse trees and different grammar formalisms on estimates of syntactic repetition. The DCPSE is hand-annotated with syntactic parse trees [30]. We produced machine parsed equivalents for the larger BNC corpus by parsing with a Combinatory Categorial Grammar (CCG) [31] using a computational parser [32]. Examples of the different parse trees the two approaches produce for the same utterances (shown in Table S1 in File S1) are provided in Figures S2 and S3 in File S1.
Procedure
For each person in each conversation we calculate the similarity between each turn they produce and each of the preceding five turns by either their interlocutors (other-similarity) or themselves (self-similarity). This provides a moving window of syntactic and lexical similarity of ten conversational turns that is passed over the whole conversation (see Table 2). Turns that are unmatched because they occur near the start of a conversation are recorded in the data files as missing values.
Syntactic similarity () is calculated as the number of non-terminal syntactic structures (see Figure S1 in File S1) shared by pairs of turns (
and
) normalised for the total number of structures in both turns:
. We include all complete subtrees that match across each pair of turns. Lexical similarity (
) is calculated as the number of matching word pairs
in each pair of turns
and
normalised for the total number of words in the two turns combined:
. This yields similarity values for pairs of turns that vary between 0 for no match and 1 for a verbatim repeat. Examples of the similarity measures are provided in Table 2 and worked examples of the calculations are provided in the supplementary materials (see Figures S2 and S3 in File S1).
The software used to calculate similarities, perform corpus randomisation and produce machine-generated syntactic parse trees for the BNC is available under GPL license on: http://sourceforge.net/projects/diasim/. A copy of the CCG parser is available on: http://svn.ask.it.usyd.edu.au/trac/candc. The syntactic parse trees used for the DCPSE are part of the official DCPSE distribution.
To measure how much syntactic and lexical repetition occurs by chance we create randomised ‘Chance Other’ and ‘Chance Self’ conversations by randomly re-pairing turns. Chance Other consists of each person's real turns in sequence interleaved with turns randomly sampled from the rest of the corpus. As Table 2 illustrates, turns randomly combined in this way still show significant lexical and syntactic matches. Chance Self consists of each person's real turns in sequence paired with a random re-ordering of those turns subject to the constraint that no turn is matched with itself. This ensures that both the sample of people and language are counterbalanced across the real and chance ‘conversations’ so that the specific contribution of interaction to syntactic repetition can be separated out.
Results
Structural priming effects are tested in four General Linear Mixed Models (GLMM) of average cross-turn syntactic similarity for each person with Conversation (Real vs. Chance) and Distance (−1 to −5 turns from target) as repeated fixed factors and Subjects as a random intercept. Lexical Similarity (to Self or to Other respectively) is also included as a covariate to separate effects of syntactic similarity due to word repetition. A criterion level of p0.05 is adopted throughout though more precise p-values are reported for completeness. Bonferroni sequential adjustment is used throughout for multiple comparisons. The overall pattern of results is shown in Figure 1 (DCPSE) and Figure 2 (BNC). Note that the overall levels of syntactic match are lower for the BNC because of the greater variety of parse trees generated by the CCG parser.
In both corpora syntactic other-similarity is strongly conditioned by lexical similarity (DCPSE: = 228.798, p
0.001,
= +0.927; BNC:
= 1860, p = 0.000,
= +0.446). The DCPSE shows a main effect of Conversation (
= 8.7, p
0.001) with syntactic other-similarity lower in real conversations compared to chance, but no other effects. As Figure 1 shows, syntactic repetition is below chance compared to the immediately preceding turn but tends to rise towards chance as distance increases (
for pairwise comparisons at each level of distance: T-1 −0.024, p
0.001; T-2 −0.010, p = 0.034; T-3 0.002, p = 0.040; T-4 0.003, p = 0.473; T-5 0.009, p = 0.041). The BNC shows no main effect of Conversation (
= 3.2, p = 0.073) but there is a Conversation
Distance Interaction (BNC:
= 5.0, p = 0.001) and a Lexical Similarity
Distance Interaction (BNC:
= 2.43, p = 0.045). As Figure 2 shows syntactic repetition is below chance in the next turn and then converges with chance (
for pairwise comparisons: T-1 −0.011, p
0.001; T-2 −0.002, p = 0.181; T-3 0.001, p = 0.555; T-4 −0.003, p = 0.123; T-5
0.001, p = 0.862).
Syntactic self-similarity is also strongly influenced by lexical self-similarity (DCPSE: = 455, p
0.001,
= +0.869; BNC:
= 2609 p
0.001,
= +0.342). The DCPSE shows no main effect of Conversation but has a Conversation
Distance Interaction (
= 2.67, p = 0.031) and a Conversation
Distance
Lexical Self-similarity interaction (
= 3.411, p = 0.009) reflecting a tendency for lexical self-similarity to boost syntactic self-similarity more in the real conversations at shorter distances. Focussed pairwise comparisons between real and chance self-similarity at each distance show no difference. The BNC also shows no main effect of Conversation but has a main effect of Distance (
= 6.5, p
0.001) a Distance
Lexical Self-similarity interaction (
= 19.4, p
0.001) and a Conversation
Distance
Lexical Self-similarity interaction (
= 4.49, p = 0.001). This reflects an overall tendency for syntactic self-similarity boosted by lexical similarity to be higher at shorter distances in the real conversations. Focussed pairwise comparisons between real and chance self-similarity at each distance show no differences for either the DCPSE or the BNC.
Discussion
These results confirm the correlation between word repetition and syntactic repetition and underline its strength. The biggest factor influencing syntactic repetition in this data is lexical repetition. As Table 2 illustrates, even randomly paired conversational turns show a degree of syntactic and lexical match. These results extend previous findings by demonstrating both repetition and a systemic correlation between syntax and word choice even in randomly paired utterances where interaction cannot have had any effect.
As argued above, the coherence of conversation depends on at least some lexical repetition. As a consequence it is necessary to take the correlation between words and syntax into account when attempting to estimate independent effects of syntactic repetition. In the present data lexical repetition is most common in the next turn and it is here that the effects on syntactic repetition are strongest.
When patterns of syntactic repetition are adjusted for the influence of lexical repetition they show a pattern that is incompatible with the predictions of priming-based models of communication. People do not repeat their own or each other's syntactic structures more than would be expected by chance. More importantly, people systematically diverge from their conversational partners in their use of syntax in the next turn. Although they sometimes respond using the same words they tend to use them in different syntactic contexts. This finding of local structural divergence is incompatible with the repetition prediction. It also runs counter to the percolation prediction since it shows lexical and syntactic other-repetition pull in opposite directions in adjacent turns. In addition it is incompatible with the prediction of decay since likelihood of other-repetition increases with distance although only rising towards chance.
Although this local pattern of divergence is opposite to the predictions of priming-based models it is compatible with observations about the functions of repetition identified in qualitative analyses of repetition in conversation. For example, Tannen [16] discusses repetition for functions such as humour, irony, expansion and elaboration. Schenkein [15] discusses the strategic use of repetition for performing sequences such as proposal, complaint, remedy. Repetition is also used to build contrastive formulations e.g. to turn a statement into a question, to introduce a disagreement, to appraise a proposal and to make corrections (e.g. [15], [16], [33], [34]). An example from the current analysis: A: “And it's Eileen's anniversary as well today.” B: “Oh bugger Eileen!” (DCPSE, KB1).
In these cases people repeat each other's words but in different syntactic contexts to produce the contrasts, elaborations and evaluations that sustain the forward momentum of conversation. This variety of uses of repetition is difficult to explain by reference to an automatic priming or ‘mirroring’ mechanism. Models which take the interaction of syntax and semantics with dialogue structure into account, and show how one type of contribution often licenses a different type as a follow-up (e.g. questions licensing fragment answers), might do more to explain these contrasts (e.g. [35], [36]).
In view of claims that conversation is “extremely repetitive” and that priming is “ubiquitous” [14] it is worth noting that even the absolute levels of lexical repetition observed across turns in the data presented here are low (e.g. 9% in real conversations which is only 3% above the chance levels of matching observed in the BNC). Ordinary conversation appears to involve relatively little word repetition and where it occurs it is a heterogeneous phenomenon. Although some words are repeated over 90% are not and a full account of successful conversation must be able to explain both.
The present results address only the general prediction that all syntactic structures should tend to repeat across turns in a conversation. This does not rule out the possibility that different syntactic structures follow different patterns. The prepositional object and double object constructions that are most strongly associated with structural priming are relatively rare in ordinary conversation and it is possible that this rarity itself may enhance the likelihood of repetition (see [37]). Nonetheless, our assumption is that the divergence effect observed here reflects the fact that the demands of constructive engagement with a conversational partner normally overwhelm the structural priming effects demonstrated in laboratory-based studies.
Conclusions
Our results show that in ordinary dialogue people systematically diverge from one another in their use of syntactic structures in adjacent turns. This is incompatible with a structural priming account of syntactic co-ordination in dialogue and challenges the more general claim that automatic resource free priming provides the basic mechanism underpinning successful human communication.
Supporting Information
File S1.
Similarity Calculations. File S1 contains: Figure S1. Example syntax tree with subtrees. Table S1. Example DCPSE turn pairs: Real Conversation and Corresponding ‘Chance Other’ Sequence. Figure S2. Example DCPSE trees with matching subtrees and words highlighted. Figure S3. CCG trees (as used in the BNC) for the same sentences as Figure S2.
https://doi.org/10.1371/journal.pone.0098598.s001
(PDF)
Acknowledgments
We thank Stuart Battersby, Arash Eshghi, Greg Mills and other members of the Cognitive Science Research Group for critical discussions that helped to inform this work.
Author Contributions
Conceived and designed the experiments: PH MP CH. Performed the experiments: PH MP CH. Analyzed the data: PH MP CH. Contributed reagents/materials/analysis tools: PH MP CH. Wrote the paper: PH MP CH. Programmed analysis software: MP.
References
- 1. Scheflen AE (1964) The significance of posture in communication systems. Journal for the Study of Interpersonal Processes 27: 316–331.
- 2.
Giles H, Coupland N, Coupland J (1991) Accommodation theory: Communication, context, and consequence. In: Giles H, Coupland J, Coupland N, editors, Contexts of Accommodation, Cambridge: Cambridge University Press. pp. 1–68.
- 3. Chartrand T, Lakin J (2013) The antecedents and consequences of human behavioural mimicry. Annual Review of Psychology 64.
- 4. Chartrand T, Bargh J (1999) The chameleon effect: The perception-behavior link and social interaction. Journal of Personality and Social Psychology 76: 893–910.
- 5. Pickering M, Garrod S (2004) The interactive alignment model. Behavioral and Brain Sciences 27: 169–189.
- 6. Pickering M, Garrod S (2006) Alignment as the basis for successful communication. Research on Language and Computation 4: 203–228.
- 7.
Iacoboni M (2005) Understanding others: Imitation, language, empathy. In: Hurley S, Chater N, editors, Perspectives on Imitation: From Mirror Neurons to Memes, New York: MIT Press. pp. 77–100.
- 8. Oberman L, Ramachandran V (2002) The simulating social mind: The role of the mirror neuron system and simulation in the social and communicative deficits of autism spectrum disorders. Psychological Bulletin 133: 310–327.
- 9. Menenti L, Pickering M, Garrod S, (2012) Toward a neural basis of interactive alignment in conversation. Frontiers in Human Neuroscience 6.
- 10. Doyen S, Klein O, Pichon CL, Cleeremans A (2012) Behavioral priming: It's all in the mind, but whose mind? PLoS ONE 7.
- 11. Shanks D, Newell B, Lee E, Balakrishnan D, Ekelund L, et al. (2013) Priming intelligent behavior: An elusive phenomenon. PLoS ONE 8.
- 12. Branigan H, Pickering M, McLean J, Stewart A (2006) The role of local and global syntactic structure in language production: Evidence from syntactic priming. Language and Cognitive Processes 21: 974–1010.
- 13. Gries S (2005) Syntactic priming: A corpus-based approach. Psycholinguistic Research 34: 365–399.
- 14. Pickering M, Ferreira V (2008) Structural priming: A critical review. Psychological Bulletin 134: 427–459.
- 15.
Schenkein J (1980) A taxonomy for repeating action sequences in natural conversation. In: Butterworth B, editor, Language Production: Volume 1 Speech and Talk, London: Academic Press. pp. 21–47.
- 16.
Tannen D (2007) Talking Voices: Repetition, Dialogue and Imagery in Conversational Discourse. Cambridge: Cambridge University Press. Second Edition.
- 17.
Aijmer K (1996) Conversational routines in English: convention and creativity. London: Longman.
- 18. Szmrecsanyi B (2005) Language users as creatures of habit: A corpus-based analysis of persistence in spoken English. Corpus Linguistics and Linguistic Theory 1: 113–149.
- 19.
Dubey A, Sturt P, Keller F (2005) Parallelism in coordination as an instance of syntactic priming: Evidence from corpus-based modeling. In: In Proceedings of Human Language Technology Conference Conference on Empirical Methods in Natural Language Processing. pp. 827–834. October 6–8.
- 20.
Reitter D, Moore J, Keller F (2006) Priming of syntactic rules in task-oriented dialogue and spontaneous conversation. In: Sun R, editor, Proceedings of the 28th Conference of the Cognitive Science Society. pp. 685–690.
- 21.
Howes C, Healey P, Purver M (2010) Tracking lexical and syntactic alignment in conversation. In: Ohlsson S, Catrambone R, editors, Proceedings of the 20th Annual Conference of the Cognitive Science Society. pp. 2004–2009.
- 22. Levelt W, Kelter S (1982) Surface form and memory in question answering. Cognitive Psychology 14: 78–106.
- 23. Branigan H, Pickering M, Cleland A (2000) Syntactic co-ordination in dialogue. Cognition 75: 13–25.
- 24. Branigan H, Pickering M, McLean J, Cleland A (2007) Participant role and syntactic alignment in dialogue. Cognition 104: 163–197.
- 25. Cleland A, Pickering MJ (2003) The use of lexical and syntactic information in language production: Evidence from the priming of noun-phrase structure. Journal of Memory and Language 49: 214–230.
- 26. Reitter D, Keller F, Moore J (2011) A computational cognitive model of syntactic priming. Cognitive Science 35: 587–637.
- 27. Weiner J, Labov B (1983) Constraints on the agentless passive. Journal of Linguistics 19: 29–58.
- 28. Davies M (2009) The British component of the International Corpus of English (ICE-GB), release 2, and: Diachronic Corpus of Present-Day Spoken English (DCPSE), and: The International Corpus of English Corpus Utility Program (ICECUP), version 3.1 (review). Language 85: 443–445.
- 29. BNC (2007) The British National Corpus, version 3 (BNC XML Edition). Distributed by Oxford University Computing Services on behalf of the BNC Consortium. Available: http://www.natcorp.ox.ac.uk/. Accessed 2014 May 15.
- 30.
Quirk R, Greenbaum S, Leech G, Svartvik J (1985) A Comprehensive Grammar of the English Language. London: Longman.
- 31.
Steedman M (2000) The Syntactic Process. Cambridge, MA: MIT Press.
- 32. Clark S, Curran J (2007) Wide-coverage efficient statistical parsing with CCG and log-linear models. Computational Linguistics 33: 493–552.
- 33. Jefferson G (1983) On exposed and embedded correction in conversation. Studium Linguistik 14: 58–68.
- 34.
Pomerantz A (1984) Agreeing and disagreeing with assessments: Some features of preferred/dispreferred turn shapes. In: Atkinson J, Heritage J, editors, Structures of Social Action, Cambridge: Cambridge University Press. pp. 57–101.
- 35.
Asher N, Lascarides A (2003) Logics of Conversation. Cambridge University Press.
- 36.
Ginzburg J (2012) The Interactive Stance: Meaning for Conversation. Oxford University Press.
- 37. Jaeger F (2010) Redundancy and reduction: Speakers manage syntactic information density. Cognitive Psychology 61: 23–62.