Introduction
Information and advice provided by scientific or other technical experts can profoundly affect how public policies are formulated, as has been demonstrated by how the COVID-19 pandemic has been handled in many countries (see, for example, Moore & MacKenzie,
2020). Experts represent professional communities specializing in the production of reliable information on a given subject matter, and expertise thus is an important aspect of the division of deliberative or epistemic labour in advanced societies (cf. Richardson,
2002). Obviously, processes of producing expert knowledge—the scientific process, for example—are very different from democratic deliberation required for making legitimate public decisions.
Political decisions require scientific and technical expertise, which has given rise to concerns that political decision making is moving into the hands of unelected policy experts, further away from the citizens and elected representatives (Dahl,
1989, 332–338). The concern over excessive impact of experts in public decision-making was one of the reasons why Dahl (
1989, 340–341) first proposed his idea of a mini-populus, which is a randomly selected citizen body complementing representative decision making on complex issues.
One of the key functions of forums for citizen deliberation, or so-called deliberative mini-publics, is to respond to technocratic tendencies in advanced societies by bridging the gap between citizens and experts (cf. Dahl,
1989). Deliberative mini-publics usually feature interaction with experts in order to help participants form more informed and reflected views on the policy issue at hand (Setälä & Smith,
2018). In general, deliberative mini-publics can be expected to offer participants good opportunities for scrutiny and weighing of expert information. However, there are also concerns that participants accept expert views uncritically or that the experts have too much of an influence on how participants’ opinions develop in the course of the deliberative process (e.g. Moore & MacKenzie,
2020).
Research concerning the role of expert information in deliberative mini-publics is still relatively scarce (see also Drury et al.,
2021; Roberts et al.,
2020; Muradova et al.,
2020). While some empirical evidence on expert influence on deliberators’ opinions exists (e.g. Luskin et al.,
2002; Setälä et al.,
2010), there are no studies systematically examining to what extent expert hearings influence opinion formation in mini-publics and whether these venues provide citizens with good opportunities to evaluate scientific and technical expertise. This article aims to fill part of this gap. We look at whether and how experts heard in deliberative mini-publics affect the ways in which participants’ attitudes change in the course of deliberation. More specifically, we analyze the impact of expert hearings in a deliberative mini-public on citizens’ perceptions of and views on the containment measures related to the COVID-19 pandemic. Our data are based on a deliberative mini-public that was held online in Finland in March 2021. The topic of deliberation was the measures that had been taken to counter the spread and contain the effects of the pandemic in Finland.
This topic is well-suited for the purpose since experts representing different fields may arguably have quite differing views on the pandemic policies. Moreover, policy responses to the pandemic often exemplify technocratic tendencies in representative systems. Policy decisions have strongly relied on the information provided and proposals made by epidemiologists, medical researchers and other health experts (Moore & MacKenzie,
2020). In addition to medical experts, the views of legal experts, economists and social scientists have influenced public policies and evaluations of their feasibility.
We focus on the following two main research questions. First, how does an expert’s field of expertise affect participants’ attitudes to pandemic policies? Second, are participants’ views affected by the order in which they hear experts of different fields? We found that even though the deliberative process increased participants’ knowledge and changed their opinions, the impacts of the field of expertise and the order of expert hearings appear to have been limited. This finding seems to dispel at least some of the concerns related to excessive expert influence in mini-publics. At the end of the article, we discuss the implications of our results for the design of deliberative mini-publics more generally.
The experiment: deliberation on COVID-19 policies in Finland
The COVID-19 pandemic has had widespread and profound effects on human lives and entire societies across the world. Not all countries have been hit equally by the pandemic, but it is safe to say that practically no nation has remained unaffected. The pandemic has caused loss of lives and put national healthcare systems under stress, which has made governments adopt drastic measures to contain the spread of the virus. These measures have included, for example, stricter border control or other restrictions on mobility, quarantines for people exposed to the virus, and closings of public venues and private businesses.
Addressing the pandemic is not only about finding the most effective ways of preventing the spread of the virus. All measures taken to this end have to be weighed against the direct and indirect costs that they inflict, their legitimacy in the eyes of the public, and their impact on people’s rights and freedoms. Restrictions have aimed at preventing the loss of lives and relieving the pressure on healthcare systems. At the same time, they have violated citizens’ basic rights, increased state-led surveillance, caused economic losses and increased inter-group inequalities, stirred political and societal unrest and, initially, sparked fears of a global economic downturn (see, for example, Eck & Hatz,
2020; Nicola et al.,
2020; Tiirinki et al.,
2020). The general public has received the measures with varying sentiments and levels of compliance (Georgieva et al.,
2021).
By early 2021, Finland, with its population of 5.5 million and relatively low population density (18.2 per square kilometre on average), had survived the pandemic with fewer deaths and less serious repercussions than many other countries. When a deliberative mini-public was held in March 2021, there were fewer than 80,000 confirmed cases of COVID-19 in Finland, and the pandemic had claimed around 800 lives (Finnish Institute for Health and Welfare,
2021a). The restrictions introduced in 2020–2021 were in many respects loose, by European standards. For example, bars and restaurants remained open most of the time, there had been no legal obligation to wear face masks and, with the exception of a period of less than three weeks in the spring of 2020, people were free to travel within the country.
Still, the restrictions imposed by the government included measures seen in other countries, including, for example, closings of schools, public venues and private businesses, restrictions on entering the country, alongside recommendations related to abstaining from traveling, working from home and reducing social contacts (see Tiirinki et al.,
2020). In line with the national coronavirus strategy, the intensity of these measures varied across regions and over time, depending on the local COVID-19 situation. The most severe restrictions were in place in the spring of 2020, while the summer and early autumn of the year can be described as less strict in terms of pandemic containment measures.
Finland exemplifies a high-trust society in terms of general and political trust as well as confidence in public officials (Grönlund & Setälä,
2012), which seems to be associated with high levels of compliance with measures taken to contain the pandemic (Georgieva et al.,
2021). Based on a survey conducted in eleven countries, Georgieva et al. (
2021) found that, in Finland, the self-reported level of compliance with measures intended to contain the pandemic was high by international standards. Finnish residents were also quite satisfied with the way their government had handled the pandemic and reported high levels of trust in their political leaders regarding the issue.
A mini-public regarding the restrictions and guidelines related to containing the COVID-19 pandemic was held online during one weekend, March 13th and 14th, 2021. The whole event was organized online using a teleconferencing software (Zoom). During the weeks preceding the event, infection rates increased and new restrictions were introduced during February and March (Finnish Institute for Health and Welfare,
2021b). The primary aim of the mini-public was to examine the impact of expert hearings in a deliberative process, and the management of the COVID-19 situation provided a topical and concrete context for the research. The mini-public was primarily motivated by scientific objectives and was not directly linked to policy processes. However, the research team prepared a non-technical research report on the participants’ views, and a press release based on it was distributed to the media.
The recruitment of participants
The recruitment to the mini-public started in February 2021 with a post card that was posted to a random sample (n = 6000) of Finnish residents aged between 18 and 80. The post card included an invitation to the mini-public, alongside basic information about the event and the monetary reward (75 euros) to which the attendees would be entitled. Respondents were also informed that the mini-public would be organized for research purposes and that the researchers would produce a report concerning the deliberations and participants’ views on the issue, which would be published after the event. No allusion was made to direct impact on or involvement in actual policy processes.
Those willing to participate were asked to fill in a recruitment survey online (T1). The online recruitment survey included questions concerning the respondents’ evaluations of the policies that the government had introduced to confine the pandemic, attitudes towards particular restrictions and recommendations, as well as questions about basic socio-economic background variables and political orientation.
Of the sample, 261 (4.4%) filled in the survey, and of these, 163 (62.5% of the respondents) declared that they would volunteer as participants in the mini-public. All volunteers were invited to the mini-public. Of these, 80 confirmed their participation and 74 showed up to deliberate on the first day of the mini-public. Two participants quit during the first day and another two did not show up to deliberate on the second day. Therefore, a total of 70 persons participated for the whole duration of the mini-public.
Despite the relatively low response rate, the mini-public brought together a diverse group of individuals that corresponded well to the national-level demographic composition in terms of gender, age group, and native language. No further selection was made based on responses to attitudinal questions in the recruitment survey because such selection could have made the mini-public excessively small. The detailed description of the Jury’s demographic composition and its comparison to national-level population statistics are presented in Appendix
1. The gender distribution was similar to that of the whole country. Middle-aged people were somewhat overrepresented in the mini-public, whereas those aged 25–34 and the oldest age groups were underrepresented. However, the age distribution of the participants reflects the general age distribution of Finland reasonably well, which is important since older people are more likely to have more severe symptoms of COVID-19, while younger age groups with, on average, a larger number of social contacts are more likely to contract the disease. Moreover, the measures to contain the pandemic have affected the various age groups in different ways.
Highly educated people were strongly overrepresented in the mini-public. This overrepresentation is most likely due, in part, to the technical requirements related to online deliberation. More generally, education has been identified as a consistent predictor of political participation (Persson,
2015), and deliberative mini-publics do not seem to be immune to this distortion. Regarding geographical representativeness, the mini-public had participants from 14 regions out of 19. Notably, the region of Uusimaa, which contains the capital city of Helsinki, was strongly overrepresented. This is could be due to the sociodemographic profile of the region, especially the above-average share of highly educated people, and the fact that the region had experienced the strictest containment measures. Although not all regions were covered, there was notable variation in terms of the COVID-19 situation and the stringency of containment measures in the regions that were represented. Hence, it is reasonable to assume that participants’ personal experiences regarding containment measures varied.
The experimental procedure
The deliberative process was held over the course of two days, on 13th and 14th of March, and lasted about four hours each day. The participants were tasked with formulating questions for four experts, listening to their responses, and deliberating on the issue in small groups after the expert hearings. Before the deliberative process, participants were divided into two treatment groups (A and B; see below) that deliberated in simultaneous but separate sessions, without having any contact with each other.
Four experts were being heard during the mini-public. Three of the experts were male, and one of them was female. All of them were around the same age and experienced in their profession. Both treatment groups listened to two pairs of experts but in a different order. One pair of experts consisted of a legal expert and a social scientist, the other pair included healthcare professionals. On the first day, treatment group A (n = 35) posed questions to the experts about legal and social issues. On the second day, the same treatment group posed questions to the experts in public health. For treatment group B (n = 35), the order of the expert hearings was reversed.
Both treatments were divided into five small groups consisting of six to eight participants and a trained facilitator, whose task was to supervise the adherence to the rules of deliberation. For both treatment groups, the first day of the mini-public started with a short introduction to the norms and rules of deliberation, as well as an overview of the schedule of the mini-public. Then, participants watched short video presentations of the two experts to be heard. The short presentations focused on the experts’ professional credentials and their expertise on the COVID-19 pandemic in particular.
Treatment group A was first asked to gather information from two experts: a university professor of public law specializing in the effects of the pandemic on the Finnish legal system, and a research professor in sociology studying the social impacts of the pandemic, e.g. welfare, inequalities, and mental health. At the same time, treatment group B listened to a medical superintendent in charge of responses to the pandemic in a Finnish city, and a research professor and epidemiologist specializing in national health and statistics on the pandemic. In addition to scientific expertise, the experts had practical experience from designing and implementing measures to mitigate the COVID-19 pandemic. More precisely, the public law professor was one of the key experts heard in drafting the pandemic legislation in Finland, and the medical superintendent was involved in implementing the legislation.
After the video presentations, each small group was asked to formulate questions for the two experts just introduced. The participants were instructed to focus on the experts’ field of specialization and formulate questions that these particular experts would likely be able to answer. Each group was expected to formulate four questions and put these questions into an order of priority. The first two questions would be presented to the experts, while the other two would be backup in case of overlapping questions from other groups. Throughout the formulation of the questions, the facilitators encouraged people to work as a group and identify common points of interest, in addition of overseeing that the discussion remained respectful and inclusive. Votes were taken if there were disagreements on the content or order of the questions.
The questions formulated in small groups were posed to the experts in a plenary where all participants of the treatment group were present. The facilitators presented their small groups’ questions, and both experts had around two minutes to answer each question. After the main questions, backup questions were posed. The number of questions asked during the Q&A sessions was between 10 and 13. During the small group discussions after a lunch break, participants deliberated on the issue and the expert information they had received. More specifically, the participants were asked to express their thoughts and views after they had heard the experts’ answers. Finally, the participants returned to the main sessions where they received directions to fill in a survey (T2) and continue deliberations the next day.
The second day of the mini-public followed the same schedule as the first day. The treatment groups remained the same, but the experts rotated; treatment group A interacted with health experts, while treatment group B listened to experts in law and social sciences. The mini-public ended with a final survey (T3). The T2 and T3 surveys included questions concerning general evaluations of the governmental response to the pandemic, as well as specific measures to contain it. In addition, there were questions measuring participants’ factual knowledge related to the pandemic, trust in different sources of information, and opinions of the experts’ answers. Together, T1, T2 and T3 allow for quantitative analyses on how participants’ opinions and attitudes developed over the course of the event.
No separate survey was carried out at the beginning of deliberation and recruitment survey
T1 was used as baseline in order to minimize anchoring effects (Gehlbach & Barge,
2012). All 70 participants who took part during both days also completed the surveys
T2 and
T3.
In addition to T1, T2 and T3, a separate control survey was administered around the same time the mini-public took place. This was done in order to get a grasp of the opinion changes that might be caused by the evolving coronavirus situation, regardless of deliberation. A random sample of survey invitations (n = 1000) yielded 131 answers between 10 and 19 March, a period during which no major shifts in public debate regarding the virus situation could be identified. Although the small n does not allow for population-level statistical deduction, the control survey responses give a rough estimate of the general attitudes prevailing at the time of the mini-public.
The experimental procedure and the surveys are summarized in Table
1.
Table 1
The experimental procedure
Recruitment survey T1 (February 2021) |
Day 1 (Saturday 13 March) | Legal/social experts | Health experts | Control survey (10–19 March 2021, n = 131) |
Survey T2 |
Day 2 (Sunday 14 March) | Health experts | Legal/social experts |
Survey T3 |
Although expert hearings in the mini-public took place in a plenary, the idea was to allow deliberation both on the formulation of questions and on the experts’ responses to those questions. The expert hearings dealt with the questions that the participants formulated in small groups, which allowed participants to discuss experts’ credentials and to pose relevant questions given the areas of expertise. Appendix
2 lists the questions that were posed to experts during the Q&A. In addition, the participants had opportunities to exchange their views on the experts’ responses, which should have encouraged critical reflection on expert information and correction of biases in the interpretation of the evidence.
Based on participants’ overall evaluations in T3, the guiding principles of deliberation were well adhered to in the mini-public. 97% agreed completely with the statement “other people’s views were respected and listened to”, 44% agreed completely and 35% partially with the statement “a diversity of opinions were represented in the discussion” and 90% agreed completely with the statement “the moderators of the discussion were impartial”. In contrast, 96% disagreed completely with the statement “during the discussions, I felt pressure to agree with the others on something I wasn’t quite sure about.” When it comes to the statement “some participants dominated the discussion too much,” 97% disagreed completely.
Results
In order to understand the impact of the field of expertise on participants' opinions, we first explore whether the experts’ fields of specialization played a role in terms of what kinds of questions participants formulated for the experts, and how these questions were answered. Were there questions that were typically directed to one type of expert but not to the other? This is important since the types of questions posed to the experts could potentially influence the ways in which participants framed the governmental policy responses to the pandemic and, consequently, their attitudes towards those policies. Similarly, we should establish how the statements of the experts themselves framed the issue.
An overview of the questions in Appendix
2 reveals that irrespective of treatment, some themes were prevalent solely in the questions for the legal and social experts and some only in the questions for the health experts. Questions related to the Emergency Powers Act, which was temporarily in force in the spring of 2020, law drafting, the (in)flexibility of jurisdiction and the formulation process of COVID-19 restrictions were directed to the legal and social experts, but not to the health experts. Furthermore, most of the questions related to the adverse side-effects of restriction measures were posed to the legal and social experts. In contrast, questions regarding vaccination coverage, COVID-19 variants and contamination routes of the virus were posed only to the health experts. There were some overlapping themes including, for example, vaccination order, measuring the restrictions’ impacts on welfare, and a potential curfew (that the government was preparing) and its justifications. While the field of expertise did not fully determine the themes of any Q&A session, it clearly influenced the questions posed.
A look at the expert answers lends more support to the assumption that field of expertise affected the framing of the issue. The social and legal experts expressed more criticism towards strict, mandatory containment measures and underlined the importance of basic rights, describing how they are safeguarded in the Finnish legal system. They also highlighted how the pandemic and containment measures had exacerbated existing structural inequalities, and how it was hard to strike a balance between all the harmful effects stemming from the disease itself and the measures to curb it. Health experts, on the other hand, expressed more worry about people not following the instructions and regulations, and emphasized that a multiplicity of efficient measures were needed. They approached legislation more in terms of its instrumental value in disease containment. The differences in experts’ emphases is probably partly due to the different nature of the questions asked.
Some common themes emerged as well. In all hearings, experts posited, e.g. that Finland had done relatively well in fighting the virus compared to other countries, and that information provision had been challenging in the quickly evolving situation. Nevertheless, the answers provided participants with two somewhat distinct viewpoints to the issues of disease containment.
In sum, fields of expertise were not insignificant to the participants since at least they seem to have framed the question formulation. In addition, topics that were emphasized in the answers differed depending on the experts’ field. Based on these observations only it is not possible to say whether the questions or the expert answers determined the themes of the small-group discussions. A detailed analysis of the discussions is, however, outside the scope of this study as we are primarily concerned with the kinds of attitudinal changes that followed the discussions.
We now turn to the more direct testing of our hypotheses 1–3 regarding the impact of the fields of expertise on the development of opinions. Participants’ attitudes towards COVID-19 policies were inspected by asking participants whether they agreed or disagreed with certain statements related to the containment of the pandemic. Participants answered the question “What do you think of the following statements?” on a five-point Likert scale (completely agree, partly agree, partly disagree, completely disagree, cannot say). To explore the effects of the expert hearings on participants’ views, we focus on three statements: 1. Government actions to prevent COVID-19 have unnecessarily violated citizens’ basic rights. 2. COVID-19 containment should be based on clear restrictions and orders instead of recommendations. 3. The most important thing in fighting the COVID-19 pandemic is to secure the capacity of the healthcare system and prevent new cases, even if that restricts citizens’ daily lives and causes major financial costs. Three participants did not provide an answer for statement 3 in either T2 or T3, so these respondents were treated as missing values in the analysis.
Based on H1, we expected that listening to public health experts would make participants more supportive of tight restrictions and thus increase agreement with statements 2 and 3. Further, based on H2, we expected that listening to social/legal experts would make participants more critical towards tight restrictions and thus more supportive of statement 1. H3 regarding discursive path-dependency entails that the experts that the group heard first would create a lasting frame for the entire deliberation. Therefore, the attitude changes and differences between treatment groups should be evident, not just in T2, but also in T3. On the contrary, if the frames created by different kinds of expert information canceled each other out, differences should be visible in T2 but not in T3.
The observed modest changes in the three items listed in Table
2 indicate partial support for H1 and H2. It seems that the participants’ views on COVID-19 restrictions in Finland did change during the mini-public, but the observed changes are small and lack statistical significance at conventional levels in the case of statements 1 and 3. Regarding statement 2, there was a clear shift towards more support for restrictions instead of recommendations after the first day in treatment group B. This suggests that hearing medical experts did indeed make participants in group B more likely to support tighter restrictions. However, this shift was reversed after hearing the legal and social experts. Therefore, there seems to be no signs that the order of expert hearings played a major part in views measured in
T3.
1 Overall, there is very little evidence to support H3, and it seems that the answers heard on the first day did not play a more pronounced role in opinion formation than those heard on the second day.
Table 2
The development of participants’ opinions on pandemic policies
What do you think of the following statements? 1 = Completely disagree, 5 = Completely agree |
1. Government actions to prevent COVID-19 have unnecessarily violated citizens’ basic rights | 1.69 (0.20) | 0.20 (0.17) | − 0.09 (0.21) | 0.11 (0.19) | 2.00 (0.20) | 0.06 (0.15) | − 0.00 (0.21) | 0.06 (0.19) |
2. COVID-19 containment should be based on clear restrictions and orders instead of recommendations | 3.91 (0.20) | 0.11 (0.16) | 0.03 (0.18) | 0.14 (0.16) | 3.43 (0.23) | 0.46* (0.21) | − 0.63** (0.22) | − 0.17 (0.25) |
3. The most important thing in fighting the COVID-19 pandemic is to secure the capacity of the healthcare system and prevent new cases, even if that restricts citizens’ daily lives and causes major financial costsª | 4.12 (0.16) | 0.09 (0.15) | 0.09 (0.17) | 0.21 (0.16) | 3.89 (0.19) | 0.17 (0.17) | 0.12 (0.13) | 0.24† (0.13) |
To further test the hypotheses, we inspect participants’ support for some restrictions that had been in place in Finland at some point (most restrictions with varying strictness levels) since the start of the pandemic. In T1– T3, participants were asked how acceptable they found a particular restriction on a scale from 0 to 10, where 0 meant “not at all acceptable” and 10 meant “fully acceptable”. We focus on the following restrictions: restrictions on movement within the country, limitations for public events, closure of schools, restrictions to opening hours of bars and restaurants, and closure of certain public spaces.
For the five restriction variables, we first performed a factor analysis to establish whether we could meaningfully discuss support for restrictions as a general category. The analysis returned high values for a KMO and Bartlett’s test (
T1 = 0.858,
p < 0.001;
T2 = 0.772,
p < 0.001;
T3 = 0.723,
p < 0.001) and all variables loaded to a single dimension in
T1,
T2 as well as
T3. Attitudes to different restrictions were also highly and significantly correlated.
2 Based on the results of the factor analysis, we combined the five restriction variables into a single “support-for-restrictions index” ranging from 0 to 50, where a higher score denotes more favorable view towards restrictions. The mean of the index in
T1 for all participants is 36.24, and the standard deviation is 11.46 (median 39, range 0–50).
The initial level of and changes in the restriction support index are reported in Table
3. As can be seen, the level of support for restrictions is somewhat lower in treatment group B than group A, and this remained the case throughout the weekend. However, in both treatment groups, the changes in support are similar in magnitude and direction: support for restrictions increased from
T1 to
T2 and, to a somewhat smaller extent, from
T2 to
T3. Part of the explanation for the increased support for tight restrictions from
T1 to
T2 is probably the fact that the overall COVID-19 situation worsened between these two measurement points. This assumption is supported by results from the control survey, in which the support for restrictions index yielded a value of 38.91. By contrast, the same value among the recruitment survey respondents who did not take part in the discussion was 36.14.
Table 3
The development of support for restrictions
Support for restrictions index (min. 0, max. 50) |
All | 36.24 (1.37) | 2.07* (0.98) | 0.50 (0.70) | 2.57** (0.80) |
Treatment A | 37.45 (2.03) | 2.40† (1.26) | 0.34 (0.98) | 2.74** (0.89) |
Treatment B | 35.03 (1.85) | 1.74 (1.51) | 0.66 (0.99) | 2.40† (1.32) |
The index increase from T1 to T2 was 0.66 points higher for group A than for group B, whereas, from T2 to T3, the increase for group B is 0.31 points higher. These differences are not statistically significant, however. The results indicate that the field of expertise had no systematic impact on overall support of restrictions and thus yields no support for H1 and H2 and, consequently, H3 does not gain support either.
Based on our analysis, none of the three hypotheses presented in this study receive consistent support. This suggests that neither the fields of experts heard nor the order in which they were heard were influential in opinion change among the participants of the mini-public.
Participants’ evaluations of expert answers
In the last part of analysis, we look at how participants evaluated experts’ answers at the end of both days of deliberation. This evaluation was done in order to assess whether the participants perceived systematic differences between experts in terms of the quality of their answers. For example, a situation where participants in both treatments would rate the health experts’ answers more favorably than the legal and social experts’ answers would be relevant when measuring opinion change and could help determine why opinions developed the way they did.
The results in Table
4 show that there were no systematic differences between the two groups’ evaluations of experts’ answers. All participants ranked the experts’ answers more positively on the second day on all measures: usefulness, diversity, justification, depth, assertiveness and relevance. This was true for both treatment groups, but even more pronounced in treatment group B. However, as both treatment groups rated the experts’ answers higher on the second day, regardless of the type of experts they were, there is no clear evidence of either pair of experts performing better than the other.
Table 4
Participants’ evaluations of experts’ answers
How would you rate today’s expert answers? To what extent were they…? 1 = Not at all; 5 = Very much |
Useful | 3.54 | 3.87 | 0.33** | 3.60 | 3.74 | 0.14 | 3.49 | 4.00 | 0.51** |
Diverse | 3.46 | 3.91 | 0.46*** | 3.43 | 3.66 | 0.23 | 3.49 | 4.17 | 0.69*** |
Well-founded | 3.86 | 4.13 | 0.27** | 3.83 | 3.94 | 0.12 | 3.89 | 4.31 | 0.43** |
Profound | 3.00 | 3.57 | 0.57*** | 3.03 | 3.32 | 0.29* | 2.97 | 3.80 | 0.83*** |
Convincing | 3.52 | 3.94 | 0.42*** | 3.41 | 3.76 | 0.35** | 3.63 | 4.11 | 0.49** |
Relevant | 3.49 | 4.04 | 0.56*** | 3.41 | 4.03 | 0.62*** | 3.56 | 4.06 | 0.50** |
This finding suggests that the communication between the experts and participants improved over the course of the event. This can be due to participants becoming more experienced in crafting questions and listening to experts’ responses, but also because the experts became more accustomed to answering the kind of questions they were presented with. In the mini-public, the experts did not read the questions beforehand or prepare their answers; rather, they answered them right away.
On the other hand, the results might also reflect the overall satisfaction among the participants at the time the deliberations ended. It is possible that after the first day, when the participants had only listened to one pair of experts, they developed sentiments that they still needed to know more about the matter, and after the second day, they had the chance to acquire more information and fill those self-identified gaps in their knowledge. Therefore, after getting to hear different sides of the matter, they gave more positive evaluations. The measurements of participants’ factual knowledge before and after the event give some support to this assumption. Whereas the initial level of knowledge in group A was high to begin with and did not change during the event, treatment group B experienced a significant increase in knowledge (see Appendix
3). Additionally, in both treatment groups the number of participants who reported that they understood the subject somewhat or much better than before increased from
T2 (54.3% in both groups) to
T3 (71.4% in group A and 85.7% in group B).
3
Conclusion
During the COVID-19 pandemic, expert opinions about desirable responses have varied considerably. This is not only because in the beginning little was known about the virus itself, but also because different experts have viewed the same problems from different angles. Meanwhile, experts have had an important role in planning and shaping national policy responses to the pandemic. In general, the way in which most democracies have dealt with the outbreak of the COVID-19 pandemic and how they have tried to mitigate impacts of the crisis can be seen as examples of how technocratic tendencies are developing in representative systems.
The aim of this study was to explore whether the outcomes of mini-publics may be affected by the specific field of the experts heard, and whether the possible frames created by expert information are durable. Mini-publics have been regarded as institutions that can help bridge the knowledge gap between lay persons and experts in decision making, and democratize expertise (see, for example, Brown,
2014; Moore,
2017; Smith,
2009). This expectation is not fulfilled if participants become too deferential to scientific authority, only receive one-sided viewpoints from experts, or do not critically weigh the information they have received.
The results seem to dispel some of the concerns regarding the role of expert information and the risks of expert domination in deliberative mini-publics. Opinions did change over the course of the event; that is, both treatment groups became slightly more supportive of restrictions introduced. However, there seems to be no indication that either the academic field of experts heard or the order of expert hearings had any significant impact on opinion change. In other words, while the fields of experts seem to have framed the deliberative process to some extent, these frames did not seem to guide the deliberations in ways that would result in systematic changes in opinion.
There is at least one design feature in this mini-public which may explain why we found no such systematic impact. Namely, the participants were tasked with crafting questions to experts and were therefore able to receive answers to precisely the questions that they had in mind. No briefing materials or plenary lectures, which are common in deliberative mini-publics, were utilized (see Roberts et al.,
2020). It is moreover likely that in the Q&A sessions, especially those held online, the personal charisma and presentation skills of experts do not have the same influence on perceived assertiveness of expert information as would be in the case with carefully prepared and rehearsed plenaries.
Our results are in line with the view that mini-publics provide good opportunities for public scrutiny of expert information. Deliberative mini-publics can be designed to emulate the ideal role for expertise in public deliberation, which Moore (
2017, 34) describes as “informing democratic opinion, but not manipulating it; empowering democratic will, but not dominating it”. In evidence gathering through Q&A sessions, the participants themselves had an active role in determining what they wanted to know, instead of the organizers or experts determining what they needed to know. In addition, the chosen procedure of expert hearing might have cultivated critical thinking in a way that another procedure, for example, a plenary lecture or an information sheet, might not have. Nonetheless, we acknowledge the need for future research on the impact of expert information in mini-publics. As indicated above, future studies could profitably address the effects that alternative formats of expert hearings potentially have. Moreover, the theme of our mini-public was the management of a crisis that was still quite acute when the discussions took place. Future studies could also address more long-lasting issues with respect to which opinions have had more time to settle.
In sum, our findings do seem to suggest that interactive modes of expert hearings in mini-publics are not particularly prone to expert domination, and in this respect, they may have merits in comparison with other types of expert hearing processes.
Publisher's Note
Springer Nature remains neutral with regard to jurisdictional claims in published maps and institutional affiliations.