Skip to main content
Log in

The STAR common metrics approach to the WFD intercalibration process: Full application for small, lowland rivers in three European countries

  • Published:
Hydrobiologia Aims and scope Submit manuscript

Abstract

Class boundaries of three European assessment systems based on macroinvertebrates were compared and harmonized. Three different approaches to comparison, one based on regression analysis and the other two on statistical testing, were described and used, however only one was considered useful for the harmonization of boundaries. In all cases, the calculations were based on a set of six Intercalibration Common Metrics, combined into a simple multimetric index (ICMi). The ICMi was calculated for three test datasets from Italy, Poland and the UK, all belonging to the same stream type (small lowland siliceous sand rivers). For comparison, a regression model was employed to convert national assessment boundary values into ICMi values. The ICMi was also calculated on samples included in a strictly WFD-compliant benchmark dataset. The values of the ICMi obtained for the quality classes Good and High for the test and benchmark datasets were statistically compared. When significant differences were observed in the harmonization phase, the boundaries of the national method were refined until no further differences were observed. For the test datasets and assessment systems of Italy (IBE index) and Poland (Polish BMWP index) small refinements of the boundaries between High/Good and Good/Moderate classes were sufficient to remove the differences from the benchmark dataset. After harmonization, in the studied stream type, the percentage of samples requiring restoration to Good quality increased by 22 and 6% for Italy and Poland, respectively. For the UK dataset (EQI ASPT) the comparison to benchmark dataset showed no significant differences, thus no harmonization was proposed. A general discussion of the options used to compare boundaries based on the ICMi and their potential for harmonization is provided. Lastly, the option of harmonizing class boundaries through comparison to an external, benchmarking dataset and then re-setting them until no differences are found is supported.

This is a preview of subscription content, log in via an institution to check access.

Access this article

Price excludes VAT (USA)
Tax calculation will be finalised during checkout.

Instant access to the full article PDF.

Institutional subscriptions

Similar content being viewed by others

References

  • APAT-IRSA/CNR, 2004. Indice Biotico Esteso (I.B.E). In APAT, Manuali e linee guida 29/2003. APAT-IRSA/CNR, Metodi analitici per il controllo della qualità delle acque 3: 1115–1136

  • AQEM Consortium, 2002. Manual for the Application of the AQEM system. A Comprehensive Method to Assess European streams using Benthic Macroinvertebrates, Developed for the Purpose of the Water Framework Directive. Version 1.0, February 2002, 202 pp

  • P. D. Armitage D. Moss J. F. Wright M. T. Furse (1983) ArticleTitleThe performance of a new biological water quality score system based on macroinvertebrates over a wide range of unpolluted running-water sites Water Research 17 333–347 Occurrence Handle1:CAS:528:DyaL3sXhtFegtLY%3D Occurrence Handle10.1016/0043-1354(83)90188-4

    Article  CAS  Google Scholar 

  • M. T. Barbour J. Gerritsen B. D. Snyder J. B Stribling (1999) Rapid Bioassessment Protocols for Use in Wadeble Streams and Rivers: Periphyton, Benthic Macroinvertebrates and Fish EditionNumber2 EPA 841-B-99–002. USEPA, Office of Water Washington, D.C

    Google Scholar 

  • S. Birk D. Hering (2006) ArticleTitleDirect comparison of assessment methods using benthic macroinvertebrates: a contribution to the EU Water Framework Directive intercalibration exercise Hydrobiologia 566 401–415

    Google Scholar 

  • Böhmer, J., C. Rawer-Jost & A. Zenker, 2004. Multimetric assessment of data provided by water managers from Germany: assessment of several different types of stressors with macrozoobenthos communities. In Hering D., P. F. M. Verdonschot, O. Moog & L. Sandin (eds), Integrated Assessment of Running Waters in Europe. Kluwer Academic Publishers, The Netherlands. Hydrobiologia 516: 215–228

  • Brabec, K., S. Zahrádková, D. Nějcová, P. Páril, J. Kokeš & J. Jarkovsk, 2004. Assessment of organic pollution effect considering differences between lotic and lentic stream habitats. In Hering D., P. F. M. Verdonschot, O. Moog & L. Sandin (eds), Integrated Assessment of Running Waters in Europe.Kluwer Academic Publishers, The Netherlands. Hydrobiologia 516: 331–346

  • A. Buffagni J. Kemp S. Erba C. Belfiore D. Hering O. Moog (2001) ArticleTitleA Europe-wide system for assessing the quality of rivers using macroinvertebrates: the AQEM Project and its importance for southern Europe (with special emphasis on Italy) Journal of Limnology 60 IssueIDSuppl. 1 39–48

    Google Scholar 

  • Buffagni, A. & S. Erba, 2004. A simple procedure to harmonize class boundaries of European assessment systems. Discussion paper for the intercalibration process – WFD CIS WG 2.A ECOSTAT, 6 February 2004, 21 pp

  • Buffagni, A., S. Erba, M. Cazzola & J. L. Kemp, 2004. The AQEM multimetric system for the southern Italian Apennines: assessing the impact of water quality and habitat degradation on pool macroinvertebrates in Mediterranean rivers. In Hering D., P. F. M. Verdonschot, O. Moog & L. Sandin (eds), Integrated Assessment of Running Waters in Europe. Kluwer Academic Publishers, The Netherlands. Hydrobiologia 516: 313–329

  • Buffagni A., S. Erba, S. Birk, M. Cazzola, C. Feld, T. Ofenböck, J. Murray-Bligh, M. T. Furse, R. Clarke, D. Hering, H. Soszka & W. van de Bund, 2005. Towards European Inter-calibration for the Water Framework Directive: Procedures and examples for different river types from the E.C. project STAR. 11th STAR deliverable. STAR Contract No: EVK1-CT 2001-00089. Rome (Italy), Quaderni Istituto di Ricerca sulle Acque 123, Rome (Italy), IRSA, 468 pp

  • Y. Cao W. A. Bark W. P. Williams (1996) ArticleTitleMeasuring the response of macroinvertebrate communities to water pollution: a comparison of multivariate approaches, biotic and diversity indices Hydrobiologia 341 1–19 Occurrence Handle10.1007/BF00012298

    Article  Google Scholar 

  • Y. Cao W. A. Bark W. P. Williams (1997) ArticleTitleAnalysing benthic macroinvertebrate community changes along a pollution gradient: a framework for the development of biotic indices Water Research 31 884–892 Occurrence Handle1:CAS:528:DyaK2sXitVylur4%3D Occurrence Handle10.1016/S0043-1354(96)00322-3

    Article  CAS  Google Scholar 

  • Dahl J., R. K. Johnson & L. Sandin, 2004. Detection of organic pollution of streams in southern Sweden using benthic macroinvertebrates. In Hering, D., P. F. M. Verdonschot, O. Moog & L. Sandin (eds), Integrated Assessment of Running Waters in Europe. Kluwer Academic Publishers, The Netherlands. Hydrobiologia 516: 161–172

  • InstitutionalAuthorNameEnvironment Agency (1997) Assessing Water Quality – General Quality Assessment (GQA) Scheme for Biology. Fact Sheet Environment Agency Bristol

    Google Scholar 

  • European Commission, 2000. Directive 2000/60/EC of the European Parliament and of the Council of 23 October 2000 establishing a framework for Community action in the field of water policy. Official Journal of the European Communities L 327, 22.12.2000, 1–72

    Google Scholar 

  • European Commission, 2003a. Common Implementation Strategy for the Water Framework Directive (2000/60/EC). Guidance Document No. 6. Towards a Guidance on Establishment of the Intercalibration Network and the Process on the Intercalibration Exercise. Produced by Working Group 2.5 – Intercalibration, 54 pp

  • European Commission, 2003b. Overview of common Intercalibration Types and Guidelines for the selection of intercalibration sites. Water Framework Directive Common Implementation Strategy Working Group 2A ‘Ecological Status’ Version 3. 9 October, 2003, 70 pp

  • European Commission, 2004. Guidance on the Intercalibration Process. Water Framework Directive Common Implementation Strategy Working Group 2. A ‘Ecological Status’ Final Draft 4.1. October, 14th 2004

  • M. Furse D. Hering O. Moog P. Verdonschot R. K. Johnson K. Brabec K. Gritzalis A. Buffagni P. Pinto N. Friberg J. Murray-Bligh J. Kokes R. Alber P. Usseglio-Polatera P. Haase R. Sweeting B. Bis K. Szoszkiewicz H. Soszka G. Springe F. Sporka I. Krno (2006) ArticleTitleThe STAR project: context, objectives and approaches Hydrobiologia 566 3–29

    Google Scholar 

  • Genoni, P., P. Beati, F. Buzzi, P. Casarini, M. Girami, E. Gozio, V. Mafessoni, P. Roella & A. Sarzilla, 1998. Intercalibrazione del metodo Indice Biotico Esteso I.B.E. (IRSA-CNR, 1995) per la valutazione della qualità dei corsi d’acqua. Regione Lombardia Direzione Generale Sanità Servizio Prevenzione Sanitaria. 34 pp

  • P. Genoni (2003) ArticleTitleInfluenza di alcuni fattori ambientali sulla composizione delle cenosi macrobentoniche dei corsi d’acqua planiziali minori Biologia Ambientale 17 9–16

    Google Scholar 

  • P. F. Ghetti G. Bonazzi (1977) ArticleTitleA comparison between various criteria for the interpretation of biological data in the analysis of running waters sites Water Research 11 819–831 Occurrence Handle1:CAS:528:DyaE1cXktFCisA%3D%3D Occurrence Handle10.1016/0043-1354(77)90053-7

    Article  CAS  Google Scholar 

  • A-S. Heiskanen W. Bund Particlevan de A. C. Cardoso P. Nõges (2004) ArticleTitleTowards good ecological status of surface waters in Europe – interpretation and harmonisation of the concept Water Science & Technology 49 169–177 Occurrence Handle1:STN:280:DC%2BD2c3psFSjtQ%3D%3D

    CAS  Google Scholar 

  • Helsel, D. R. & R. M. Hirsch, 1992. Statistical Methods in Water Resources. Elsevier (ed.) 522 pp

  • D. Hering A. Buffagni O. Moog L. Sandin M. Sommerhäuser I. Stubauer C. Feld R. K. Johnson P. Pinto N. Skoulikidis P. F. M. Verdonschot S. Zahrádková (2003) ArticleTitleThe development of a system to assess the ecological quality of streams based on macroinvertebrates – design of the sampling programme within the AQEM project Int. Rev. Hydrobiol. 88 345–361 Occurrence Handle10.1002/iroh.200390030

    Article  Google Scholar 

  • Hering, D., O. Moog, L. Sandin & P. F. M. Verdonschot, 2004a. Overview and application of the AQEM assessment system. In Hering D., P. F. M. Verdonschot, O. Moog & L. Sandin (eds), Integrated Assessment of Running Waters in Europe. Kluwer Academic Publishers, Printed in the Netherlands. Hydrobiologia 516: 1–20

  • Hering, D., P. F. M. Verdonschot, O. Moog & L. Sandin (eds), 2004b. Integrated Assessment of Running Waters in Europe. Developments in Hydrobiology, 175. Kluwer Academic Publishers. Reprinted from Hydrobiologia 516 (2004), 379 pp

  • B. L. Kerans J. B. Karr (1994) ArticleTitleA benthic index of biotic integrity (B-IBI) for rivers of the Tennessee valley Ecological Application 4 768–785 Occurrence Handle10.2307/1942007

    Article  Google Scholar 

  • Kownacki, A., H. Soszka, T. Fleituch & D. Kudelska (eds), 2002. River biomonitoring and benthic invertebrate communities. Institute of Environmental Protection, Karol Starmach Institute of Freshwater Biology PAS, Warszawa-Krakow, 88 pp

  • Kownacki, A., H. Soszka, D. Kudelska & T. Fleituch, 2004. Bioassessment of Polish rivers based on macroinvertebrates. In Geller W. et al. (eds), Proceedings of the International 11th Magdeburg Seminar on Waters in Central and Eastern Europe: Assessment, Protection, Management. 18–22 October 2004, UFZ Leipzig: 250–251

  • P. Logan (2001) ArticleTitleEcological quality assessment of rivers and integrated catchment management in England and Wales Journal of Limnology 60 IssueIDSuppl.1 25–32

    Google Scholar 

  • Lorenz, A., D. Hering, C. K. Feld & P. Rolauffs, 2004. A new method for assessing the impact of hydromorphological degradation on the macroinvertebrate fauna of five German stream types. In Hering D., P. F. M. Verdonschot, O. Moog & L. Sandin (eds), Integrated Assessment of Running Waters in Europe. Kluwer Academic Publishers. The Netherlands. Hydrobiologia 516: 107–127

  • Morais, M., P. Pinto, P. Guilherme, J. Rosado & I. Antunes, 2004. Assessment of temporary streams: the robustness of metric and multimetric indices under different hydrological conditions. In Hering D., P. F. M. Verdonschot, O. Moog & L. Sandin (eds), Integrated Assessment of Running Waters in Europe. Kluwer Academic Publishers, The Netherlands. Hydrobiologia 516: 229–249

  • J. A. D. Murray-Bligh (1999) Procedures for collecting and analysing macro-invertebrate samples. Quality Management Systems for Environmental Monitoring: Biological Techniques, BT001. (Version 2.0, 30 July 1999) Environment Agency Bristol

    Google Scholar 

  • Nijboer, R. C., R. K. Johnson, P. F. M. Verdonschot, M. Sommerhäuser & A. Buffagni, 2004. Establishing reference conditions for European streams. In Hering D., P. F. M. Verdonschot, O. Moog & L. Sandin (eds), Integrated Assessment of Running Waters in Europe. Kluwer Academic Publishers, The Netherlands. Hydrobiologia 516: 91–105

  • Ofenböck, T., O. Moog, J. Gerritsen & M. Barbour, 2004. A stressor specific multimetric approach for monitoring running waters in Austria using benthic macro-invertebrates. In Hering D., P. F. M. Verdonschot, O. Moog & L. Sandin (eds), Integrated Assessment of Running Waters in Europe. Kluwer Academic Publishers, The Netherlands. Hydrobiologia 516: 251–268

  • Pinto, P., J. Rosado, M. Morais & I. Antunes, 2004. Assessment methodology for southern siliceous basins in Portugal. In Hering D., P. F. M. Verdonschot, O. Moog & L. Sandin (eds), Integrated Assessment of Running Waters in Europe. Kluwer Academic Publishers, The Netherlands. Hydrobiologia 516: 191–214

  • E. Rico A. Rallo M. A. Sevillano M. L. Arretxe (1992) ArticleTitleComparison of several biological indices based on river macroinvertebrate benthic community for assessment of running water quality Annales de Limnologie 28 147–156 Occurrence Handle10.1051/limn/1992013

    Article  Google Scholar 

  • Sandin, L. & D. Hering 2004. Comparing macroinvertebrate indices to detect organic pollution across Europe: a contribution to the EC Water Framework Directive intercalibration. In D. Hering, P. F. M. Verdonschot, O. Moog & L. Sandin (eds), Integrated Assessment of Running Waters in Europe. Kluwer Academic Publishers, The Netherlands. Hydrobiologia 516: 55–68

  • C. E. Shannon W. Weaver (1949) The Mathematical Theory of Communication The University of Illinois Press Urbana, IL

    Google Scholar 

  • R. Spaggiari S. Franceschini (2000) ArticleTitleProcedure di calcolo dello stato ecologico dei corsi d’acqua e di rappresentazione grafica delle informazioni Biologia Ambientale 14 IssueID2 1–6

    Google Scholar 

  • R. S. Thorne W. P. Williams (1997) ArticleTitleThe response of benthic macroinvertebrates to pollution in developing countries: a multimetric system of bioassessment Freshwater Biology 37 671–686 Occurrence Handle10.1046/j.1365-2427.1997.00181.x

    Article  Google Scholar 

  • P. F. M. Verdonshot (2000) ArticleTitleIntegrated ecological assessment methods as a basis for sustainable catchment management Hydrobiologia 442/443 389–412 Occurrence Handle10.1023/A:1017094905369

    Article  Google Scholar 

  • Wasson, J. G., A. Chandesris, H. Pella, & L. Blanc, 2003. Typologie des eaux courantes pour la Directive Cadre Européenne sur l’Eau : l’approche par Hydro-écorégion. “5ème séminaire du réseau d’animation REGLIS (Représentation et Gestion de l’Information Spatialisée)”, Cemagref UMR Structures et Systèmes Spatiaux, Montpellier, 13–14 novembre, 7 p

  • J. F. Wright (1995) ArticleTitleDevelopment and use of a system for predicting the macroinvertebrate fauna in flowing waters Australian Journal of Ecology 20 181–198

    Google Scholar 

Download references

Author information

Authors and Affiliations

Authors

Corresponding author

Correspondence to Andrea Buffagni.

Rights and permissions

Reprints and permissions

About this article

Cite this article

Buffagni, A., Erba, S., Cazzola, M. et al. The STAR common metrics approach to the WFD intercalibration process: Full application for small, lowland rivers in three European countries. Hydrobiologia 566, 379–399 (2006). https://doi.org/10.1007/s10750-006-0082-7

Download citation

  • Issue Date:

  • DOI: https://doi.org/10.1007/s10750-006-0082-7

Keywords

Navigation