Vern Paxson
ABSTRACT
Conducting an Internet measurement study in a sound fashion can be much more difficult than it might first appear. We present a number of strategies drawn from experiences for avoiding or overcoming some of the pitfalls. In particular, we discuss dealing with errors and inaccuracies; the importance of associating <i>meta-data</i> with measurements; the technique of calibrating measurements by examining outliers and testing for consistencies; difficulties that arise with large-scale measurements; the utility of developing a discipline for reliably reproducing analysis results; and issues with making datasets publicly available. We conclude with thoughts on the sorts of tools and community practices that can assist researchers with conducting sound measurement studies.
- M. Allman. Private communication. 2001.]]Google Scholar
- M. Allman, E. Blanton, and W. Eddy. A Scalable System for Sharing Internet Measurements. Proc. PAM 2002.]]Google Scholar
- M. Allman, W. Eddy and S. Ostermann. Estimating Loss Rates With TCP. ACM Performance Evaluation Review, 31(3). 2003.]] Google ScholarDigital Library
- P. Barford. Private communication. 2000.]]Google Scholar
- S. Floyd and V. Paxson. Difficulties in Simulating the Internet. IEEE/ACM Transactions on Networking 9(4):392--403. 2001.]] Google ScholarDigital Library
- C. Fraleigh et al. Packet-Level Traffic Measurements from the Sprint IP Backbone. IEEE Network 17(6). 2003.]] Google ScholarDigital Library
- A. Gilat. MATLAB: An Introduction with Applications. Wiley Text Books. 2003.]] Google ScholarDigital Library
- M. Handley, C. Kreibich and V. Paxson. Network Intrusion Detection: Evasion, Traffic Normalization, and End-to-End Protocol Semantics. Proc. USENIX Security Symposium. 2001.]] Google ScholarDigital Library
- J. Heidemann, K. Mills, and S. Kumar. Expanding Confidence in Network Simulation. IEEE Network, 15(5):58--63. 2001.]] Google ScholarDigital Library
- S. Jaiswal et al. Measurement and Classification of Out-of-Sequence Packets in a Tier-1 IP Backbone. Proc. ACM SIGCOMM IMW, 2002.]] Google ScholarDigital Library
- E. Kohler. ipsumdump. http:www//icir.org/kohler/ipsumdump/. 2002.]]Google Scholar
- C. Kreibich. Design and Implementation of Netdude, a Framework for Packet Trace Manipulation. Proc. USENIX/FREENIX, 2004.]] Google ScholarDigital Library
- P. Martin-Löf. The Notion of Redundancy and Its Use as a Quantitative Measure of the Discrepancy between a Statistical Hypothesis and a Set of Observational Data. Scandinavian Journal of Statistics, 1(1), pp. 3--18. 1974.]]Google Scholar
- D. Mills. Network Time Protocol (Version 3): Specification, Implementation and Analysis. RFC 1305, Network Information Center, SRI International, Menlo Park, CA. March 1992.]] Google ScholarDigital Library
- D. Mills. Modelling and Analysis of Computer Network Clocks. Technical Report 92-5-2, Electrical Engineering Department, Univ. Delaware. mbox May 1992.]]Google Scholar
- Greg Minshall. TCPdpriv manual. http:www.acm.org/sigcomm/ITA/. 1996.]]Google Scholar
- J. Mogul. Trace anonymization misses the point. WWW 2002 panel on Web Measurements. http://www2002.org/presentations/mogul-n.pdf]]Google Scholar
- S. Moon, P. Skelly and D. Towsley. Estimation and Removal of Clock Skew from Network Delay Measurements. Proc. IEEE INFOCOM. 1999.]]Google ScholarCross Ref
- R. Pang and V. Paxson. A High-level Programming Environment for Packet Trace Anonymization and Transformation. Proc. ACM SIGCOMM. 2003.]] Google ScholarDigital Library
- A. Pasztor and D. Veitch. PC Based Precision Timing Without GPS. Proc. ACM SIGMETRICS. 2002.]] Google ScholarDigital Library
- V. Paxson. Automated Packet Trace Analysis of TCP Implementations. Proc. ACM SIGCOMM. 1997.]] Google ScholarDigital Library
- V. Paxson. Measurements and Analysis of End-to-End Internet Dynamics. Ph.D. dissertation. Univ. California, Berkeley. 1997.]] Google ScholarDigital Library
- V. Paxson. On Calibrating Measurements of Packet Transit Times. Proc. ACM SIGMETRICS '98.]] Google ScholarDigital Library
- V. Paxson. Bro: A System for Detecting Network Intruders in Real-Time. Computer Networks 31(23--24), pp. 2435--2463, Dec. 1999.]] Google ScholarDigital Library
- T. Ptacek and T. Newsham, Insertion, Evasion, and Denial of Service: Eluding Network Intrusion Detection. Technical report, Secure Networks. http:www.icir.org/vern/Ptacek-Newsham-Evasion-98.ps. Jan. 1998.]]Google Scholar
- R Development Core Team. R: A language and environment for statistical computing. R Foundation for Statistical Computing, Vienna, Austria. 2003.]]Google Scholar
- W. Venables and B. Ripley. Modern Applied Statistics with S-PLUS. Springer. 1999.]]Google Scholar
- L. Wang et al. Observation and Analysis of BGP Behavior under Stress. Proc. ACM SIGCOMM IMW. 2002.]] Google ScholarDigital Library
- J. Xu, J. Fan, M. Ammar, S. Moon. Prefix-Preserving IP Address Anonymization: Measurement-Based Security Evaluation and a New Cryptography-based Scheme. Proc. ICNP. 2002.]] Google ScholarDigital Library
- L. Zhang, Z. Liu, and C. Xia. Clock Synchronization Algorithms for Network Measurements. Proc. IEEE INFOCOM. 2002]]Google Scholar
Index Terms
- Strategies for sound internet measurement
Recommendations
Addressing Ethical Considerations in Network Measurement Papers: Abstract
NS Ethics '15: Proceedings of the 2015 ACM SIGCOMM Workshop on Ethics in Networked Systems ResearchWe explore the benefits of requiring measurement papers to include an ethical considerations section. We focus our attention on what specific questions such a section should answer and how to keep the section simple and easy to write for measurement ...
Design of Multi-resolution 3D Measurement System Using Light Sectioning Method and Multi-sensor Data Fusion Techniques
Intelligent Robotics and ApplicationsAbstractWith the rapid development of shape measurement technique, multi-resolution approach becomes one of valid way to improve the accuracy, to expend measuring range, to reduce occlusion, to realize multi-resolution measurement, and to increase ...
Evaluating measurement error of a 3D movable body scanner for calibration
ISTASC'09: Proceedings of the 9th WSEAS International Conference on Systems Theory and Scientific ComputationFor the evaluation of measurement error of a 3D movable body scanner, a set of dimension-certified measurement equipment was introduced and its true dimensions were obtained. The evaluation and calibration models of height, breadth and depth measurement ...
Comments