Kirill Levchenko
Vern Paxson
ABSTRACT
The right vantage point is critical to the success of any active measurement. However, most research groups cannot afford to design, deploy, and maintain their own network of measurement endpoints, and thus rely measurement infrastructure shared by others. Unfortunately, the mechanism by which we share access to measurement endpoints today is not frictionless; indeed, issues of compatibility, trust, and a lack of incentives get in the way of efficiently sharing measurement infrastructure.
We propose PacketLab, a universal measurement endpoint interface that lowers the barriers faced by experimenters and measurement endpoint operators. PacketLab is built on two key ideas: It moves the measurement logic out of the endpoint to a separate experiment control server, making each endpoint a lightweight packet source/sink. At the same time, it provides a way to delegate access to measurement endpoints while retaining fine-grained control over how one's endpoints are used by others, allowing research groups to share measurement infrastructure with each other with little overhead. By making the endpoint interface simple, we also make it easier to deploy measurement endpoints on any device anywhere, for any period of time the owner chooses. We offer PacketLab as a candidate measurement interface that can accommodate the research community's demand for future global-scale Internet measurement.
- Internet Censorship Lab. http://www.internetcensorshiplab.com.Google Scholar
- Measuring Broadband America. https://www.fcc.gov/general/measuring-broadband-america.Google Scholar
- PlanetLab: An Open Platform for Developing, Deploying, and Accessing Planetary-scale Services. https://www.planet-lab.org.Google Scholar
- RIPE Atlas. https://atlas.ripe.net.Google Scholar
- V. Bajpai, A. W. Berger, P. Eardley, J. Ott, and J. Schönwälder. Global Measurements: Practice and Experience (Report on Dagstuhl Seminar #16012). SIGCOMM Comput. Commun. Rev., 46(2):32--39, May 2016. Google ScholarDigital Library
- V. Bajpai and J. Schonwalder. A Survey on Internet Performance Measurement Platforms and Related Standardization Efforts. IEEE Communications Surveys and Tutorials, 17(3):1313--1341, Apr 2015.Google ScholarDigital Library
- A. Begel, S. McCanne, and S. L. Graham. BPF+: Exploiting Global Data-flow Optimization in a Generalized Packet Filter Architecture. In Proceedings of the Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication, 1999. Google ScholarDigital Library
- H. Bos, W. De Bruijn, M.-L. Cristea, T. Nguyen, and G. Portokalidis. FFPF: Fairly Fast Packet Filters. In Proceedings of the USENIX Symposium on Operating Systems Design and Implementation, pages 24--24, 2004. Google ScholarDigital Library
- T. Bourgeau, J. Augé, and T. Friedman. TopHat: Supporting Experiments through Measurement Infrastructure Federation. In in: Proceedings of the International Conference on Testbeds and Research Infrastructures for the Development of Networks and Communities (TridentCom, 2010.Google Scholar
- R. T. Braden. A Pseudo-machine for Packet Monitoring and Statistics. In Symposium Proceedings on Communications Architectures and Protocols, pages 200--209, 1988. Google ScholarDigital Library
- CAIDA. AIMS 2015: Workshop on Active Internet Measurements. https://www.caida.org/workshops/aims/1503.Google Scholar
- CAIDA. AIMS 2016: Workshop on Active Internet Measurements. https://www.caida.org/workshops/aims/1602.Google Scholar
- CAIDA. AIMS 2017: Workshop on Active Internet Measurements. https://www.caida.org/workshops/aims/1703.Google Scholar
- k. claffy, Y. Hyun, K. Keys, M. Fomenkov, and D. Krioukov. Internet Mapping: from Art to Science. In IEEE DHS Cybersecurity Applications and Technologies Conference for Homeland Security (CATCH), pages 205--211, Watham, MA, Mar 2009. Google ScholarDigital Library
- D. R. Engler and M. F. Kaashoek. DPF: Fast, Flexible Message Demultiplexing Using Dynamic Code Generation. In Proceedings of the Conference on Applications, Technologies, Architectures, and Protocols for Computer Communication, pages 53--59, 1996. Google ScholarDigital Library
- V. Giotsas, A. Dhamdhere, and k. claffy. Periscope: Unifying Looking Glass Querying. In Passive and Active Network Measurement Workshop (PAM), Mar 2016.Google Scholar
- U. Goel, A. Miyyapuram, M. Wittie, and Q. Yang. MITATE: Mobile Internet Testbed for Application Traffic Experimentation. In Mobile and Ubiquitous Systems: Computing, Networking, and Services. 10th International Conference, MOBIQUITOUS 2013, Tokyo, Japan, Revised Selected Papers, 2014.Google Scholar
- S. Ioannidis, K. G. Anagnostakis, J. Ioannidis, and A. D. Keromytis. xPF: Packet Filtering for Low-Cost Network Monitoring. In Proceedings of the Workshop on High Performance Switching and Routing, pages 116--120, 2002.Google ScholarCross Ref
- C. Kreibich, N. Weaver, B. Nechaev, and V. Paxson. Netalyzr: Illuminating the Edge Network. In Proceedings of the ACM Conference on Internet Measurement, pages 246--259, 2010. Google ScholarDigital Library
- M. Luckie, A. Dhamdhere, D. Clark, B. Huffaker, and K. Claffy. Challenges in Measuring Internet Interdomain Congestion. In Proceedings of the ACM SIGCOMM Internet Measurement Conference (IMC), 2014. Google ScholarDigital Library
- S. McCanne and V. Jacobson. The BSD Packet Filter: A New Architecture for User-level Packet Capture. In Proceedings of the USENIX Conference, 1993. Google ScholarDigital Library
- D. L. Mills. Improved Algorithms for Synchronizing Computer Network Clocks. IEEE/ACM Transactions on Networking, 3(3):245--254, 1995. Google ScholarDigital Library
- J. Mogul, R. Rashid, and M. Accetta. The Packer Filter: An Efficient Mechanism for User-level Network Code. In Proceedings of the Eleventh ACM Symposium on Operating Systems Principles, pages 39--51, 1987. Google ScholarDigital Library
- D. Moore, C. Shannon, G. M. Voelker, and S. Savage. Network Telescopes. Technical Report 2004--04, Department of Computer Science and Engineering, University of California, San Diego, 2004.Google Scholar
- OONI. Open Observatory of Network Interference. https://ooni.torproject.org.Google Scholar
- M. A. Sánchez, J. S. Otto, Z. S. Bischof, D. R. Choffnes, F. E. Bustamante, B. Krishnamurthy, and W. Willinger. Dasu: Pushing Experiments to the Internet's Edge. In Proceedings of the 10th USENIX Conference on Networked Systems Design and Implementation, nsdi'13, pages 487--500, Berkeley, CA, USA, 2013. USENIX Association. Google ScholarDigital Library
- B. Schlinker, K. Zarifis, I. Cunha, N. Feamster, and E. Katz-Bassett. PEERING: An AS for Us. In Proceedings of the 13th ACM Workshop on Hot Topics in Networks, 2014. Google ScholarDigital Library
- J. Schulist, D. Borkmann, and A. Starovoitov. Linux Socket Filtering aka Berkeley Packet Filter (BPF). https://www.kernel.org/doc/Documentation/networking/filter.txt.Google Scholar
- N. Spring, D. Wetherall, and T. Anderson. Scriptroute: A Public Internet Measurement Facility. In Proceedings of the 4th Conference on USENIX Symposium on Internet Technologies and Systems - Volume 4, USITS'03, pages 17--17, Berkeley, CA, USA, 2003. USENIX Association. Google ScholarDigital Library
- S. Sundaresan, S. Burnett, N. Feamster, and W. De Donato. BISmark: A Testbed for Deploying Measurements and Applications in Broadband Access Networks. In 2014 USENIX Conference on USENIX Annual Technical Conference (USENIX ATC 14), pages 383--394, 2014. Google ScholarDigital Library
- The Mplane Consortium. MPlane: Building an Intelligent Measuremet Plane for the Internet. http://www.ict-mplane.eu.Google Scholar
- Z. Wu, M. Xie, and H. Wang. Swift: A Fast Dynamic Packet Filter. In Proceedings of the USENIX Symposium on Networked Systems Design and Implementation, pages 279--292, 2008. Google ScholarDigital Library
- M. Yuhara, B. N. Bershad, C. Maeda, and J. E. B. Moss. Efficient Packet Demultiplexing for Multiple Endpoints and Large Messages. In USENIX Winter Technical Conference Proceedings, Jan. 1994. Google ScholarDigital Library
Index Terms
- Packetlab: a universal measurement endpoint interface
Recommendations
PacketLab: tools alpha release and demo
IMC '22: Proceedings of the 22nd ACM Internet Measurement ConferenceThe PacketLab universal measurement endpoint interface design facilitates vantage point sharing among experimenters and measurement endpoint operators [1]. We have continued working on fleshing out the design details of PacketLab components and adding ...
Poster: Empirically Testing the PacketLab Model
IMC '23: Proceedings of the 2023 ACM on Internet Measurement ConferencePacketLab is a recently proposed model for accessing remote vantage points. The core design is for the vantage points to export low-level network operations that measurement researchers could rely on to construct more complex measurements. Motivating the ...
OMware: an open measurement ware for stable residential broadband measurement
A number of home-installed middleboxes, e.g., BISMark and SamKnows, and web-based tools, e.g., Netalyzr and Ookla's speedtest service, have been developed recently to enable residential broadband users to gauge their network service quality. One ...
Comments