research-article

A Survey on Internet Performance Measurement Platforms and Related Standardization Efforts

Authors:

Vaibhav Bajpai,

Jurgen SchonwalderAuthors Info & Claims

IEEE Communications Surveys & Tutorials, Volume 17, Issue 3

Pages 1313 - 1341

https://doi.org/10.1109/COMST.2015.2418435

Published: 01 July 2015 Publication History

Abstract

A number of Internet measurement platforms have emerged in the last few years. These platforms have deployed thousands of probes at strategic locations within access and backbone networks and behind residential gateways. In this paper, we provide a taxonomy of these measurement platforms on the basis of their deployment use-case. We describe these platforms in detail by exploring their coverage, scale, lifetime, deployed metrics and measurement tools, architecture and overall research impact. We conclude the survey by describing current standardization efforts to make large-scale performance measurement platforms interoperable.

References

[1]

B. Donnet, “ Internet topology discovery,” in Data Traffic Monitoring and Analysis, Lecture Notes in Computer Science, E. Biersack, C. Callegari, and M. Matijasevic, Eds. Berlin, Germany: Springer-Verlag, 2013, vol. 7754, pp. 44– 81. [Online]. Available: https://doi.org/10.1007/978-3-642-36784-7_3

Digital Library

[2]

H. Haddadi, M. Rio, G. Iannaccone, A. Moore, and R. Mortier, “ Network topologies: Inference, modeling, and generation,” Commun. Surveys Tuts., vol. 10, no. 2, pp. 48– 69, Apr. 2008.

Digital Library

[3]

B. Donnet and T. Friedman, “ Internet topology discovery: A survey,” Commun. Surveys Tuts., vol. 9, no. 4, pp. 56– 69, Oct. 2007.

Digital Library

[4]

F. Michaut and F. Lepage, “ Application-oriented network metrology: Metrics and active measurement tools,” Commun. Surveys Tuts., vol. 7, no. 2, pp. 2– 24, Apr. 2005.

Digital Library

[5]

R. Prasad, C. Dovrolis, M. Murray, and K. Claffy, “ Bandwidth estimation: Metrics, measurement techniques, and tools,” IEEE Netw. Mag. Global Internet, vol. 17, no. 6, pp. 27– 35, Nov. 2003.

Digital Library

[6]

K. Claffy, Y. Hyun, K. Keys, M. Fomenkov, and D. Krioukov, “ Internet mapping: From art to science,” in Proc. IEEE CATCH, Washington, DC, USA, 2009, pp. 205– 211.

[7]

Y. Shavitt and E. Shir, “ Dimes: Let the Internet measure itself,” SIGCOMM Comput. Commun. Rev., vol. 35, no. 5, pp. 71– 74, Oct. 2005.

Digital Library

[8]

H. V. Madhyastha et al., “ Iplane: An information plane for distributed services,” in Proc. 7th Symp. OSDI, Berkeley, CA, USA, 2006, pp. 367– 380.

[9]

B. Chun et al., “ Planetlab: An overlay testbed for broad-coverage services,” SIGCOMM Comput. Commun. Rev., vol. 33, no. 3, pp. 3– 12, Jul. 2003.

Digital Library

[10]

M. E. Fiuczynski, “ Planetlab: Overview, history, and future directions,” SIGOPS Oper. Syst. Rev., vol. 40, no. 1, pp. 6– 10, Jan. 2006.

Digital Library

[11]

C. Dovrolis, K. Gummadi, A. Kuzmanovic, and S. D. Meinrath, “ Measurement lab: Overview and an invitation to the research community,” SIGCOMM Comput. Commun. Rev., vol. 40, no. 3, pp. 53– 56, Jun. 2010.

Digital Library

[12]

M. Murray and K. Claffy, “ Measuring the immeasurable: Global Internet measurement infrastructure,” in Proc. PAM, Amsterdam, Netherlands, Apr. 2001, pp. 159– 167.

[13]

S. Sundaresan et al., “ Measuring home broadband performance,” Commun. ACM, vol. 55, no. 11, pp. 100– 109, Nov. 2012.

Digital Library

[14]

S. McKee et al., “ Monitoring the us atlas network infrastructure with perfsonar-ps,” J. Phys.: Conf. Ser., vol. 396, no. 4, 2012, Art. ID. [Online]. Available: http://stacks.iop.org/1742-6596/396/i=4/a=042038

[15]

M. Rimondini, C. Squarcella, and G. Battista, “ Towards an automated investigation of the impact of bgp routing changes on network delay variations,” in Passive Active Measurement, Lecture Notes in Computer Science, M. Faloutsos and A. Kuzmanovic, Eds. Berlin, Germany: Springer-Verlag, 2014, vol. 8362, pp. 193– 203. [Online]. Available: https://doi.org/10.1007/978-3-319-04918-2_19

[16]

M. A. Sánchez et al., “ Dasu: Pushing experiments to the Internet's edge,” in Proc. 10th USENIX Conf. NSDI, Berkeley, CA, USA, 2013, pp. 487– 500.

[17]

S. Shalunov, B. Teitelbaum, A. Karp, J. Boote, and M. Zekauskas, “ A One-way Active Measurement Protocol (OWAMP),” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 4656 (Proposed Standard), Sep. 2006. [Online]. Available: http://www.ietf.org/rfc/rfc4656.txt

[18]

A. Gupta et al., “ Peering at the Internet's frontier: A first look at isp interconnectivity in africa,” in Passive and Active Measurement, Lecture Notes in Computer Science, M. Faloutsos and A. Kuzmanovic, Eds. Berlin, Germany: Springer-Verlag, 2014, vol. 8362, pp. 204– 213. [Online]. Available: https://doi.org/10.1007/978-3-319-04918-2_20

[19]

W. Matthews and L. Cottrell, “ The pinger project: Active Internet performance monitoring for the henp community,” Comm. Mag., vol. 38, no. 5, pp. 130– 136, May 2000.

Digital Library

[20]

A. Faggiani, E. Gregori, L. Lenzini, S. Mainardi, and A. Vecchio, “ On the feasibility of measuring the Internet through smartphone-based crowdsourcing,” in Proc. 10th Int. Symp. Modeling Optim. Mobile, Ad Hoc WiOpt, May 2012, pp. 318– 323.

[21]

S. Sundaresan et al., “ Broadband Internet performance: A view from the gateway,” in Proc. ACM SIGCOMM, New York, NY, USA, 2011, pp. 134– 145.

[22]

X. Zhou and P. Van Mieghem, “ Hopcount and e2e delay: Ipv6 versus ipv4,” in Proc. 6th Int. Conf. PAM, Berlin, Germany, 2005, pp. 345– 348.

[23]

B. Augustin et al., “ Avoiding traceroute anomalies with paris traceroute,” in Proc. 6th ACM SIGCOMM IMC, New York, NY, USA, 2006, pp. 153– 158.

[24]

C. Pelsser, L. Cittadini, S. Vissicchio, and R. Bush, “ From paris to tokyo: On the suitability of ping to measure latency,” in Proc. Conf. IMC, New York, NY, USA, 2013, pp. 427– 432.

[25]

B. Augustin, T. Friedman, and R. Teixeira, “ Measuring loadbalanced paths in the Internet,” in Proc. 7th ACM SIGCOMM IMC, New York, NY, USA, 2007, pp. 149– 160.

[26]

M. Dischinger, A. Haeberlen, K. P. Gummadi, and S. Saroiu, “ Characterizing residential broadband networks,” in Proc. 7th ACM SIGCOMM IMC, New York, NY, USA, 2007, pp. 43– 56.

[27]

A. Schulman and N. Spring, “ Pingin' in the rain,” in Proc. ACM SIGCOMM Conf. IMC, New York, NY, USA, 2011, pp. 19– 28.

[28]

K. Lakshminarayanan and V. N. Padmanabhan, “ Some findings on the network performance of broadband hosts,” in Proc. 3rd ACM SIGCOMM IMC, New York, NY, USA, 2003, pp. 45– 50.

[29]

M. Siekkinen, D. Collange, G. Urvoy-Keller, and E. W. Biersack, “ Performance limitations of adsl users: A case study,” in Proc. 8th Int. Conf. PAM, Berlin, Germany, 2007, pp. 145– 154.

[30]

G. Maier, A. Feldmann, V. Paxson, and M. Allman, “ On dominant characteristics of residential broadband Internet traffic,” in Proc. 9th ACM SIGCOMM IMC, New York, NY, USA, 2009, pp. 90– 102.

[31]

G. Maier, F. Schneider, and A. Feldmann, “ Nat usage in residential broadband networks,” in Proc. 12th Int. Conf. PAM, Berlin, Germany, 2011, pp. 32– 41.

[32]

M. Dischinger et al., “ Glasnost: Enabling end users to detect traffic differentiation,” in Proc. 7th USENIX Conf. NSDI, Berkeley, CA, USA, 2010, pp. 27– 27.

[33]

P. Kanuparthy and C. Dovrolis, “ Shaperprobe: End-to-end detection of isp traffic shaping using active methods,” in Proc. ACM SIGCOMM Conf. IMC, New York, NY, USA, 2011, pp. 473– 482.

[34]

C. Kreibich, N. Weaver, B. Nechaev, and V. Paxson, “ Netalyzr: Illuminating the edge network,” in Proc. 10th ACM SIGCOMM IMC, New York, NY, USA, 2010, pp. 246– 259.

[35]

M. Dhawan et al., “ Fathom: A Browser-based network measurement platform,” in Proc. ACM Conf. IMC, New York, NY, USA, 2012, pp. 73– 86.

[36]

L. DiCioccio, R. Teixeira, and C. Rosenberg, “ Measuring home networks with homenet profiler,” in Proc. 14th Int. Conf. PAM, Berlin, Germany, 2013, pp. 176– 186.

[37]

O. Goga and R. Teixeira, “ Speed measurements of residential Internet access,” in Proc. 13th Int. Conf. PAM, Berlin, Germany, 2012, pp. 168– 178.

[38]

M. Jain and C. Dovrolis, “ Pathload: A measurement tool for end-toend available bandwidth,” in Proc. PAM Workshop, 2002, pp. 14– 25.

[39]

W. Li, R. K. Mok, R. K. Chang, and W. W. Fok, “ Appraising the delay accuracy in browser-based network measurement,” in Proc. Conf. IMC, New York, NY, USA, 2013, pp. 361– 368.

[40]

M. Linsner, P. Eardley, T. Burbridge, and F. Sorensen, “ Large-scale broadband measurement use cases,” Internet Engineering Task Force (IETF), Fremont, CA, USA, Internet-Draft Draft-Ietf-lmap-use-Cases-06, Feb. 2015, work in Progress. [Online]. Available: http://tools.ietf.org/html/draft-ietf-lmap-use-cases-06

[41]

S. Bauer, D. Clark, and W. Lehr, “ Powerboost,” in Proc. 2Nd ACM SIGCOMM Workshop HomeNets, New York, NY, USA, 2011, pp. 7– 12.

Digital Library

[42]

Z. S. Bischof et al., “ Crowdsourcing isp characterization to the network edge,” in Proc. 1st ACM SIGCOMM W-MUST, New York, NY, USA, 2011, pp. 61– 66.

[43]

Z. S. Bischof, J. S. Otto, and F. E. Bustamante, “ Up, down and around the stack: Isp characterization from network intensive applications,” in Proc. ACM SIGCOMM W-MUST, New York, NY, USA, 2012, pp. 13– 18.

[44]

G. Bernardi, D. Fenacci, M. K. Marina, and D. P. Pezaros, “ Bsense: A flexible and open-source broadband mapping framework,” in Proc. Conf. Netw.—Volume Part I IFIP. Berlin, Germany, 2012, pp. 344– 357.

[45]

I. Canadi, P. Barford, and J. Sommers, “ Revisiting broadband performance,” in Proc. ACM Conf. IMC, New York, NY, USA, 2012, pp. 273– 286.

[46]

D. Genin and J. Splett, “ Where in the Internet is congestion?” CoRR. [Online]. Available: http://arxiv.org/abs/1307.3696

[47]

V. Bajpai and J. Schönwälder, “ IPv4 versus IPv6—who connects faster?” in Proc. IFIP Networking, Toulouse, France, May 2015.

[48]

V. Bajpai and J. Schönwälder, “ Measuring the effects of happy eyeballs,” Internet Engineering Task Force (IETF), Fremont, CA, USA, Internet-Draft Draftbajpai-Happy-01, Jul. 2013, work in Progress. [Online]. Available: http://tools.ietf.org/html/draft-bajpai-happy-01

[49]

S. Ahsan, V. Bajpai, J. Ott, and J. Schönwälder, “ Measuring youtube from dual-stacked hosts,” in Passive and Active Measurement, Lecture Notes in Computer Science, J. Mirkovic and Y. Liu, Eds. Berlin, Germany: Springer-Verlag, 2015, vol. 8995, pp. 249– 261. [Online]. Available: https://doi.org/10.1007/978-3-319-15509-8_19

[50]

S. Sundaresan, S. Burnett, N. Feamster, and W. de Donato, “ Bismark: A testbed for deploying measurements and applications in broadband access networks,” in Proc. USENIX ATC, Philadelphia, PA, USA, Jun. 19–20, 2014, pp. 383– 394.

[51]

S. Grover et al., “ Peeking behind the nat: An empirical study of home networks,” in Proc. IMC, New York, NY, USA, 2013, pp. 377– 390.

[52]

S. Avallone, S. Guadagno, D. Emma, A. Pescape, and G. Ventre, “ D-ITG distributed Internet traffic generator,” in Proc. 1st Int. Conf. QEST, Washington, DC, USA, 2004, pp. 316– 317.

[53]

S. Sundaresan, N. Feamster, R. Teixeira, and N. Magharei, “ Community contribution award—measuring and mitigating web performance bottlenecks in broadband access networks,” in Proc. Conf. IMC, New York, NY, USA, 2013, pp. 213– 226.

[54]

S. Sundaresan et al., “ Helping users shop for isps with Internet nutrition labels,” in Proc. 2Nd ACM SIGCOMM Workshop HomeNets, New York, NY, USA, 2011, pp. 13– 18.

Digital Library

[55]

H. Kim, S. Sundaresan, M. Chetty, N. Feamster, and W. K. Edwards, “ Communicating with caps: Managing usage caps in home networks,” in Proc. ACM SIGCOMM Conf., New York, NY, USA, 2011, pp. 470– 471.

[56]

S. Roy and N. Feamster, “ Characterizing correlated latency anomalies in broadband access networks,” in Proc. ACM SIGCOMM, New York, NY, USA, 2013, pp. 525– 526.

[57]

S. Sundaresan, N. Magharei, N. Feamster, R. Teixeira, and S. Crawford, “ Web performance bottlenecks in broadband access networks,” in Proc. ACM SIGMETRICS, New York, NY, USA, 2013, pp. 383– 384.

[58]

S. Sundaresan, N. Magharei, N. Feamster, and R. Teixeira, “ Accelerating last-mile web performance with popularity-based prefetching,” in Proc. ACM SIGCOMM Conf. Appl., Technol., Archit., Protocols Comput. Commun., New York, NY, USA, 2012, pp. 303– 304.

[59]

M. Chetty, S. Sundaresan, S. Muckaden, N. Feamster, and E. Calandro, “ Measuring broadband performance in south africa,” in Proc. 4th ACM DEV-4, New York, NY, USA, 2013, pp. 1:1– 1:10.

[60]

S. Sundaresan, N. Feamster, and R. Teixeira, “ Measuring the Performance of User Traffic in Home Wireless Networks,” in Passive and Active Measurement, Lecture Notes in Computer Science, J. Mirkovic and Y. Liu, Eds. Berlin, Germany: Springer-Verlag, 2015, vol. 8995, pp. 305– 317. [Online]. Available: https://doi.org/10.1007/978-3-319-15509-8_23

[61]

M. A. Sánchez, J. S. Otto, Z. S. Bischof, and F. E. Bustamante, “ Dasu—isp characterization from the edge: A bittorrent implementation,” in Proc. ACM SIGCOMM, New York, NY, USA, 2011, pp. 454– 455.

[62]

M. Sanchez et al., “ A measurement experimentation platform at the Internet's edge,” IEEE/ACM Trans. Netw.. [Online]. Available: https://doi.org/10.1109/TNET.2014.2354348

[63]

M. Sánchez, J. Otto, Z. Bischof, and F. Bustamante, “ Trying broadband characterization at home,” in Passive and Active Measurement, Lecture Notes in Computer Science, M. Roughan and R. Chang, Eds. Berlin, Germany: Springer-Verlag, 2013, vol. 7799, pp. 198– 207. [Online]. Available: https://doi.org/10.1007/978-3-642-36516-4_20

[64]

Z. S. Bischof, F. E. Bustamante, and R. Stanojevic, “ Need, want, can afford: Broadband markets and the behavior of users,” in Proc. Conf. IMC, New York, NY, USA, 2014, pp. 73– 86. [Online]. Available: http://doi.acm.org/10.1145/2663716.2663753

[65]

S. Sonntag, J. Manner, and L. Schulte, “ Netradar—Measuring the wireless world,” in Proc. 11th Int. Symp. Modeling Optim. Mobile, Ad Hoc WiOpt, May 2013, pp. 29– 34.

[66]

S. Sonntag, L. Schulte, and J. Manner, “ Mobile network measurements—It's not all about signal strength,” in Proc. IEEE WCNC, Apr. 2013, pp. 4624– 4629.

[67]

L. Wang and J. Manner, “ Energy-efficient mobile web in a bundle,” Comput. Netw., vol. 57, no. 17, pp. 3581– 3600, Dec. 2013.

Digital Library

[68]

A. Faggiani, E. Gregori, L. Lenzini, V. Luconi, and A. Vecchio, “ Smartphone-based crowdsourcing for network monitoring: Opportunities, challenges, and a case study,” IEEE Commun. Mag., vol. 52, no. 1, pp. 106– 113, Jan. 2014.

[69]

A. Faggiani, E. Gregori, L. Lenzini, V. Luconi, and A. Vecchio, “ Lessons learned from the design, implementation, and management of a smartphone-based crowdsourcing system,” in Proc. 1st Int. Workshop SENSEMINE, New York, NY, USA, 2013, pp. 2:1– 2:6.

[70]

E. Gregori, L. Lenzini, V. Luconi, and A. Vecchio, “ Sensing the Internet through crowdsourcing,” in Proc. IEEE Int. Conf. PERCOM Workshops, Mar. 2013, pp. 248– 254.

[71]

F. Disperati et al., “ Smartprobe: A bottleneck capacity estimation tool for smartphones,” in IEEE Int. Conf. GREENCOM-ITHINGS-CPSCOM, Washington, DC, USA, 2013, pp. 1980– 1985.

[72]

M. Botts, G. Percivall, C. Reed, and J. Davidson, “ Geosensor networks,” in Sensor Web Enablement: Overview and High Level Architecture, S. Nittel, A. Labrinidis, and A. Stefanidis, Eds. Berlin, Germany: Springer-Verlag, 2008, pp. 175– 190. [Online]. Available: https://doi.org/10.1007/978-3-540-79996-2_10

[73]

L.-J. Chen et al., “ Estimating link capacity in high speed networks,” in Proc. 5th Int. IFIP-TC6 Conf. NETWORKING, Berlin, Germany, 2006, pp. 98– 109.

[74]

T. McGregor, S. Alcock, and D. Karrenberg, “ The ripe ncc Internet measurement data repository,” in Proc. 11th Int. Conf. PAM, Berlin, Germany, 2010, pp. 111– 120.

[75]

M. Candela, M. Bartolomeo, G. Battista, and C. Squarcella, “ Dynamic traceroute visualization at multiple abstraction levels,” in Graph Drawing, Lecture Notes in Computer Science, S. Wismath and A. Wolff, Eds. Berlin, Germany: Springer-Verlag, 2013, vol. 8242, pp. 496– 507. [Online]. Available: https://doi.org/10.1007/978-3-319-03841-4_43

[76]

A. Lutu, M. Bagnulo, C. Pelsser, and O. Maennel, “ Understanding the reachability of ipv6 limited visibility prefixes,” in Passive and Active Measurement, Lecture Notes in Computer Science, M. Faloutsos and A. Kuzmanovic, Eds. Berlin, Germany: Springer-Verlag, 2014, vol. 8362, pp. 163– 172. [Online]. Available: https://doi.org/10.1007/978-3-319-04918-2_16

[77]

A. Lutu, M. Bagnulo, and O. Maennel, “ The bgp visibility scanner,” in Proc. IEEE INFOCOM WKSHPS, Apr. 2013, pp. 115– 120.

[78]

N. Brownlee, “ On searching for patterns in traceroute responses,” in Passive and Active Measurement, Lecture Notes in Computer Science, M. Faloutsos and A. Kuzmanovic, Eds. Berlin, Germany: Springer-Verlag, 2014, vol. 8362, pp. 67– 76. [Online]. Available: https://doi.org/10.1007/978-3-319-04918-2_7

[79]

A. Faggiani et al., “ A study on traceroute potentiality in revealing the Internet as-level topology,” in Proc. Netw. Conf. IFIP, Jun. 2014, pp. 1– 9.

[80]

E. Gregori, A. Improta, L. Lenzini, L. Rossi, and L. Sani, “ On the incompleteness of the as-level graph: A novel methodology for bgp route collector placement,” in Proc. ACM Conf. IMC, New York, NY, USA, 2012, pp. 253– 264.

[81]

C. Anderson, P. Winter, and Roya, “ Global network interference detection over the RIPE atlas network,” in Proc. 4th USENIX Workshop FOCI, San Diego, CA, USA, Aug. 2014. [Online]. Available: https://www.usenix.org/conference/foci14/workshop-program/presentation/anderson

[82]

M. D. Bartolomeo, V. D. Donato, M. Pizzonia, C. Squarcella, and M. Rimondini, “ Mining network events using traceroute empathy,” CoRR, to be published. [Online]. Available: http://arxiv.org/abs/1412.4074

[83]

C. J. Bovy, H. T. Mertodimedjo, G. Hooghiemstra, H. Uijterwaal, and P. V. Mieghem, “ Analysis of end-to-end delay measurements in Internet,” in Proc. 3rd PAM, 2002, pp. 1– 8.

[84]

A. Ziviani, S. Fdida, J. Rezende, and O. Duarte, “ Toward a measurement-based geographic location service,” in Passive Active Netw. Meas., Lecture Notes in Computer Science, C. Barakat and I. Pratt, Eds. Berlin, Germany: Springer-Verlag, 2004, vol. 3015, pp. 43– 52. [Online]. Available: https://doi.org/10.1007/978-3-540-24668-8_5

[85]

X. Zhou and P. Mieghem, “ Reordering of ip packets in Internet,” in Passive and Active Network Measurement, Lecture Notes in Computer Science, C. Barakat and I. Pratt, Eds. Berlin, Germany: Springer-Verlag, 2004, vol. 3015, pp. 237– 246. [Online]. Available: https://doi.org/10.1007/978-3-540-24668-8_24

[86]

A. Hanemann et al., “ Perfsonar: A service oriented architecture for multi-domain network monitoring,” in Proc. ICSOC, Berlin, Germany, 2005, pp. 241– 254.

[87]

A. Hanemann et al., “ Complementary visualization of perfsonar network performance measurements,” in Proc. Internet Surveillance Protection, Aug. 2006, pp. 6– 6.

[88]

J. Zurawski, M. Swany, and D. Gunter, “ A scalable framework for representation and exchange of network measurements,” in Proc. Testbeds Res. Infrastructures Develop. Netw. Communities, 2006, pp. 1– 9. [Online]. Available: https://doi.org/10.1109/TRIDNT.2006.1649176

[89]

J. Zurawski et al., “ Hierarchically federated registration and lookup within the perfsonar framework,” in Proc. 10th IFIP/IEEE Int. Symp. IM, May 2007, pp. 705– 708.

[90]

B. Tierney et al., “ Perf-SONAR: Instantiating a Global Network Measurement Framework,” Oct. 2009.

[91]

P. Calyam, L. Kumarasamy, C.-G. Lee, and F. Ozguner, “ Ontologybased semantic priority scheduling for multi-domain active measurements,” J. Netw. Syst. Management, vol. 22, no. 3, pp. 1– 35, Jul. 2014. [Online]. Available: https://doi.org/10.1007/s10922-013-9297-x

[92]

P. Calyam, L. Kumarasamy, and F. Ozguner, “ Semantic scheduling of active measurements for meeting network monitoring objectives,” in Proc. IEEE CNSM, Oct. 2010, pp. 435– 438. [Online]. Available: https://doi.org/10.1109/CNSM.2010.5691256

[93]

P. Calyam et al., “ OnTimeSecure: Secure middleware for federated network performance monitoring,” in Proc. CNSM, Oct. 2013, pp. 100– 104. [Online]. Available: https://doi.org/10.1109/CNSM.2013.6727815

[94]

I. Monga, C. Guok, W. Johnston, and B. Tierney, “ Hybrid networks: Lessons learned and future challenges based on ESnet4 experience,” IEEE Commun. Mag., vol. 49, no. 5, pp. 114– 121, May 2011.

[95]

A. Oslebo, “ Share and visualize your data using the perfsonar nc framework,” in Proc. IEEE NOMS, Apr. 2012, pp. 838– 852. [Online]. Available: https://doi.org/10.1109/NOMS.2012.6211998

[96]

J. Andreeva et al., “ Automating ATLAS computing operations using the site status board,” to be published. [Online]. Available: https://doi.org/10.1088/1742-6596/396/3/032072

[97]

J. Zurawski et al., “ perfSONAR: On-board diagnostics for big data,” in Proc. IEEE Int. Conf. Big Data, Oct. 2013, pp. 1– 6.

[98]

R. Dourado, L. Sampaio, and J. Suruagy Monteiro, “ On the composition of performance metrics in multi-domain networks,” IEEE Commun. Mag., vol. 51, no. 11, pp. 72– 77, Nov. 2013.

[99]

A. Morton and E. Stephan, “ Spatial composition of metrics,” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 6049 (Proposed Standard), Jan. 2011, updated by RFC 6248. [Online]. Available: http://www.ietf.org/rfc/rfc6049.txt

[100]

P. Kanuparthy, D. Lee, W. Matthews, C. Dovrolis, and S. Zarifzadeh, “ Pythia: Detection, localization, and diagnosis of performance problems,” IEEE Commun. Mag., vol. 51, no. 11, pp. 55– 62, Nov. 2013. [Online]. Available: https://doi.org/10.1109/MCOM.2013.6658653

[101]

P. Kanuparthy and C. Dovrolis, “ Pythia: Diagnosing performance problems in wide area providers,” in Proc. USENIX Annu. Tech. Conf., Berkeley, CA, USA, 2014, pp. 371– 382. http://dl.acm.org/citation.cfm?id=2643634.2643672

[102]

H. Yu et al., “ GÉANT perfSONAR MDM-based circuit monitoring in a multidomain environment,” IEEE Commun. Mag., vol. 52, no. 5, pp. 174– 181, May 2014. [Online]. Available: https://doi.org/10.1109/MCOM.2014.6815909

[103]

P. Calyam, M. Dhanapalan, M. Sridharan, A. Krishnamurthy, and R. Ramnath, “ Topology-aware correlated network anomaly event detection and diagnosis,” J. Netw. Syst. Manage., vol. 22, no. 2, pp. 208– 234, Apr. 2014.

Digital Library

[104]

M. Bagnulo et al., “ Building a standard measurement platform,” IEEE Commun. Mag., vol. 52, no. 5, pp. 165– 173, May 2014.

[105]

M. Bagnulo, T. Burbridge, S. Crawford, P. Eardley, and J. Schonwalder, “ A framework for large-scale measurements,” in Proc. IEEE FutureNetworkSummit, Jul. 2013, pp. 1– 10.

[106]

M. Bagnulo, P. Eardley, T. Burbridge, B. Trammell, and R. Winter, “ Standardizing large-scale measurement platforms,” SIGCOMM Comput. Commun. Rev., vol. 43, no. 2, pp. 58– 63, Apr. 2013.

Digital Library

[107]

M. Boucadair and C. Jacquenet, “ Large scale measurement of access network performance (LMAP): Requirements and issues from a network provider perspective,” Internet Engineering Task Force (IETF), Fremont, CA, USA, Internet-Draft Draft-Boucadair-Lmap-Considerations-00, Feb. 2013, work in Progress. [Online]. Available: http://tools.ietf.org/html/draft-boucadair-lmap-considerations-00

[108]

K. Nagami, S. Kamei, K. Koita, T. Jitsuzumi, and I. Mizukoshi, “ Use Case from a measurement provider perspective for LMAP,” Internet Engineering Task Force (IETF), Fremont, CA, USA, Internet-Draft Draft-Nagami-Lmap-use-Case-Measurement-Provider-00, Jul. 2013, work in Progress. [Online]. Available: http://tools.ietf.org/html/draft-nagami-lmap-use-case-measurement-provider-00

[109]

R. Huang, “ Use case for large scale measurements used in data collection of network management systems,” Internet Engineering Task Force (IETF), Fremont, CA, USA, Internet-Draft Draft-Huang-Lmap-Data-Collection-use-Case-00, Jun. 2013, work in Progress. [Online]. Available: http://tools.ietf.org/html/draft-huang-lmap-data-collection-use-case-00

[110]

P. Eardley et al., “ A framework for large-scale measurement of broadband performance (LMAP),” Internet Engineering Task Force (IETF), Fremont, CA, USA, Internet-Draft draft-Ietf-Lmap-Framework-12, Mar. 2015, work in Progress. [Online]. Available: http://tools.ietf.org/html/draft-ietf-lmap-framework-12

[111]

A. Pras and J. Schoenwaelder, “ On the Difference between information models and data models,” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 3444 (Informational), Jan. 2003. [Online]. Available: http://www.ietf.org/rfc/rfc3444.txt

[112]

T. Burbridge, P. Eardley, M. Bagnulo, and J. Schönwälder, “ Information model for large-scale measurement platforms (LMAP),” Internet Engineering Task Force (IETF), Fremont, CA, USA, Internet-Draft Draft-Ietf-Lmap-Informationmodel-05, Apr. 2015, work in Progress. [Online]. Available: http://tools.ietf.org/html/draft-ietf-lmap-information-model-05

[113]

R. Enns, M. Bjorklund, J. Schoenwaelder, and A. Bierman, “ Network Configuration Protocol (NETCONF),” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 6241 (Proposed Standard), Jun. 2011. [Online]. Available: http://www.ietf.org/rfc/rfc6241.txt

[114]

J. Schoenwaelder, “ Considerations on using NETCONF with LMAP measurement agents,” Internet Engineering Task Force (IETF), Fremont, CA, USA, Internet-Draft Draft-Schoenw-Lmap-Netconf-00, Feb. 2013, work in Progress. [Online]. Available: http://tools.ietf.org/html/draft-schoenw-lmap-netconf-00

[115]

V. Bajpai and R. Krejci, “ Managing SamKnows probes using NETCONF,” in Proc. IEEE NOMS, May 2014, pp. 1– 2. [Online]. Available: https://doi.org/10.1109/NOMS.2014.6838279

[116]

M. Bjorklund, “ YANG—A data modeling language for the Network Configuration Protocol (NETCONF),” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 6020 (Proposed Standard), Oct. 2010. [Online]. Available: http://www.ietf.org/rfc/rfc6020.txt

[117]

J. Schönwälder and V. Bajpai, “ A YANG data model for LMAP measurement agents,” Internet Engineering Task Force (IETF), Fremont, CA, USA, Internet-Draft Draft-Ietf-Lmap-Yang-00, Apr. 2015, work in Progress. [Online]. Available: http://tools.ietf.org/html/draft-ietf-lmap-yang-00

[118]

J. Schönwälder and V. Bajpai, “ Using RESTCONF with LMAP measurement agents,” Internet Engineering Task Force (IETF), Fremont, CA, USA, Internet-Draft draft-schoenw-lmaprestconf-00, Mar. 2015, work in Progress. [Online]. Available: http://tools.ietf.org/html/draft-schoenw-lmap-restconf-00

[119]

A. Bierman, M. Bjorklund, and K. Watsen, “ RESTCONF Protocol,” Internet Engineering Task Force (IETF), Fremont, CA, USA, Internet-Draft draft-ietf-netconfrestconf-04, Jan. 2015, work in Progress. [Online]. Available: http://tools.ietf.org/html/draft-ietf-netconf-restconf-04

[120]

A. Oslebo, “ A YANG based data model for the LMAP controller,” Internet Engineering Task Force (IETF), Fremont, CA, USA, Internet-Draft Draft-Oslebo-Lmapcontrol-Yang-01, Oct. 2014, work in Progress. [Online]. Available: http://tools.ietf.org/html/draft-oslebo-lmap-control-yang-01

[121]

B. Claise, B. Trammell, and P. Aitken, “ Specification of the IP Flow Information Export (IPFIX) protocol for the exchange of flow information,” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 7011 (INTERNET STANDARD), Sep. 2013. [Online]. Available: http://www.ietf.org/rfc/rfc7011.txt

[122]

M. Bagnulo and B. Trammell, “ An LMAP application for IPFIX,” Internet Engineering Task Force (IETF), Fremont, CA, USA, Internet-Draft Draftbagnulo-Lmap-Ipfix-01, Feb. 2013, work in Progress. [Online]. Available: http://tools.ietf.org/html/draft-bagnulo-lmap-ipfix-01

[123]

R. Alimi et al., “ Application-Layer Traffic Optimization (ALTO) protocol,” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 7285 (Proposed Standard), Sep. 2014. [Online]. Available: http://www.ietf.org/rfc/rfc7285.txt

[124]

J. Seedorf, D. Goergen, R. State, V. Gurbani, and E. Marocco, “ ALTO for Querying LMAP Results,” Internet Engineering Task Force (IETF), Fremont, CA, USA, Internet-Draft Draft-Seedorf-Lmap-Alto-02, Oct. 2013, work in Progress. [Online]. Available: http://tools.ietf.org/html/draft-seedorf-lmap-alto-02

[125]

D. Goergen, R. State, and V. Gurbani, “ Aggregating largescale measurements for application layer traffic optimization (ALTO) protocol,” Internet Engineering Task Force (IETF), Fremont, CA, USA, Internet-Draft Draft-Goergen-Lmap-fcc-00, Jul. 2013, work in Progress. [Online]. Available: http://tools.ietf.org/html/draft-goergen-lmap-fcc-00

[126]

M. Bagnulo, T. Burbridge, S. Crawford, J. Schönwälder, and V. Bajpai, “ Large measurement platform protocol,” Internet Engineering Task Force (IETF), Fremont, CA, USA, Internet-Draft Draft-Bagnulo-lmap-http-03, Sep. 2014, work in Progress. [Online]. Available: http://tools.ietf.org/html/draft-bagnulo-lmap-http-03

[127]

V. Liu, D. Lingli, S. Liu, and C. Li, “ REST style large measurement platform protocol,” Internet Engineering Task Force (IETF), Fremont, CA, USA, Internet-Draft draft-liu-lmap-rest-02, Mar. 2015, work in Progress. [Online]. Available: http://tools.ietf.org/html/draft-liu-lmap-rest-02

[128]

V. Paxson, G. Almes, J. Mahdavi, and M. Mathis, “ Framework for IP performance metrics,” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 2330 (Informational), May 1998. [Online]. Available: http://www.ietf.org/rfc/rfc2330.txt

[129]

J. Mahdavi and V. Paxson, “ IPPM metrics for measuring connectivity,” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 2678 (Proposed Standard), Sep. 1999. [Online]. Available: http://www.ietf.org/rfc/rfc2678.txt

[130]

A. Morton, L. Ciavattone, G. Ramachandran, S. Shalunov, and J. Perser, “ Packet reordering metrics,” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 4737 (Proposed Standard), Nov. 2006, updated by RFC 6248. [Online]. Available: http://www.ietf.org/rfc/rfc4737.txt

[131]

J. Bellardo and S. Savage, “ Measuring packet reordering,” in Proc. ACM SIGCOMM IMW, New York, NY, USA, 2002, pp. 97– 105. [Online]. Available: http://doi.acm.org/10.1145/637201.637216

[132]

G. Almes, S. Kalidindi, and M. Zekauskas, “ A one-way delay metric for IPPM,” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 2679 (Proposed Standard), Sep. 1999. [Online]. Available: http://www.ietf.org/rfc/rfc2679.txt

[133]

C. Demichelis and P. Chimento, “ IP packet delay variation metric for IP Performance Metrics (IPPM),” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 3393 (Proposed Standard), Nov. 2002. [Online]. Available: http://www.ietf.org/rfc/rfc3393.txt

Digital Library

[134]

G. Almes, S. Kalidindi, and M. Zekauskas, “ A one-way packet loss metric for IPPM,” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 2680 (Proposed Standard), Sep. 1999. [Online]. Available: http://www.ietf.org/rfc/rfc2680.txt

[135]

R. Koodli and R. Ravikanth, “ One-way loss pattern sample metrics,” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 3357 (Informational), Aug. 2002. [Online]. Available: http://www.ietf.org/rfc/rfc3357.txt

[136]

H. Uijterwaal, “ A one-way packet duplication metric,” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 5560 (Proposed Standard), May 2009, updated by RFC 6248. [Online]. Available: http://www.ietf.org/rfc/rfc5560.txt

[137]

S. Savage, “ Sting: A tcp-based network measurement tool,” in Proc. USITS, Berkeley, CA, USA, 1999, pp. 7– 7. http://dl.acm.org/citation.cfm?id=1251480.1251487

[138]

G. Almes, S. Kalidindi, and M. Zekauskas, “ A round-trip delay metric for IPPM,” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 2681 (Proposed Standard), Sep. 1999. [Online]. Available: http://www.ietf.org/rfc/rfc2681.txt

[139]

A. Morton, “ Round-trip packet loss metrics,” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 6673 (Proposed Standard), Aug. 2012. [Online]. Available: http://www.ietf.org/rfc/rfc6673.txt

[140]

P. Chimento and J. Ishac, “ Defining network capacity,” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 5136 (Informational), Feb. 2008. [Online]. Available: http://www.ietf.org/rfc/rfc5136.txt

[141]

M. Mathis and M. Allman, “ A framework for defining empirical bulk transfer capacity metrics,” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 3148 (Informational), Jul. 2001. [Online]. Available: http://www.ietf.org/rfc/rfc3148.txt

[142]

B. Constantine, G. Forget, R. Geib, and R. Schrage, “ Framework for TCP throughput testing,” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 6349 (Informational), Aug. 2011. [Online]. Available: http://www.ietf.org/rfc/rfc6349.txt

[143]

M. Mathis and A. Morton, “ Model based bulk performance metrics,” Internet Engineering Task Force (IETF), Fremont, CA, USA, Internet-Draft Draft-Ietf-ippm-Modelbased-Metrics-04, Mar. 2015, work in Progress. [Online]. Available: http://tools.ietf.org/html/draft-ietf-ippm-model-based-metrics-04

[144]

K. Hedayat, R. Krzanowski, A. Morton, K. Yum, and J. Babiarz, “ A two-way active measurement protocol (TWAMP),” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 5357 (Proposed Standard), Oct. 2008, updated by RFCs 5618, 5938, 6038. [Online]. Available: http://www.ietf.org/rfc/rfc5357.txt

[145]

S. Niccolini, S. Tartarelli, J. Quittek, T. Dietz, and M. Swany, “ Information model and XML data model for traceroute measurements,” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 5388 (Proposed Standard), Dec. 2008. [Online]. Available: http://www.ietf.org/rfc/rfc5388.txt

[146]

J. Quittek and K. White, “ Definitions of managed objects for remote ping, traceroute, and lookup operations,” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 4560 (Proposed Standard), Jun. 2006. [Online]. Available: http://www.ietf.org/rfc/rfc4560.txt

[147]

A. Morton, “ Rate measurement test protocol problem statement and requirements,” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 7497 (Informational), Apr. 2015. [Online]. Available: http://www.ietf.org/rfc/rfc7497.txt

[148]

J. Fabini and A. Morton, “ Advanced stream and sampling framework for IP Performance Metrics (IPPM),” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 7312 (Informational), Aug. 2014. [Online]. Available: http://www.ietf.org/rfc/rfc7312.txt

[149]

A. Morton and B. Claise, “ Packet delay variation applicability statement,” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 5481 (Informational), Mar. 2009. [Online]. Available: http://www.ietf.org/rfc/rfc5481.txt

[150]

K. Pentikousis, E. Zhang, and Y. Cui, “ IKEv2-based shared secret key for O/TWAMP,” Internet Engineering Task Force (IETF), Fremont, CA, USA, Internet-Draft draft-ietf-ippm-ipsec-09, Feb. 2015, work in Progress. [Online]. Available: http://tools.ietf.org/html/draft-ietf-ippm-ipsec-09

[151]

M. Bagnulo, B. Claise, P. Eardley, A. Morton, and A. Akhter, “ Registry for performance metrics,” Internet Engineering Task Force (IETF), Fremont, CA, USA, Internet-Draft Draft-Ietf-Ippm-Metric-Registry-02, Feb. 2015, work in Progress. [Online]. Available: http://tools.ietf.org/html/draft-ietf-ippm-metric-registry-02

[152]

M. Bagnulo, T. Burbridge, S. Crawford, P. Eardley, and A. Morton, “ A reference path and measurement points for large-scale measurement of broadband performance,” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 7398 (Informational), Feb. 2015. [Online]. Available: http://www.ietf.org/rfc/rfc7398.txt

[153]

H. Schulzrinne, S. Casner, R. Frederick, and V. Jacobson, “ RTP: A transport protocol for real-time applications,” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 3550 (INTERNET STANDARD), Jul. 2003, updated by RFCs 5506, 5761, 6051, 6222. [Online]. Available: http://www.ietf.org/rfc/rfc3550.txt

[154]

T. Friedman, R. Caceres, and A. Clark, “ RTP Control Protocol Extended Reports (RTCP XR),” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 3611 (Proposed Standard), Nov. 2003. [Online]. Available: http://www.ietf.org/rfc/rfc3611.txt

[155]

A. Clark and Q. Wu, “ Measurement identity and information reporting using a source description (SDES) item and an RTCP Extended Report (XR) block,” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 6776 (Proposed Standard), Oct. 2012. [Online]. Available: http://www.ietf.org/rfc/rfc6776.txt

[156]

A. Clark, K. Gross, and Q. Wu, “ RTP Control Protocol (RTCP) Extended Report (XR) block for delay metric reporting,” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 6843 (Proposed Standard), Jan. 2013. [Online]. Available: http://www.ietf.org/rfc/rfc6843.txt

[157]

A. Clark and Q. Wu, “ RTP Control Protocol (RTCP) Extended Report (XR) block for packet delay variation metric reporting,” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 6798 (Proposed Standard), Nov. 2012. [Online]. Available: http://www.ietf.org/rfc/rfc6798.txt

[158]

A. Clark, S. Zhang, J. Zhao, and Q. Wu, “ RTP Control Protocol (RTCP) Extended Report (XR) block for burst/gap loss metric reporting,” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 6958 (Proposed Standard), May 2013. [Online]. Available: http://www.ietf.org/rfc/rfc6958.txt

[159]

R. Huang, Q. Wu, H. Asaeda, and G. Zorn, “ RTP Control Protocol (RTCP) Extended Report (XR) Block for MPEG-2 Transport Stream (TS) Program Specific Information (PSI) independent decodability statistics metrics reporting,” Internet Engineering Task Force (IETF), Fremont, CA, USA, RFC 6990 (Proposed Standard), Aug. 2013. [Online]. Available: http://www.ietf.org/rfc/rfc6990.txt

[160]

D. Fellows and D. Jones, “ Docsistm cable modem technology,” IEEE Commun. Mag., vol. 39, no. 3, pp. 202– 209, Mar. 2001. [Online]. Available: https://doi.org/10.1109/35.910608

Digital Library

[161]

A. Faggiani, E. Gregori, L. Lenzini, V. Luconi, and A. Vecchio, “ Network sensing through smartphone-based crowdsourcing,” in Proc. 11th ACM Conf. Embedded Netw. SenSys, New York, NY, USA, 2013, pp. 31:1– 31:2. [Online]. Available: http://doi.acm.org/10.1145/2517351.2517397

[162]

B. Briscoe et al., “ Reducing Internet latency: A survey of techniques and their merits,” IEEE Commun. Surveys Tuts. [Online]. Available: https://doi.org/10.1109/COMST.2014.2375213

[163]

B. Trammell et al., “ Mplane: An intelligent measurement plane for the Internet,” IEEE Commun. Mag., vol. 52, no. 5, pp. 148– 156, May 2014.

[164]

I. Bermudez, S. Traverso, M. Munafo, and M. Mellia, “ A distributed architecture for the monitoring of clouds and CDNs: Applications to amazon AWS,” IEEE Trans. Netw. Service Manage., vol. 11, no. 4, pp. 516– 529, Dec. 2014.

[165]

S. Niccolini, F. Huici, B. Trammell, G. Bianchi, and F. Ricciato, “ Building a decentralized, cooperative, and privacy-preserving monitoring system for trustworthiness: The approach of the EU FP7 DEMONS project [very large projects],” IEEE Commun. Mag., vol. 49, no. 11, pp. 16– 18, Nov. 2011.

[166]

G. Bianchi et al., “ Towards privacy-preserving network monitoring: Issues and challenges,” in Proc. Pers., Indoor Mobile Radio Commun., Sep. 2007, pp. 1– 5. [Online]. Available: https://doi.org/10.1109/PIMRC.2007.4394186

[167]

S. Knight, H. Nguyen, N. Falkner, R. Bowden, and M. Roughan, “ The internet topology zoo,” IEEE J. Sel. Areas Commun., vol. 29, no. 9, pp. 1765– 1775, Oct. 2011. [Online]. Available: https://doi.org/10.1109/JSAC.2011.111002

[168]

P. Borgnat, G. Dewaele, K. Fukuda, P. Abry, and K. Cho, “ Seven years and one day: Sketching the evolution of internet traffic,” in Proc. IEEE INFOCOM, Apr. 2009, pp. 711– 719. [Online]. Available: https://doi.org/10.1109/INFCOM.2009.5061979

[169]

E. Dart, L. Rotman, B. Tierney, M. Hester, and J. Zurawski, “ The science dmz: A network design pattern for data-intensive science,” in Proc. Int. Conf. High Perform. Comput., Netw., Storage Anal. SC, New York, NY, USA, 2013, pp. 85:1– 85:10. [Online]. Available: http://doi.acm.org/10.1145/2503210.2503245

[170]

H. Yan et al., “ BGPmon: A real-time, scalable, extensible monitoring system,” in Proc. CATCH, Mar. 2009, pp. 212– 223. [Online]. Available: https://doi.org/10.1109/CATCH.2009.28

[171]

A. Lodhi, N. Larson, A. Dhamdhere, C. Dovrolis, and K. Claffy, “ Using peeringdb to understand the peering ecosystem,” SIGCOMM Comput. Commun. Rev., vol. 44, no. 2, pp. 20– 27, Apr. 2014. [Online]. Available: http://doi.acm.org/10.1145/2602204.2602208

[172]

T. McGregor, H.-W. Braun, and J. Brown, “ The NLANR network analysis infrastructure,” IEEE Commun. Mag., vol. 38, no. 5, pp. 122– 128, May 2000. [Online]. Available: https://doi.org/10.1109/35.841836

Digital Library

[173]

V. Bajpai and J. Schönwälder, “ Understanding the impact of network infrastructure changes using large-scale measurement platforms,” in Proc. Emerging Manage. Mechanisms Future Internet, Jun. 2013, pp. 1– 19. [Online]. Available: https://doi.org/10.1007/978-3-642-38998-6_5

[174]

V. Bajpai and J. Schönwälder, “ Measuring TCP connection establishment times of dual-stacked web services,” in Proc. 9th Int. CNSM, Zürich, Switzerland, Oct. 2013, pp. 130– 133. [Online]. Available: https://doi.org/10.1109/CNSM.2013.6727822

[175]

I. Csabai et al., “ Etomic advanced network monitoring system for future Internet experimentation,” in Testbeds and Research Infrastructures. Berlin, Germany: Springer-Verlag, 2011. [Online]. Available: https://doi.org/10.1007/978-3-642-17851-1_20

[176]

V. Bajpai and J. Schönwälder, “ A Report on the 1st NMRG workshop on large scale network measurements,” J. Netw. Syst. Manage., vol. 23, no. 1, pp. 1– 8, Jan. 2015. [Online]. Available: https://doi.org/10.1007/s10922-014-9328-2

[177]

P. Eardley, M. Mellia, J. Ott, J. Schönwälder, and H. Schulzrinne, “ Global measurement framework (Dagstuhl Seminar 13472),” Dagstuhl Reports, vol. 3, no. 11, pp. 144– 153, 2014. [Online]. Available: http://drops.dagstuhl.de/opus/volltexte/2014/4440

Cited By

K. Fezeu RFiandrino CRamadan ECarpenter Jde Freitas LBilal FYe WWidmer JQian FZhang ZSekar VYu MSeneviratne AVeitch D(2024)Unveiling the 5G Mid-Band Landscape: From Network Deployment to Performance and Application QoEProceedings of the ACM SIGCOMM 2024 Conference10.1145/3651890.3672269(358-372)Online publication date: 4-Aug-2024
https://dl.acm.org/doi/10.1145/3651890.3672269
Pauley EBarford PMcDaniel PCalandrino JTroncoso C(2023)DSCOPEProceedings of the 32nd USENIX Conference on Security Symposium10.5555/3620237.3620572(5989-6006)Online publication date: 9-Aug-2023
https://dl.acm.org/doi/10.5555/3620237.3620572
Burger EKrishnaswamy PSchulzrinne H(2023)Measuring Broadband America: A Retrospective on Origins, Achievements, and ChallengesACM SIGCOMM Computer Communication Review10.1145/3610381.361038453:2(11-21)Online publication date: 19-Jul-2023
https://dl.acm.org/doi/10.1145/3610381.3610384
Show More Cited By

Index Terms

A Survey on Internet Performance Measurement Platforms and Related Standardization Efforts
1. General and reference
  1. Cross-computing tools and techniques
2. Networks

Index terms have been assigned to the content through auto-classification.

Recommendations

Next Generation Network Related Standardization - Enablers for the Convergence
AICT '08: Proceedings of the 2008 Fourth Advanced International Conference on Telecommunications

In this article we present the on-going standardization work related to the Next Generation Network (NGN) standardization. Several standardization organizations are working on different aspects of NGN, such as Internet Engineering Task Force (IETF), ...
Standardizing large-scale measurement platforms

Over the last few years, we have witnessed the deployment of large measurement platforms that enable measurements from many vantage points. Examples of these platforms include SamKnows and RIPE ATLAS. All told, there are tens of thousands of measurement ...
Standardization efforts for wireless LANs

The Digital European Cordless Telecommunications (DECT) draft standard, which is the only wireless local area network (LAN) standard close to the 1-Mb/s data rate is briefly described. Active standards groups and their activities are reviewed. The work ...

Comments

Information & Contributors

Information

Published In

cover image IEEE Communications Surveys & Tutorials

IEEE Communications Surveys & Tutorials Volume 17, Issue 3

thirdquarter 2015

593 pages

ISSN:1553-877X

Issue’s Table of Contents

Copyright © 2015.

Publisher

IEEE Press

Publication History

Published: 01 July 2015

Author Tags

Qualifiers

Research-article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

20
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 08 Feb 2025

Other Metrics

View Author Metrics

Citations

Cited By

K. Fezeu RFiandrino CRamadan ECarpenter Jde Freitas LBilal FYe WWidmer JQian FZhang ZSekar VYu MSeneviratne AVeitch D(2024)Unveiling the 5G Mid-Band Landscape: From Network Deployment to Performance and Application QoEProceedings of the ACM SIGCOMM 2024 Conference10.1145/3651890.3672269(358-372)Online publication date: 4-Aug-2024
https://dl.acm.org/doi/10.1145/3651890.3672269
Pauley EBarford PMcDaniel PCalandrino JTroncoso C(2023)DSCOPEProceedings of the 32nd USENIX Conference on Security Symposium10.5555/3620237.3620572(5989-6006)Online publication date: 9-Aug-2023
https://dl.acm.org/doi/10.5555/3620237.3620572
Burger EKrishnaswamy PSchulzrinne H(2023)Measuring Broadband America: A Retrospective on Origins, Achievements, and ChallengesACM SIGCOMM Computer Communication Review10.1145/3610381.361038453:2(11-21)Online publication date: 19-Jul-2023
https://dl.acm.org/doi/10.1145/3610381.3610384
Raje AAgrawal ASanthosh TDe ISinha SHaq JSachan SNayak M(2023)An Edge Computing Architecture for Internet Measurement Network to Measure and Analyze Protocol DataSN Computer Science10.1007/s42979-023-02267-14:6Online publication date: 28-Oct-2023
https://dl.acm.org/doi/10.1007/s42979-023-02267-1
Li XChen YZhou MGuo TWang CXiao YWan JWang X(2022)Artemis: A Latency-Oriented Naming and Routing SystemIEEE Transactions on Parallel and Distributed Systems10.1109/TPDS.2022.320718933:12(4874-4890)Online publication date: 1-Dec-2022
https://dl.acm.org/doi/10.1109/TPDS.2022.3207189
Silveira SZaina LSampaio LVerdi F(2022)On the evaluation of usability design guidelines for improving network monitoring tools interfacesJournal of Systems and Software10.1016/j.jss.2022.111223187:COnline publication date: 1-May-2022
https://dl.acm.org/doi/10.1016/j.jss.2022.111223
Chefrour D(2021)One-Way Delay Measurement From Traditional Networks to SDNACM Computing Surveys10.1145/346616754:7(1-35)Online publication date: 18-Jul-2021
https://dl.acm.org/doi/10.1145/3466167
Calzarossa MMassari LTessera DBourcier JJiang ZBezemer CCortellessa V(2021)Performance Monitoring GuidelinesCompanion of the ACM/SPEC International Conference on Performance Engineering10.1145/3447545.3451195(109-114)Online publication date: 19-Apr-2021
https://dl.acm.org/doi/10.1145/3447545.3451195
Jueckstock JSarker SSnyder PBeggs APapadopoulos PVarvello MLivshits BKapravelos A(2021)Towards Realistic and ReproducibleWeb Crawl MeasurementsProceedings of the Web Conference 202110.1145/3442381.3450050(80-91)Online publication date: 19-Apr-2021
https://dl.acm.org/doi/10.1145/3442381.3450050
Candela MLuconi VVecchio A(2021)A worldwide study on the geographic locality of Internet routesComputer Networks: The International Journal of Computer and Telecommunications Networking10.1016/j.comnet.2021.108555201:COnline publication date: 24-Dec-2021
https://dl.acm.org/doi/10.1016/j.comnet.2021.108555
Show More Cited By

View Options

View options

Figures

Tables

Media

View Issue’s Table of Contents