Article

BISmark: a testbed for deploying measurements and applications in broadband access networks

Authors:

Srikanth Sundaresan,

Walter De DonatoAuthors Info & Claims

USENIX ATC'14: Proceedings of the 2014 USENIX conference on USENIX Annual Technical Conference

Pages 383 - 394

Published: 19 June 2014 Publication History

Abstract

BISmark (Broadband Internet Service Benchmark) is a deployment of home routers running custom software, and backend infrastructure to manage experiments and collect measurements. The project began in 2010 as an attempt to better understand the characteristics of broadband access networks. We have since deployed BISmark routers in hundreds of home networks in about thirty countries. BISmark is currently used and shared by researchers at nine institutions, including commercial Internet service providers, and has enabled studies of access link performance, network connectivity, Web page load times, and user behavior and activity. Research using BISmark and its data has informed both technical and policy research. This paper describes and revisits design choices we made during the platform's evolution and lessons we have learned from the deployment effort thus far. We also explain how BISmark enables experimentation, and our efforts to make it available to the networking community. We encourage researchers to contact us if they are interested in running experiments on BISmark.

References

[1]

D. G. Andersen, H. Balakrishnan, M. F. Kaashoek, and R. Morris. Resilient Overlay Networks. In Proc. 18th ACM Symposium on Operating Systems Principles (SOSP), Banff, Canada, Oct. 2001.

[2]

A. Bavier, M. Bowman, D. Culler, B. Chun, S. Karlin, S. Muir, L. Peterson, T. Roscoe, T. Spalink, and M. Wawrzoniak. Operating System Support for Planetary-Scale Network Services. In Proc. First Symposium on Networked Systems Design and Implementation (NSDI), San Francisco, CA, Mar. 2004.

[3]

G. Bernardi and M. K. Marina. BSense: a system for enabling automated broadband census. In Proceedings of the 4th ACM Workshop on Networked Systems for Developing Regions, 2010.

[4]

BISmark Project Partners with Comcast. http://noise-lab.net/2013/05/19/bismark-project-partners.

[5]

BISmark privacy statement. http://projectbismark.net/participant/privacy.

[6]

BISmark uploads. http://uploads.projectbismark.net.

[7]

M. Calder, X. Fan, Z. Hu, E. Katz-Basset, J. Heidemann, and R. Govindan. Mapping the expansion of Google's serving infrastructure. In ACM SIGCOMM IMC, IMC '13, 2013.

[8]

J. Cappos, I. Beschastnikh, A. Krishnamurthy, and T. Anderson. Seattle: a platform for educational cloud computing. In ACM SIGCSE Bulletin, volume 41, pages 111-115. ACM, 2009.

[9]

R. Carlson. Network Diagnostic Tool. http://e2epi. internet2.edu/ndt/.

[10]

M. Chetty, S. Sundaresan, S. Muckaden, N. Feamster, and E. Calandro. Measuring broadband performance in south africa. In Proceedings of the 4th ACM Annual Symposium on Computing for Development, DEV 4, 2013.

[11]

K. Cho, K. Fukuda, H. Esaki, and A. Kato. The impact and implications of the growth in residential user-to-user traffic. In ACM SIGCOMM Computer Communication Review, volume 36, pages 207-218. ACM, 2006.

[12]

D. Croce, T. En-Najjary, G. Urvoy-Keller, and E. Biersack. Capacity Estimation of ADSL links. In Proc. CoNEXT, Dec. 2008.

[13]

M. Dischinger, A. Haeberlen, K. P. Gummadi, and S. Saroiu. Characterizing residential broadband networks. In Proc. ACM SIGCOMM IMC, San Diego, CA, Oct. 2007.

[14]

A. Filastò and J. Appelbaum. Ooni: Open observatory of network interference. In USENIX FOCI, Aug. 2012.

[15]

J. Gettys. Bufferbloat. http://www.bufferbloat.net/.

[16]

Glasnost: Bringing Transparency to the Internet. http://broadband.mpi-sws.mpg.de/transparency.

[17]

Grenouille. http://www.grenouille.com/.

[18]

S. Grover, S. Sundaresan, M. S. Park, S. Burnett, H. Kim, B. Ravi, and N. Feamster. Peeking behind the nat: An empirical study of home networks. In Proceedings of the 13nd ACM SIGCOMM conference on Internet measurement, IMC '13, 2013.

[19]

A. Gupta, M. Calder, N. Feamster, M. Chetty, E. Calandro, and E. Katz-Bassett. Peering at the Internet's frontier: A first look at ISP interconnectivity in Africa. In Passive and Active Measurement Conference, 2014.

[20]

Internet Usage for all the Americas. http://www.internetworldstats.com/stats2.htm.

[21]

Internet Usage in Asia. http://www.internetworldstats.com/stats3.htm.

[22]

ITU. Ict facts and figures, Jan. 2012. http://www.itu.int/ITU-D/ict/facts/2011/material/ICTFactsFigures2011.pdf.

[23]

C. Kreibich, N. Weaver, B. Nechaev, and V. Paxson. Netalyzr: illuminating the edge network. In Proceedings of the 10th ACM SIGCOMM conference on Internet measurement, 2010.

[24]

G. Maier, A. Feldmann, V. Paxson, and M. Allman. On dominant characteristics of residential broadband internet traffic. In Proc. Internet Measurement Conference, Chicago, Illinois, Oct. 2009.

[25]

M. Mathis, J. Heffner, and R. Reddy. Network Path and Application Diagnosis. http://www.psc.edu/networking/projects/pathdiag/.

[26]

Measurement Lab. http://measurementlab.net, Jan. 2009.

[27]

Network Dashboard. http://networkdashboard.org/.

[28]

B. Norton. Peering in africa, Aug. 2012. http://drpeering.net/AskDrPeering/blog/articles/Ask_DrPeering/Entries/2012/8/29_Peering_in_Africa.html.

[29]

OpenWrt. https://openwrt.org, Sept. 2013.

[30]

Public access wifi service. http://publicaccesswifi.org/. Retrieved: September 2013.

[31]

L. Peterson, A. Bavier, M. E. Fiuczynski, and S. Muir. Experiences building PlanetLab. In Proceedings of the 7th symposium on Operating systems design and implementation, pages 351-366. USENIX Association, 2006.

[32]

Project BISmark: Open development portal. http://projectbismark.github.io.

[33]

RIPE Atlas. https://atlas.ripe.net.

[34]

S. Roy and N. Feamster. Characterizing correlated latency anomalies in broadband access networks. In Proceedings of ACM SIGCOMM, pages 525-526. ACM, 2013.

[35]

SamKnows. http://samknows.com/.

[36]

M. A. Sánchez, J. S. Otto, Z. S. Bischof, D. R. Choffnes, F. E. Bustamante, B. Krishnamurthy, and W. Willinger. Dasu: Pushing experiments to the internets edge. In Proc. of USENIX NSDI, 2013.

[37]

M. Siekkinen, D. Collange, G. Urvoy-Keller, and E. Biersack. Performance limitations of ADSL users: A case study. In Passive and Active Measurement Conference (PAM), 2007.

[38]

C. R. Simpson, Jr. and G. F. Riley. NETI@home: A distributed approach to collecting end-to-end network performance measurements. In Passive & Active Measurement (PAM), Apr. 2004.

[39]

N. T. Spring, D. Wetherall, and T. Anderson. Scriptroute: A public internet measurement facility. In Proc. 4th USENIX Symposium on Internet Technologies and Systems (USITS), Mar. 2003.

[40]

S. Sundaresan, W. de Donato, N. Feamster, R. Teixeira, S. Crawford, and A. Pescapè. Broadband internet performance: A view from the gateway. In Proc. ACM SIGCOMM, Toronto, Ontario, Canada, Aug. 2011.

[41]

S. Sundaresan, N. Feamster, R. Teixeira, and N. Magharei. Measuring and mitigating web performance bottlenecks in broadband access networks. In Proc. ACM SIGCOMM IMC, 2013.

[42]

uCap: Your data usage assistant. http://ucap. projectbismark.net/promo/.

[43]

Web attack knows where you live. http://www.bbc.co.uk/news/technology-10850875, Aug. 2010.

Cited By

Burnett SChen LCreager DEfimov MGrigorik IJones BMadhyastha HPapageorge PRogan BStahl CTuttle JBhagwan RPorter G(2020)Network error loggingProceedings of the 17th Usenix Conference on Networked Systems Design and Implementation10.5555/3388242.3388312(985-998)Online publication date: 25-Feb-2020
https://dl.acm.org/doi/10.5555/3388242.3388312
Bonniot LNeumann CTaïani F(2020)DiagSysProceedings of the 21st International Middleware Conference Industrial Track10.1145/3429357.3430520(16-22)Online publication date: 7-Dec-2020
https://dl.acm.org/doi/10.1145/3429357.3430520
Kumar DShen KCase BGarg DAlperovich GKuznetsov DKuznetsov DGupta RDurumeric ZHeninger NTraynor P(2019)All things consideredProceedings of the 28th USENIX Conference on Security Symposium10.5555/3361338.3361419(1169-1185)Online publication date: 14-Aug-2019
https://dl.acm.org/doi/10.5555/3361338.3361419
Show More Cited By

Index Terms

BISmark: a testbed for deploying measurements and applications in broadband access networks
1. Networks
  1. Network services
    1. Network monitoring

Index terms have been assigned to the content through auto-classification.

Recommendations

Bismark

Summary: A combination of bisulfite treatment of DNA and high-throughput sequencing (BS-Seq) can capture a snapshot of a cell's epigenomic state by revealing its genome-wide cytosine methylation at single base resolution. Bismark is a flexible tool ...
Elderly daily activity habits or lifestyle in their natural environments
PETRA '11: Proceedings of the 4th International Conference on PErvasive Technologies Related to Assistive Environments

A research and development innovation project partly funded by the French company EDF was conducted for the advancement of smart homes. The aim is to help elderly to live at home in safe conditions. The experiments were carried out in a long-term ...
Sensor based micro context for mild dementia assistance
PETRA '10: Proceedings of the 3rd International Conference on PErvasive Technologies Related to Assistive Environments

Due to decline in their cognitive function, elderly people with mild dementia living alone at home are at risk of making errors in their activities of daily living (ADLs). In order to help such people, most activity recognition systems for assistive ...

Comments

Information & Contributors

Information

Published In

cover image Guide Proceedings

USENIX ATC'14: Proceedings of the 2014 USENIX conference on USENIX Annual Technical Conference

June 2014

512 pages

ISBN:9781931971102

Editors:
Garth Gibson
Carnegie Mellon University
,
Nickolai Zeldovich
Massachusetts Institute of Technology

Sponsors

VMware
NetApp
IBMR: IBM Research
Facebook: Facebook
HP: HP

Publisher

USENIX Association

United States

Publication History

Published: 19 June 2014

Qualifiers

Article

Contributors

Other Metrics

View Article Metrics

Bibliometrics & Citations

Bibliometrics

Article Metrics

14
Total Citations
View Citations
0
Total Downloads

Downloads (Last 12 months)0
Downloads (Last 6 weeks)0

Reflects downloads up to 22 Sep 2024

Other Metrics

View Author Metrics

Citations

Cited By

Burnett SChen LCreager DEfimov MGrigorik IJones BMadhyastha HPapageorge PRogan BStahl CTuttle JBhagwan RPorter G(2020)Network error loggingProceedings of the 17th Usenix Conference on Networked Systems Design and Implementation10.5555/3388242.3388312(985-998)Online publication date: 25-Feb-2020
https://dl.acm.org/doi/10.5555/3388242.3388312
Bonniot LNeumann CTaïani F(2020)DiagSysProceedings of the 21st International Middleware Conference Industrial Track10.1145/3429357.3430520(16-22)Online publication date: 7-Dec-2020
https://dl.acm.org/doi/10.1145/3429357.3430520
Kumar DShen KCase BGarg DAlperovich GKuznetsov DKuznetsov DGupta RDurumeric ZHeninger NTraynor P(2019)All things consideredProceedings of the 28th USENIX Conference on Security Symposium10.5555/3361338.3361419(1169-1185)Online publication date: 14-Aug-2019
https://dl.acm.org/doi/10.5555/3361338.3361419
Calder MSchröder MGao RStewart RPadhye JMahajan RAnanthanarayanan GKatz-Bassett ESeshan SBanerjee S(2018)OdinProceedings of the 15th USENIX Conference on Networked Systems Design and Implementation10.5555/3307441.3307484(501-517)Online publication date: 9-Apr-2018
https://dl.acm.org/doi/10.5555/3307441.3307484
Richter PPadmanabhan RSpring NBerger AClark D(2018)Advancing the Art of Internet Edge Outage DetectionProceedings of the Internet Measurement Conference 201810.1145/3278532.3278563(350-363)Online publication date: 31-Oct-2018
https://dl.acm.org/doi/10.1145/3278532.3278563
Zhang BJin XRatnasamy SWawrzynek JLee EGorinsky STapolcai J(2018)AWStreamProceedings of the 2018 Conference of the ACM Special Interest Group on Data Communication10.1145/3230543.3230554(236-252)Online publication date: 7-Aug-2018
https://dl.acm.org/doi/10.1145/3230543.3230554
Levchenko KDhamdhere AHuffaker BClaffy KAllman MPaxson VUhlig SMaennel O(2017)PacketlabProceedings of the 2017 Internet Measurement Conference10.1145/3131365.3131396(254-260)Online publication date: 1-Nov-2017
https://dl.acm.org/doi/10.1145/3131365.3131396
Phokeer ADensmore MJohnson DFeamster N(2016)A First Look at Mobile Internet Use in Township Communities in South AfricaProceedings of the 7th Annual Symposium on Computing for Development10.1145/3001913.3001926(1-10)Online publication date: 18-Nov-2016
https://dl.acm.org/doi/10.1145/3001913.3001926
Luckie MDhamdhere AHuffaker BClark Dclaffy kGill PHeidemann JByers JGovindan R(2016)bdrmapProceedings of the 2016 Internet Measurement Conference10.1145/2987443.2987467(381-396)Online publication date: 14-Nov-2016
https://dl.acm.org/doi/10.1145/2987443.2987467
Bajpai VBerger AEardley POtt JSchönwälder J(2016)Global MeasurementsACM SIGCOMM Computer Communication Review10.1145/2935634.293564146:2(32-39)Online publication date: 9-May-2016
https://dl.acm.org/doi/10.1145/2935634.2935641
Show More Cited By

View Options

View options

Media

Figures

Other

Tables

View Table of Contents