Identifying elephant flows using dynamic thresholds in programmable IXP networks
Tóm tắt
Internet eXchange Points (IXPs) are Internet infrastructures composed of high-performance networks that allow multiple autonomous systems to exchange traffic. Given the challenges of managing the flows that cross an IXP, identifying elephant flows may help improve the quality of services provided to its participants. In this context, we leverage the new flexibility and resources of programmable data planes to identify elephant flows in IXP networks adaptively via the dynamic adjustment of thresholds. Our mechanism uses the information reported by the data plane to monitor network utilization in the control plane, calculating new thresholds based on previous flow sizes and durations percentiles and configuring them back into switches to support the local classification of flows. Thus, the thresholds are updated to make the identification process better aligned with the network behavior. The experimental results show that it is possible to identify and react to elephant flows quickly, less than 0.4ms, and efficiently, with only 98.4KB of data inserted into the network by the mechanism. In addition, the threshold updating mechanism achieved accuracy of up to 90% in our evaluation scenarios.
Tài liệu tham khảo
Afaq M, Rehman S, Song WC. Visualization of Elephant Flows and QoS Provisioning in SDN-based Networks. In: 17th Asia-Pacific Network Operations and Management Symposium (APNOMS). IEEE: 2015. p. 444–7. https://doi.org/10.1109/apnoms.2015.7275384.
Ager B, Chatzis N, Feldmann A, Sarrar N, Uhlig S, Willinger W. Anatomy of a large European IXP. In: ACM SIGCOMM Computer Communication Review, vol. 42. ACM: 2012. p. 163–74. https://doi.org/10.1145/2342356.2342393.
Ager B, Chatzis N, Feldmann A, Sarrar N, Uhlig S, Willinger W. Anatomy of a large European IXP. ACM SIGCOMM Conf Internet Meas. 2012; 42(4):163–74.
Augustin B, Krishnamurthy B, Willinger W. IXPs: Mapped? In: ACM SIGCOMM Conference on Internet Measurement, IMC ’09. USA: ACM, NY: 2009. p. 336–49.
Basat R, Einziger G, Friedman R, Luizelli M, Waisbard E. Constant Time Updates in Hierarchical Heavy Hitter. In: ACM SIGCOMM Conf Internet Meas. USA: ACM, NY: 2017. p. 127–40.
Basat RB, Einziger G, Friedman R, Kassner Y. Optimal elephant flow detection. In: IEEE Conference on Computer Communications (INFOCOM). IEEE: 2017. p. 1–9. https://doi.org/10.1109/infocom.2017.8057216.
Bosshart P, Daly D, Gibb G, Izzard M, McKeown N, Rexford J, Schlesinger C, Talayco D, Vahdat A, Varghese G, et al. P4: Programming Protocol-independent Packet Processors. In: ACM SIGCOMM Conference on Internet Measurement. New York: ACM: 2014. p. 87–95.
Cardona Restrepo JC, Stanojevic R. IXP Traffic: a Macroscopic View. New York: ACM: 2012. p. 1–8.
Curtis AR, Kim W, Yalagandula P. Mahout: Low-overhead Datacenter Traffic Management Using End-host-based Elephant Detection. In: IEEE INFOCOM Conference on Computer Communications. IEEE: 2011. p. 1629–37. https://doi.org/10.1109/infcom.2011.5934956.
Curtis AR, Mogul JC, Tourrilhes J, Yalagandula P, Sharma P, Banerjee S. DevoFlow: Scaling Flow Management for High-performance Networks. In: ACM SIGCOMM Conference on Internet Measurement, vol. 41. USA: ACM, NY: 2011. p. 254–65.
da Silva MVB, Jacobs AS, Pfitscher RJ, Granville LZ. IDEAFIX: Identifying Elephant Flows in P4-Based IXP Networks. In: Proceedings of the IEEE GLOBECOM Global Telecommunications Conference. IEEE: 2018. https://doi.org/10.1109/glocom.2018.8647685.
Gregori E, Improta A, Lenzini L, Orsini C. The Impact of IXPs on the AS-level Topo-logy Structure of the Internet. In: Computer Communications. Elsevier: 2011. p. 68–82. https://doi.org/10.1016/j.comcom.2010.09.002.
Guo L, Matta I. The War Between Mice and Elephants. In: Network Protocols, 2001. Ninth International Conference on. IEEE: 2001. p. 180–8. https://doi.org/10.1109/icnp.2001.992898.
Gupta A, Vanbever L, Shahbaz M, Donovan SP, Schlinker B, Feamster N, Rexford J, Shenker S, Clark R, Katz-Bassett E. Sdx: A Software Defined Internet Exchange. In: ACM SIGCOMM Conference on Internet Measurement, vol. 44. New York: ACM: 2015. p. 551–62.
Hancock D, Van der Merwe J. Hyper4: Using p4 to virtualize the programmable data plane. In: Proceedings of the 12th International on Conference on emerging Networking EXperiments and Technologies. Irvine: ACM: 2016. p. 35–49.
Harrison R, Cai Q, Gupta A, Rexford J. Network-Wide Heavy Hitter Detection with Commodity Switches. In: Proceedings of the Symposium on SDN Research, SOSR ’18. New York: ACM: 2018. p. 8:1–8:7.
Knob LAD, Esteves RP, Granville LZ, Tarouco LMR. SDEFIX—Identifying Elephant Flows in SDN-based IXP Networks. In: IEEE/IFIP NOMS Network Operations and Management Symposium. IEEE: 2016. p. 19–26. https://doi.org/10.1109/noms.2016.7502792.
Knob LAD, Esteves RP, Granville LZ, Tarouco LMR. Mitigating Elephant Flows in SDN-based IXP Networks. In: IEEE ISCC Symposium on Computers and Communication. IEEE: 2017. p. 1352–9. https://doi.org/10.1109/iscc.2017.8024712.
McKeown N, Anderson T, Balakrishnan H, Parulkar G, Peterson L, Rexford J, Shenker S, Turner J. OpenFlow: Enabling Innovation in Campus Networks. In: ACM SIGCOMM Conference on Internet Measurement. USA: ACM, NY: 2008. p. 69–74.
sFlow. sFlow.org. http://www.sflow.org. Accessed 15 Feb 2019.
Silva MVB, Marques JA, Gaspary LP, Granville LZ. Identificacão de Fluxos Elefantes em Redes de Ponto de Troca de Tráfego com Suporte à Programabilidade P4 [in Portuguese]̧. In: 36th SBRC Simpósio Brasileiro de Redes de Computadores e Sistemas Distribuídos: 2018.
Sivaraman V, Narayana S, Rottenstreich O, Muthukrishnan S, Rexford J. Heavy-hitter detection entirely in the data plane. In: Symposium on SDN Research. ACM: 2017. p. 164–76. https://doi.org/10.1145/3050220.3063772.
Suh J, Kwon TT, Dixon C, Felter W, Carter J. Opensample: A Low-latency, Sampling-based Measurement Platform for Commodity SDN. In: 34th IEEE ICDCS International Conference on Distributed Computing Systems. IEEE: 2014. p. 228–37. https://doi.org/10.1109/icdcs.2014.31.
Tong D, Prasanna V. High Throughput Hierarchical Heavy Hitter Detection in Data Streams. In: 22nd IEEE HiPC International Conference on High Performance Computing. IEEE: 2015. p. 224–33. https://doi.org/10.1109/hipc.2015.30.
Turkovic B, Kuipers F, van Adrichem N, Langendoen K. Fast network congestion detection and avoidance using P4. In: Proceedings of the 2018 Workshop on Networking for Emerging Applications and Technologies. ACM: 2018. p. 45–51. https://doi.org/10.1145/3229574.3229581.