The original paper is in English. Non-English content has been machine-translated and may contain typographical errors or mistranslations. ex. Some numerals are expressed as "XNUMX".
Copyrights notice
The original paper is in English. Non-English content has been machine-translated and may contain typographical errors or mistranslations. Copyrights notice
Em aplicações de processamento paralelo, alguns nós de trabalho chamados “retardatários”, que executam suas tarefas significativamente mais lentamente do que outras tarefas, aumentam o tempo de execução do trabalho. Neste artigo, propomos um sistema de manipulação de retardatários baseado em switch de rede para mitigar a carga dos nós de computação. Também propomos como descarregar a detecção de retardatários e calcular seus resultados no switch de rede sem comunicações adicionais entre os nós trabalhadores. Apresentamos algumas técnicas aproximadas para o cálculo do proxy e resposta no switch; portanto, nosso switch é chamado de “AproxSW”. Como resultado de um experimento de simulação, a aproximação proposta baseada na similaridade de tarefas alcança a melhor precisão em termos de qualidade dos resultados do Mapa gerados. Também analisamos como suprimir a computação desnecessária de proxy pelo approxSW. Implementamos approxSW na placa NetFPGA-SUME que possui quatro interfaces Ethernet de 10 Gbit (10 GbE) e um FPGA Virtex-7. Os resultados experimentais mostram que as funções approxSW não degradam o desempenho original do switch 10GbE.
Koya MITSUZUKA
Keio University
Michihiro KOIBUCHI
National Institute of Informatics
Hideharu AMANO
Keio University
Hiroki MATSUTANI
Keio University
The copyright of the original papers published on this site belongs to IEICE. Unauthorized use of the original or translated papers is prohibited. See IEICE Provisions on Copyright for details.
Copiar
Koya MITSUZUKA, Michihiro KOIBUCHI, Hideharu AMANO, Hiroki MATSUTANI, "Proxy Responses by FPGA-Based Switch for MapReduce Stragglers" in IEICE TRANSACTIONS on Information,
vol. E101-D, no. 9, pp. 2258-2268, September 2018, doi: 10.1587/transinf.2017EDP7287.
Abstract: In parallel processing applications, a few worker nodes called “stragglers”, which execute their tasks significantly slower than other tasks, increase the execution time of the job. In this paper, we propose a network switch based straggler handling system to mitigate the burden of the compute nodes. We also propose how to offload detecting stragglers and computing their results in the network switch with no additional communications between worker nodes. We introduce some approximate techniques for the proxy computation and response at the switch; thus our switch is called “ApproxSW.” As a result of a simulation experiment, the proposed approximation based on task similarity achieves the best accuracy in terms of quality of generated Map outputs. We also analyze how to suppress unnecessary proxy computation by the ApproxSW. We implement ApproxSW on NetFPGA-SUME board that has four 10Gbit Ethernet (10GbE) interfaces and a Virtex-7 FPGA. Experimental results shows that the ApproxSW functions do not degrade the original 10GbE switch performance.
URL: https://global.ieice.org/en_transactions/information/10.1587/transinf.2017EDP7287/_p
Copiar
@ARTICLE{e101-d_9_2258,
author={Koya MITSUZUKA, Michihiro KOIBUCHI, Hideharu AMANO, Hiroki MATSUTANI, },
journal={IEICE TRANSACTIONS on Information},
title={Proxy Responses by FPGA-Based Switch for MapReduce Stragglers},
year={2018},
volume={E101-D},
number={9},
pages={2258-2268},
abstract={In parallel processing applications, a few worker nodes called “stragglers”, which execute their tasks significantly slower than other tasks, increase the execution time of the job. In this paper, we propose a network switch based straggler handling system to mitigate the burden of the compute nodes. We also propose how to offload detecting stragglers and computing their results in the network switch with no additional communications between worker nodes. We introduce some approximate techniques for the proxy computation and response at the switch; thus our switch is called “ApproxSW.” As a result of a simulation experiment, the proposed approximation based on task similarity achieves the best accuracy in terms of quality of generated Map outputs. We also analyze how to suppress unnecessary proxy computation by the ApproxSW. We implement ApproxSW on NetFPGA-SUME board that has four 10Gbit Ethernet (10GbE) interfaces and a Virtex-7 FPGA. Experimental results shows that the ApproxSW functions do not degrade the original 10GbE switch performance.},
keywords={},
doi={10.1587/transinf.2017EDP7287},
ISSN={1745-1361},
month={September},}
Copiar
TY - JOUR
TI - Proxy Responses by FPGA-Based Switch for MapReduce Stragglers
T2 - IEICE TRANSACTIONS on Information
SP - 2258
EP - 2268
AU - Koya MITSUZUKA
AU - Michihiro KOIBUCHI
AU - Hideharu AMANO
AU - Hiroki MATSUTANI
PY - 2018
DO - 10.1587/transinf.2017EDP7287
JO - IEICE TRANSACTIONS on Information
SN - 1745-1361
VL - E101-D
IS - 9
JA - IEICE TRANSACTIONS on Information
Y1 - September 2018
AB - In parallel processing applications, a few worker nodes called “stragglers”, which execute their tasks significantly slower than other tasks, increase the execution time of the job. In this paper, we propose a network switch based straggler handling system to mitigate the burden of the compute nodes. We also propose how to offload detecting stragglers and computing their results in the network switch with no additional communications between worker nodes. We introduce some approximate techniques for the proxy computation and response at the switch; thus our switch is called “ApproxSW.” As a result of a simulation experiment, the proposed approximation based on task similarity achieves the best accuracy in terms of quality of generated Map outputs. We also analyze how to suppress unnecessary proxy computation by the ApproxSW. We implement ApproxSW on NetFPGA-SUME board that has four 10Gbit Ethernet (10GbE) interfaces and a Virtex-7 FPGA. Experimental results shows that the ApproxSW functions do not degrade the original 10GbE switch performance.
ER -