Measuring data locality ratio in virtual MapReduce cluster using WorkflowSim

Conference proceedings article

ผู้เขียน/บรรณาธิการ

กลุ่มสาขาการวิจัยเชิงกลยุทธ์

ไม่พบข้อมูลที่เกี่ยวข้อง

รายละเอียดสำหรับงานพิมพ์

รายชื่อผู้แต่ง: Wangsom P., Lavangnananda K., Bouvry P.

ผู้เผยแพร่: Hindawi

ปีที่เผยแพร่ (ค.ศ.): 2017

ISBN: 9781509048342

นอก: 0146-9428

eISSN: 1745-4557

URL: https://www.scopus.com/inward/record.uri?eid=2-s2.0-85031717971&doi=10.1109%2fJCSSE.2017.8025944&partnerID=40&md5=bfef74f57809f331361146873748fb87

ภาษา: English-Great Britain (EN-GB)

ดูบนเว็บไซต์ของสำนักพิมพ์

บทคัดย่อ

The data locality is significant factor which has a direct impact on the performance of MapReduce framework. Several previous works have proposed alternative scheduling algorithms for improving the performance by increasing data locality. Nevertheless, their studies had focused the data locality on physical MapReduce cluster. As more and more deployment of MapReduce cluster have been on virtual environment, a more suitable evaluation of MapReduce cluster may be necessary. This study adopts a simulation based approach. Five scheduling algorithms were used for the simulation. WorkflowSim is extended by inclusion of three implemented modules to assess the new performance measure called 'data locality ratio'. Comparison of their results reveals interesting findings. The proposed implementation can be used to assess 'data locality ratio' and allows users prior to efficiently select and tune scheduler and system configurations suitable for an environment prior to its actual physical MapReduce deployment. ฉ 2017 IEEE.

คำสำคัญ

Data Locality, Data Locality Raito, Virtual Environment, WorkflowSim