首页 - 学术活动 - 正文

大数据网络:针对地理分布大数据分析的网络优化

创建时间:  2017/06/26  谢姚   浏览次数:   返回

活动地点: 延长校区乐乎楼第二会议室
活动时间: 2017年6月29日 上午10:30
报告题目:大数据网络:针对地理分布大数据分析的网络优化
报告人:Peng Li, Associate professor, School of Computer Science and Engineering, the University of Aizu, Japan
内容提要:Big data generated from everything around us at an unprecedented velocity, volume and variety is changing the way we sense the world. Big data analytics has shown great potential in decision making, optimizing operations, preventing threats and capitalizing on new sources of revenues in various fields such as manufacturing, healthcare, insurance, and retail. To harness the power of big data, many research efforts have been made to develop new data programming models, e.g., MapReduce, and enhance data processing infrastructure from aspects of computation, storage and network. This talk will covers the most recent research results that address the challenges of networking for big data. First, a traffic-aware aggregation architecture will be studied for a single cluster. The all-to-all data forwarding from map tasks to reduce tasks in the traditional MapReduce framework would generate a large amount of network traffic. An aggregation architecture will be designed under the existing MapReduce framework with the objective of minimizing the data traffic during the shuffle phase. Second, for multiple clusters, a novel data-centric architecture with three key techniques, namely, cross-cloud virtual cluster, data-centric job placement, and network coding based traffic routing, will be studied. This design leads to an optimization framework with the objective of minimizing both computation and transmission cost for running a set of MapReduce jobs in geo-distributed clouds.

上一条:精机系学术报告

下一条:Advanced Modeling and Optimization Techniques for Power System Operation under Uncertain Environment