大数据处理高级 - 真传X - IT前沿技术在线大学【官网】 - Powered By EduSoho

74人加入学习

(0人评价)

大数据处理高级

分布式进阶、性能优化

价格 ¥ 5999.00

学习有效期永久有效

扫一扫扫二维码继续学习二维码时效为半小时
分享
已收藏
收藏

抱歉，该课程为限制课程，请联系客服

课程介绍

【课程简介】

通过本课程，你可以对分布式是系统设计的原理有着深刻的认识和理解，可以实现更高效的分布式程序，对hadoop的性能优化有着进更深入的认识，掌握复杂问题的解决方案。同时也对其他一些常见的nosql解决方案有所了解。

【大咖导师】

呼老师-前百度资深工程师

中国科学技术大学、香港城市大学双博士，读博期间获得朱李月华优秀博士生奖。2008年加入百度自然语言处理部篇章分析组的技术负责人，拥有10项专利申请。2014年创业，任职数据部技术总监，负责数据挖掘分析技术部，为客户提供大数据分析及消费者分析的整体解决方案。现在进行互联网金融方面的创业。

【课程内容】

章1hdfs mapreduce高阶

节1Hdfs 模型回顾
节2Hdfs进阶
节3Mr回顾
节4Mr编程高阶技巧
节5Mr的Secondary sort
节6实训：Mr高阶控制技巧实践及Secondary sort实现

章2hbase

节1Hbase简介
节2Hbase的数据模型
节3Hbase的架构
节4hbase的关键流程
节5实训：hbase环境搭建及编程实践

章3Yarn

节1hadoop的问题
节2Yarn引入
节3Yarn架构
节4Yarn的开发
节5实训：Yarn环境搭建及操作实践

章4大数据系统下的数据仓库

节1平台应用场景
节2传统数据仓库
节3大数据时代的特点
节4理论基础
节5调度与入库
节6模型与多维度分析
节7实训：全面搭建一个模拟的数据仓库系统

章5zookeeper

节1背景
节2Paxos协议简介
节3Zookeeper架构
节4Zookeeper使用接口
节5Zookeeper的应用场景
节6实训：利用zk实现一个分布式锁服务

章6理论提升

节1分布式系统定义
节2系统分类
节3事务与并发解决
节4故障恢复及异常处理
节5一致性原理
节6实训：实现一个简单的冗灾处理系统

目录

[{"itemType":"chapter","number":"1","published_number":0,"title":"Hdfs Mapreduce\u9ad8\u9636","result":"","resultStatus":"","lock":"","status":"published","taskId":"231","isOptional":"0","type":"chapter","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"1","published_number":0,"title":"Hdfs \u6a21\u578b\u56de\u987e","result":"","resultStatus":"","lock":"","status":"published","taskId":"232","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"2","published_number":0,"title":"Hdfs\u8fdb\u9636","result":"","resultStatus":"","lock":"","status":"published","taskId":"233","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"3","published_number":0,"title":"Mr\u56de\u987e","result":"","resultStatus":"","lock":"","status":"published","taskId":"234","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"4","published_number":0,"title":"Mr\u7f16\u7a0b\u9ad8\u9636\u6280\u5de7","result":"","resultStatus":"","lock":"","status":"published","taskId":"235","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"5","published_number":0,"title":"Mr\u7684Secondary sort","result":"","resultStatus":"","lock":"","status":"published","taskId":"236","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"6","published_number":0,"title":"Mr\u9ad8\u9636\u63a7\u5236\u6280\u5de7\u5b9e\u8df5\u53caSecondary sort\u5b9e\u73b0","result":"","resultStatus":"","lock":"","status":"published","taskId":"237","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"chapter","number":"2","published_number":0,"title":"Hbase","result":"","resultStatus":"","lock":"","status":"published","taskId":"238","isOptional":"0","type":"chapter","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"1","published_number":0,"title":"Hbase\u7b80\u4ecb","result":"","resultStatus":"","lock":"","status":"published","taskId":"239","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"2","published_number":0,"title":"Hbase\u7684\u6570\u636e\u6a21\u578b","result":"","resultStatus":"","lock":"","status":"published","taskId":"240","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"3","published_number":0,"title":"Hbase\u7684\u67b6\u6784","result":"","resultStatus":"","lock":"","status":"published","taskId":"242","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"4","published_number":0,"title":"hbase\u7684\u5173\u952e\u6d41\u7a0b","result":"","resultStatus":"","lock":"","status":"published","taskId":"243","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"5","published_number":0,"title":"\u5b9e\u8bad\uff1ahbase\u73af\u5883\u642d\u5efa\u53ca\u7f16\u7a0b\u5b9e\u8df5","result":"","resultStatus":"","lock":"","status":"published","taskId":"245","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"chapter","number":"3","published_number":0,"title":"Yarn","result":"","resultStatus":"","lock":"","status":"published","taskId":"247","isOptional":"0","type":"chapter","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"1","published_number":0,"title":"hadoop\u7684\u95ee\u9898","result":"","resultStatus":"","lock":"","status":"published","taskId":"249","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"2","published_number":0,"title":"Yarn\u5f15\u5165","result":"","resultStatus":"","lock":"","status":"published","taskId":"250","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"3","published_number":0,"title":"Yarn\u67b6\u6784","result":"","resultStatus":"","lock":"","status":"published","taskId":"252","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"4","published_number":0,"title":"Yarn\u7684\u5f00\u53d1","result":"","resultStatus":"","lock":"","status":"published","taskId":"254","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"5","published_number":0,"title":"\u5b9e\u8bad\uff1aYarn\u73af\u5883\u642d\u5efa\u53ca\u64cd\u4f5c\u5b9e\u8df5","result":"","resultStatus":"","lock":"","status":"published","taskId":"255","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"chapter","number":"4","published_number":0,"title":"\u5927\u6570\u636e\u7cfb\u7edf\u4e0b\u7684\u6570\u636e\u4ed3\u5e93","result":"","resultStatus":"","lock":"","status":"published","taskId":"257","isOptional":"0","type":"chapter","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"1","published_number":0,"title":"\u5e73\u53f0\u5e94\u7528\u573a\u666f","result":"","resultStatus":"","lock":"","status":"published","taskId":"259","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"2","published_number":0,"title":"\u4f20\u7edf\u6570\u636e\u4ed3\u5e93","result":"","resultStatus":"","lock":"","status":"published","taskId":"260","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"3","published_number":0,"title":"\u5927\u6570\u636e\u65f6\u4ee3\u7684\u7279\u70b9","result":"","resultStatus":"","lock":"","status":"published","taskId":"262","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"4","published_number":0,"title":"\u7406\u8bba\u57fa\u7840","result":"","resultStatus":"","lock":"","status":"published","taskId":"263","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"5","published_number":0,"title":"\u8c03\u5ea6\u4e0e\u5165\u5e93","result":"","resultStatus":"","lock":"","status":"published","taskId":"265","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"6","published_number":0,"title":"\u6a21\u578b\u4e0e\u591a\u7ef4\u5ea6\u5206\u6790","result":"","resultStatus":"","lock":"","status":"published","taskId":"267","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"7","published_number":0,"title":"\u5b9e\u8bad\uff1a\u5168\u9762\u642d\u5efa\u4e00\u4e2a\u6a21\u62df\u7684\u6570\u636e\u4ed3\u5e93\u7cfb\u7edf","result":"","resultStatus":"","lock":"","status":"published","taskId":"268","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"chapter","number":"5","published_number":0,"title":"zookeeper","result":"","resultStatus":"","lock":"","status":"published","taskId":"270","isOptional":"0","type":"chapter","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"1","published_number":0,"title":"\u80cc\u666f","result":"","resultStatus":"","lock":"","status":"published","taskId":"271","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"2","published_number":0,"title":"Paxos\u534f\u8bae\u7b80\u4ecb","result":"","resultStatus":"","lock":"","status":"published","taskId":"273","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"3","published_number":0,"title":"Zookeeper\u67b6\u6784","result":"","resultStatus":"","lock":"","status":"published","taskId":"275","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"4","published_number":0,"title":"Zookeeper\u4f7f\u7528\u63a5\u53e3","result":"","resultStatus":"","lock":"","status":"published","taskId":"277","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"5","published_number":0,"title":"Zookeeper\u7684\u5e94\u7528\u573a\u666f","result":"","resultStatus":"","lock":"","status":"published","taskId":"278","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"6","published_number":0,"title":"\u5b9e\u8bad\uff1a\u5229\u7528zk\u5b9e\u73b0\u4e00\u4e2a\u5206\u5e03\u5f0f\u9501\u670d\u52a1","result":"","resultStatus":"","lock":"","status":"published","taskId":"280","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"chapter","number":"6","published_number":0,"title":"\u7406\u8bba\u63d0\u5347","result":"","resultStatus":"","lock":"","status":"published","taskId":"282","isOptional":"0","type":"chapter","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"1","published_number":0,"title":"\u5206\u5e03\u5f0f\u7cfb\u7edf\u5b9a\u4e49","result":"","resultStatus":"","lock":"","status":"published","taskId":"284","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"2","published_number":0,"title":"\u7cfb\u7edf\u5206\u7c7b","result":"","resultStatus":"","lock":"","status":"published","taskId":"285","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"3","published_number":0,"title":"\u4e8b\u52a1\u4e0e\u5e76\u53d1\u89e3\u51b3","result":"","resultStatus":"","lock":"","status":"published","taskId":"287","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"4","published_number":0,"title":"\u6545\u969c\u6062\u590d\u53ca\u5f02\u5e38\u5904\u7406","result":"","resultStatus":"","lock":"","status":"published","taskId":"288","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"5","published_number":0,"title":"\u4e00\u81f4\u6027\u539f\u7406","result":"","resultStatus":"","lock":"","status":"published","taskId":"290","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false},{"itemType":"unit","number":"6","published_number":0,"title":"\u5b9e\u8bad\uff1a\u5b9e\u73b0\u4e00\u4e2a\u7b80\u5355\u7684\u5197\u707e\u5904\u7406\u7cfb\u7edf","result":"","resultStatus":"","lock":"","status":"published","taskId":"292","isOptional":"0","type":"unit","isTaskFree":"","watchLimitRemaining":false,"replayStatus":"","activityStartTimeStr":"","activityStartTime":"","activityLength":"","activityEndTime":"","fileStorage":"","isTaskTryLookable":"","isSingleTaskLesson":false}]

查看全部

个性化推荐系统实战进阶

个性化推荐系统实战进阶

88 0

大数据处理初级

大数据处理初级

69 0

数据挖掘实战应用

数据挖掘实战应用

24 0

授课教师

Mark

教务长

最新学员

学员动态

刘云林加入学习

QING 加入学习

feiying 加入学习

熊飞加入学习

郭bin 加入学习