实战Hadoop和HBase,好文档分享
实战Hadoop和HBase目录
概述 ................................................................................................................................................. 3
一些说明.......................................................................................................................................... 3
测试环境.......................................................................................................................................... 4
安装 ................................................................................................................................................. 4
创建用户 .................................................................................................................................. 4
建立互信 .................................................................................................................................. 4
安装程序准备 ........................................................................................................................... 5
安装JDK ................................................................................................................................... 6
安装hadoop .............................................................................................................................. 8
将hadoop 解压到/home/hadoop 目录下。 .................................................................... 8
修改环境变量 ................................................................................................................... 8
修改配置文件 ................................................................................................................... 9
格式化文件系统 ............................................................................................................. 12
启动hadoop .................................................................................................................... 14
测试hadoop .................................................................................................................... 15
Hadoop 管理 ................................................................................................................... 16
安装zookeeper ...................................................................................................................... 17
解压zookeeper .............................................................................................................. 17
修改环境变量 ................................................................................................................. 17
修改配置文件 ................................................................................................................. 17
建立相关目录 ................................................................................................................. 18
建立myid 文件 ............................................................................................................... 18
复制目录到其它节点 ..................................................................................................... 18
启动zookeeper .............................................................................................................. 19
测试zookeeper .............................................................................................................. 20
查看谁是leader ............................................................................................................ 22
安装HBase .............................................................................................................................. 23
解压HBase ...................................................................................................................... 23
修改环境变量 ................................................................................................................. 23
修改配置文件 ................................................................................................................. 23
复制文件到其它节点 ..................................................................................................... 24
启动HBase ...................................................................................................................... 25
查看HBase 进程 ............................................................................................................. 25
操作HBase ...................................................................................................................... 26
安装pig .................................................................................................................................. 27
将pig 解压到/home/hadoop ......................................................................................... 27
修改环境变量 ................................................................................................................. 28
启动pig ........................................................................................................................... 28
测试pig ........................................................................................................................... 29
安装MySQL ............................................................................................................................ 31
安装MySQL 服务 ........................................................................................................... 32
启动MySQL .................................................................................................................... 34
中国存储网 . 推荐http://www.chinastor.com
2
测试MySQL .................................................................................................................... 34
创建Hive 需要的数据库并赋权 .................................................................................... 35
安装Hive ............................................................................................................................... 36
解压Hive ........................................................................................................................ 36
修改环境变量 ................................................................................................................. 36
创建相关目录 ................................................................................................................. 36
配置元数据管理 ............................................................................................................. 37
修改配置文件 ................................................................................................................. 38
运行Hive Server ............................................................................................................. 38
运行Hive ........................................................................................................................ 39
编译Hadoop ................................................................................................................................... 39
准备编译环境 ......................................................................................................................... 40
下载需要的软件,并编译安装 ..................................................................................... 40
编译Hadoop ........................................................................................................................... 40
查看编译安装包 ..................................................................................................................... 42
附录 ............................................................................................................................................... 42
Hadoop 常见操作命令参考 ................................................................................................... 42
Overview .........................................................................................................................
**** Hidden Message *****
好帖,学习 看一下................................ 看一下................................ 学习学习:) 感谢楼主分享! 感谢楼主分享! 不错,支持支持。。。 感谢楼主分享! 好东东,谢谢老大分享!