IT狂人 发表于 2015-2-12 12:39:26

实战Hadoop和HBase,好文档分享

实战Hadoop和HBase

目录
概述 ................................................................................................................................................. 3
一些说明.......................................................................................................................................... 3
测试环境.......................................................................................................................................... 4
安装 ................................................................................................................................................. 4
创建用户 .................................................................................................................................. 4
建立互信 .................................................................................................................................. 4
安装程序准备 ........................................................................................................................... 5
安装JDK ................................................................................................................................... 6
安装hadoop .............................................................................................................................. 8
将hadoop 解压到/home/hadoop 目录下。 .................................................................... 8
修改环境变量 ................................................................................................................... 8
修改配置文件 ................................................................................................................... 9
格式化文件系统 ............................................................................................................. 12
启动hadoop .................................................................................................................... 14
测试hadoop .................................................................................................................... 15
Hadoop 管理 ................................................................................................................... 16
安装zookeeper ...................................................................................................................... 17
解压zookeeper .............................................................................................................. 17
修改环境变量 ................................................................................................................. 17
修改配置文件 ................................................................................................................. 17
建立相关目录 ................................................................................................................. 18
建立myid 文件 ............................................................................................................... 18
复制目录到其它节点 ..................................................................................................... 18
启动zookeeper .............................................................................................................. 19
测试zookeeper .............................................................................................................. 20
查看谁是leader ............................................................................................................ 22
安装HBase .............................................................................................................................. 23
解压HBase ...................................................................................................................... 23
修改环境变量 ................................................................................................................. 23
修改配置文件 ................................................................................................................. 23
复制文件到其它节点 ..................................................................................................... 24
启动HBase ...................................................................................................................... 25
查看HBase 进程 ............................................................................................................. 25
操作HBase ...................................................................................................................... 26
安装pig .................................................................................................................................. 27
将pig 解压到/home/hadoop ......................................................................................... 27
修改环境变量 ................................................................................................................. 28
启动pig ........................................................................................................................... 28
测试pig ........................................................................................................................... 29
安装MySQL ............................................................................................................................ 31
安装MySQL 服务 ........................................................................................................... 32
启动MySQL .................................................................................................................... 34
中国存储网 . 推荐http://www.chinastor.com
2
测试MySQL .................................................................................................................... 34
创建Hive 需要的数据库并赋权 .................................................................................... 35
安装Hive ............................................................................................................................... 36
解压Hive ........................................................................................................................ 36
修改环境变量 ................................................................................................................. 36
创建相关目录 ................................................................................................................. 36
配置元数据管理 ............................................................................................................. 37
修改配置文件 ................................................................................................................. 38
运行Hive Server ............................................................................................................. 38
运行Hive ........................................................................................................................ 39
编译Hadoop ................................................................................................................................... 39
准备编译环境 ......................................................................................................................... 40
下载需要的软件,并编译安装 ..................................................................................... 40
编译Hadoop ........................................................................................................................... 40
查看编译安装包 ..................................................................................................................... 42
附录 ............................................................................................................................................... 42
Hadoop 常见操作命令参考 ................................................................................................... 42
Overview .........................................................................................................................
**** Hidden Message *****


spencerkeykb 发表于 2015-4-1 13:39:36

好帖,学习

尚少爷 发表于 2016-1-12 10:49:24

看一下................................

尚少爷 发表于 2016-1-12 10:51:24

看一下................................

xuefenfen 发表于 2016-3-18 15:26:32

学习学习:)

chestinbbs 发表于 2020-11-5 23:25:32

感谢楼主分享!

renxiaoyao 发表于 2020-11-5 23:58:54

感谢楼主分享!

lapseven 发表于 2020-11-7 23:49:40

不错,支持支持。。。

y18810292967 发表于 2020-11-20 21:04:45

感谢楼主分享!

onewgt2 发表于 2020-11-29 23:41:27

好东东,谢谢老大分享!
页: [1] 2 3 4 5 6
查看完整版本: 实战Hadoop和HBase,好文档分享