Flume快速入門系列(7) | Flume監(jiān)控之Ganglia的安裝與部署

這篇文章我們講解的是flume監(jiān)控之Ganglia的安裝與部署。

目錄

1. Ganglia的安裝與部署

2. 操作Flume測試監(jiān)控

1. Ganglia的安裝與部署

1. 安裝httpd服務(wù)與php

[bigdata@hadoop002 flume]$ sudo yum -y install httpd php

1

2. 安裝其他依賴

[bigdata@hadoop002 flume]$ sudo yum -y install rrdtool perl-rrdtool rrdtool-devel [bigdata@hadoop002 flume]$ sudo yum -y install apr-devel

1

2

3. 安裝ganglia

[atguigu@hadoop102 flume]$ sudo rpm -Uvh http://dl.fedoraproject.org/pub/epel/6/x86_64/epel-release-6-8.noarch.rpm [bigdata@hadoop002 flume]$ sudo yum -y install ganglia-gmetad [bigdata@hadoop002 flume]$ sudo yum -y install ganglia-web [bigdata@hadoop002 flume]$ sudo yum install -y ganglia-gmond // 如果這三個不能下載安裝的話修改epel源即可

1

2

3

4

5

Ganglia由gmond、gmetad和gweb三部分組成。

gmond（Ganglia Monitoring Daemon）是一種輕量級服務(wù)，安裝在每臺需要收集指標(biāo)數(shù)據(jù)的節(jié)點主機上。使用gmond，你可以很容易收集很多系統(tǒng)指標(biāo)數(shù)據(jù)，如CPU、內(nèi)存、磁盤、網(wǎng)絡(luò)和活躍進程的數(shù)據(jù)等。

gmetad（Ganglia Meta Daemon）整合所有信息，并將其以RRD格式存儲至磁盤的服務(wù)。

gweb（Ganglia Web）Ganglia可視化工具，gweb是一種利用瀏覽器顯示gmetad所存儲數(shù)據(jù)的PHP前端。在Web界面中以圖表方式展現(xiàn)集群的運行狀態(tài)下收集的多種不同指標(biāo)數(shù)據(jù)。

4. 修改配置文件/etc/httpd/conf.d/ganglia.conf

[bigdata@hadoop002 flume]$ sudo vim /etc/httpd/conf.d/ganglia.conf // 修改成如下的內(nèi)容 # Ganglia monitoring system php web frontend Alias /ganglia /usr/share/ganglia Order deny,allow #Deny from all Allow from all # Allow from 127.0.0.1 # Allow from ::1 # Allow from .example.com

1

2

3

4

5

6

7

8

9

10

11

12

13

14

5. 修改配置文件/etc/ganglia/gmetad.conf

[bigdata@hadoop002 flume]$ sudo vim /etc/ganglia/gmetad.conf // 僅修改此處 data_source "hadoop102" 192.168.1.102

1

2

3

6. 修改配置文件/etc/ganglia/gmond.conf

[bigdata@hadoop002 flume]$ sudo vim /etc/ganglia/gmond.conf // 以下為要修改部分 cluster { name = "hadoop002" owner = "unspecified" latlong = "unspecified" url = "unspecified" } udp_send_channel { #bind_hostname = yes # Highly recommended, soon to be default. # This option tells gmond to use a source address # that resolves to the machine's hostname. Without # this, the metrics may appear to come from any # interface and the DNS names associated with # those IPs will be used to create the RRDs. # mcast_join = 239.2.11.71 host = 192.168.2.112 port = 8649 ttl = 1 } udp_recv_channel { # mcast_join = 239.2.11.71 port = 8649 bind = 192.168.2.112 retry_bind = true # Size of the UDP buffer. If you are handling lots of metrics you really # should bump it up to e.g. 10MB or even higher. # buffer = 10485760 }

1

2

3

4

5

6

7

8

9

10

11

12

13

14

15

16

17

18

19

20

21

22

23

24

25

26

27

28

29

30

31

7. 修改配置文件/etc/selinux/config

[bigdata@hadoop002 flume]$ sudo vim /etc/selinux/config

1

2

8. 啟動ganglia

[bigdata@hadoop002 flume]$ sudo service httpd start [bigdata@hadoop002 flume]$ sudo service gmetad start [bigdata@hadoop002 flume]$ sudo service gmond start

1

2

3

4

9. 打開網(wǎng)頁瀏覽ganglia頁面

http://192.168.2.112/ganglia

提示

：如果完成以上操作依然出現(xiàn)權(quán)限不足錯誤，請修改/var/lib/ganglia目錄的權(quán)限：

[bigdata@hadoop002 flume]$ sudo chmod -R 777 /var/lib/ganglia

1

2. 操作Flume測試監(jiān)控

1. 修改/opt/module/flume/conf目錄下的flume-env.sh配置

JAVA_OPTS="-Dflume.monitoring.type=ganglia -Dflume.monitoring.hosts=192.168.2.112:8649 -Xms100m -Xmx200m"

1

2

3

4

5

2. 啟動Flume任務(wù)

[bigdata@hadoop002 flume]$ bin/flume-ng agent -c conf/ -n a1 -f job/flume-netcat-logger.conf -Dflume.root.logger=INFO,console

1

2

3. 發(fā)送數(shù)據(jù)觀察ganglia監(jiān)測圖

[bigdata@hadoop002 flume]$ nc localhost 44444

1

圖例說明：

本次的分享就到這里了,

看 完 就 贊 ， 養(yǎng) 成 習(xí) 慣 ！ ！ ！ \color{#FF0000}{看完就贊，養(yǎng)成習(xí)慣！！！} 看完就贊，養(yǎng)成習(xí)慣！！！^ _ ^ ?? ?? ??

碼字不易，大家的支持就是我堅持下去的動力。后不要忘了關(guān)注我哦！

web前端

版權(quán)聲明：本文內(nèi)容由網(wǎng)絡(luò)用戶投稿，版權(quán)歸原作者所有，本站不擁有其著作權(quán)，亦不承擔(dān)相應(yīng)法律責(zé)任。如果您發(fā)現(xiàn)本站中有涉嫌抄襲或描述失實的內(nèi)容，請聯(lián)系我們jiasou666@gmail.com 處理，核實后本網(wǎng)站將在24小時內(nèi)刪除侵權(quán)內(nèi)容。