求助、hadoop自动更改配置文件中的IP

回复收藏

公司有个环境是PaaS，类似于阿里云购买一台带mysql 或者nginx预配置环境的虚机问题来了：我做好了一个hadoop镜像，通过puppet自动根据镜像创建新的 hadoop虚机，但是因为IP会动态改变，我需要写个脚本开机自动获取eth0的IP 并写入到hadoop配置文件中。其中获取IP已经写出来了：#!/bin/bashIP=`ifconfig eth0 | sed -n 's#^.*addr:$.*$ B.*$#\1#gp'`我需要全局声明变量，然后写入到下面这些文件中，求助

vim /usr/local/hadoop/etc/hadoop/core-site.xml

fs.defaultFS

hdfs://192.168.1.231:9000

hadoop.tmp.dir

file:/usr/local/hadoop/tmp

io.file.buffer.size

131702

------------------------------

vim /usr/local/hadoop/etc/hadoop/hdfs-site.xml

dfs.namenode.name.dir

file:/usr/local/hadoop/dfs/name

dfs.datanode.data.dir

file:/usr/local/hadoop/dfs/data

dfs.replication

2

dfs.namenode.secondary.http-address

192.168.1.231

:9001

dfs.webhdfs.enabled

true

-----------------------------

cp /usr/local/hadoop/etc/hadoop/mapred-site.xml.template \/usr/local/hadoop/etc/hadoop/mapred-site.xml

vim /usr/local/hadoop/etc/hadoop/mapred-site.xml

mapreduce.framework.name

yarn

mapreduce.jobhistory.address

192.168.1.231:10020

mapreduce.jobhistory.webapp.address

192.168.1.231:19888

------------------------------

vim /usr/local/hadoop/etc/hadoop/yarn-site.xml

yarn.nodemanager.aux-services mapreduce_shuffle yarn.nodemanager.auxservices.mapreduce.shuffle.class org.apache.hadoop.mapred.ShuffleHandler yarn.resourcemanager.address 192.168.1.231:8032 yarn.resourcemanager.scheduler.address 192.168.1.231:8030 yarn.resourcemanager.resource-tracker.address 192.168.1.231:8031 yarn.resourcemanager.admin.address 192.168.1.231:8033 yarn.resourcemanager.webapp.address 192.168.1.231:8088 yarn.nodemanager.resource.memory-mb 768

http://weixin.lifesongs.cn/mp3/790.mp3

2016-08-23 10:39 举报评分