cloudera manager 离线安装安装agent时,向主节点下载资源超时 20C

错误日志:
[19/Nov/2018 16:16:04 +0000] 2789 MainThread stacks_collection_manager INFO Using max_uncompressed_file_size_bytes: 5242880
[19/Nov/2018 16:16:04 +0000] 2789 MainThread init INFO Importing metric schema from file /opt/cloudera-manager/cm-5.10.2/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.10.2-py2.6.egg/cmf/monitor/schema.json
[19/Nov/2018 16:16:04 +0000] 2789 MainThread agent INFO Supervised processes will add the following to their environment (in addition to the supervisor's env): {'CDH_PARQUET_HOME': '/usr/lib/parquet', 'JSVC_HOME': '/usr/libexec/bigtop-utils', 'CMF_PACKAGE_DIR': '/opt/cloudera-manager/cm-5.10.2/lib64/cmf/service', 'CDH_HADOOP_BIN': '/usr/bin/hadoop', 'MGMT_HOME': '/opt/cloudera-manager/cm-5.10.2/share/cmf', 'CDH_IMPALA_HOME': '/usr/lib/impala', 'CDH_YARN_HOME': '/usr/lib/hadoop-yarn', 'CDH_HDFS_HOME': '/usr/lib/hadoop-hdfs', 'PATH': '/sbin:/usr/sbin:/bin:/usr/bin', 'CDH_HUE_PLUGINS_HOME': '/usr/lib/hadoop', 'CM_STATUS_CODES': u'STATUS_NONE HDFS_DFS_DIR_NOT_EMPTY HBASE_TABLE_DISABLED HBASE_TABLE_ENABLED JOBTRACKER_IN_STANDBY_MODE YARN_RM_IN_STANDBY_MODE', 'KEYTRUSTEE_KP_HOME': '/usr/share/keytrustee-keyprovider', 'CLOUDERA_ORACLE_CONNECTOR_JAR': '/usr/share/java/oracle-connector-java.jar', 'CDH_SQOOP2_HOME': '/usr/lib/sqoop2', 'KEYTRUSTEE_SERVER_HOME': '/usr/lib/keytrustee-server', 'CDH_MR2_HOME': '/usr/lib/hadoop-mapreduce', 'HIVE_DEFAULT_XML': '/etc/hive/conf.dist/hive-default.xml', 'CLOUDERA_POSTGRESQL_JDBC_JAR': '/opt/cloudera-manager/cm-5.10.2/share/cmf/lib/postgresql-9.0-801.jdbc4.jar', 'CDH_KMS_HOME': '/usr/lib/hadoop-kms', 'CDH_HBASE_HOME': '/usr/lib/hbase', 'CDH_SQOOP_HOME': '/usr/lib/sqoop', 'WEBHCAT_DEFAULT_XML': '/etc/hive-webhcat/conf.dist/webhcat-default.xml', 'CDH_OOZIE_HOME': '/usr/lib/oozie', 'CDH_ZOOKEEPER_HOME': '/usr/lib/zookeeper', 'CDH_HUE_HOME': '/usr/lib/hue', 'CLOUDERA_MYSQL_CONNECTOR_JAR': '/usr/share/java/mysql-connector-java.jar', 'CDH_HBASE_INDEXER_HOME': '/usr/lib/hbase-solr', 'CDH_MR1_HOME': '/usr/lib/hadoop-0.20-mapreduce', 'CDH_SOLR_HOME': '/usr/lib/solr', 'CDH_PIG_HOME': '/usr/lib/pig', 'CDH_SENTRY_HOME': '/usr/lib/sentry', 'CDH_CRUNCH_HOME': '/usr/lib/crunch', 'CDH_LLAMA_HOME': '/usr/lib/llama/', 'CDH_HTTPFS_HOME': '/usr/lib/hadoop-httpfs', 'ROOT': '/opt/cloudera-manager/cm-5.10.2/lib64/cmf', 'CDH_HADOOP_HOME': '/usr/lib/hadoop', 'CDH_HIVE_HOME': '/usr/lib/hive', 'ORACLE_HOME': '/usr/share/oracle/instantclient', 'CDH_HCAT_HOME': '/usr/lib/hive-hcatalog', 'CDH_KAFKA_HOME': '/usr/lib/kafka', 'CDH_SPARK_HOME': '/usr/lib/spark', 'TOMCAT_HOME': '/usr/lib/bigtop-tomcat', 'CDH_FLUME_HOME': '/usr/lib/flume-ng'}
[19/Nov/2018 16:16:04 +0000] 2789 MainThread agent INFO To override these variables, use /etc/cloudera-scm-agent/config.ini. Environment variables for CDH locations are not used when CDH is installed from parcels.
[19/Nov/2018 16:16:04 +0000] 2789 MainThread agent INFO Created /opt/cloudera-manager/cm-5.10.2/run/cloudera-scm-agent/process
[19/Nov/2018 16:16:04 +0000] 2789 MainThread agent INFO Chmod'ing /opt/cloudera-manager/cm-5.10.2/run/cloudera-scm-agent/process to 0751
[19/Nov/2018 16:16:04 +0000] 2789 MainThread agent INFO Created /opt/cloudera-manager/cm-5.10.2/run/cloudera-scm-agent/supervisor
[19/Nov/2018 16:16:04 +0000] 2789 MainThread agent INFO Chmod'ing /opt/cloudera-manager/cm-5.10.2/run/cloudera-scm-agent/supervisor to 0751
[19/Nov/2018 16:16:04 +0000] 2789 MainThread agent INFO Created /opt/cloudera-manager/cm-5.10.2/run/cloudera-scm-agent/flood
[19/Nov/2018 16:16:04 +0000] 2789 MainThread agent INFO Chowning /opt/cloudera-manager/cm-5.10.2/run/cloudera-scm-agent/flood to cloudera-scm (498) cloudera-scm (498)
[19/Nov/2018 16:16:04 +0000] 2789 MainThread agent INFO Chmod'ing /opt/cloudera-manager/cm-5.10.2/run/cloudera-scm-agent/flood to 0751
[19/Nov/2018 16:16:04 +0000] 2789 MainThread agent INFO Created /opt/cloudera-manager/cm-5.10.2/run/cloudera-scm-agent/supervisor/include
[19/Nov/2018 16:16:04 +0000] 2789 MainThread agent INFO Chmod'ing /opt/cloudera-manager/cm-5.10.2/run/cloudera-scm-agent/supervisor/include to 0751
[19/Nov/2018 16:16:04 +0000] 2789 MainThread agent ERROR Failed to connect to previous supervisor.
Traceback (most recent call last):
File "/opt/cloudera-manager/cm-5.10.2/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.10.2-py2.6.egg/cmf/agent.py", line 2073, in find_or_start_supervisor
self.configure_supervisor_clients()
File "/opt/cloudera-manager/cm-5.10.2/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.10.2-py2.6.egg/cmf/agent.py", line 2254, in configure_supervisor_clients
supervisor_options.realize(args=["-c", os.path.join(self.supervisor_dir, "supervisord.conf")])
File "/opt/cloudera-manager/cm-5.10.2/lib64/cmf/agent/build/env/lib/python2.6/site-packages/supervisor-3.0-py2.6.egg/supervisor/options.py", line 1599, in realize
Options.realize(self, *arg, **kw)
File "/opt/cloudera-manager/cm-5.10.2/lib64/cmf/agent/build/env/lib/python2.6/site-packages/supervisor-3.0-py2.6.egg/supervisor/options.py", line 333, in realize
self.process_config()
File "/opt/cloudera-manager/cm-5.10.2/lib64/cmf/agent/build/env/lib/python2.6/site-packages/supervisor-3.0-py2.6.egg/supervisor/options.py", line 341, in process_config
self.process_config_file(do_usage)
File "/opt/cloudera-manager/cm-5.10.2/lib64/cmf/agent/build/env/lib/python2.6/site-packages/supervisor-3.0-py2.6.egg/supervisor/options.py", line 376, in process_config_file
self.usage(str(msg))
File "/opt/cloudera-manager/cm-5.10.2/lib64/cmf/agent/build/env/lib/python2.6/site-packages/supervisor-3.0-py2.6.egg/supervisor/options.py", line 164, in usage
self.exit(2)
SystemExit: 2
[19/Nov/2018 16:16:04 +0000] 2789 MainThread tmpfs INFO Successfully mounted tmpfs at /opt/cloudera-manager/cm-5.10.2/run/cloudera-scm-agent/process
[19/Nov/2018 16:16:05 +0000] 2789 MainThread agent INFO Trying to connect to newly launched supervisor (Attempt 1)
[19/Nov/2018 16:16:05 +0000] 2789 MainThread agent INFO Supervisor version: 3.0, pid: 2821
[19/Nov/2018 16:16:05 +0000] 2789 MainThread agent INFO Successfully connected to supervisor
[19/Nov/2018 16:16:05 +0000] 2789 MainThread status_server INFO Using maximum impala profile bundle size of 1073741824 bytes.
[19/Nov/2018 16:16:05 +0000] 2789 MainThread status_server INFO Using maximum stacks log bundle size of 1073741824 bytes.
[19/Nov/2018 16:16:05 +0000] 2789 MainThread cplogging INFO [19/Nov/2018:16:16:05] ENGINE Bus STARTING
[19/Nov/2018 16:16:05 +0000] 2789 MainThread _cplogging INFO [19/Nov/2018:16:16:05] ENGINE Started monitor thread '_TimeoutMonitor'.
[19/Nov/2018 16:16:06 +0000] 2789 MainThread _cplogging INFO [19/Nov/2018:16:16:06] ENGINE Serving on yingzhi01.com:9000
[19/Nov/2018 16:16:06 +0000] 2789 MainThread _cplogging INFO [19/Nov/2018:16:16:06] ENGINE Bus STARTED
[19/Nov/2018 16:16:06 +0000] 2789 MainThread __init
_ INFO New monitor: (,)
[19/Nov/2018 16:16:06 +0000] 2789 MonitorDaemon-Scheduler init INFO Monitor ready to report: ('HostMonitor',)
[19/Nov/2018 16:16:06 +0000] 2789 MainThread agent INFO Setting default socket timeout to 30
[19/Nov/2018 16:16:06 +0000] 2789 Monitor-HostMonitor network_interfaces INFO NIC iface eth0 doesn't support ETHTOOL (95)
[19/Nov/2018 16:16:06 +0000] 2789 Monitor-HostMonitor throttling_logger ERROR Error getting directory attributes for /opt/cloudera-manager/cm-5.10.2/log/cloudera-scm-agent
Traceback (most recent call last):
File "/opt/cloudera-manager/cm-5.10.2/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.10.2-py2.6.egg/cmf/monitor/dir_monitor.py", line 90, in get_directory_attributes
name = pwd.getpwuid(uid)[0]
KeyError: 'getpwuid(): uid not found: 1106'
[19/Nov/2018 16:16:06 +0000] 2789 MainThread heartbeat_tracker INFO HB stats (seconds): num:1 LIFE_MIN:0.22 min:0.22 mean:0.22 max:0.22 LIFE_MAX:0.22
[19/Nov/2018 16:16:06 +0000] 2789 MainThread agent INFO CM server guid: dceeafae-a884-42f1-ba7b-4ee187ef3bef
[19/Nov/2018 16:16:06 +0000] 2789 MainThread agent INFO Using parcels directory from server provided value: /opt/cloudera/parcels
[19/Nov/2018 16:16:06 +0000] 2789 MainThread agent WARNING Expected user root for /opt/cloudera/parcels but was cloudera-scm
[19/Nov/2018 16:16:06 +0000] 2789 MainThread agent WARNING Expected group root for /opt/cloudera/parcels but was cloudera-scm
[19/Nov/2018 16:16:06 +0000] 2789 MainThread agent INFO Created /opt/cloudera/parcel-cache
[19/Nov/2018 16:16:06 +0000] 2789 MainThread agent INFO Chowning /opt/cloudera/parcel-cache to root (0) root (0)
[19/Nov/2018 16:16:06 +0000] 2789 MainThread agent INFO Chmod'ing /opt/cloudera/parcel-cache to 0755
[19/Nov/2018 16:16:06 +0000] 2789 MainThread parcel INFO Agent does create users/groups and apply file permissions
[19/Nov/2018 16:16:06 +0000] 2789 MainThread downloader INFO Downloader path: /opt/cloudera/parcel-cache
[19/Nov/2018 16:16:06 +0000] 2789 MainThread parcel_cache INFO Using /opt/cloudera/parcel-cache for parcel cache
[19/Nov/2018 16:16:06 +0000] 2789 MainThread agent INFO Flood daemon (re)start attempt
[19/Nov/2018 16:16:06 +0000] 2789 MainThread agent INFO Created /opt/cloudera/parcels/.flood
[19/Nov/2018 16:16:06 +0000] 2789 MainThread agent INFO Chowning /opt/cloudera/parcels/.flood to cloudera-scm (498) cloudera-scm (498)
[19/Nov/2018 16:16:06 +0000] 2789 MainThread agent INFO Chmod'ing /opt/cloudera/parcels/.flood to 0755
[19/Nov/2018 16:16:06 +0000] 2789 MainThread agent INFO Triggering supervisord update.
[19/Nov/2018 16:16:36 +0000] 2789 MainThread downloader ERROR Failed rack peer update: timed out
[19/Nov/2018 16:16:36 +0000] 2789 MainThread agent INFO Active parcel list updated; recalculating component info.
[19/Nov/2018 16:16:36 +0000] 2789 MainThread throttling_logger WARNING CMF_AGENT_JAVA_HOME environment variable host override will be deprecated in future. JAVA_HOME setting configured from CM server takes precedence over host agent override. Configure JAVA_HOME setting from CM server.
[19/Nov/2018 16:16:36 +0000] 2789 MainThread throttling_logger INFO Identified java component java8 with full version JAVA_HOME=/opt/modules/jdk1.8.0_144 java version "1.8.0_144" Java(TM) SE Runtime Environment (build 1.8.0_144-b01) Java HotSpot(TM) 64-Bit Server VM (build 25.144-b01, mixed mode) for requested version .
[19/Nov/2018 16:16:36 +0000] 2789 MainThread agent WARNING Long HB processing time: 30.6659779549
[19/Nov/2018 16:16:36 +0000] 2789 MainThread agent WARNING Delayed HB: 15s since last
[19/Nov/2018 16:16:44 +0000] 2789 Monitor-HostMonitor throttling_logger ERROR Timeout with args ['ntpdc', '-np']
None
[19/Nov/2018 16:16:44 +0000] 2789 Monitor-HostMonitor throttling_logger ERROR Failed to collect NTP metrics
Traceback (most recent call last):
File "/opt/cloudera-manager/cm-5.10.2/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.10.2-py2.6.egg/cmf/monitor/host/ntp_monitor.py", line 48, in collect
self.collect_ntpd()
File "/opt/cloudera-manager/cm-5.10.2/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.10.2-py2.6.egg/cmf/monitor/host/ntp_monitor.py", line 66, in collect_ntpd
result, stdout, stderr = self._subprocess_with_timeout(args, self._timeout)
File "/opt/cloudera-manager/cm-5.10.2/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.10.2-py2.6.egg/cmf/monitor/host/ntp_monitor.py", line 38, in _subprocess_with_timeout
return subprocess_with_timeout(args, timeout)
File "/opt/cloudera-manager/cm-5.10.2/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.10.2-py2.6.egg/cmf/subprocess_timeout.py", line 94, in subprocess_with_timeout
raise Exception("timeout with args %s" % args)
Exception: timeout with args ['ntpdc', '-np']
[19/Nov/2018 16:17:06 +0000] 2789 DnsResolutionMonitor throttling_logger INFO Using java location: '/opt/modules/jdk1.8.0_144/bin/java'.
[19/Nov/2018 16:17:06 +0000] 2789 MainThread downloader ERROR Failed rack peer update: timed out
[19/Nov/2018 16:17:06 +0000] 2789 MainThread agent WARNING Long HB processing time: 30.1082139015
[19/Nov/2018 16:17:06 +0000] 2789 MainThread agent WARNING Delayed HB: 15s since last
[19/Nov/2018 16:17:36 +0000] 2789 MainThread downloader ERROR Failed rack peer update: timed out
[19/Nov/2018 16:17:36 +0000] 2789 MainThread agent WARNING Long HB processing time: 30.1235852242
[19/Nov/2018 16:17:36 +0000] 2789 MainThread agent WARNING Delayed HB: 15s since last
[19/Nov/2018 16:18:07 +0000] 2789 MainThread downloader ERROR Failed rack peer update: timed out
[19/Nov/2018 16:18:07 +0000] 2789 MainThread agent WARNING Long HB processing time: 30.1040799618
[19/Nov/2018 16:18:07 +0000] 2789 MainThread agent WARNING Delayed HB: 15s since last
[19/Nov/2018 16:18:37 +0000] 2789 MainThread downloader ERROR Failed rack peer update: timed out
[19/Nov/2018 16:18:37 +0000] 2789 MainThread agent WARNING Long HB processing time: 30.1849529743
[19/Nov/2018 16:18:37 +0000] 2789 MainThread agent WARNING Delayed HB: 15s since last
[19/Nov/2018 16:19:07 +0000] 2789 MainThread downloader ERROR Failed rack peer update: timed out
[19/Nov/2018 16:19:07 +0000] 2789 MainThread agent WARNING Long HB processing time: 30.1211960316
[19/Nov/2018 16:19:07 +0000] 2789 MainThread agent WARNING Delayed HB: 15s since last
[19/Nov/2018 16:19:37 +0000] 2789 MainThread downloader ERROR Failed rack peer update: timed out
[19/Nov/2018 16:19:37 +0000] 2789 MainThread agent WARNING Long HB processing time: 30.1215620041
[19/Nov/2018 16:19:37 +0000] 2789 MainThread agent WARNING Delayed HB: 15s since last
[19/Nov/2018 16:20:01 +0000] 2789 CP Server Thread-4 _cplogging INFO 192.168.164.35 - - [19/Nov/2018:16:20:01] "GET /heartbeat HTTP/1.1" 200 2 "" "NING/1.0"
[19/Nov/2018 16:20:04 +0000] 2789 CP Server Thread-5 _cplogging INFO 192.168.164.35 - - [19/Nov/2018:16:20:04] "GET /heartbeat HTTP/1.1" 200 2 "" "NING/1.0"
[19/Nov/2018 16:20:07 +0000] 2789 MainThread downloader ERROR Failed rack peer update: timed out
[19/Nov/2018 16:20:07 +0000] 2789 MainThread agent WARNING Long HB processing time: 30.1212861538
[19/Nov/2018 16:20:07 +0000] 2789 MainThread agent WARNING Delayed HB: 15s since last
[19/Nov/2018 16:20:37 +0000] 2789 MainThread downloader ERROR Failed rack peer update: timed out
[19/Nov/2018 16:20:37 +0000] 2789 MainThread agent WARNING Long HB processing time: 30.1753029823
[19/Nov/2018 16:20:37 +0000] 2789 MainThread agent WARNING Delayed HB: 15s since last
[19/Nov/2018 16:20:37 +0000] 2789 Thread-13 downloader INFO Fetching torrent: http://yingzhi01.com:7180/cmf/parcel/download/CDH-5.10.2-1.cdh5.10.2.p0.5-el6.parcel.torrent
[19/Nov/2018 16:20:37 +0000] 2789 Thread-13 downloader INFO Starting download of: http://yingzhi01.com:7180/cmf/parcel/download/CDH-5.10.2-1.cdh5.10.2.p0.5-el6.parcel
[19/Nov/2018 16:21:07 +0000] 2789 Thread-13 downloader ERROR Unexpected exception during download
Traceback (most recent call last):
File "/opt/cloudera-manager/cm-5.10.2/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.10.2-py2.6.egg/cmf/downloader.py", line 279, in download
self.client.AddTorrent(torrent_url)
File "/opt/cloudera-manager/cm-5.10.2/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.10.2-py2.6.egg/flood/util/cmd.py", line 159, in __call
_
return self.fn.__get__(self.binding)(*args, **kwargs)
File "/opt/cloudera-manager/cm-5.10.2/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.10.2-py2.6.egg/flood/util/rpc.py", line 68, in
return lambda *pargs, **kwargs: self._invoke(*pargs, **kwargs)
File "/opt/cloudera-manager/cm-5.10.2/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.10.2-py2.6.egg/flood/util/rpc.py", line 77, in invoke
return rpcClient.requestor.request(self.schema.name, msg)
File "/opt/cloudera-manager/cm-5.10.2/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.10.2-py2.6.egg/flood/util/rpc.py", line 129, in requestor
return avro.ipc.Requestor(self.SCHEMA, self.transceiver)
File "/opt/cloudera-manager/cm-5.10.2/lib64/cmf/agent/build/env/lib/python2.6/site-packages/cmf-5.10.2-py2.6.egg/flood/util/rpc.py", line 125, in transceiver
return avro.ipc.HTTPTransceiver(self.server.host, self.server.port)
File "/opt/cloudera-manager/cm-5.10.2/lib64/cmf/agent/build/env/lib/python2.6/site-packages/avro-1.6.3-py2.6.egg/avro/ipc.py", line 469, in __init
_
self.conn.connect()
File "/usr/lib64/python2.6/httplib.py", line 771, in connect
self.timeout)
File "/usr/lib64/python2.6/socket.py", line 567, in create_connection
raise error, msg
timeout: timed out
[19/Nov/2018 16:21:07 +0000] 2789 Thread-13 downloader INFO Finished download [ url: http://yingzhi01.com:7180/cmf/parcel/download/CDH-5.10.2-1.cdh5.10.2.p0.5-el6.parcel, state: exception, total_bytes: 0, downloaded_bytes: 0, start_time: 2018-11-19 16:20:37, download_end_time: , end_time: 2018-11-19 16:21:07, code: 600, exception_msg: timed out, path: None ]
[19/Nov/2018 16:21:07 +0000] 2789 MainThread downloader ERROR Failed rack peer update: timed out
[19/Nov/2018 16:21:07 +0000] 2789 MainThread agent WARNING Long HB processing time: 30.1247620583
[19/Nov/2018 16:21:07 +0000] 2789 MainThread agent WARNING Delayed HB: 15s since last
[19/Nov/2018 16:21:07 +0000] 2789 Thread-13 downloader INFO Fetching torrent: http://yingzhi01.com:7180/cmf/parcel/download/CDH-5.10.2-1.cdh5.10.2.p0.5-el6.parcel.torrent
[19/Nov/2018 16:21:08 +0000] 2789 Thread-13 downloader INFO Starting download of: http://yingzhi01.com:7180/cmf/parcel/download/CDH-5.10.2-1.cdh5.10.2.p0.5-el6.parcel
[19/Nov/2018 16:21:38 +0000] 2789 Thread-13 downloader ERROR Unexpected exception during download

然后就是不断重复超时错误求大神指点。。。

1个回答

yhntgbrfv1
yhntgbrfv1 并不是这个问题!而是选择完机器之后的安装页面一直卡在那!log报错连接超时
10 个月之前 回复
Csdn user default icon
上传中...
上传图片
插入图片
抄袭、复制答案,以达到刷声望分或其他目的的行为,在CSDN问答是严格禁止的,一经发现立刻封号。是时候展现真正的技术了!
其他相关推荐
Cloudera Manager 和 CHD5.3.3 集群 离线安装
Cloudera Manager 和 CHD5.3.3 集群 离线安装,非常好用。
cloudera manager的agent安装时候 出现的问题
/tmp/scm_prepare_node.K0tOAFSy  using SSH_CLIENT to get the SCM hostname: 10.221.5.140 33607 22  opening logging file descriptor  正在启动安装脚本... 正在获取安装锁... BEGIN flock 4 END (0)  正在检测根权限... effectiv...
Cloudera Manager 之三(安装)
操作系统: CentOs6.4 虚拟机(4核 3G) 主机: cdh01(server & agent) + cdh02( agent ) CDH版本:cdh5.7.1 jdk8 准备工作 关闭防火墙 在两台主机上都运行一下命令 service iptables stop 设置主机名 vim /etc/sysconfig/network 将HOSTNAME 分别改成cdh01和c...
Cloudera Manager安装方式
Cloudera CDH构建企业大数据平台视频教程:本课程主要讲解如何在企业实际应用中构建大数据平台,详细阐述了大数据平台的资源规划与设计在企业中的佳方案。并且基于Cloudera Manager如何去管理大数据平台的各个服务组件。从经验理论到实战,从设计思想到流程实施,本课程做了全面、细致的讲解。
安装Cloudera Manager Server
Cloudera CDH构建企业大数据平台视频教程:本课程主要讲解如何在企业实际应用中构建大数据平台,详细阐述了大数据平台的资源规划与设计在企业中的佳方案。并且基于Cloudera Manager如何去管理大数据平台的各个服务组件。从经验理论到实战,从设计思想到流程实施,本课程做了全面、细致的讲解。
cloudera manager安装
自己安装的安装过程记录,可能出现的问题都有记录,图片和文字结合,通俗易懂。
大数据平台cloudera manager安装
主节点是 server,其他节点是 agent 1:apache服务器       sudo rpm -qa|grep http       sudo service httpd status       sudo service httpd start   sudo chkconfig httpd on 访问 : bigdata-cdh01.ibeifeng.
离线安装Cloudera
下载文件: 1,下载CDH,http://archive.cloudera.com/cdh5/parcels/latest 注意版本问题parcel, parcel.sha1, manifest.json 2,下载CM http://archive-primary.cloudera.com/cm5/cm/5/ 3,下载JDK 使用7.79版本 配置: 如果没有说明都是root操作
离线安装Cloudera Manager 5和CDH5 完全教程
1.关闭防火墙(所有节点) (省略) 2.关闭Selinux(所有节点) (省略) 3.安装依赖包(所有节点) [root@master ~]# yum install chkconfig python bind-utils psmisc libxslt zlib sqlite cyrus-sasl-plain cyrus-sasl-gssapi fuse portmap fuse-libs r...
CentOS7离线安装Cloudera Manager(tar包版)
最近在搞Cloudera Manager,在线离线的安装都试验了,在网上也借鉴了很多大神们的教程。发现很多标注离线安装的rmp版本都或多或少需要联网。最后采用了tar包的方式安装。将本人的安装过程和网上的教程结合了一下总结一篇安装文档
cloudera 离线安装
1.1 设置ip地址service network restart 验证: ifconfig1.2 关闭防火墙service iptables stop 验证: service iptables status1.3 关闭防火墙的自动运行chkconfig iptables off chkconfig --list iptables 验证: chkconfig --list | grep iptabl
cloudera manager的agent的ip地址改变解决方案
1、首先在安装cloudera-manager的主机上,启动所有的cloudera管理进程 [root@node1 ~]# /etc/init.d/cloudera-scm-server-db status [root@node1 ~]# /etc/init.d/cloudera-scm-server status 2、查看postgresql 的scm用户的密码 grep pa...
安装部署-改后Cloudera Manager Agent(1)
本课程主要讲解在实际项目开发中,企业构建大数据平台的方案及实战。详细阐述企业级大数据平台的架构设计、机器选型、集群规划、技术选型、资源规划等技术方案。实战演练基于Cloudera Manager安装部署、监控管理、运营维护大数据平台的各个服务组件。从理论经验到实战演练,从设计思想到流程实施。
Centos6离线安装CDH5.14.2最全详细教程-5安装Cloudera Manager
概述 文章写得很详细,很长,所以这里分成了7个部分 这里是第二部分, 第一部分:前言 第二部分:环境准备1 第三部分:环境准备2 第四部分:安装Mysql数据库 第五部分:安装Cloudera Manager主服务 第六部分:配置Mysql数据库 第七部分:所有节点安装Cloudera Manager从服务及大数据组件 记得先看下第一部分的概述 这里再强调一下注意事项 1....
检查本地源并安装Cloudera Manager Agent(二)
Cloudera CDH构建企业大数据平台视频教程:本课程主要讲解如何在企业实际应用中构建大数据平台,详细阐述了大数据平台的资源规划与设计在企业中的佳方案。并且基于Cloudera Manager如何去管理大数据平台的各个服务组件。从经验理论到实战,从设计思想到流程实施,本课程做了全面、细致的讲解。
安装Cloudera Manager Server和Agent过程中遇到的问题
在安装hadoop 的cloudera manager 和 agent的过程中  版本 5.5.1 /opt/cm-5.5.1/etc/init.d/cloudera-scm-server start 是能正常启动的 /opt/cm-5.5.1/etc/init.d/cloudera-scm-agent 则无法正常启动 去查看了一下日志文件,也没有看出是什么错误,然后重装了好几次,还是这
检查本地源并安装Cloudera Manager Agent(一)
Cloudera CDH构建企业大数据平台视频教程:本课程主要讲解如何在企业实际应用中构建大数据平台,详细阐述了大数据平台的资源规划与设计在企业中的佳方案。并且基于Cloudera Manager如何去管理大数据平台的各个服务组件。从经验理论到实战,从设计思想到流程实施,本课程做了全面、细致的讲解。
cloudera manager安装遇到的问题
使用mysql作为数据库,提示 JDBC driver cannot be found. Unable to find the JDBC database jar on host      当报驱动找不到,需要手工拷贝 mysql-connector-java-5.1.6-bin.jar  到 mysql主机上的CM5 的目录     如下目录参考:     /opt/cloud
Cloudera Manager 安装遇到的问题
1、Unable toverify database connection在安装hue数据库的时候出现Unable to verify databaseconnection这个问题,现在有两种不同的解决方案,需要根据自己的实际情况来进行解决1、安装mysql-compat-libs包      rpm -ivh mysql-community-libs-compat-5.1.7-1.el6.x86...
Cloudera Manager安装(只需要在NODE1主节点执行上述操作便会自动分配部署到各节点)
总帖:CDH 6系列(CDH 6.0、CHD6.1等)安装和使用 Cloudera Manager安装(只需要在NODE1做) 1.配置本地repo源 1.下载CM6.0的安装包,地址为: https://archive.cloudera.com/cm6/6.0.0/redhat7/yum/RPMS/x86_64/cloudera-manager...
Cloudera CDH 离线安装与使用
CDH 在线安装方法如下,方便,但是由于在国内,访问这个网站的速度很慢,并不快捷。在线安装Cloudera Manager服务器 # 配置cloudera-cdh源和cloudera-manager源# cloudera-managerwget http://archive.cloudera.com/cm5/redhat/6/x86_64/cm/cloudera-manager.repo# clo...
离线安装Cloudera Manager 5和CDH5(最新版5.12.0) 完全教程
关于CDH和Cloudera Manager CDH (Cloudera's Distribution, including Apache Hadoop),是Hadoop众多分支中的一种,由Cloudera维护,基于稳定版本的Apache Hadoop构建,并集成了很多补丁,可直接用于生产环境。 Cloudera Manager则是为了便于在集群中进行Hadoop等大数据处理相关的服务
离线安装Cloudera Manager 5和CDH5及与遇到的问题总结
今天介绍一下:在linux系统下,如何搭建CDH集群. 1.1Cloudera Manager简介 Cloudera Manager是一个拥有集群自动化安装、中心化管理、集群监控、报警功能的一个工具(软件),使得安装集群从几天的时间缩短在几个小时内, 运维人员从数十人降低到几人以内,极大的提高集群管理的效率。 Cloudera Manager有四大功能:    (1)管理:...
【干货】离线安装Cloudera Manager 5和CDH5(最新版5.13.0)详细过程
2019独角兽企业重金招聘Python工程师标准>>> ...
Cloudera Manager 之二 (架构)
架构(Architecture) 如下图所示,Cloudera Manager 的核心是 Cloudera Manager Server(一下简称Server)。Server 托管管理控制台 web 服务和应用程序逻辑,并负责软件的安装、配置、服务的启动与关闭以及管理集群。 Server 和其他一些组件共同工作: Agent - 安装在每台主机上。Agent 负责进程的启动和停止,解压配置,触...
Cloudera Manager 之四(管理控制台)
Cloudera 管理控制台是一个网站页面,你可以用它来配置、管理以及监控 CDH。 如果服务已经配置,控制台头部的导航栏将显示如下: 导航栏显示以下信息: 集群(Clusters > cluster_name) 服务(Services) - 展示个别服务,以及 Cloudera Management 服务,在这个页面你可以: 查看服务实例的状态以及其他细节,也可以查看与服务相关的...
成功安装部署Cloudera Manager
本课程主要讲解在实际项目开发中,企业构建大数据平台的方案及实战。详细阐述企业级大数据平台的架构设计、机器选型、集群规划、技术选型、资源规划等技术方案。实战演练基于Cloudera Manager(CDH6)安装部署、监控管理、运营维护大数据平台的各个服务组件。从理论经验到实战演练,从设计思想到流程实施,亲力亲测,你也绝对可以。
在虚拟机上安装cloudera manager
1、准备工作的设置 在安装或者拷贝虚拟机时,如果网络连接不上,那么先删除之前的配置文件: rm -rf /etc/udev/rules.d/70-persistent-net.rules 设置网络(配置为桥接模式): /etc/sysconfig/network-scripts/ifcfg-eth0 DEVICE="eth0" BOOTPROTO="static" IPADDR=19
cloudera manager启动失败的问题
1.  [root@hd0 ~]# service cloudera-scm-server start Starting cloudera-scm-server:                              [FAILED] 2.  [root@hd0 ~]# service cloudera-scm-server status cloudera-scm-server
最新Cloudera Manager中文手册
最新Cloudera Manager中文手册,Cloudera Manager产品介绍
Cloudera Manager 离线安装教程
前言 以前部署hadoop集群,一直使用cloudera提供的tarball部署安装,今天尝试使用CM在新机器部署hadoop,因为使用它使用起来简单方便,并且提供了一系列的监控功能.但由于CM的安装是要联网的,而且cloudera还在中国没有源,所以安装过程非常的慢,而且失败率很高(网络不好的同学相信很有体会).所以自己摸索着搭建一个本地源,用于CM的安装.记录如下     环境: ...
cloudera manager安装问题记录
使用cloudera manager安装hadoop,过程中日志记录错误如下: Could not initialize database server. This usually means that your PostgreSQL installation failed or isn't working properly. PostgreSQL is installed us...
cloudera manager CCAH
我是一位大数据方向的大四在校生,由于实习公司最近在使用cloudera 搭建hadoop集群,才深知自己对Hadoop的认知是多么的肤浅,所以萌生了 考CCAH的想法,话说开头万事难,所以希望有对CCAH的了解的可以给予一些建议和分享一些自己的心得,再次深表感谢。
cloudera manager报错解决方案
问题1 错误提示: cloudera-scm-agent 已死,但 pid 文件仍存 解决办法: [root@node1 ~]# cd /var/run/ [root@node1 run]# rm -rf cloudera-scm-agent.pid 问题2 错误提示: error: No socket could be created on (‘node...
Cloudera Manager安装部署
Cloudera Manager安装部署.pdf
cloudera manager的运行机制及目录
cloudera manager的运行机制及目录,cloudera manager的运行机制及目录。
Cloudera Manager安装部署手册
1. 准备阶段—系统环境搭建 1.1 网络配置(所有节点) 修改hostname:vi /etc/sysconfig/network,按照如下进行设置: NETWORKING=yes HOSTNAME=master(注意这里的主机名称,可以自己定义) 重启网络服务生效:service network restart 修改ip与主机名的对应关系,vi /etc/h...
Cloudera manager为什么用python写agent而不用java?
Cloudera manager的server端事用java写的,而agent端用的是python,他们之间用RPC通信,请问python在执行shell脚本方面比java有什么优势,为什么CDH团队会选择python做agent?
安装Cloudera manager的时候页面卡住
安装Cloudera manager的时候页面卡住,一直获取lock获取不到。 解决方法:到/tmp下找到该lock,然后删除
Cloudera Manager的搭建及hadoop组件的安装
一、准备工作:    系统环境:redhat6.7企业版,    cm版本:cloudera-manager-el6-cm5.7.1_x86_64.tar.gz    cdh版本:CDH-5.7.1-1.cdh5.7.1.p0.11-el6   a、修改主机名:         操作命令:vim  /etc/sysconfig/network (例如:HOSTNAME= master,每...
相关热词 c# stream 复制 android c# c#监测窗口句柄 c# md5 引用 c# 判断tabtip 自己写个浏览器程序c# c# 字符串变成整数数组 c#语言编程写出一个方法 c# 转盘抽奖 c#选中treeview