aka持续高温 2021-05-24 10:41 采纳率: 0%
浏览 155

使用Sqoop连接MySQL并将数据表导入到HDFS中:出错

  • 写回答

2条回答 默认 最新

  • aka持续高温 2021-05-24 10:46
    关注
    Warning: /opt/bigdata/sqoop/../hcatalog does not exist! HCatalog jobs will fail.
    Please set $HCAT_HOME to the root of your HCatalog installation.
    Warning: /opt/bigdata/sqoop/../accumulo does not exist! Accumulo imports will fail.
    Please set $ACCUMULO_HOME to the root of your Accumulo installation.
    21/05/24 02:27:50 INFO sqoop.Sqoop: Running Sqoop version: 1.4.7
    21/05/24 02:27:50 WARN tool.BaseSqoopTool: Setting your password on the command-line is insecure. Consider using -P instead.
    21/05/24 02:27:50 INFO manager.MySQLManager: Preparing to use a MySQL streaming resultset.
    21/05/24 02:27:50 INFO tool.CodeGenTool: Beginning code generation
    21/05/24 02:27:51 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `user_info` AS t LIMIT 1
    21/05/24 02:27:51 INFO manager.SqlManager: Executing SQL statement: SELECT t.* FROM `user_info` AS t LIMIT 1
    21/05/24 02:27:51 INFO orm.CompilationManager: HADOOP_MAPRED_HOME is /opt/bigdata/hadoop
    注: /tmp/sqoop-zhangyu/compile/5dbd4960514747a4a548ab01432eaad9/user_info.java使用或覆盖了已过时的 API。
    注: 有关详细信息, 请使用 -Xlint:deprecation 重新编译。
    21/05/24 02:27:52 INFO orm.CompilationManager: Writing jar file: /tmp/sqoop-zhangyu/compile/5dbd4960514747a4a548ab01432eaad9/user_info.jar
    21/05/24 02:27:52 WARN manager.MySQLManager: It looks like you are importing from mysql.
    21/05/24 02:27:52 WARN manager.MySQLManager: This transfer can be faster! Use the --direct
    21/05/24 02:27:52 WARN manager.MySQLManager: option to exercise a MySQL-specific fast path.
    21/05/24 02:27:52 INFO manager.MySQLManager: Setting zero DATETIME behavior to convertToNull (mysql)
    21/05/24 02:27:52 INFO mapreduce.ImportJobBase: Beginning import of user_info
    SLF4J: Class path contains multiple SLF4J bindings.
    SLF4J: Found binding in [jar:file:/opt/bigdata/hadoop/share/hadoop/common/lib/slf4j-log4j12-1.7.10.jar!/org/slf4j/impl/StaticLoggerBinder.class]
    SLF4J: Found binding in [jar:file:/opt/bigdata/hbase/lib/slf4j-log4j12-1.7.25.jar!/org/slf4j/impl/StaticLoggerBinder.class]
    SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation.
    SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory]
    21/05/24 02:27:52 INFO Configuration.deprecation: mapred.jar is deprecated. Instead, use mapreduce.job.jar
    21/05/24 02:27:53 INFO Configuration.deprecation: mapred.map.tasks is deprecated. Instead, use mapreduce.job.maps
    21/05/24 02:27:53 INFO client.RMProxy: Connecting to ResourceManager at master/172.100.3.160:8032
    21/05/24 02:27:56 INFO db.DBInputFormat: Using read commited transaction isolation
    21/05/24 02:27:56 INFO db.DataDrivenDBInputFormat: BoundingValsQuery: SELECT MIN(`id`), MAX(`id`) FROM `user_info`
    21/05/24 02:27:56 INFO db.IntegerSplitter: Split size: 0; Num splits: 4 from: 1 to: 2
    21/05/24 02:27:56 INFO mapreduce.JobSubmitter: number of splits:2
    21/05/24 02:27:56 INFO mapreduce.JobSubmitter: Submitting tokens for job: job_1621823245599_0001
    21/05/24 02:27:57 INFO impl.YarnClientImpl: Submitted application application_1621823245599_0001
    21/05/24 02:27:57 INFO mapreduce.Job: The url to track the job: http://master:8088/proxy/application_1621823245599_0001/
    21/05/24 02:27:57 INFO mapreduce.Job: Running job: job_1621823245599_0001
    21/05/24 02:28:05 INFO mapreduce.Job: Job job_1621823245599_0001 running in uber mode : false
    21/05/24 02:28:05 INFO mapreduce.Job:  map 0% reduce 0%
    21/05/24 02:28:05 INFO mapreduce.Job: Job job_1621823245599_0001 failed with state FAILED due to: Application application_1621823245599_0001 failed 2 times due to AM Container for appattempt_1621823245599_0001_000002 exited with  exitCode: 127
    For more detailed output, check application tracking page:http://master:8088/cluster/app/application_1621823245599_0001Then, click on links to logs of each attempt.
    Diagnostics: Exception from container-launch.
    Container id: container_1621823245599_0001_02_000001
    Exit code: 127
    Stack trace: ExitCodeException exitCode=127: 
    	at org.apache.hadoop.util.Shell.runCommand(Shell.java:585)
    	at org.apache.hadoop.util.Shell.run(Shell.java:482)
    	at org.apache.hadoop.util.Shell$ShellCommandExecutor.execute(Shell.java:776)
    	at org.apache.hadoop.yarn.server.nodemanager.DefaultContainerExecutor.launchContainer(DefaultContainerExecutor.java:212)
    	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:302)
    	at org.apache.hadoop.yarn.server.nodemanager.containermanager.launcher.ContainerLaunch.call(ContainerLaunch.java:82)
    	at java.util.concurrent.FutureTask.run(FutureTask.java:266)
    	at java.util.concurrent.ThreadPoolExecutor.runWorker(ThreadPoolExecutor.java:1149)
    	at java.util.concurrent.ThreadPoolExecutor$Worker.run(ThreadPoolExecutor.java:624)
    	at java.lang.Thread.run(Thread.java:748)
    
    
    Container exited with a non-zero exit code 127
    Failing this attempt. Failing the application.
    21/05/24 02:28:05 INFO mapreduce.Job: Counters: 0
    21/05/24 02:28:05 WARN mapreduce.Counters: Group FileSystemCounters is deprecated. Use org.apache.hadoop.mapreduce.FileSystemCounter instead
    21/05/24 02:28:05 INFO mapreduce.ImportJobBase: Transferred 0 bytes in 12.3882 seconds (0 bytes/sec)
    21/05/24 02:28:05 WARN mapreduce.Counters: Group org.apache.hadoop.mapred.Task$Counter is deprecated. Use org.apache.hadoop.mapreduce.TaskCounter instead
    21/05/24 02:28:05 INFO mapreduce.ImportJobBase: Retrieved 0 records.
    21/05/24 02:28:05 ERROR tool.ImportTool: Import failed: Import job failed!
    
    评论

报告相同问题?

悬赏问题

  • ¥15 微信小程序 用oss下载 aliyun-oss-sdk-6.18.0.min client报错
  • ¥15 ArcGIS批量裁剪
  • ¥15 labview程序设计
  • ¥15 为什么在配置Linux系统的时候执行脚本总是出现E: Failed to fetch http:L/cn.archive.ubuntu.com
  • ¥15 Cloudreve保存用户组存储空间大小时报错
  • ¥15 伪标签为什么不能作为弱监督语义分割的结果?
  • ¥15 编一个判断一个区间范围内的数字的个位数的立方和是否等于其本身的程序在输入第1组数据后卡住了(语言-c语言)
  • ¥15 Mac版Fiddler Everywhere4.0.1提示强制更新
  • ¥15 android 集成sentry上报时报错。
  • ¥15 抖音看过的视频,缓存在哪个文件