kettle连接oracle 11g 报错 IO Error: Connection reset

报错信息如下:
Error occurred while trying to connect to the database
Error connecting to database: (using class oracle.jdbc.driver.OracleDriver)
IO Error: Connection reset
ERROR (version 7.0.0.0-25, build 1 from 2016-11-05 15.35.36 by buildguy) : Error initializing step [CREWS
IDE_SOFL_T]

我的kettle版本是7.0 oracle是11g
这个问题困扰我一个月了 求大神指导 网上找了好多解决办法都不行

2个回答

我猜测:可能是因为kettle目录下lib里面的ojdbc.jar包版本与当前链接的Oracle版本对不上,试试更换ojdbc*.jar

wangzisongxfg
悟净__ 回复Waterruthless: 什么问题,怎么不说清楚呢。。
8 个月之前 回复
wangzisongxfg
悟净__ 回复zhyaozy: 怎么解决的?
8 个月之前 回复
dewayweiwei
Atlas_oyc 回复Waterruthless: 请问是如何解决的,我最近也碰到这个问题,求教,QQ345853659
2 年多之前 回复
zhyaozy
zhyaozy 回复Waterruthless: 请问jar包是什么版本啊?我用的是ojdbc6换成5还是一样的reset啊
2 年多之前 回复
fzf555
fzf555 回复Waterruthless: 兄台,jar包用的几版本的?
2 年多之前 回复
Waterruthless
Waterruthless 确实是jar包的问题 谢谢!
2 年多之前 回复
Waterruthless
Waterruthless 嗯 有可能是这个问题 我去试试 谢谢!最近比较忙没及时回复 不好意思
2 年多之前 回复

在kitchen.sh文件的最后一行中的Java 命令行中增加参数:-Djava.security.egd=file:/dev/../dev/urandom 试试

Waterruthless
Waterruthless 最近比较忙没及时回复 不好意思
2 年多之前 回复
Waterruthless
Waterruthless 这种方法我试过 解决不了问题 谢谢了
2 年多之前 回复
Csdn user default icon
上传中...
上传图片
插入图片
抄袭、复制答案,以达到刷声望分或其他目的的行为,在CSDN问答是严格禁止的,一经发现立刻封号。是时候展现真正的技术了!
其他相关推荐
kettle7.1抽取oracle11gR2 提示错误 Io exception: Connection reset
``` 2019/06/11 18:18:19 - 表输入.0 - ERROR (version 7.1.0.0-12, build 1 from 2017-05-16 17.18.02 by buildguy) : An error occurred, processing will be stopped: 2019/06/11 18:18:19 - 表输入.0 - Error occurred while trying to connect to the database 2019/06/11 18:18:19 - 表输入.0 - 2019/06/11 18:18:19 - 表输入.0 - Error connecting to database: (using class oracle.jdbc.driver.OracleDriver) 2019/06/11 18:18:19 - 表输入.0 - Io exception: Connection reset 2019/06/11 18:18:19 - 表输入.0 - ERROR (version 7.1.0.0-12, build 1 from 2017-05-16 17.18.02 by buildguy) : Error initializing step [表输入] 2019/06/11 18:18:19 - tr_ibs_aitrp101 - ERROR (version 7.1.0.0-12, build 1 from 2017-05-16 17.18.02 by buildguy) : Step [表输入.0] failed to initialize! 2019/06/11 18:18:19 - 表输入.0 - Finished reading query, closing connection. 2019/06/11 18:18:19 - 获取会计日.0 - Finished reading query, closing connection. 2019/06/11 18:18:19 - 执行SQL脚本.0 - Finished reading query, closing connection. Unable to prepare and initialize this transformation ``` 服务器centos7.6 ojdbc6.jar 试过spoon.sh添加-Djava.security.egd=file:/dev/./urandom没有生效
求助:kettle连接cdh510-hbase报错问题
最近在用hbase与oracle的数据搬运工作,之前一直用sqoop,最近用kettle在做这个事情,在windows,os环境测试一切正常,包括客户端直接跑Job,和生成ktr脚本去跑,都没问题,但是我把生成的.ktr文件拿到ubuntu跑,就报错 org.pentaho.di.core.exception.KettleException: Unable to obtain a connection to HBase: null 如下图 ![图片说明](https://img-ask.csdn.net/upload/201707/12/1499870023_502959.png)
kettle 如何设置只读权限
我在kettle资料库是放在Oracle, 想实现的效果是:别的用户可以登陆kettle的资料库,查看数仓的数据处理方式,但是不可以(修改)保存,可以通过登陆用户设置吗? ![图片说明](https://img-ask.csdn.net/upload/201911/26/1574754404_880968.jpg)
KETTLE SQLSERVER到ORACLE 数据迁移问题 IMAGE类型转BLOB
最近需要从SQLSERVER中向ORACLE中做数据迁移,遇到sqlserver中字段类型为image,向oracle中转化为blob 类型,增加了字段选择,不知道怎么操作,老是报错,求解,错误信息如下: 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : Unexpected error 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : org.pentaho.di.core.exception.KettleDatabaseException: 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : Couldn't get row from result set 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : Unable to get value 'String(9999999)<binary-string>' from database resultset, index 12 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : 不支持的特性 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : at org.pentaho.di.core.database.Database.getRow(Database.java:2824) 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : at org.pentaho.di.core.database.Database.getRow(Database.java:2796) 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : at org.pentaho.di.core.database.Database.getRow(Database.java:2770) 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : at org.pentaho.di.trans.steps.tableinput.TableInput.doQuery(TableInput.java:257) 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : at org.pentaho.di.trans.steps.tableinput.TableInput.processRow(TableInput.java:143) 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : at org.pentaho.di.trans.step.RunThread.run(RunThread.java:50) 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : at java.lang.Thread.run(Thread.java:722) 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : Caused by: org.pentaho.di.core.exception.KettleDatabaseException: 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : Unable to get value 'String(9999999)<binary-string>' from database resultset, index 12 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : 不支持的特性 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : at org.pentaho.di.core.database.BaseDatabaseMeta.getValueFromResultSet(BaseDatabaseMeta.java:1900) 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : at org.pentaho.di.core.database.DatabaseMeta.getValueFromResultSet(DatabaseMeta.java:2613) 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : at org.pentaho.di.core.database.Database.getRow(Database.java:2816) 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : ... 6 more 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : Caused by: java.sql.SQLException: 不支持的特性 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:112) 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:146) 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : at oracle.jdbc.driver.DatabaseError.throwSqlException(DatabaseError.java:208) 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : at oracle.jdbc.driver.DatabaseError.throwUnsupportedFeatureSqlException(DatabaseError.java:499) 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : at oracle.jdbc.driver.ClobAccessor.getBytes(ClobAccessor.java:279) 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : at oracle.jdbc.driver.OracleResultSetImpl.getBytes(OracleResultSetImpl.java:708) 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : at org.pentaho.di.core.database.BaseDatabaseMeta.getValueFromResultSet(BaseDatabaseMeta.java:1868) 2013/11/09 15:16:34 - 接收方数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : ... 8 more 2013/11/09 15:16:34 - 接收方数据库.0 - Finished reading query, closing connection. 2013/11/09 15:16:34 - 接收方数据库.0 - 完成处理 (I=0, O=0, R=0, W=0, U=0, E=1 2013/11/09 15:16:34 - CY_HD_YCCYFZSQB - CY_HD_YCCYFZSQB 2013/11/09 15:16:34 - CY_HD_YCCYFZSQB - CY_HD_YCCYFZSQB 2013/11/09 15:16:34 - 源数据库.0 - Finished reading query, closing connection. 2013/11/09 15:16:34 - 源数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : Unexpected error closing query : org.pentaho.di.core.exception.KettleDatabaseException: 2013/11/09 15:16:34 - 源数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : Couldn't close query: resultset or prepared statements 2013/11/09 15:16:34 - 源数据库.0 - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : Cancel has been invoked on this Statement. 2013/11/09 15:16:34 - 源数据库.0 - 完成处理 (I=2, O=0, R=0, W=0, U=0, E=1 2013/11/09 15:16:34 - Spoon - 转换完成!! 2013/11/09 15:16:34 - CY_HD_YCCYFZSQB - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : 错误被检测到! 2013/11/09 15:16:34 - CY_HD_YCCYFZSQB - ERROR (version 4.3.0, build 1 from 2012-07-24 10.59.03 by Administrator) : 错误被检测到!
Kettle DB连接报错,InvocationTargetException
kettle 新手,刚刚下载好kettle后想要连接数据库,却出现如下bao'cuo org.pentaho.ui.xul.XulException: org.pentaho.ui.xul.XulException: java.lang.reflect.InvocationTargetException at org.pentaho.ui.xul.impl.AbstractXulLoader.loadXul(AbstractXulLoader.java:144) at org.pentaho.ui.xul.swt.SwtXulLoader.loadXul(SwtXulLoader.java:127) at org.pentaho.ui.xul.swt.SwtXulLoader.loadXul(SwtXulLoader.java:121) at org.pentaho.ui.xul.impl.AbstractXulLoader.loadXul(AbstractXulLoader.java:252) at org.pentaho.ui.database.DatabaseConnectionDialog.getSwtInstance(DatabaseConnectionDialog.java:56) at org.pentaho.di.ui.core.database.dialog.XulDatabaseDialog.createDialog(XulDatabaseDialog.java:144) at org.pentaho.di.ui.core.database.dialog.XulDatabaseDialog.open(XulDatabaseDialog.java:105) at org.pentaho.di.ui.core.database.dialog.DatabaseDialog.open(DatabaseDialog.java:59) at org.pentaho.di.ui.spoon.delegates.SpoonDBDelegate.newConnection(SpoonDBDelegate.java:464) at org.pentaho.di.ui.spoon.delegates.SpoonDBDelegate.newConnection(SpoonDBDelegate.java:451) at org.pentaho.di.ui.spoon.Spoon.newConnection(Spoon.java:8728) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:567) at org.pentaho.ui.xul.impl.AbstractXulDomContainer.invoke(AbstractXulDomContainer.java:313) at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:157) at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:141) at org.pentaho.ui.xul.jface.tags.JfaceMenuitem.access$100(JfaceMenuitem.java:43) at org.pentaho.ui.xul.jface.tags.JfaceMenuitem$1.run(JfaceMenuitem.java:106) at org.eclipse.jface.action.Action.runWithEvent(Action.java:498) at org.eclipse.jface.action.ActionContributionItem.handleWidgetSelection(ActionContributionItem.java:545) at org.eclipse.jface.action.ActionContributionItem.access$2(ActionContributionItem.java:490) at org.eclipse.jface.action.ActionContributionItem$5.handleEvent(ActionContributionItem.java:402) at org.eclipse.swt.widgets.EventTable.sendEvent(Unknown Source) at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source) at org.eclipse.swt.widgets.Display.runDeferredEvents(Unknown Source) at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source) at org.pentaho.di.ui.spoon.Spoon.readAndDispatch(Spoon.java:1319) at org.pentaho.di.ui.spoon.Spoon.waitForDispose(Spoon.java:7939) at org.pentaho.di.ui.spoon.Spoon.start(Spoon.java:9190) at org.pentaho.di.ui.spoon.Spoon.main(Spoon.java:654) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:567) at org.pentaho.commons.launcher.Launcher.main(Launcher.java:92) Caused by: org.pentaho.ui.xul.XulException: java.lang.reflect.InvocationTargetException at org.pentaho.ui.xul.impl.XulParser.getElement(XulParser.java:239) at org.pentaho.ui.xul.impl.XulParser.parse(XulParser.java:164) at org.pentaho.ui.xul.impl.XulParser.parseDocument(XulParser.java:85) at org.pentaho.ui.xul.impl.AbstractXulLoader.loadXul(AbstractXulLoader.java:136) ... 36 more Caused by: java.lang.reflect.InvocationTargetException at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at java.base/jdk.internal.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:62) at java.base/jdk.internal.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:43) at java.base/java.lang.reflect.Method.invoke(Method.java:567) at org.apache.commons.beanutils.PropertyUtilsBean.invokeMethod(PropertyUtilsBean.java:2155) at org.apache.commons.beanutils.PropertyUtilsBean.setSimpleProperty(PropertyUtilsBean.java:2141) at org.apache.commons.beanutils.PropertyUtilsBean.setNestedProperty(PropertyUtilsBean.java:1948) at org.apache.commons.beanutils.PropertyUtilsBean.setProperty(PropertyUtilsBean.java:2054) at org.apache.commons.beanutils.BeanUtilsBean.setProperty(BeanUtilsBean.java:1015) at org.apache.commons.beanutils.BeanUtilsBean.populate(BeanUtilsBean.java:830) at org.apache.commons.beanutils.BeanUtils.populate(BeanUtils.java:433) at org.pentaho.ui.xul.impl.XulParser.getElement(XulParser.java:235) ... 39 more Caused by: java.lang.ClassCastException: class [Ljava.lang.Object; cannot be cast to class [Ljava.lang.String; ([Ljava.lang.Object; and [Ljava.lang.String; are in module java.base of loader 'bootstrap') at org.pentaho.ui.xul.swt.tags.SwtDialog.setButtons(SwtDialog.java:268) ... 51 more
Kettle 连接数据库错误报错如图,如何解决,求大神。
![图片说明](https://img-ask.csdn.net/upload/201608/01/1470031905_964369.png) 点击打开转换出现的问题。 org.pentaho.di.core.exception.KettleDatabaseException: Unable to populate tree with repository objects Unable to get list of repository objects MODIFIED_DATE String : couldn't convert string [2016-07-28 15:31:56] to a date using format [yyyy/MM/dd HH:mm:ss.SSS] Unparseable date: "2016-07-28 15:31:56" at org.pentaho.di.ui.repository.RepositoryDirectoryUI.getTreeWithNames(RepositoryDirectoryUI.java:193) at org.pentaho.di.ui.repository.dialog.SelectObjectDialog.refreshTree(SelectObjectDialog.java:433) at org.pentaho.di.ui.repository.dialog.SelectObjectDialog.setSort(SelectObjectDialog.java:420) at org.pentaho.di.ui.repository.dialog.SelectObjectDialog.getData(SelectObjectDialog.java:453) at org.pentaho.di.ui.repository.dialog.SelectObjectDialog.open(SelectObjectDialog.java:344) at org.pentaho.di.ui.spoon.Spoon.openFile(Spoon.java:3731) at org.pentaho.di.ui.spoon.Spoon.openFile(Spoon.java:3682) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.pentaho.ui.xul.impl.AbstractXulDomContainer.invoke(AbstractXulDomContainer.java:329) at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:139) at org.pentaho.ui.xul.impl.AbstractXulComponent.invoke(AbstractXulComponent.java:123) at org.pentaho.ui.xul.swt.tags.SwtToolbarbutton.access$100(SwtToolbarbutton.java:38) at org.pentaho.ui.xul.swt.tags.SwtToolbarbutton$1.widgetSelected(SwtToolbarbutton.java:85) at org.eclipse.swt.widgets.TypedListener.handleEvent(Unknown Source) at org.eclipse.swt.widgets.EventTable.sendEvent(Unknown Source) at org.eclipse.swt.widgets.Widget.sendEvent(Unknown Source) at org.eclipse.swt.widgets.Display.runDeferredEvents(Unknown Source) at org.eclipse.swt.widgets.Display.readAndDispatch(Unknown Source) at org.pentaho.di.ui.spoon.Spoon.readAndDispatch(Spoon.java:1221) at org.pentaho.di.ui.spoon.Spoon.waitForDispose(Spoon.java:7051) at org.pentaho.di.ui.spoon.Spoon.start(Spoon.java:8311) at org.pentaho.di.ui.spoon.Spoon.main(Spoon.java:580) at sun.reflect.NativeMethodAccessorImpl.invoke0(Native Method) at sun.reflect.NativeMethodAccessorImpl.invoke(NativeMethodAccessorImpl.java:39) at sun.reflect.DelegatingMethodAccessorImpl.invoke(DelegatingMethodAccessorImpl.java:25) at java.lang.reflect.Method.invoke(Method.java:597) at org.pentaho.commons.launcher.Launcher.main(Launcher.java:134) Caused by: org.pentaho.di.core.exception.KettleException: Unable to get list of repository objects MODIFIED_DATE String : couldn't convert string [2016-07-28 15:31:56] to a date using format [yyyy/MM/dd HH:mm:ss.SSS] Unparseable date: "2016-07-28 15:31:56" at org.pentaho.di.repository.kdr.delegates.KettleDatabaseRepositoryConnectionDelegate.getRepositoryObjects(KettleDatabaseRepositoryConnectionDelegate.java:1469) at org.pentaho.di.repository.kdr.KettleDatabaseRepository.getRepositoryObjects(KettleDatabaseRepository.java:717) at org.pentaho.di.repository.kdr.KettleDatabaseRepository.getTransformationObjects(KettleDatabaseRepository.java:702) at org.pentaho.di.repository.kdr.KettleDatabaseRepository.getJobAndTransformationObjects(KettleDatabaseRepository.java:1761) at org.pentaho.di.ui.repository.RepositoryDirectoryUI.getTreeWithNames(RepositoryDirectoryUI.java:115) ... 29 more Caused by: org.pentaho.di.core.exception.KettleValueException: MODIFIED_DATE String : couldn't convert string [2016-07-28 15:31:56] to a date using format [yyyy/MM/dd HH:mm:ss.SSS] Unparseable date: "2016-07-28 15:31:56" at org.pentaho.di.core.row.ValueMeta.convertStringToDate(ValueMeta.java:619) at org.pentaho.di.core.row.ValueMeta.getDate(ValueMeta.java:1670) at org.pentaho.di.core.row.RowMeta.getDate(RowMeta.java:245) at org.pentaho.di.repository.kdr.delegates.KettleDatabaseRepositoryConnectionDelegate.getRepositoryObjects(KettleDatabaseRepositoryConnectionDelegate.java:1462) ... 33 more Caused by: java.text.ParseException: Unparseable date: "2016-07-28 15:31:56" at java.text.DateFormat.parse(DateFormat.java:337) at org.pentaho.di.core.row.ValueMeta.convertStringToDate(ValueMeta.java:614) ... 36 more
Kettle数据迁移MySQL连接关闭导致失败?
使用的是kettle8.2,数据迁移用的是表输入-表输出,然后数据量现在到了200多万条后报错了,错误信息如下 2019/09/13 02:20:42 - 表输入.0 - linenr 2050000 2019/09/13 02:20:47 - 表输出.0 - linenr 2050000 2019/09/13 02:21:06 - 表输入.0 - linenr 2100000 2019/09/13 02:21:11 - 表输出.0 - linenr 2100000 2019/09/13 02:22:43 - 表输出.0 - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : Because of an error, this step can't continue: 2019/09/13 02:22:43 - 表输出.0 - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : org.pentaho.di.core.exception.KettleDatabaseException: 2019/09/13 02:22:43 - 表输出.0 - Unable to clear batch for prepared statement 2019/09/13 02:22:43 - 表输出.0 - No operations allowed after statement closed. 2019/09/13 02:22:43 - 表输出.0 - 2019/09/13 02:22:43 - 表输出.0 - at org.pentaho.di.core.database.Database.clearBatch(Database.java:1342) 2019/09/13 02:22:43 - 表输出.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.writeToTable(TableOutput.java:337) 2019/09/13 02:22:43 - 表输出.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.processRow(TableOutput.java:125) 2019/09/13 02:22:43 - 表输出.0 - at org.pentaho.di.trans.step.RunThread.run(RunThread.java:62) 2019/09/13 02:22:43 - 表输出.0 - at java.lang.Thread.run(Thread.java:745) 2019/09/13 02:22:43 - 表输出.0 - Caused by: java.sql.SQLException: No operations allowed after statement closed. 2019/09/13 02:22:43 - 表输出.0 - at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:959) 2019/09/13 02:22:43 - 表输出.0 - at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:898) 2019/09/13 02:22:43 - 表输出.0 - at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:887) 2019/09/13 02:22:43 - 表输出.0 - at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:862) 2019/09/13 02:22:43 - 表输出.0 - at com.mysql.jdbc.StatementImpl.checkClosed(StatementImpl.java:438) 2019/09/13 02:22:43 - 表输出.0 - at com.mysql.jdbc.PreparedStatement.clearBatch(PreparedStatement.java:1007) 2019/09/13 02:22:43 - 表输出.0 - at org.pentaho.di.core.database.Database.clearBatch(Database.java:1340) 2019/09/13 02:22:43 - 表输出.0 - ... 4 more 2019/09/13 02:22:43 - 表输入.0 - Finished reading query, closing connection. 2019/09/13 02:22:43 - 表输出.0 - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : Unexpected batch update error committing the database connection. 开始时间是 02:04,跑了大概18分钟后报错,但是什么都不修改重新启动就跑成功了,什么情况报错还没搞清楚。 是服务端把我的连接关闭了吗? MySQL加testOnBorrow和testOnReturn暂时不允许加,要怎么修改呢?有没有用过kettle连接池的,能解决吗?
kettle连接hive2,连接正常,但是获取表信息报错
java.lang.reflect.InvocationTargetException: Problem encountered getting information from the database: org.pentaho.di.core.exception.KettleDatabaseException: Unable to retrieve database information because of an error Unable to get list of procedures from database meta-data: Unable to get list of rows from ResultSet : Error determining value metadata from SQL resultset metadata Method not supported at org.pentaho.di.ui.core.database.dialog.GetDatabaseInfoProgressDialog$1.run(GetDatabaseInfoProgressDialog.java:67) at org.eclipse.jface.operation.ModalContext$ModalContextThread.run(ModalContext.java:113) Caused by: org.pentaho.di.core.exception.KettleDatabaseException: Unable to retrieve database information because of an error Unable to get list of procedures from database meta-data: Unable to get list of rows from ResultSet : Error determining value metadata from SQL resultset metadata Method not supported kettle 版本为5.4, hive版本为1.2.1,hadoop版本为2.7.1
kettle: 调用webservice
1. 使用kettle(8.2)调用webservice时候出现异常 2. 报错信息如下: Could not find the schema with the name {http:/xxxx/}Exception within the specified wsdl. General - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : Could not retrieve WSDL Operator for operation name: xxx
求助!使用Kettle从impala中取数慢
CDH6.2 第一套环境:4C,64G 有3台 第二套环境:4C,256G有5台 使用kettle配置两个数据源,分别从impala中取数(两套环境的数据量一样)。 单独把sql在Impala上执行,两套环境的执行时间几乎一样(相差几秒) 但是使用Kettle抽取时间3台机子的抽取时间为20秒。 5台机子的抽取时间是45秒。
kettle连接MYSQL数据库问题
![图片说明](https://img-ask.csdn.net/upload/201909/24/1569314912_453856.png)![图片说明](https://img-ask.csdn.net/upload/201909/24/1569314922_599953.png) mysql的驱动放到kettle安装文件中的lib下,连不上一直报错,折腾一下午了 求大佬来看看呀!
kettle,把oracle的数据迁移到Mysql中是报错,感觉是字段方面的错误,求大神指教
2015/03/23 11:25:52 - 表输出.0 - Connected to database [local_hsps1] (commit=1000) 2015/03/23 11:25:52 - 表输出.0 - ERROR (version 5.3.0.0-213, build 1 from 2015-02-02_12-17-08 by buildguy) : Unexpected batch update error committing the database connection. 2015/03/23 11:25:52 - 表输出.0 - ERROR (version 5.3.0.0-213, build 1 from 2015-02-02_12-17-08 by buildguy) : org.pentaho.di.core.exception.KettleDatabaseBatchException: 2015/03/23 11:25:52 - 表输出.0 - Error updating batch 2015/03/23 11:25:52 - 表输出.0 - You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'MAXVALUE, MINVALUE, MODIFIER, MODIFYTIME, NAME, RANK, RECORDTIME, RECORDER, STAT' at line 1 2015/03/23 11:25:52 - 表输出.0 - 2015/03/23 11:25:52 - 表输出.0 - at org.pentaho.di.core.database.Database.createKettleDatabaseBatchException(Database.java:1351) 2015/03/23 11:25:52 - 表输出.0 - at org.pentaho.di.core.database.Database.emptyAndCommit(Database.java:1340) 2015/03/23 11:25:52 - 表输出.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.dispose(TableOutput.java:571) 2015/03/23 11:25:52 - 表输出.0 - at org.pentaho.di.trans.step.RunThread.run(RunThread.java:96) 2015/03/23 11:25:52 - 表输出.0 - at java.lang.Thread.run(Thread.java:745) 2015/03/23 11:25:52 - 表输出.0 - Caused by: java.sql.BatchUpdateException: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'MAXVALUE, MINVALUE, MODIFIER, MODIFYTIME, NAME, RANK, RECORDTIME, RECORDER, STAT' at line 1 2015/03/23 11:25:52 - 表输出.0 - at com.mysql.jdbc.PreparedStatement.executeBatchSerially(PreparedStatement.java:1815) 2015/03/23 11:25:52 - 表输出.0 - at com.mysql.jdbc.PreparedStatement.executeBatch(PreparedStatement.java:1277) 2015/03/23 11:25:52 - 表输出.0 - at org.pentaho.di.core.database.Database.emptyAndCommit(Database.java:1327) 2015/03/23 11:25:52 - 表输出.0 - ... 3 more 2015/03/23 11:25:52 - 表输出.0 - Caused by: com.mysql.jdbc.exceptions.jdbc4.MySQLSyntaxErrorException: You have an error in your SQL syntax; check the manual that corresponds to your MySQL server version for the right syntax to use near 'MAXVALUE, MINVALUE, MODIFIER, MODIFYTIME, NAME, RANK, RECORDTIME, RECORDER, STAT' at line 1 2015/03/23 11:25:52 - 表输出.0 - at sun.reflect.NativeConstructorAccessorImpl.newInstance0(Native Method) 2015/03/23 11:25:52 - 表输出.0 - at sun.reflect.NativeConstructorAccessorImpl.newInstance(NativeConstructorAccessorImpl.java:62) 2015/03/23 11:25:52 - 表输出.0 - at sun.reflect.DelegatingConstructorAccessorImpl.newInstance(DelegatingConstructorAccessorImpl.java:45) 2015/03/23 11:25:52 - 表输出.0 - at java.lang.reflect.Constructor.newInstance(Constructor.java:408) 2015/03/23 11:25:52 - 表输出.0 - at com.mysql.jdbc.Util.handleNewInstance(Util.java:377) 2015/03/23 11:25:52 - 表输出.0 - at com.mysql.jdbc.Util.getInstance(Util.java:360) 2015/03/23 11:25:52 - 表输出.0 - at com.mysql.jdbc.SQLError.createSQLException(SQLError.java:978) 2015/03/23 11:25:52 - 表输出.0 - at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3887) 2015/03/23 11:25:52 - 表输出.0 - at com.mysql.jdbc.MysqlIO.checkErrorPacket(MysqlIO.java:3823) 2015/03/23 11:25:52 - 表输出.0 - at com.mysql.jdbc.MysqlIO.sendCommand(MysqlIO.java:2435) 2015/03/23 11:25:52 - 表输出.0 - at com.mysql.jdbc.MysqlIO.sqlQueryDirect(MysqlIO.java:2582) 2015/03/23 11:25:52 - 表输出.0 - at com.mysql.jdbc.ConnectionImpl.execSQL(ConnectionImpl.java:2530) 2015/03/23 11:25:52 - 表输出.0 - at com.mysql.jdbc.PreparedStatement.executeInternal(PreparedStatement.java:1907) 2015/03/23 11:25:52 - 表输出.0 - at com.mysql.jdbc.PreparedStatement.executeUpdate(PreparedStatement.java:2141) 2015/03/23 11:25:52 - 表输出.0 - at com.mysql.jdbc.PreparedStatement.executeBatchSerially(PreparedStatement.java:1773) 2015/03/23 11:25:52 - 表输出.0 - ... 5 more 2015/03/23 11:25:52 - 表输出.0 - 完成处理 (I=0, O=0, R=15, W=0, U=0, E=1
kettle的JOB互相嵌套的作业,在windows上正常运行,迁移到Linux服务器就报错了
windows系统运行正常: ![图片说明](https://img-ask.csdn.net/upload/201907/29/1564389024_347344.png) Linux系统下运行报错: ``` /usr/local/kettle/data-integration/spoon.sh: line 140: ldconfig: command not found ####################################################################### WARNING: no libwebkitgtk-1.0 detected, some features will be unavailable Consider installing the package with apt-get or yum. e.g. 'sudo apt-get install libwebkitgtk-1.0-0' ####################################################################### Java HotSpot(TM) 64-Bit Server VM warning: ignoring option MaxPermSize=256m; support was removed in 8.0 log4j:WARN Continuable parsing error 45 and column 76 log4j:WARN Element type "rollingPolicy" must be declared. log4j:WARN Continuable parsing error 52 and column 14 log4j:WARN The content of element type "appender" must match "(errorHandler?,param*,layout?,filter*,appender-ref*)". log4j:WARN Please set a rolling policy for the RollingFileAppender named 'pdi-execution-appender' 16:11:29,469 INFO [KarafBoot] Checking to see if org.pentaho.clean.karaf.cache is enabled 16:11:29,646 INFO [KarafInstance] ******************************************************************************* *** Karaf Instance Number: 1 at /usr/local/kettle/data-integration/./system *** *** /karaf/caches/kitchen/data-1 *** *** FastBin Provider Port:52901 *** *** Karaf Port:8802 *** *** OSGI Service Port:9051 *** ******************************************************************************* Jul 29, 2019 4:11:32 PM org.apache.karaf.main.Main$KarafLockCallback lockAquired INFO: Lock acquired. Setting startlevel to 100 2019/07/29 16:11:36 - Kitchen - Start of run. 2019/07/29 16:11:36 - RepositoriesMeta - Reading repositories XML file: /usr/local/kettle/.kettle/repositories.xml 2019-07-29 16:11:53.034:INFO:oejs.Server:jetty-8.1.15.v20140411 2019-07-29 16:11:53.106:INFO:oejs.AbstractConnector:Started NIOSocketConnectorWrapper@0.0.0.0:9051 Jul 29, 2019 4:11:58 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/core Jul 29, 2019 4:11:58 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://cxf.apache.org/configuration/beans Jul 29, 2019 4:11:58 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://cxf.apache.org/configuration/parameterized-types Jul 29, 2019 4:11:58 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://cxf.apache.org/configuration/security Jul 29, 2019 4:11:58 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/wsdl/ Jul 29, 2019 4:11:58 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://www.w3.org/2005/08/addressing Jul 29, 2019 4:11:58 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/ws/2004/08/addressing Jul 29, 2019 4:11:58 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-management (195) [org.apache.cxf.management.InstrumentationManager] Jul 29, 2019 4:11:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-wsdl (198) [org.apache.cxf.wsdl.WSDLManager] Jul 29, 2019 4:11:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-bindings-xml (200) [org.apache.cxf.binding.xml.XMLBindingFactory, org.apache.cxf.binding.xml.wsdl11.XMLWSDLExtensionLoader] Jul 29, 2019 4:11:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-bindings-soap (201) [org.apache.cxf.binding.soap.SoapBindingFactory, org.apache.cxf.binding.soap.SoapTransportFactory] Jul 29, 2019 4:11:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/bindings/soap Jul 29, 2019 4:11:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-transports-http (202) [org.apache.cxf.transport.http.HTTPTransportFactory, org.apache.cxf.transport.http.HTTPWSDLExtensionLoader, org.apache.cxf.transport.http.policy.HTTPClientAssertionBuilder, org.apache.cxf.transport.http.policy.HTTPServerAssertionBuilder, org.apache.cxf.transport.http.policy.NoOpPolicyInterceptorProvider] Jul 29, 2019 4:11:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-policy (220) [org.apache.cxf.ws.policy.PolicyEngine, org.apache.cxf.policy.PolicyDataEngine, org.apache.cxf.ws.policy.AssertionBuilderRegistry, org.apache.cxf.ws.policy.PolicyInterceptorProviderRegistry, org.apache.cxf.ws.policy.PolicyBuilder, org.apache.cxf.ws.policy.PolicyAnnotationListener, org.apache.cxf.ws.policy.attachment.ServiceModelPolicyProvider, org.apache.cxf.ws.policy.attachment.external.DomainExpressionBuilderRegistry, org.apache.cxf.ws.policy.attachment.external.EndpointReferenceDomainExpressionBuilder, org.apache.cxf.ws.policy.attachment.external.URIDomainExpressionBuilder, org.apache.cxf.ws.policy.attachment.wsdl11.Wsdl11AttachmentPolicyProvider, org.apache.cxf.ws.policy.mtom.MTOMAssertionBuilder, org.apache.cxf.ws.policy.mtom.MTOMPolicyInterceptorProvider] Jul 29, 2019 4:11:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://cxf.apache.org/transports/http/configuration Jul 29, 2019 4:11:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/simple Jul 29, 2019 4:11:59 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-frontend-jaxws (204) [org.apache.cxf.jaxws.context.WebServiceContextResourceResolver] Jul 29, 2019 4:11:59 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/jaxws Jul 29, 2019 4:12:00 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/jaxrs Jul 29, 2019 4:12:00 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/jaxrs-client Jul 29, 2019 4:12:00 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://cxf.apache.org/binding/coloc Jul 29, 2019 4:12:00 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-transports-local (216) [org.apache.cxf.transport.local.LocalTransportFactory] Jul 29, 2019 4:12:00 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-bindings-object (217) [org.apache.cxf.binding.object.ObjectBindingFactory] Jul 29, 2019 4:12:00 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://cxf.apache.org/blueprint/binding/object Jul 29, 2019 4:12:00 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://cxf.apache.org/policy Jul 29, 2019 4:12:00 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://www.w3.org/ns/ws-policy Jul 29, 2019 4:12:00 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://www.w3.org/2006/07/ws-policy Jul 29, 2019 4:12:00 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/ws/2004/09/policy Jul 29, 2019 4:12:00 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-secext-1.0.xsd Jul 29, 2019 4:12:00 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://docs.oasis-open.org/wss/2004/01/oasis-200401-wss-wssecurity-utility-1.0.xsd Jul 29, 2019 4:12:00 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://www.w3.org/2000/09/xmldsig# Jul 29, 2019 4:12:00 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://docs.oasis-open.org/ws-sx/ws-securitypolicy/200702 Jul 29, 2019 4:12:00 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-addr (237) [org.apache.cxf.ws.addressing.policy.AddressingAssertionBuilder, org.apache.cxf.ws.addressing.policy.UsingAddressingAssertionBuilder, org.apache.cxf.ws.addressing.policy.AddressingPolicyInterceptorProvider, org.apache.cxf.ws.addressing.impl.AddressingWSDLExtensionLoader, org.apache.cxf.ws.addressing.WSAddressingFeature$WSAddressingFeatureApplier, org.apache.cxf.ws.addressing.MAPAggregator$MAPAggregatorLoader] Jul 29, 2019 4:12:00 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://cxf.apache.org/ws/addressing Jul 29, 2019 4:12:01 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-security (239) [org.apache.cxf.ws.security.policy.WSSecurityPolicyLoader, org.apache.cxf.ws.security.cache.CacheCleanupListener] Jul 29, 2019 4:12:01 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-ws-rm (241) [org.apache.cxf.ws.rm.RMManager, org.apache.cxf.ws.rm.policy.RMPolicyInterceptorProvider, org.apache.cxf.ws.rm.policy.RM10AssertionBuilder, org.apache.cxf.ws.rm.policy.RM12AssertionBuilder, org.apache.cxf.ws.rm.policy.WSRMP12PolicyLoader, org.apache.cxf.ws.rm.policy.MC11PolicyLoader, org.apache.cxf.ws.rm.policy.RSPPolicyLoader] Jul 29, 2019 4:12:01 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://cxf.apache.org/ws/rm/manager Jul 29, 2019 4:12:01 PM org.apache.cxf.bus.blueprint.NamespaceHandlerRegisterer register INFO: Registered blueprint namespace handler for http://schemas.xmlsoap.org/ws/2005/02/rm/policy Jul 29, 2019 4:12:01 PM org.apache.cxf.bus.osgi.CXFExtensionBundleListener addExtensions INFO: Adding the extensions from bundle org.apache.cxf.cxf-rt-javascript (242) [org.apache.cxf.javascript.JavascriptServerListener] Jul 29, 2019 4:12:01 PM org.pentaho.caching.impl.PentahoCacheManagerFactory$RegistrationHandler$1 onSuccess INFO: New Caching Service registered SLF4J: Class path contains multiple SLF4J bindings. SLF4J: Found binding in [jar:file:/usr/local/kettle/data-integration/launcher/../lib/slf4j-log4j12-1.7.7.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: Found binding in [jar:file:/usr/local/kettle/data-integration/plugins/pentaho-big-data-plugin/lib/slf4j-log4j12-1.7.7.jar!/org/slf4j/impl/StaticLoggerBinder.class] SLF4J: See http://www.slf4j.org/codes.html#multiple_bindings for an explanation. SLF4J: Actual binding is of type [org.slf4j.impl.Log4jLoggerFactory] 2019/07/29 16:12:08 - test - Start of job execution log4j:ERROR No output stream or file set for the appender named [pdi-execution-appender]. 2019/07/29 16:12:08 - test - Starting entry [job1] 2019/07/29 16:12:08 - test - Launched job entry [job1] in parallel. 2019/07/29 16:12:08 - test - Starting entry [job2] 2019/07/29 16:12:08 - test - Launched job entry [job2] in parallel. 2019/07/29 16:12:08 - job2 - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : Error running job entry 'job' : 2019/07/29 16:12:08 - job1 - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : Error running job entry 'job' : 2019/07/29 16:12:08 - job2 - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : org.pentaho.di.core.exception.KettleException: 2019/07/29 16:12:08 - job2 - Unexpected error during job metadata load 2019/07/29 16:12:08 - job2 - at java.lang.Thread.run (Thread.java:748) 2019/07/29 16:12:08 - job2 - at org.pentaho.di.job.Job$1.run (Job.java:798) 2019/07/29 16:12:08 - job2 - at org.pentaho.di.job.Job.access$000 (Job.java:121) 2019/07/29 16:12:08 - job2 - at org.pentaho.di.job.Job.execute (Job.java:680) 2019/07/29 16:12:08 - job2 - at org.pentaho.di.job.entries.job.JobEntryJob.execute (JobEntryJob.java:667) 2019/07/29 16:12:08 - job2 - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta (JobEntryJob.java:1343) 2019/07/29 16:12:08 - job2 - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta (JobEntryJob.java:1381) 2019/07/29 16:12:08 - job2 - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMetaFromRepository (JobEntryJob.java:1353) 2019/07/29 16:12:08 - job2 - 2019/07/29 16:12:08 - job2 - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta(JobEntryJob.java:1421) 2019/07/29 16:12:08 - job2 - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta(JobEntryJob.java:1343) 2019/07/29 16:12:08 - job2 - at org.pentaho.di.job.entries.job.JobEntryJob.execute(JobEntryJob.java:667) 2019/07/29 16:12:08 - job2 - at org.pentaho.di.job.Job.execute(Job.java:680) 2019/07/29 16:12:08 - job2 - at org.pentaho.di.job.Job.access$000(Job.java:121) 2019/07/29 16:12:08 - job2 - at org.pentaho.di.job.Job$1.run(Job.java:798) 2019/07/29 16:12:08 - job2 - at java.lang.Thread.run(Thread.java:748) 2019/07/29 16:12:08 - job2 - Caused by: java.lang.NullPointerException 2019/07/29 16:12:08 - job2 - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMetaFromRepository(JobEntryJob.java:1353) 2019/07/29 16:12:08 - job2 - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta(JobEntryJob.java:1381) 2019/07/29 16:12:08 - job2 - ... 6 more 2019/07/29 16:12:08 - job1 - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : org.pentaho.di.core.exception.KettleException: 2019/07/29 16:12:08 - job1 - Unexpected error during job metadata load 2019/07/29 16:12:08 - job1 - at java.lang.Thread.run (Thread.java:748) 2019/07/29 16:12:08 - job1 - at org.pentaho.di.job.Job$1.run (Job.java:798) 2019/07/29 16:12:08 - job1 - at org.pentaho.di.job.Job.access$000 (Job.java:121) 2019/07/29 16:12:08 - job1 - at org.pentaho.di.job.Job.execute (Job.java:680) 2019/07/29 16:12:08 - job1 - at org.pentaho.di.job.entries.job.JobEntryJob.execute (JobEntryJob.java:667) 2019/07/29 16:12:08 - job1 - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta (JobEntryJob.java:1343) 2019/07/29 16:12:08 - job1 - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta (JobEntryJob.java:1381) 2019/07/29 16:12:08 - job1 - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMetaFromRepository (JobEntryJob.java:1353) 2019/07/29 16:12:08 - job1 - 2019/07/29 16:12:08 - job1 - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta(JobEntryJob.java:1421) 2019/07/29 16:12:08 - job1 - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta(JobEntryJob.java:1343) 2019/07/29 16:12:08 - job1 - at org.pentaho.di.job.entries.job.JobEntryJob.execute(JobEntryJob.java:667) 2019/07/29 16:12:08 - job1 - at org.pentaho.di.job.Job.execute(Job.java:680) 2019/07/29 16:12:08 - job1 - at org.pentaho.di.job.Job.access$000(Job.java:121) 2019/07/29 16:12:08 - job1 - at org.pentaho.di.job.Job$1.run(Job.java:798) 2019/07/29 16:12:08 - job1 - at java.lang.Thread.run(Thread.java:748) 2019/07/29 16:12:08 - job1 - Caused by: java.lang.NullPointerException 2019/07/29 16:12:08 - job1 - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMetaFromRepository(JobEntryJob.java:1353) 2019/07/29 16:12:08 - job1 - at org.pentaho.di.job.entries.job.JobEntryJob.getJobMeta(JobEntryJob.java:1381) 2019/07/29 16:12:08 - job1 - ... 6 more 2019/07/29 16:12:08 - test - Job execution finished 2019/07/29 16:12:08 - Kitchen - Finished! 2019/07/29 16:12:08 - Kitchen - ERROR (version 8.2.0.0-342, build 8.2.0.0-342 from 2018-11-14 10.30.55 by buildguy) : Finished with errors 2019/07/29 16:12:08 - Kitchen - Start=2019/07/29 16:11:36.193, Stop=2019/07/29 16:12:08.071 2019/07/29 16:12:08 - Kitchen - Processing ended after 31 seconds. ``` Linux环境运行作业调用转换的就没问题,作业调用作业的就报错,望大神指点,哪儿有问题。 kettle版本为8.2,jdk版本为 java version "1.8.0_171" 如果需要什么其他的参数,我再上传
kettle输出报错-4229,哪位大神能帮忙看看
2017/11/19 13:04:56 - 表输出.0 - ERROR (version 5.1.0.0, build 1 from 2014-06-19_19-02-57 by buildguy) : Unexpected batch update error committing the database connection. 2017/11/19 13:04:56 - 表输出.0 - ERROR (version 5.1.0.0, build 1 from 2014-06-19_19-02-57 by buildguy) : org.pentaho.di.core.exception.KettleDatabaseBatchException: 2017/11/19 13:04:56 - 表输出.0 - Error updating batch 2017/11/19 13:04:56 - 表输出.0 - [jcc][t4][102][10040][4.19.66] 批处理出现故障。虽然已经提交了批处理,但是该批处理的某个成员至少发生了一个异常。 2017/11/19 13:04:56 - 表输出.0 - 使用 getNextException() 来检索已经过批处理的特定元素的异常。 ERRORCODE=-4229, SQLSTATE=null 2017/11/19 13:04:56 - 表输出.0 - 2017/11/19 13:04:56 - 表输出.0 - at org.pentaho.di.core.database.Database.createKettleDatabaseBatchException(Database.java:1365) 2017/11/19 13:04:56 - 表输出.0 - at org.pentaho.di.core.database.Database.emptyAndCommit(Database.java:1354) 2017/11/19 13:04:56 - 表输出.0 - at org.pentaho.di.trans.steps.tableoutput.TableOutput.dispose(TableOutput.java:571) 2017/11/19 13:04:56 - 表输出.0 - at org.pentaho.di.trans.step.RunThread.run(RunThread.java:96) 2017/11/19 13:04:56 - 表输出.0 - at java.lang.Thread.run(Thread.java:745) 2017/11/19 13:04:56 - 表输出.0 - Caused by: com.ibm.db2.jcc.am.BatchUpdateException: [jcc][t4][102][10040][4.19.66] 批处理出现故障。虽然已经提交了批处理,但是该批处理的某个成员至少发生了一个异常。 2017/11/19 13:04:56 - 表输出.0 - 使用 getNextException() 来检索已经过批处理的特定元素的异常。 ERRORCODE=-4229, SQLSTATE=null 2017/11/19 13:04:56 - 表输出.0 - at com.ibm.db2.jcc.am.kd.a(kd.java:475) 2017/11/19 13:04:56 - 表输出.0 - at com.ibm.db2.jcc.am.Agent.endBatchedReadChain(Agent.java:414) 2017/11/19 13:04:56 - 表输出.0 - at com.ibm.db2.jcc.am.gp.a(gp.java:5342) 2017/11/19 13:04:56 - 表输出.0 - at com.ibm.db2.jcc.am.gp.c(gp.java:4929) 2017/11/19 13:04:56 - 表输出.0 - at com.ibm.db2.jcc.am.gp.executeBatch(gp.java:3045) 2017/11/19 13:04:56 - 表输出.0 - at org.pentaho.di.core.database.Database.emptyAndCommit(Database.java:1341) 2017/11/19 13:04:56 - 表输出.0 - ... 3 more 2017/11/19 13:04:57 - 表输出.0 - 完成处理 (I=0, O=0, R=153, W=0, U=0, E=1 2017/11/19 13:04:57 - mtrl_sum - ERROR (version 5.1.0.0, build 1 from 2014-06-19_19-02-57 by buildguy) : 错误被检测到! 2017/11/19 13:04:57 - Spoon - 转换完成!! 2017/11/19 13:04:57 - mtrl_sum - ERROR (version 5.1.0.0, build 1 from 2014-06-19_19-02-57 by buildguy) : 错误被检测到! 2017/11/19 13:04:57 - mtrl_sum - ERROR (version 5.1.0.0, build 1 from 2014-06-19_19-02-57 by buildguy) : 错误被检测到!
kettle连接SAP hana数据库问题
使用的8.2版本的kettle 根据这篇教程 使用的下面这种方式连接到的SAP https://blog.csdn.net/stone0823/article/details/78629096 ![图片说明](https://img-ask.csdn.net/upload/201908/20/1566267602_155113.png) 但是在表输入中执行在查询的时候报错找不到表 相关查询语句在SAP ST04中测试没问题 ![图片说明](https://img-ask.csdn.net/upload/201908/20/1566268424_374366.png) 获取sql查询语句里看到的表 不是日常在SAP系统中se16n中看到的表 ![图片说明](https://img-ask.csdn.net/upload/201908/20/1566268132_981502.png) 请各位大佬指点 是哪里操作有问题 (怎么标签我看别人有kettle选项,我的就没有..)
JDBC连接hive连接超时
hiveserver2启动了,然后日志也正常,但是用kettle连接或者自己的java代码用jdbc连接都是报错,报错日志如下: java.sql.SQLException: Could not open connection to jdbc:hive2://192.168.162.129:10000/hivedb: java.net.ConnectException: Connection timed out: connect at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:206) at org.apache.hive.jdbc.HiveConnection.<init>(HiveConnection.java:178) at org.apache.hive.jdbc.HiveDriver.connect(HiveDriver.java:105) at java.sql.DriverManager.getConnection(DriverManager.java:582) at java.sql.DriverManager.getConnection(DriverManager.java:185) at com.ljq.hive.HiveJdbcClient.run(HiveJdbcClient.java:21) at com.ljq.hive.HiveJdbcClient.main(HiveJdbcClient.java:46) Caused by: org.apache.thrift.transport.TTransportException: java.net.ConnectException: Connection timed out: connect at org.apache.thrift.transport.TSocket.open(TSocket.java:185) at org.apache.thrift.transport.TSaslTransport.open(TSaslTransport.java:248) at org.apache.thrift.transport.TSaslClientTransport.open(TSaslClientTransport.java:37) at org.apache.hive.jdbc.HiveConnection.openTransport(HiveConnection.java:203) ... 6 more Caused by: java.net.ConnectException: Connection timed out: connect at java.net.PlainSocketImpl.socketConnect(Native Method) at java.net.PlainSocketImpl.doConnect(PlainSocketImpl.java:351) at java.net.PlainSocketImpl.connectToAddress(PlainSocketImpl.java:213) at java.net.PlainSocketImpl.connect(PlainSocketImpl.java:200) at java.net.SocksSocketImpl.connect(SocksSocketImpl.java:366) at java.net.Socket.connect(Socket.java:529) at org.apache.thrift.transport.TSocket.open(TSocket.java:180) ... 9 more error 实在是不知道怎么搞了
Linux下,kettle连接MySQL资源库问题(数据库资源库,非文件资源库)
Linux下,部署完kettle之后,执行“./kitchen.sh”命令,已成功部署。 自动化执行文件如下图: ![图片说明](https://img-ask.csdn.net/upload/201704/28/1493350014_282102.jpg) 启动自动化调度后,报错,如下图: ![图片说明](https://img-ask.csdn.net/upload/201704/28/1493350048_288319.jpg) Processing stopped because of an error: Error connecting to the repository! Error occurred while trying to connect to the database Error connecting to database: (using class org.gjt.mm.mysql.Driver) Communications link failure The last packet sent successfully to the server was 0 milliseconds ago. The driver has not received any packets from the server. ERROR: Kitchen can't continue because the job couldn't be loaded. 注:mysql的jdbc驱动(mysql-connector-java-5.1.15-bin.jar)已经放到了 data-integration\lib下但仍然报错(在网上说这么好用,但是没有效果,还有说放到/app/kettle/data-integration/libext/JDBC目录下的,因为没有此目录,新建后放入此jar包,还是不管用),望大神赐教
kettle生产环境hive到mysql连接出错
1.kettle做数据转换 从hive到mysql,本地spoon.bat开发运行正常,上传到linux下用kitchen.sh执行不报错但是会卡住,debug模式下日志如图。 2.做了单个测试,job转换中只连接mysql执行个查询可以,或者只连接hive执行查询语句也可以。但是同时将两个步骤放到一个转换里 就出现跟上面一样的问题 ![图片说明](https://img-ask.csdn.net/upload/201910/30/1572405694_49226.jpg) na位路过的大佬帮忙看下。
kettle配置连接mysql数据库已测可以通,但是后续获取字段步骤时就会卡住,也没报错信息
![图片说明](https://img-ask.csdn.net/upload/201910/30/1572402204_219510.png)mysql版本5.7,百度了这个版本的mysql连接OK的。表输入,也可以预览到具体数据。![图片说明](https://img-ask.csdn.net/upload/201910/30/1572402436_13799.png) 预览数据:![图片说明](https://img-ask.csdn.net/upload/201910/30/1572402884_737902.png)
Kafka实战(三) - Kafka的自我修养与定位
Apache Kafka是消息引擎系统,也是一个分布式流处理平台(Distributed Streaming Platform) Kafka是LinkedIn公司内部孵化的项目。LinkedIn最开始有强烈的数据强实时处理方面的需求,其内部的诸多子系统要执行多种类型的数据处理与分析,主要包括业务系统和应用程序性能监控,以及用户行为数据处理等。 遇到的主要问题: 数据正确性不足 数据的收集主要...
volatile 与 synchronize 详解
Java支持多个线程同时访问一个对象或者对象的成员变量,由于每个线程可以拥有这个变量的拷贝(虽然对象以及成员变量分配的内存是在共享内存中的,但是每个执行的线程还是可以拥有一份拷贝,这样做的目的是加速程序的执行,这是现代多核处理器的一个显著特性),所以程序在执行过程中,一个线程看到的变量并不一定是最新的。 volatile 关键字volatile可以用来修饰字段(成员变量),就是告知程序任何对该变量...
Java学习的正确打开方式
在博主认为,对于入门级学习java的最佳学习方法莫过于视频+博客+书籍+总结,前三者博主将淋漓尽致地挥毫于这篇博客文章中,至于总结在于个人,实际上越到后面你会发现学习的最好方式就是阅读参考官方文档其次就是国内的书籍,博客次之,这又是一个层次了,这里暂时不提后面再谈。博主将为各位入门java保驾护航,各位只管冲鸭!!!上天是公平的,只要不辜负时间,时间自然不会辜负你。 何谓学习?博主所理解的学习,它是一个过程,是一个不断累积、不断沉淀、不断总结、善于传达自己的个人见解以及乐于分享的过程。
程序员必须掌握的核心算法有哪些?
由于我之前一直强调数据结构以及算法学习的重要性,所以就有一些读者经常问我,数据结构与算法应该要学习到哪个程度呢?,说实话,这个问题我不知道要怎么回答你,主要取决于你想学习到哪些程度,不过针对这个问题,我稍微总结一下我学过的算法知识点,以及我觉得值得学习的算法。这些算法与数据结构的学习大多数是零散的,并没有一本把他们全部覆盖的书籍。下面是我觉得值得学习的一些算法以及数据结构,当然,我也会整理一些看过...
有哪些让程序员受益终生的建议
从业五年多,辗转两个大厂,出过书,创过业,从技术小白成长为基层管理,联合几个业内大牛回答下这个问题,希望能帮到大家,记得帮我点赞哦。 敲黑板!!!读了这篇文章,你将知道如何才能进大厂,如何实现财务自由,如何在工作中游刃有余,这篇文章很长,但绝对是精品,记得帮我点赞哦!!!! 一腔肺腑之言,能看进去多少,就看你自己了!!! 目录: 在校生篇: 为什么要尽量进大厂? 如何选择语言及方...
大学四年自学走来,这些私藏的实用工具/学习网站我贡献出来了
大学四年,看课本是不可能一直看课本的了,对于学习,特别是自学,善于搜索网上的一些资源来辅助,还是非常有必要的,下面我就把这几年私藏的各种资源,网站贡献出来给你们。主要有:电子书搜索、实用工具、在线视频学习网站、非视频学习网站、软件下载、面试/求职必备网站。 注意:文中提到的所有资源,文末我都给你整理好了,你们只管拿去,如果觉得不错,转发、分享就是最大的支持了。 一、电子书搜索 对于大部分程序员...
linux系列之常用运维命令整理笔录
本博客记录工作中需要的linux运维命令,大学时候开始接触linux,会一些基本操作,可是都没有整理起来,加上是做开发,不做运维,有些命令忘记了,所以现在整理成博客,当然vi,文件操作等就不介绍了,慢慢积累一些其它拓展的命令,博客不定时更新 free -m 其中:m表示兆,也可以用g,注意都要小写 Men:表示物理内存统计 total:表示物理内存总数(total=used+free) use...
比特币原理详解
一、什么是比特币 比特币是一种电子货币,是一种基于密码学的货币,在2008年11月1日由中本聪发表比特币白皮书,文中提出了一种去中心化的电子记账系统,我们平时的电子现金是银行来记账,因为银行的背后是国家信用。去中心化电子记账系统是参与者共同记账。比特币可以防止主权危机、信用风险。其好处不多做赘述,这一层面介绍的文章很多,本文主要从更深层的技术原理角度进行介绍。 二、问题引入 假设现有4个人...
GitHub开源史上最大规模中文知识图谱
近日,一直致力于知识图谱研究的 OwnThink 平台在 Github 上开源了史上最大规模 1.4 亿中文知识图谱,其中数据是以(实体、属性、值),(实体、关系、实体)混合的形式组织,数据格式采用 csv 格式。 到目前为止,OwnThink 项目开放了对话机器人、知识图谱、语义理解、自然语言处理工具。知识图谱融合了两千五百多万的实体,拥有亿级别的实体属性关系,机器人采用了基于知识图谱的语义感...
程序员接私活怎样防止做完了不给钱?
首先跟大家说明一点,我们做 IT 类的外包开发,是非标品开发,所以很有可能在开发过程中会有这样那样的需求修改,而这种需求修改很容易造成扯皮,进而影响到费用支付,甚至出现做完了项目收不到钱的情况。 那么,怎么保证自己的薪酬安全呢? 我们在开工前,一定要做好一些证据方面的准备(也就是“讨薪”的理论依据),这其中最重要的就是需求文档和验收标准。一定要让需求方提供这两个文档资料作为开发的基础。之后开发...
网页实现一个简单的音乐播放器(大佬别看。(⊙﹏⊙))
今天闲着无事,就想写点东西。然后听了下歌,就打算写个播放器。 于是乎用h5 audio的加上js简单的播放器完工了。 演示地点演示 html代码如下` music 这个年纪 七月的风 音乐 ` 然后就是css`*{ margin: 0; padding: 0; text-decoration: none; list-...
微信支付崩溃了,但是更让马化腾和张小龙崩溃的竟然是……
loonggg读完需要3分钟速读仅需1分钟事件还得还原到昨天晚上,10 月 29 日晚上 20:09-21:14 之间,微信支付发生故障,全国微信支付交易无法正常进行。然...
Python十大装B语法
Python 是一种代表简单思想的语言,其语法相对简单,很容易上手。不过,如果就此小视 Python 语法的精妙和深邃,那就大错特错了。本文精心筛选了最能展现 Python 语法之精妙的十个知识点,并附上详细的实例代码。如能在实战中融会贯通、灵活使用,必将使代码更为精炼、高效,同时也会极大提升代码B格,使之看上去更老练,读起来更优雅。
数据库优化 - SQL优化
以实际SQL入手,带你一步一步走上SQL优化之路!
2019年11月中国大陆编程语言排行榜
2019年11月2日,我统计了某招聘网站,获得有效程序员招聘数据9万条。针对招聘信息,提取编程语言关键字,并统计如下: 编程语言比例 rank pl_ percentage 1 java 33.62% 2 cpp 16.42% 3 c_sharp 12.82% 4 javascript 12.31% 5 python 7.93% 6 go 7.25% 7 p...
通俗易懂地给女朋友讲:线程池的内部原理
餐盘在灯光的照耀下格外晶莹洁白,女朋友拿起红酒杯轻轻地抿了一小口,对我说:“经常听你说线程池,到底线程池到底是个什么原理?”
《奇巧淫技》系列-python!!每天早上八点自动发送天气预报邮件到QQ邮箱
将代码部署服务器,每日早上定时获取到天气数据,并发送到邮箱。 也可以说是一个小型人工智障。 知识可以运用在不同地方,不一定非是天气预报。
经典算法(5)杨辉三角
杨辉三角 是经典算法,这篇博客对它的算法思想进行了讲解,并有完整的代码实现。
英特尔不为人知的 B 面
从 PC 时代至今,众人只知在 CPU、GPU、XPU、制程、工艺等战场中,英特尔在与同行硬件芯片制造商们的竞争中杀出重围,且在不断的成长进化中,成为全球知名的半导体公司。殊不知,在「刚硬」的背后,英特尔「柔性」的软件早已经做到了全方位的支持与支撑,并持续发挥独特的生态价值,推动产业合作共赢。 而对于这一不知人知的 B 面,很多人将其称之为英特尔隐形的翅膀,虽低调,但是影响力却不容小觑。 那么,在...
腾讯算法面试题:64匹马8个跑道需要多少轮才能选出最快的四匹?
昨天,有网友私信我,说去阿里面试,彻底的被打击到了。问了为什么网上大量使用ThreadLocal的源码都会加上private static?他被难住了,因为他从来都没有考虑过这个问题。无独有偶,今天笔者又发现有网友吐槽了一道腾讯的面试题,我们一起来看看。 腾讯算法面试题:64匹马8个跑道需要多少轮才能选出最快的四匹? 在互联网职场论坛,一名程序员发帖求助到。二面腾讯,其中一个算法题:64匹...
面试官:你连RESTful都不知道我怎么敢要你?
干货,2019 RESTful最贱实践
刷了几千道算法题,这些我私藏的刷题网站都在这里了!
遥想当年,机缘巧合入了 ACM 的坑,周边巨擘林立,从此过上了"天天被虐似死狗"的生活… 然而我是谁,我可是死狗中的战斗鸡,智力不够那刷题来凑,开始了夜以继日哼哧哼哧刷题的日子,从此"读题与提交齐飞, AC 与 WA 一色 ",我惊喜的发现被题虐既刺激又有快感,那一刻我泪流满面。这么好的事儿作为一个正直的人绝不能自己独享,经过激烈的颅内斗争,我决定把我私藏的十几个 T 的,阿不,十几个刷题网...
为啥国人偏爱Mybatis,而老外喜欢Hibernate/JPA呢?
关于SQL和ORM的争论,永远都不会终止,我也一直在思考这个问题。昨天又跟群里的小伙伴进行了一番讨论,感触还是有一些,于是就有了今天这篇文。 声明:本文不会下关于Mybatis和JPA两个持久层框架哪个更好这样的结论。只是摆事实,讲道理,所以,请各位看官勿喷。 一、事件起因 关于Mybatis和JPA孰优孰劣的问题,争论已经很多年了。一直也没有结论,毕竟每个人的喜好和习惯是大不相同的。我也看...
白话阿里巴巴Java开发手册高级篇
不久前,阿里巴巴发布了《阿里巴巴Java开发手册》,总结了阿里巴巴内部实际项目开发过程中开发人员应该遵守的研发流程规范,这些流程规范在一定程度上能够保证最终的项目交付质量,通过在时间中总结模式,并推广给广大开发人员,来避免研发人员在实践中容易犯的错误,确保最终在大规模协作的项目中达成既定目标。 无独有偶,笔者去年在公司里负责升级和制定研发流程、设计模板、设计标准、代码标准等规范,并在实际工作中进行...
SQL-小白最佳入门sql查询一
不要偷偷的查询我的个人资料,即使你再喜欢我,也不要这样,真的不好;
项目中的if else太多了,该怎么重构?
介绍 最近跟着公司的大佬开发了一款IM系统,类似QQ和微信哈,就是聊天软件。我们有一部分业务逻辑是这样的 if (msgType = "文本") { // dosomething } else if(msgType = "图片") { // doshomething } else if(msgType = "视频") { // doshomething } else { // doshom...
Nginx 原理和架构
Nginx 是一个免费的,开源的,高性能的 HTTP 服务器和反向代理,以及 IMAP / POP3 代理服务器。Nginx 以其高性能,稳定性,丰富的功能,简单的配置和低资源消耗而闻名。 Nginx 的整体架构 Nginx 里有一个 master 进程和多个 worker 进程。master 进程并不处理网络请求,主要负责调度工作进程:加载配置、启动工作进程及非停升级。worker 进程负责处...
YouTube排名第一的励志英文演讲《Dream(梦想)》
Idon’t know what that dream is that you have, I don't care how disappointing it might have been as you've been working toward that dream,but that dream that you’re holding in your mind, that it’s po...
“狗屁不通文章生成器”登顶GitHub热榜,分分钟写出万字形式主义大作
一、垃圾文字生成器介绍 最近在浏览GitHub的时候,发现了这样一个骨骼清奇的雷人项目,而且热度还特别高。 项目中文名:狗屁不通文章生成器 项目英文名:BullshitGenerator 根据作者的介绍,他是偶尔需要一些中文文字用于GUI开发时测试文本渲染,因此开发了这个废话生成器。但由于生成的废话实在是太过富于哲理,所以最近已经被小伙伴们给玩坏了。 他的文风可能是这样的: 你发现,...
程序员:我终于知道post和get的区别
是一个老生常谈的话题,然而随着不断的学习,对于以前的认识有很多误区,所以还是需要不断地总结的,学而时习之,不亦说乎
相关热词 c# 二进制截断字符串 c#实现窗体设计器 c#检测是否为微信 c# plc s1200 c#里氏转换原则 c# 主界面 c# do loop c#存为组套 模板 c# 停掉协程 c# rgb 读取图片
立即提问