java - Kettle(PDI) 中出现 StackOverFlow 错误

Question

大家，当我用kettle做循环时，出现了错误，kettle的内存是8G，我用了几百次循环，Kettle循环了1500次，当循环次数到700次左右时出现错误，请问如何解决解决它

ERROR (version 5.0.1-stable, build 1 from 2013-11-15_16-08-58 by buildguy) : java.lang.StackOverflowError
   at java.io.UnixFileSystem.getBooleanAttributes0(Native Method)
   at java.io.UnixFileSystem.getBooleanAttributes(UnixFileSystem.java:242)
   at java.io.File.exists(File.java:772)
   at sun.misc.URLClassPath$FileLoader.getResource(URLClassPath.java:1057)
   at sun.misc.URLClassPath$FileLoader.findResource(URLClassPath.java:1024)
   at sun.misc.URLClassPath.findResource(URLClassPath.java:172)
   at java.net.URLClassLoader$2.run(URLClassLoader.java:551)
   at java.net.URLClassLoader$2.run(URLClassLoader.java:549)
   at java.security.AccessController.doPrivileged(Native Method)
   at java.net.URLClassLoader.findResource(URLClassLoader.java:548)
   at java.lang.ClassLoader.getResource(ClassLoader.java:1138)
   at java.net.URLClassLoader.getResourceAsStream(URLClassLoader.java:227)
   at org.apache.xerces.parsers.SecuritySupport$6.run(Unknown Source)
   at java.security.AccessController.doPrivileged(Native Method)
   at org.apache.xerces.parsers.SecuritySupport.getResourceAsStream(Unknown Source)
   at org.apache.xerces.parsers.ObjectFactory.findJarServiceProvider(Unknown Source)
   at org.apache.xerces.parsers.ObjectFactory.createObject(Unknown Source)
   at org.apache.xerces.parsers.ObjectFactory.createObject(Unknown Source)
   at org.apache.xerces.parsers.DOMParser.<init>(Unknown Source)
   at org.apache.xerces.parsers.DOMParser.<init>(Unknown Source)
   at org.apache.xerces.jaxp.DocumentBuilderImpl.<init>(Unknown Source)
   at org.apache.xerces.jaxp.DocumentBuilderFactoryImpl.newDocumentBuilder(Unknown Source)
   at org.pentaho.di.core.xml.XMLHandler.loadXMLFile(XMLHandler.java:553)
   at org.pentaho.di.core.xml.XMLHandler.loadXMLFile(XMLHandler.java:515)
   at org.pentaho.di.core.xml.XMLHandler.loadXMLFile(XMLHandler.java:501)
   at org.pentaho.di.trans.TransMeta.<init>(TransMeta.java:2797)
   at org.pentaho.di.trans.TransMeta.<init>(TransMeta.java:2774)
   at org.pentaho.di.trans.TransMeta.<init>(TransMeta.java:2759)
   at org.pentaho.di.job.entries.trans.JobEntryTrans.getTransMeta(JobEntryTrans.java:1166)
   at org.pentaho.di.job.entries.trans.JobEntryTrans.execute(JobEntryTrans.java:634)
   at org.pentaho.di.job.Job.execute(Job.java:678)
   at org.pentaho.di.job.Job.execute(Job.java:815)
   at org.pentaho.di.job.Job.execute(Job.java:815)
   at org.pentaho.di.job.Job.execute(Job.java:815)

Answer 1

我不是 Kettle 方面的专家。但是，StackOverflowError 并不是由内存不足引起的，因此您拥有 8Gb 堆的事实并不直接相关。相关的是线程堆栈的大小。这是由 java 命令的 -Xss 命令行选项控制的。

我也不知道你在 Kettle 上下文中所说的“循环”是什么意思……而且 Google 没有帮助我。但是，我猜想这与导致其他作业运行的作业有关。由于您达到了 ~700 的限制并且需要达到 ~1500，因此您可能需要将当前线程堆栈大小增加三倍......无论是什么。