Troubleshooting Data Integration

Contents:

Troubleshooting issues with Pentaho Data Integration and its components: spoon, pan, kitchen.

"Communications link failure due to underlying exception"

This is normally due to a problem in communicating the the database. You may also see java.io.EOFException errors.

There are several possible causes.

Network

A bad network connection can disrupt traffic flow. Make sure that the connection is good. Poor network drivers or network hardware may fail on large transfers of data. Test by making a large file transfer across the network.

Database

The database may not be accepting any more connections, or the connections are timing out. It may have exhausted its quota.

Check to see if the database is still running, and that a port is open to accept connections. If the underlying operating system has run out of memory, the database may have been killed.

When streaming result sets are open and in use on a given connection, no new queries can be made.

You can ensure unique connections to the database in Spoon:

  1. open the Transformation properties
  2. go to the Miscellaneous tab
  3. tick "Make the transaction database transactional"

MySQL

Refer to the MySQL page on the Pentaho wiki.

Switch off "Use result streaming cursor". This will force data to be loaded and written in one go, instead of being streamed.

Resources

Creator: Sridhar Dhanapalan on 2009/10/29 12:14
XWiki Enterprise 1.7.2.16857 - Documentation