[#5132] - java OutOfMemoryError exporting table rows to a CSV file (tFileOutputMSDelimited)

Category:
Bug report
Priority:
High
Status:
Assigned
Project: Severity:
Critical
Resolution:
Open
Component: Reproducibility:
Always
Assigned to:
0

I am trying to export a couple million lines from a DB2 table to a csv file (tFileOutputMSDelimited), but keep getting a java OutOfMemoryError after about 600K lines.
I tried with the default of -Xmx1024M, then with -Xmx1536M (in Talend -> Run/Debug -> "Job run VM arguments"); also tried to disable statistics, but I always get the error.
Is JasperETL trying to keep everything in memory?
This is a BAD limitation, any serious ETL product should be able to export tens of millions of rows without problems.

cris70's picture
5
Joined: Feb 22 2011 - 4:47am
Last seen: 4 days 23 hours ago
Feedback
randomness