Category: | Bug report |
Priority: | High |
Status: | Assigned |
Project: | Severity: | Critical |
Resolution: | Open |
|
Component: | Reproducibility: | Always |
Assigned to: |
I am trying to export a couple million lines from a DB2 table to a csv file (tFileOutputMSDelimited), but keep getting a java OutOfMemoryError after about 600K lines.
I tried with the default of -Xmx1024M, then with -Xmx1536M (in Talend -> Run/Debug -> "Job run VM arguments"); also tried to disable statistics, but I always get the error.
Is JasperETL trying to keep everything in memory?
This is a BAD limitation, any serious ETL product should be able to export tens of millions of rows without problems.