The following question come up regarding 'Character Encoding' error on FlatFileReader component.
As far as i see, if its encounter with 'character encoding' problem, its stops.
Example error message:
'Error when parsing record #22746 field XYZ
Character decoding error occurred. Set correct charset. Current charset is windows-1257'
I know, charset need to be okay. But in real life, sometimes not okay... :(
Question 1.) Its stops even it set to 'Controlled mode' (and not sent to the 'error' port)
Even its stop when the 'Data policy' for FlatFileReader set to 'Controlled', it's not send out to the 'Error' port.
But may some case its can be good to pass thru, to know the 'rows', where problem detected.
Its any way to pass thru this rows on Error port (in 'Controlled mode') ?
Question 2.) If i set the FlatFilereader 'Data Policy' to 'Lenient' (in this char encoding case) - What happen?
But what happen exactly?
As i see, all the rows 'pass thru', and its try to do charset decoding anyhow ('forced')
Note: the help not provide too much info regarding lenient mode: ('Lenient. This data policy means that incorrect records are only skipped and data parsing continues.') ...
For example, in 'char encoding problem' case its definitely not skip the record (but may it's good in this case)...