Can defaultProperties file into high, medium and low three m

Can defaultProperties file into high, medium and low three models of samples,eg. MySQL database my.cnf file. my-small.ini ,my-medium.ini,my-large.ini

Hello, I’m not sure if I understand your question. Could you please show me an example of what you want to accomplish?

Thanks!
Jaro

Need to read/write arbitrary size blob types,Depending on the memory demand, optimizing different configuration file.
eg.

jvm configure -Xmx100M
The contents of the defaultProperties-low is

Record.MAX_RECORD_SIZE = 8192
Record.DEFAULT_COMPRESSION_LEVEL=5
DataParser.FIELD_BUFFER_LENGTH = 512
DataFormatter.FIELD_BUFFER_LENGTH = 512
DEFAULT_INTERNAL_IO_BUFFER_SIZE = 32768
DEFAULT_IOSTREAM_CHANNEL_BUFFER_SIZE = 2048

jvm configure -Xmx512M
The contents of the defaultProperties-medium is

Record.MAX_RECORD_SIZE =
Record.DEFAULT_COMPRESSION_LEVEL=
DataParser.FIELD_BUFFER_LENGTH =
DataFormatter.FIELD_BUFFER_LENGTH =
DEFAULT_INTERNAL_IO_BUFFER_SIZE =
DEFAULT_IOSTREAM_CHANNEL_BUFFER_SIZE =

jvm configure -Xmx1024M
The contents of the defaultProperties-high is

Record.MAX_RECORD_SIZE =
Record.DEFAULT_COMPRESSION_LEVEL=
DataParser.FIELD_BUFFER_LENGTH =
DataFormatter.FIELD_BUFFER_LENGTH =
DEFAULT_INTERNAL_IO_BUFFER_SIZE =
DEFAULT_IOSTREAM_CHANNEL_BUFFER_SIZE =

So you want to edit the configuration file depending on the value of the -Xmx parameter of JVM? Or do you want to do the opposite, depending on the configuration file you want to set the -Xmx parameter?

depending on the configuration file , to set the -Xmx parameter,edit configuration file to achieve the demand.

what do you run with the jvm command? If Clover then it’s not possible to automatically set the -Xmx parameter before clover even starts.

jvm command Parameters from the application I installed,Runtime can specify the use of defaultProperties configuration files which. :slight_smile:

Sorry, I don’t understand. Who runs the jvm command? Do you run it from the SYSTEM_EXECUTE component of clover?

Jaro

Jdk1.5.0_04\jre\bin\java -Xmx1024m -Xms512m org.jetel.main.runGraph.java graphFileName defaultPropertiesFileName

if you want to change the -Xmx parameter in the command you specified depending on the content of the defaultPropertiesFile, then it’s not possible.

Operational procedures, I can according to the different demands and will defaultproperties document, the document put cloveretl.engine.jar org.jetel.data directory.

The values of the defaultProperties don’t have a significant impact on the memory requirements of Clover. So you don’t need to set the -Xmx parameter based on the values of the properties.

Of course more memory available to Clover is better, because the garbage collector can run less often.

I need from the file / database input/output to a binary field,eg. blob type field.
The actual contents of this field is the size of 2 M or greater M, I need to edit defaultProperties content of the document, but the contents of this document directly affects the engine running effect. So the best is to provide an optimal configuration.

I’m sorry, but I’m unable to understand your question.

Jaro

I want to bring the 10 M from the database BLOB field guide to the delimited text, then the delimited text Introduction to database failure. Can you relate to the configuration file of all parameters and values to me

Hi !

For working with BLOBs (assuming field lengths of 8KB an more), you may use following configuration:

Record.MAX_RECORD_SIZE = 65536
DataParser.FIELD_BUFFER_LENGTH = 32768
DataFormatter.FIELD_BUFFER_LENGTH = 32768
DEFAULT_INTERNAL_IO_BUFFER_SIZE = 131072

This should be ok for record sizes up to 65KBs. You may consider using CBYTE field (compressed byte field) for carrying large fields.

David.

I derived the content of a blob field types into a separation text,the content of this blog field was stored by jpg document or pdf document.
then take the contents of the documents into the target data table, we found a problem when reading documents, the problem is primarily reflected in DATA_READER read string,encountered ??) Exif or %PDF -1.3% Had problems.

step 1: DB_INPUT_TABLE → DATA_WRITER
step 2: DATA_READER → DB_OUTPUT_TABLE

If you just need to move data from one DB to other, try to use CLOVER_DATA_WRITER & CLOVER_DATA_READER (with the adjusted Defaults). These two work with data in binary(Clover native) form.

Thank you very much help, the problem has been resolved.