Features

List of features that you can use

List of available features that you can enable during the installation

NameDescriptionComponant
use_xml_documentAdd the possibility to read and write xml documentsdocument/xml
use_toml_documentAdd the possibility to read and write toml documentsdocument/toml
use_csv_documentAdd the possibility to read and write csv documentsdocument/csv
use_bucket_connectorAdd the possibility to read and write documents with bucket minio/s3connector/bucket et connector/bucket_select
use_curl_connectorAdd the possibility to read and write documents with APIsconnector/curl
use_mongodb_connectorAdd the possibility to read and write documents with mongodbconnector/mongodb
tracing/release_max_level_[LOG_LEVEL]Enable log level, LOG_LEVEL: [ off / error / warn / info / debug / trace ]-

Example of command in order to add features

cargo install chewdata --no-default-features --features "use_xml_document use_bucket_connector"

Custom the log level

If you need to change the log level of the command, you need to define it during the installation Display info logs and highest severities

cargo install chewdata --no-default-features --features "tracing/release_max_level_info"
echo '{"field1":"value1"}' | RUST_LOG=trace chewdata '[{"type":"reader","document":{"type":"json"},"connector":{"type":"io"}},{"type":"writer","document":{"type":"json"},"connector":{"type":"io"}}]'

Display trace logs and highest severities

cargo install chewdata --no-default-features --features "tracing/release_max_level_trace"
echo '{"field1":"value1"}' | RUST_LOG=trace chewdata '[{"type":"reader","document":{"type":"json"},"connector":{"type":"io"}},{"type":"writer","document":{"type":"json"},"connector":{"type":"io"}}]'

If you want to filter logs, you can use the directive syntax from tracing_subscriber

cargo install chewdata --no-default-features --features "tracing/release_max_level_trace"
echo '{"field1":"value1"}' | RUST_LOG=chewdata=trace chewdata '[{"type":"reader","document":{"type":"json"},"connector":{"type":"io"}},{"type":"writer","document":{"type":"json"},"connector":{"type":"io"}}]'