...
- json.write.metadata: Dumps the metadata
- json.write.starttimestamp: Adds the starttimestamp to the key value object under the given key
- json.write.endtimestamp: Adds the endtimestamp to the key value object under the given key
- schema: Due to the principles of key value data no schema is needed. But you can define a JSON element, which should be used as STARTTIMESTAMP or ENDTIMESTAMP.
Example
PQL
Code Block | ||||||
---|---|---|---|---|---|---|
| ||||||
json = ACCESS({
source='json',
wrapper='GenericPull',
transport='File',
protocol='JSON',
dataHandler='KeyValueObject',
options=[['filename','scrobbles-2006-10.json']]
/// schema=[['timestamp','STARTTIMESTAMP']]
}) |
Code Block | ||||||
---|---|---|---|---|---|---|
| ||||||
SENDERjson = SENDER({ transport='File', wrapper='GenericPush', protocol='JSON', dataHandler='KeyValueObject', SINK="SENDERjson", options=[ ['filename','${WORKSPACEPROJECT}\testdata\tupletokeyvalue\output.json'], ['json.write.metadata','true'], ['json.write.starttimestamp','metadata.starttimestamp'], ['json.write.endtimestamp','metadata.endtimestamp'] ]}, tupletokeyvalue0) |
...