Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

The JSON protocol handler parses JSON documents.

Options

...

  • json.write.metadata: Dumps the metadata
  • json.write.starttimestamp: Adds the starttimestamp to the key value object under the given key
  • json.write.endtimestamp: Adds the endtimestamp to the key value object under the given key
  • schema: Due to the principles of key value data no schema is needed. But you can define a JSON element, which should be used as STARTTIMESTAMP or ENDTIMESTAMP.

Example

PQL

theme
Code Block
Eclipselanguagejavascriptpql
titleJSON Protocol HandlerJSONProtocolHandler
linenumberstrue
inputjson = ACCESS({
    source='JSONjson', 
    wrapper='GenericPushGenericPull',
    transport='File',
    protocol='JSON',
    dataHandler='TupleKeyValueObject',   
    options=[['filename','scrobbles-2006-10.json']]
/// schema=[['timestamp','STARTTIMESTAMP'], ['timestamp2','ENDTIMESTAMP']] /// only used for definition of START- or ENDTIMESTAMP
})
Code Block
languagepql
titleJSONProtocolHandler
linenumberstrue
SENDERjson = SENDER({ 
    transport='File', 
  schema=[    wrapper='GenericPush', 
    protocol='JSON', 
    dataHandler='KeyValueObject', 
    SINK="SENDERjson", 
    options=[ 
        ['symbol'filename','${WORKSPACEPROJECT}\testdata\tupletokeyvalue\output.json'], 
        ['json.write.metadata','Stringtrue'],
        ['pointsjson.write.starttimestamp','Double'] ]
})metadata.starttimestamp'], 
        ['json.write.endtimestamp','metadata.endtimestamp'] 
    ]}, tupletokeyvalue0)

 

CQL

Code Block
themeEclipse
languagesqlcql
titleJSON Protocol Handler
linenumberstrue
CREATE STREAM line (symbol String, points Double)   
    WRAPPER 'GenericPush'
    PROTOCOL 'JSON'
    TRANSPORT 'File'
    DATAHANDLER 'Tuple'