Versions Compared

Key

  • This line was added.
  • This line was removed.
  • Formatting was changed.

The HTTP transport handler allows the communication over the HTTP standard.

Options

  • uri: The URI
  • method: The HTTP method, one of: GET, POST, PUT, DELETE, HEAD (default: GET) (optional)
  • body: The content for POST and PUT requests when using this transport handler for a source (optional)
  • chunked: Controls the 'chunked' header (see Chunked transfer encoding). (default: true) (optional)
  • scheduler.delay: If you want to query in a given time-interval. The unit are milliseconds.
  • oneDocPerCall: If set to false, the transport handler assumes an endless stream. If set to false, assumes whole documents per call

Example

PQL

Code Block
languagejavascript
themeEclipse
titleHTTP Transport Handler
linenumberstrue
input = ACCESS({source='Source',
wrapper='GenericPull',
transport='HTTP',
protocol='CSV',
dataHandler='Tuple',
options=[['uri', 'http://www.example.com'], ['method', 'get']],
schema=[
['id', 'Double'],
['data', 'String']]
})

output = SENDER({sink='Sink',
wrapper='GenericPush',
transport='HTTP',
protocol='CSV',
dataHandler='Tuple',
options=[['uri', 'http://www.example.com'], ['method', 'post']]
}, input)


/// Example for the scheduler.delay option
#PARSER PQL
#ADDQUERY
 finance2 =  ACCESS({
                  source='Google',
                  wrapper='GenericPull',
                  transport='HTTP',
                  protocol='Document',
                  datahandler='Document',
                  options=[
                    ['uri', 'http://google.de'],
                    ['scheduler.delay','1000'],
                    ['oneDocPerCall','true'],
                    ['contentType','application/json']
                  ]                                                               
                }                                                     
              ) 

CQL

Code Block
languagesql
themeEclipse
titleHTTP Transport Handler
linenumberstrue
CREATE STREAM source (id Double, data STRING)
    WRAPPER 'GenericPush'
    PROTOCOL 'CSV'
    TRANSPORT 'HTTP'
    DATAHANDLER 'Tuple'
    OPTIONS ( 'uri' 'http://www.example.com' 'method' 'get')


CREATE SINK sink (id Double, data STRING)
    WRAPPER 'GenericPush'
    PROTOCOL 'CSV'
    TRANSPORT 'HTTP'
    DATAHANDLER 'Tuple'
    OPTIONS ( 'uri' 'http://www.example.com' 'method' 'post')