The directory watcher transport handler allows to watch a directory and process modification and creation of files
directory:
The directoryfilter
: The file filter (optional)input = ACCESS({source='Source', wrapper='GenericPush', transport='Directory', protocol='CSV', dataHandler='Tuple', options=[['directory', '/src/odysseus'], ['filter', '.txt$']], schema=[ ['id', 'Double'], ['data', 'String']] }) |
CREATE STREAM source (id Double, data String) WRAPPER 'GenericPush' PROTOCOL 'CSV' TRANSPORT 'Directory' DATAHANDLER 'Tuple' OPTIONS ( 'filename' '/src/odysseus') |