No Status

Vast Sized File split up for data processing.

  • 28 November 2019
  • 3 replies
  • 108 views

Userlevel 1
Badge

Earlier when we get the huge sized files from S3 connectors, the data processing through rules become too slow and for time being the files were manually splitted up. So current idea is to create a File splitter option in connector to automate the splitting process based on our requirement. 


3 replies

Userlevel 3
Badge

Even we face this issue during initial stages of onboarding , it will be really help full if we implement this in our product.

Userlevel 7
Badge

Hi Satya - how big of a file size are you having issues with?

Userlevel 1
Badge

We faced issue with the files having 700-800MB size.

Reply