Vast Sized File split up for data processing.

Related products: None

Earlier when we get the huge sized files from S3 connectors, the data processing through rules become too slow and for time being the files were manually splitted up. So current idea is to create a File splitter option in connector to automate the splitting process based on our requirement. 

Hi Satya - how big of a file size are you having issues with?


We faced issue with the files having 700-800MB size.


Even we face this issue during initial stages of onboarding , it will be really help full if we implement this in our product.