Add option ignore_malformed_files

[abriel]

Hi,

CloudTrail creates CouldTrail-Digest files in the same bucket.
That files don't have 'Records' key
and we get Error: undefined methodeach' for nil:NilClass"`.
It can be solved by tuning s3 input settings,
but can we add the option to skip malformed files?

Thanks,

[cdenneen]

👍 Haven't experienced this issue until this week when we enabled CloudTrail logging for new region.
Other regions never created this CloudTrail-Digest folder, not sure how to "disable" it which would fix this.
@abriel not sure if you used the exclude_pattern for input?