fix: Improve field access safety and duration parsing to prevent runtime exceptions

[cyberflying]

Purpose

• Refactored data processing scripts to improve error handling and code robustness.

• Use get_field_value() helper function for safer field access to avoid KeyError exceptions
• Add try-except block for duration parsing to handle ValueError and TypeError gracefully
• Default to 0 when duration field is missing or contains invalid data

Does this introduce a breaking change?

• Yes
• No

Golden Path Validation

• I have tested the primary workflows (the "golden path") to ensure they function correctly without errors.

Deployment Validation

• I have validated the deployment process successfully and all services are running as expected with this change.

What to Check

Verify that the following are valid

• ...

Other Information