Update deprecated pad_to_max_length argument in tokenization pipeline

[spinola103]

Description

While running EduAid locally, warnings appear from the HuggingFace Transformers library related to deprecated parameters used in the tokenization pipeline.

The following warning is shown during execution:

FutureWarning: The pad_to_max_length argument is deprecated and will be removed in future versions.

The current implementation uses:

pad_to_max_length=True

This parameter has been deprecated and should be replaced with the newer argument format recommended by the Transformers library.

Expected Behavior

Tokenization should use the updated padding parameter recommended by the Transformers library.

Current Behavior

The code currently uses deprecated arguments which trigger warnings during execution.

Proposed Improvement

Replace the deprecated parameter:

pad_to_max_length=True

with the updated format:

padding='max_length'

This will align the codebase with the latest Transformers API.

Benefits

• removes deprecation warnings
• ensures compatibility with future Transformers versions
• improves long-term maintainability of the codebase

[mahek2016]

Hi 👋

I’d like to work on updating the deprecated pad_to_max_length parameter to the new padding='max_length' format.

I’ll ensure compatibility across all affected tokenization calls.

Please let me know if I can proceed.

[metaloozee]

@mahek2016
I have already worked on this issue. Kindly review my PR #516 at your convenience and provide any relevant suggestions