As a developer working on data ingestion architecture I want a Teams connector that autonomously syncs meeting video data to Azure storage

[emincalyakaisskar]

As a developer working on data ingestion architecture
I want a Teams connector that autonomously syncs meeting video data to Azure storage
So that we can validate our connector architecture pattern and provide rich meeting context to our chatbot

WHY - Business Context

This Teams connector serves as a POC to define and validate the architecture for data connectors that will feed contextual data to our chatbot. This is the first implementation to challenge our design patterns and identify technical constraints.

Definition of Done :

Core Functionality

•  Connector retrieves all meetings from the last 30 days using personal token
•  Downloads meeting videos in MP4 format to Azure storage
•  Organizes files by date structure (e.g., /2025/01/15/meeting_name_id.mp4)
•  Generates JSON metadata file alongside each video file
•  Skips already downloaded meetings (no re-download)
•  Handles metadata updates for existing meetings

Trigger System

•  Cron trigger: Configurable scheduled execution
•  Manual trigger: Script can be executed on-demand via CLI
  Event driven : Define the how if it is possible

Error Handling & Edge Cases

•  Skips inaccessible videos without breaking the sync process
•  Logs all operations (success/failure/skip) for debugging
•  Handles API rate limiting gracefully
•  Continues processing other meetings if one fails

Configuration & Security

•  Reads Microsoft Graph token from .env file (local development)
•  Azure storage credentials properly configured

Technical Implementation

•  Implements abstract connector interface/pattern
•  Runs asynchronously without blocking
•  Code is structured to serve as architecture reference
•  Documentation explains connector pattern for future implementations

Acceptance Criteria Examples

• Given a Teams token in .env, when I run the connector manually, then all new meetings from last 30 days are downloaded to Azure storage
• Given existing meetings in storage, when I run sync again, then only new meetings are processed
• Given an inaccessible meeting, when sync runs, then it logs the error and continues with other meetings

Technical Notes

• Personal token stored in .env for POC (production security TBD)
• Azure storage as target destination
• Focus on architecture patterns that can be replicated for other connectors
• Metadata should include: meeting ID, date, participants, duration, file path

[emincalyakaisskar]

@chiptuned

Notre process pour avoir un petit script qui récupère les vidéos en utilisant Graph
1.
https://developer.microsoft.com/graph/graph-explorer
2.
"Sign in to Microsoft Graph" avec identifiants Teams/Office 365 habituels

3. On prend le access token dans l'interface

Avec l'adresse mail et le token on peut accéder aux vidéos qui nous "appartiennent", je ne saurais pas définir exactement lesquelles, mais si je me fais un meeting entre moi et moi, je peux le télécharger ce qui nous donnera de quoi construire la pipeline d'ingestion vidéo

[chiptuned]

You should do a python MWE to ask for a token and list videos.

Here is a screenshot of a one-liner to automatize token creation :

For a CI/CD there is probably a way to automatically have a valid token.

[emincalyakaisskar]

From what I can see, we have a token that lasts 24 hours, you can see it in “expire on”, it works on my side too (maybe I made a mistake yesterday).
I already created the MWE to list and download videos that are classified as “recent”, but without automating token creation.
I tried to integrate token creation with “subprocess” and it's fine.

[chiptuned]

ok. is there still a problem about handling tokens ?

BTW, for a user perspective, They will need to provide tokens, which is a bummer. I think we should keep it like this and create a whole epic for app integrations (where I want to link XXX service, I should have one button then have a permission request pop up, then the service is available for isschat)

[emincalyakaisskar]

No, I don't see any immediate blockage on tokens.
Ok to create this epic I agree !