Add BYODL dataflow refresh troubleshooting documentation

README.md

@@ -59,6 +59,8 @@ If you are interested in contributing to the CoE Starter Kit by fixing issues or
 ## Setup Instructions and Documentation
 Please find all information on how to install and use the kit on https://docs.microsoft.com/power-platform/guidance/coe/starter-kit
 
+For troubleshooting common issues, see the [troubleshooting guides](docs/troubleshooting/)
+
 ## Microsoft Open Source Code of Conduct
 
 This project has adopted the [Microsoft Open Source Code of Conduct](https://opensource.microsoft.com/codeofconduct/).

docs/README.md

@@ -0,0 +1,76 @@
+# CoE Starter Kit Documentation
+
+This directory contains supplementary documentation for the Microsoft Power Platform Center of Excellence (CoE) Starter Kit.
+
+## Documentation Structure
+
+### [Troubleshooting](troubleshooting/)
+Guides for diagnosing and resolving common issues with the CoE Starter Kit components.
+
+## Official Documentation
+
+The primary documentation for the CoE Starter Kit is hosted on Microsoft Learn:
+
+**Main Documentation Hub**: https://learn.microsoft.com/en-us/power-platform/guidance/coe/starter-kit
+
+### Key Documentation Sections:
+
+- **[Getting Started](https://learn.microsoft.com/en-us/power-platform/guidance/coe/setup)** - Setup and installation guides
+- **[Core Components](https://learn.microsoft.com/en-us/power-platform/guidance/coe/core-components)** - Understanding the core solution
+- **[Governance Components](https://learn.microsoft.com/en-us/power-platform/guidance/coe/governance-components)** - Policy and compliance features
+- **[Nurture Components](https://learn.microsoft.com/en-us/power-platform/guidance/coe/nurture-components)** - Maker engagement and training
+- **[ALM Accelerator](https://learn.microsoft.com/en-us/power-platform/guidance/coe/almaccelerator-components)** - Application Lifecycle Management
+
+## Repository Documentation
+
+This repository also contains:
+
+- **[README.md](../README.md)** - Repository overview and quick start
+- **[CONTRIBUTING.md](../CONTRIBUTING.md)** - Contribution guidelines
+- **[HOW_TO_CONTRIBUTE.md](../HOW_TO_CONTRIBUTE.md)** - Detailed contribution instructions
+- **[SECURITY.md](../SECURITY.md)** - Security policies and vulnerability reporting
+
+## Getting Help
+
+### For CoE Starter Kit Issues:
+1. Search [existing GitHub issues](https://github.com/microsoft/coe-starter-kit/issues)
+2. Review [troubleshooting guides](troubleshooting/)
+3. Check [closed issues](https://github.com/microsoft/coe-starter-kit/issues?q=is%3Aissue+is%3Aclosed) for similar problems
+4. Create a [new issue](https://github.com/microsoft/coe-starter-kit/issues/new/choose) if needed
+
+### For General Power Platform Questions:
+- [Power Platform Community Forum](https://powerusers.microsoft.com/)
+- [Power Platform Documentation](https://learn.microsoft.com/en-us/power-platform/)
+
+## Release Information
+
+- **Latest Release**: Check [Releases](https://github.com/microsoft/coe-starter-kit/releases)
+- **Release Notes**: See [Release Notes](../CenterofExcellenceResources/Release/Notes/)
+- **Roadmap**: View [open milestones](https://github.com/microsoft/coe-starter-kit/milestones?state=open)
+
+## Important Notes
+
+⚠️ **Support**: The CoE Starter Kit is provided as-is without official Microsoft support. Community support is available through GitHub issues and the Power Platform Community forum.
+
+⚠️ **BYODL Deprecation**: Bring Your Own Data Lake (BYODL) is no longer the recommended data source. New deployments should use Dataverse inventory. See [official guidance](https://learn.microsoft.com/en-us/power-platform/guidance/coe/setup-core-components#what-data-source-should-i-use-for-my-power-platform-inventory).
+
+⚠️ **Language Support**: The CoE Starter Kit supports English language only. Ensure your environment has the English language pack enabled.
+
+## Contributing to Documentation
+
+We welcome contributions to improve documentation:
+
+1. Fork the repository
+2. Create a new branch
+3. Add or update documentation
+4. Submit a pull request
+
+Please follow the [contribution guidelines](../CONTRIBUTING.md) and ensure your documentation:
+- Is clear and concise
+- Includes examples where appropriate
+- Links to official Microsoft documentation
+- Is tested and verified
+
+---
+
+*For the most current information, always refer to the [official Microsoft documentation](https://learn.microsoft.com/en-us/power-platform/guidance/coe/starter-kit).*

docs/troubleshooting/ISSUE_RESPONSE_TEMPLATE.md

@@ -0,0 +1,121 @@
+# GitHub Issue Response Template - BYODL Dataflow Refresh Issues
+
+## Standard Response for Dataflow Refresh Issues
+
+Use this template when responding to issues where BYODL dataflows are not refreshing automatically.
+
+---
+
+### Response Template:
+
+```markdown
+## Summary
+
+Thank you for reporting this issue. This is a common problem with BYODL (Bring Your Own Data Lake) dataflows where only the Makers dataflow refreshes automatically while other dataflows remain stuck at their initial publication date.
+
+Based on the screenshot provided, I can see that the refresh settings show a **future start date (15/12/2025 at 08:30)**. This is the most likely cause of your issue.
+
+## Immediate Fix
+
+### Issue: Future Start Date
+The "Start at" field in your refresh settings is set to a **future date**. Dataflows will not refresh until that date arrives.
+
+**Resolution:**
+1. Go to **Power Apps** (make.powerapps.com)
+2. Select your CoE environment
+3. Navigate to **Dataflows**
+4. For each non-refreshing dataflow:
+   - Click on the dataflow name
+   - Select **Settings** > **Refresh settings**
+   - Ensure **"Refresh automatically"** is selected (NOT "Refresh manually")
+   - Change the **"Start at"** date to the **current date** or a **past date**
+   - Save the settings
+
+### Initial Manual Refresh Required
+After fixing the start date, you need to manually trigger each dataflow once to establish the refresh chain:
+
+1. **First**: Manually refresh the **Makers** dataflow (wait for completion)
+2. **Second**: Manually refresh the **Environments** dataflow
+3. **Third**: Manually refresh **Apps** and **Flows** dataflows (can do in parallel)
+4. **Fourth**: Manually refresh all remaining dataflows:
+   - Model Driven Apps
+   - Apps Connections  
+   - Apps Last Launch Date
+   - Flows Connections
+   - Flows Last Run Date
+
+After this initial manual refresh sequence, the dataflows should begin refreshing automatically according to their schedule.
+
+## Important Notice: BYODL Deprecation
+
+⚠️ **BYODL (Bring Your Own Data Lake) is no longer the recommended approach.**
+
+Microsoft is moving toward **Microsoft Fabric** as the preferred data lake solution. For new CoE Starter Kit deployments, we strongly recommend using the **Dataverse inventory method** instead of Data Export (BYODL).
+
+**Benefits of Dataverse method:**
+- Simpler setup and maintenance
+- No external Azure Data Lake dependency
+- Better integration with Power Platform
+- Lower licensing requirements
+- Official Microsoft recommended approach
+
+**Migration guidance:** https://learn.microsoft.com/en-us/power-platform/guidance/coe/setup-core-components#what-data-source-should-i-use-for-my-power-platform-inventory
+
+## Additional Troubleshooting
+
+If the above doesn't resolve your issue, please review our comprehensive troubleshooting guides:
+
+- **Quick Reference**: [BYODL Dataflow Quick Reference](../docs/troubleshooting/byodl-dataflow-quick-reference.md)
+- **Comprehensive Guide**: [BYODL Dataflow Refresh Issues](../docs/troubleshooting/byodl-dataflow-refresh-issues.md)
+
+Common additional issues to check:
+- [ ] Refresh schedule "Start at" date is NOT in the future ✅ (Fix this first)
+- [ ] "Refresh automatically" is selected (not manual)
+- [ ] Admin account has Power Apps Plan 2 license (NOT trial license)
+- [ ] Data Export service is enabled in environment
+- [ ] Azure Data Lake connection is valid and authenticated
+
+## Next Steps
+
+1. **Fix the future start date** in all dataflow refresh settings
+2. **Manually refresh** each dataflow in the order specified above
+3. **Wait 24 hours** to verify automatic refresh is working
+4. If issues persist after following these steps, please provide:
+   - Screenshots of the refresh history showing any errors
+   - Confirmation that start dates have been updated
+   - License type assigned to the admin account performing refreshes
+
+Please let us know if this resolves your issue or if you need further assistance!
+
+---
+
+**Additional Resources:**
+- [CoE Starter Kit Documentation](https://learn.microsoft.com/en-us/power-platform/guidance/coe/starter-kit)
+- [CoE Setup Guide](https://learn.microsoft.com/en-us/power-platform/guidance/coe/setup)
+```
+
+---
+
+## Notes for Maintainers
+
+### Key Points to Emphasize:
+1. **Future start date** is the most common cause (visible in the screenshot)
+2. **Manual refresh required** after initial setup to establish dependency chain
+3. **BYODL is deprecated** - recommend Dataverse method for new deployments
+4. **Licensing matters** - Trial licenses won't work properly
+
+### Escalation Criteria:
+If user has already:
+- Fixed the start date
+- Manually refreshed in correct order
+- Verified licensing is adequate
+- Checked Data Lake connections
+
+Then escalate to check:
+- Data Export service configuration
+- Azure Data Lake permissions
+- Dataflow refresh history for specific error messages
+- Power Platform service health status
+
+### Related Issues:
+Search for similar issues using: `is:issue label:coe-starter-kit dataflow OR BYODL`

docs/troubleshooting/README.md

@@ -0,0 +1,49 @@
+# CoE Starter Kit Troubleshooting Guides
+
+This directory contains troubleshooting guides for common issues encountered with the Microsoft Power Platform Center of Excellence (CoE) Starter Kit.
+
+## Available Guides
+
+### [BYODL Dataflow Refresh Issues](byodl-dataflow-refresh-issues.md)
+Comprehensive guide for troubleshooting CoE BYODL (Bring Your Own Data Lake) dataflows that don't refresh automatically on schedule.
+
+**Common symptoms addressed:**
+- Only Makers dataflow refreshes, other dataflows don't
+- Dataflows show last refresh date from initial publication
+- Refresh schedule shows future dates
+- Authentication and connection errors
+
+**Topics covered:**
+- Root cause analysis
+- Step-by-step troubleshooting
+- Dataflow dependency chain
+- Licensing requirements
+- Migration path away from BYODL to Dataverse
+
+### [BYODL Dataflow Quick Reference](byodl-dataflow-quick-reference.md)
+Quick diagnostic checklist and common fixes for BYODL dataflow refresh issues. Use this for rapid troubleshooting before diving into the comprehensive guide.
+
+## Contributing
+
+If you've encountered and resolved issues not covered in these guides, please consider contributing:
+
+1. Follow the [contribution guidelines](../../CONTRIBUTING.md)
+2. Create a new troubleshooting document
+3. Submit a pull request
+4. Update this README with a link to your guide
+
+## Additional Resources
+
+- [CoE Starter Kit Official Documentation](https://learn.microsoft.com/en-us/power-platform/guidance/coe/starter-kit)
+- [GitHub Issues](https://github.com/microsoft/coe-starter-kit/issues)
+- [Community Forum](https://powerusers.microsoft.com/t5/Power-Apps-Governance-and/bd-p/Admin_PowerApps)
+
+## Need Help?
+
+1. **Search existing issues**: Check if someone else has reported the same problem
+2. **Check the official docs**: Microsoft's documentation is regularly updated
+3. **Create a new issue**: If you can't find a solution, create a detailed issue report
+4. **Engage the community**: Post questions in the Power Apps Community forum
+
+---
+**Important Notice**: The CoE Starter Kit is provided as-is without official Microsoft support. These troubleshooting guides are community-contributed best practices and workarounds.

docs/troubleshooting/byodl-dataflow-quick-reference.md

@@ -0,0 +1,62 @@
+# BYODL Dataflow Refresh - Quick Reference
+
+## Issue: Dataflows Not Refreshing Automatically
+
+### Most Common Causes & Quick Fixes
+
+#### 1. Future Start Date ⏰
+**Check:** Dataflow > Settings > Refresh settings > "Start at" field
+**Fix:** Change date to current date or past date
+
+#### 2. Manual Refresh Mode Selected 🔧
+**Check:** Dataflow > Settings > Refresh settings
+**Fix:** Select "Refresh automatically" (NOT "Refresh manually")
+
+#### 3. First Manual Trigger Needed 🚀
+**Issue:** Dataflows never manually refreshed after setup
+**Fix:** Manually refresh in this order:
+1. Makers dataflow (wait for completion)
+2. Environments dataflow  
+3. Apps and Flows dataflows
+4. All remaining dataflows (Apps Connections, Last Launch Date, etc.)
+
+#### 4. Insufficient Licensing 📋
+**Check:** Admin account license (Trial licenses won't work)
+**Fix:** Assign Power Apps Plan 2 or Per App license
+
+#### 5. Data Lake Connection Issues 🔌
+**Check:** Refresh history for authentication errors
+**Fix:** Verify Azure Data Lake Storage Gen2 permissions and connection
+
+### Detailed Documentation
+
+For comprehensive troubleshooting, see: [BYODL Dataflow Refresh Issues](byodl-dataflow-refresh-issues.md)
+
+### BYODL Deprecation Notice
+
+⚠️ **Important:** BYODL is no longer recommended. Consider migrating to Dataverse inventory method.
+
+See: https://learn.microsoft.com/en-us/power-platform/guidance/coe/setup-core-components#what-data-source-should-i-use-for-my-power-platform-inventory
+
+---
+
+## Quick Diagnostic Checklist
+
+- [ ] Refresh schedule "Start at" date is NOT in the future
+- [ ] "Refresh automatically" is selected (not manual)
+- [ ] Makers dataflow was successfully refreshed at least once
+- [ ] Other dataflows were manually triggered after Makers refresh
+- [ ] Admin account has Power Apps Plan 2 (NOT trial license)
+- [ ] Data Export service is enabled in environment
+- [ ] Azure Data Lake connection is valid and authenticated
+- [ ] Service principal has "Storage Blob Data Contributor" role
+
+## Need More Help?
+
+1. Review [full troubleshooting guide](byodl-dataflow-refresh-issues.md)
+2. Check [existing GitHub issues](https://github.com/microsoft/coe-starter-kit/issues?q=is%3Aissue+dataflow)
+3. Create [new issue](https://github.com/microsoft/coe-starter-kit/issues/new/choose) with:
+   - CoE version
+   - Screenshot of refresh settings
+   - Refresh history errors
+   - Steps already tried