Skip to content

Investigate local reasoning models for PlannerΒ #10

@marutilai

Description

@marutilai

🧩 Feature Request


πŸ” Summary

Evaluate and integrate a local reasoning model for the Planner with pluggable runtime support.


βœ… Expected Behavior

A local reasoning model (e.g., Magistral) is benchmarked, integrated via a runtime like Ollama, and fully documented for developers to use reliably.


πŸ’‘ Suggested Fix (if any)

  • Curate and benchmark local reasoning models for Planner usage.
  • Evaluate candidates on:
    • Reasoning accuracy
    • Inference latency
    • Resource usage
  • Define a pluggable integration strategy using local runtimes (e.g., Ollama).
  • Document:
    • Setup steps
    • Configuration parameters
    • Troubleshooting workflows

πŸ”— Relevant Files / Code

  • Planner integration layer
  • Model adapters or runtime bridge
  • Developer docs directory

Metadata

Metadata

Assignees

No one assigned

    Labels

    explorationResearch more and decide what needs to be done

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions