Sensor page shows latest forecasts visually, but stats use all horizons

[nhoening]

When I see the sensor page, I see only data with the smallest horizon (latest forecasts or measurements).
However, the sensor Statistics select all available data.

• So the graphs might not show the min/max I see in the Statistics
• And: I might get a sum over all forecasts (not sure, we should check that), which is not what the user expects.

Option 1: We should compute the statistics also with only latest horizons. We should also add an informative sentence saying that that is what you see.

Option 2: Option 1, but also add (keep) the statistics with all horizons. Because, if one runs the playback, they do see all the forecasts coming by, actually. Then there would be a switch, to see Statistics with all or only latest horizons (default: only latest)

It is okay to do only Option 1 for now.

[nhoening]

For Seita devs, I used https://ems.seita.energy/sensors/267 to see this in action and in the DB: select * from timed_belief where sensor_id = 267 and event_start = '2024-11-27 05:00:00+00' order by belief_horizon asc provides a good insight into the time of min price.

[Flix6x]

It is okay to do only Option 2 for now.

Option 2 implies also implementing option 1, though. Did you mean to write that only doing option 1 is okay for now?

[nhoening]

Yes, sorry, I'll edit the description

[nhoening]

Looking into this a bit further, I believe it means that the function that fetches sensor statistics (`data/services/sensors.py::_get_sensor_stats()) needs an update to its query, selecting only the most recent beliefs.

In the main sensor query, that case (most_recent_beliefs_only=True) leads to a subquery with a min() applied on belief_horizon) - and that gets a bit costly.

We can apply that directly, or we wait until we do have #1671 in place, and we can query right from that materialized view.