Performance?

[samsamm777]

I've reimplemented your example with a few minor changes. However im seeing very slow predictions. Its taking me about 4seconds for a 320x240 image. Curious what sort of speeds you were seeing?

[juandes]

Hi @samsamm777 , thanks for the comment.
In my case, during the very first prediction, the latency is around 3 seconds. The subsequent ones are around 50 ms. I can't really tell why's that but my first impression could be something related to lazy loading of the model. I need to double check that. Below is the output of several predictions using the "person" image I have in static/images.

Elapsed time 3.318130403s
Elapsed time 51.727287ms
Elapsed time 64.10641ms
Elapsed time 62.552891ms
Elapsed time 51.351888ms
Elapsed time 56.766457ms
Elapsed time 48.956447ms
Elapsed time 57.46466ms
Elapsed time 52.033128ms

I've updated the code with the new elapsed time calculation functionality.