Profiling #269
Open
Profiling #269
Conversation
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
PyPi release
Outputs chrome tracing profiles, which are beautifully readable
pesser
approved these changes
Jun 23, 2020
Owner
pesser
left a comment
pesser
left a comment
There was a problem hiding this comment.
Nice, I love it! I was always wondering if there is such a functionality which can be integrated. I guess you just need to reformat and fix the typo if you feel like doing so ;)
| class PyProfilingHook(Hook): | ||
| '''Allows to profile your pytorch code! | ||
|
|
||
| Best of all: It allows you to create chrome traces, which can be view |
Owner
There was a problem hiding this comment.
btw. your docstring is great and allows one to get going immediately, but if you have a link to an exhaustive documentation of the profiler you could add it, too!
Collaborator
|
This needs to be documented, otherwise it is just another awesome feature which nobody will ever know about and we will kick it out again after some time. Besides that, I love it! |
Collaborator
|
black formatting is missing |
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
3 participants
Add this suggestion to a batch that can be applied as a single commit.
This suggestion is invalid because no changes were made to the code.
Suggestions cannot be applied while the pull request is closed.
Suggestions cannot be applied while viewing a subset of changes.
Only one suggestion per line can be applied in a batch.
Add this suggestion to a batch that can be applied as a single commit.
Applying suggestions on deleted lines is not supported.
You must change the existing code in this line in order to create a valid suggestion.
Outdated suggestions cannot be applied.
This suggestion has been applied or marked resolved.
Suggestions cannot be applied from pending reviews.
Suggestions cannot be applied on multi-line comments.
Suggestions cannot be applied while the pull request is queued to merge.
Suggestion cannot be applied right now. Please check back later.
Introducing: The Pytorch Profiling hook! Saves a trace, that can be interactively viewed via the
chrome://tracingtool. Take a look at the attached pictures.Still on the todo list:
Image 1: Some 15 training steps. Note the validation steps every 2^n steps.
Image 2: Zoom to about one step. Left: Forward pass, middle: gradient calculation, right: gradient application.
Image 3: Some Conv - Batch-Norm - ReLU layers