Added an ImapToken cache to try and reduce ImapToken allocations#1630
Open
Added an ImapToken cache to try and reduce ImapToken allocations#1630
Conversation
Owner
Author
a50f9a2 to
7632855
Compare
ba9a703 to
3b06559
Compare
9bec213 to
aa56d4a
Compare
Also reduced memory allocations in ImapTokenCache.AddOrGet()
…lders This drastically reduces the number of allocations made when tokenizing IMAP responses. ImapCommand's usage was not really a major issue, but since ImapEngine.ReadLine/Async() needed a reusable ByteArrayBuilder anyway, might as well share that with ImapCommand.
…own too large One potential problem with reusing ByteArrayBuilders is that, because they can grow for some abnormally long tokens/lines/commands/etc, those oversized buffers will remain referenced by the ImapStream/ImapEngine until they are disposed which could be the life of the program. If we oportunistically scale back the size of the buffers when they are Clear()'d, then we can periodically reduce memory usage and allow those larger buffers to be used elsewhere.
aa56d4a to
90db485
Compare
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.



Theoretically, this could drastically reduce ImapToken allocations which might help with issue #1335.
Of course, this also adds more overhead in other aspects.
TODO:
ImapTokenCacheImapEngine-specific? Might be better than a globalImapTokencache like it is now. Another advantage of that would be that the mutex locking wouldn't be necessary anymore. Not sure how expensive locking is...Alternative Idea:
Instead of (or in combination with?) the
ImapTokenCache, if we usedReadOnlyMemory<byte>, we wouldn't need:This would reduce memory allocations, memory fragmentation, and improve performance because there'd be no (or less) need to copy data around.
That said, there are a few things to consider: