ParseBytes no longer copies data + added result.Bytes()#383
Open
Yoone wants to merge 1 commit intotidwall:masterfrom
Open
ParseBytes no longer copies data + added result.Bytes()#383Yoone wants to merge 1 commit intotidwall:masterfrom
Yoone wants to merge 1 commit intotidwall:masterfrom
Conversation
|
@tidwall , what do you think about this change? |
Owner
|
This PR breaks the rules of immutability for strings in Go. Using the change in this PR, run this code: json := []byte(`{ "first": "Janet", "last": "Prichard" }`)
first := gjson.ParseBytes(json).Get("first").String()
println(first)
copy(json[11:18], `"Carol"`)
println(first)
// Output:
// Janet
// CarolIt should not be possible to change the backed memory of a string, but in the example above the string This is because the A safer workaround would be to cast before parse, then immediately copy the result (which contains a mutable string), back into an immutable string. json := []byte(`{ "first": "Janet", "last": "Prichard" }`)
jsonStr := *(*string)(unsafe.Pointer(&json)) // cast []bytes to string, zero-copy
first := Parse(jsonStr).Get("first").String() // use Parse instead of ParseBytes
first = string([]byte(first)) // copy result back into string
println(first)
copy(json[11:18], `"Carol"`)
println(first)
// Output:
// Janet
// Janet |
This file contains hidden or bidirectional Unicode text that may be interpreted or compiled differently than what appears below. To review, open the file in an editor that reveals hidden Unicode characters.
Learn more about bidirectional Unicode characters
Sign up for free
to join this conversation on GitHub.
Already have an account?
Sign in to comment
Add this suggestion to a batch that can be applied as a single commit.This suggestion is invalid because no changes were made to the code.Suggestions cannot be applied while the pull request is closed.Suggestions cannot be applied while viewing a subset of changes.Only one suggestion per line can be applied in a batch.Add this suggestion to a batch that can be applied as a single commit.Applying suggestions on deleted lines is not supported.You must change the existing code in this line in order to create a valid suggestion.Outdated suggestions cannot be applied.This suggestion has been applied or marked resolved.Suggestions cannot be applied from pending reviews.Suggestions cannot be applied on multi-line comments.Suggestions cannot be applied while the pull request is queued to merge.Suggestion cannot be applied right now. Please check back later.
Summary
ParseBytes(json []byte) Resultnow uses thebytesStringhelper function (unsafe cast) overstring(...)conversion to avoid copying the byte slice.result.Bytes()helper was added to accessresult.Rawas[]bytewithout copying data.Motivation
This change aims at allowing the use of
[]byteoverstringas input when using gjson without having to copy data or perform extra memory allocations, since one of the selling points of this library is its ability to parse and process JSON with no copy / zero allocations.