您好,登錄后才能下訂單哦!
本文小編為大家詳細介紹“Go中過濾范型集合性能怎么實現”,內容詳細,步驟清晰,細節處理妥當,希望這篇“Go中過濾范型集合性能怎么實現”文章能幫助大家解決疑惑,下面跟著小編的思路慢慢深入,一起來學習新知識吧。
最近,我有機會在一個真實的 Golang 場景中使用泛型,同時尋找與 Stream filter(Predicate<? super T> predicate)和 Python list comprehension 等同的函數。我沒有依賴現有的包,而是選擇自己寫一個過濾函數,以達到學習的目的。
func filterStrings(collection []string, test func(string) bool) (f []string) { for _, s := range collection { if test(s) { f = append(f, s) } } return }
然而,這只適用于字符串。如果我需要過濾一個整數的集合,那么我就需要另一個極其相似的函數。
這對于一個范型函數來說似乎是一個完美的選擇。
func filter[T any](collection []T, test func(T) bool) (f []T) { for _, e := range collection { if test(e) { f = append(f, e) } } return }
函數名后面是一個范型T的定義。
T被定義為任何類型。
輸入 slice 中元素的類型從字符串變成了T
輸入、輸出的 clice 類型也從字符串變成了T
不多說了,讓我們來寫一些單元測試。首先,我需要一個隨機集合(在我的例子中,是字符串)的生成器。
func generateStringCollection(size, strLen int) []string { var collection []string for i := 0; i < size; i++ { collection = append(collection, strings.Repeat(fmt.Sprintf("%c", rune('A'+(i%10))), strLen)) } return collection }
現在我可以寫一個測試用例,判斷 filterStrings
函數的輸出與我的過濾范型器的輸出相同。
func TestFilter(t *testing.T) { c := generateStringCollection(1000, 3) t.Run("the output of the typed and generic functions is the same", func(t *testing.T) { predicate := func(s string) bool { return s == "AAA" } filteredStrings := filterStrings(c, predicate) filteredElements := filter(c, predicate) if !reflect.DeepEqual(filteredStrings, filteredElements) { t.Errorf("the output of the two functions is not the same") } }) }
=== RUN TestFilter === RUN TestFilter/the_output_of_the_typed_and_generic_functions_is_the_same --- PASS: TestFilter (0.00s) --- PASS: TestFilter/the_output_of_the_typed_and_generic_functions_is_the_same (0.00s) PASS
考慮新函數在處理大的 slice 時的性能問題。我怎樣才能確保它在這種情況下也能表現良好?
答案是:基準測試。用Go編寫基準測試與單元測試很相似。
const ( CollectionSize = 1000 ElementSize = 3 ) func BenchmarkFilter_Typed_Copying(b *testing.B) { c := generateStringCollection(CollectionSize, ElementSize) b.Run("Equals to AAA", func(b *testing.B) { for i := 0; i < b.N; i++ { filterStrings(c, func(s string) bool { return s == "AAA" }) } }) } func BenchmarkFilter_Generics_Copying(b *testing.B) { c := generateStringCollection(CollectionSize, ElementSize) b.Run("Equals to AAA", func(b *testing.B) { for i := 0; i < b.N; i++ { filter(c, func(s string) bool { return s == "AAA" }) } }) }
go test -bench=. -count=10 -benchmem goos: darwin goarch: arm64 pkg: github.com/timliudream/go-test/generic_test BenchmarkFilter_Typed_Copying/Equals_to_AAA-8 718408 1641 ns/op 4080 B/op 8 allocs/op BenchmarkFilter_Typed_Copying/Equals_to_AAA-8 718148 1640 ns/op 4080 B/op 8 allocs/op BenchmarkFilter_Typed_Copying/Equals_to_AAA-8 732939 1655 ns/op 4080 B/op 8 allocs/op BenchmarkFilter_Typed_Copying/Equals_to_AAA-8 723036 1639 ns/op 4080 B/op 8 allocs/op BenchmarkFilter_Typed_Copying/Equals_to_AAA-8 699075 1639 ns/op 4080 B/op 8 allocs/op BenchmarkFilter_Typed_Copying/Equals_to_AAA-8 707232 1643 ns/op 4080 B/op 8 allocs/op BenchmarkFilter_Typed_Copying/Equals_to_AAA-8 616422 1652 ns/op 4080 B/op 8 allocs/op BenchmarkFilter_Typed_Copying/Equals_to_AAA-8 730702 1649 ns/op 4080 B/op 8 allocs/op BenchmarkFilter_Typed_Copying/Equals_to_AAA-8 691488 1700 ns/op 4080 B/op 8 allocs/op BenchmarkFilter_Typed_Copying/Equals_to_AAA-8 717043 1646 ns/op 4080 B/op 8 allocs/op BenchmarkFilter_Generics_Copying/Equals_to_AAA-8 428851 2754 ns/op 4080 B/op 8 allocs/op BenchmarkFilter_Generics_Copying/Equals_to_AAA-8 428437 2762 ns/op 4080 B/op 8 allocs/op BenchmarkFilter_Generics_Copying/Equals_to_AAA-8 430444 2800 ns/op 4080 B/op 8 allocs/op BenchmarkFilter_Generics_Copying/Equals_to_AAA-8 429314 2757 ns/op 4080 B/op 8 allocs/op BenchmarkFilter_Generics_Copying/Equals_to_AAA-8 430938 2754 ns/op 4080 B/op 8 allocs/op BenchmarkFilter_Generics_Copying/Equals_to_AAA-8 429795 2754 ns/op 4080 B/op 8 allocs/op BenchmarkFilter_Generics_Copying/Equals_to_AAA-8 426714 2755 ns/op 4080 B/op 8 allocs/op BenchmarkFilter_Generics_Copying/Equals_to_AAA-8 418152 2755 ns/op 4080 B/op 8 allocs/op BenchmarkFilter_Generics_Copying/Equals_to_AAA-8 431739 2761 ns/op 4080 B/op 8 allocs/op BenchmarkFilter_Generics_Copying/Equals_to_AAA-8 412221 2755 ns/op 4080 B/op 8 allocs/op PASS ok github.com/timliudream/go-test/generic_test 25.005s
我對這個結果并不滿意。看起來我用可讀性換取了性能。
此外,我對分配的數量也有點擔心。你注意到我的測試名稱中的_Copying后綴了嗎?那是因為我的兩個過濾函數都是將過濾后的項目從輸入集合復制到輸出集合中。為什么我必須為這樣一個簡單的任務占用內存?
到最后,我需要做的是過濾原始的收集。我決定先解決這個問題。
func filterInPlace[T any](collection []T, test func(T) bool) []T { var position, size = 0, len(collection) for i := 0; i < size; i++ { if test(collection[i]) { collection[position] = collection[i] position++ } } return collection[:position] }
我不是把過濾后的結果寫到一個新的集合中,然后再返回,而是把結果寫回原來的集合中,并保留一個額外的索引,以便在過濾后的項目數上 "切 "出一個片斷。
我的單元測試仍然通過,在改變了下面這行之后。
filteredStrings := filterStrings(c, predicate) //filteredElements := filter(c, predicate) filteredElements := filterInPlace(c, predicate) // new memory-savvy function
func BenchmarkFilter_Generics_InPlace(b *testing.B) { c := generateStringCollection(CollectionSize, 3) b.Run("Equals to AAA", func(b *testing.B) { for i := 0; i < b.N; i++ { filterInPlace(c, func(s string) bool { return s == "AAA" }) } }) }
結果是出色的。
go test -bench=. -benchmem goos: darwin goarch: arm64 pkg: github.com/timliudream/go-test/generic_test BenchmarkFilter_Typed_Copying/Equals_to_AAA-8 713928 1642 ns/op 4080 B/op 8 allocs/op BenchmarkFilter_Generics_Copying/Equals_to_AAA-8 426055 2787 ns/op 4080 B/op 8 allocs/op BenchmarkFilter_Generics_Inplace/Equals_to_AAA-8 483994 2467 ns/op 0 B/op 0 allocs/op PASS ok github.com/timliudream/go-test/generic_test 4.925s
不僅內存分配歸零,而且性能也明顯提高。
讀到這里,這篇“Go中過濾范型集合性能怎么實現”文章已經介紹完畢,想要掌握這篇文章的知識點還需要大家自己動手實踐使用過才能領會,如果想了解更多相關內容的文章,歡迎關注億速云行業資訊頻道。
免責聲明:本站發布的內容(圖片、視頻和文字)以原創、轉載和分享為主,文章觀點不代表本網站立場,如果涉及侵權請聯系站長郵箱:is@yisu.com進行舉報,并提供相關證據,一經查實,將立刻刪除涉嫌侵權內容。