Performance Result Comparison

label

common value

baseline-commit

6ce74ceaddcc4ff081d22ae134f4264a667d394f

benchmarks-commit

84f2805de5779fc1ba11d1763137518bc461e975

branch

release-branch.go1.20

coordinator@symbolic-datum-552.iam.gserviceaccount.com

cpu

Intel(R) Xeon(R) CPU @ 3.10GHz

experiment-commit

6d90c13c7adeddfe171a42742d380b6c9095f7ca

experiment-commit-time

2023-09-18T19:10:26Z

downloading golang.org/x/exp/typeparams v0.0.0-20221212164502-fae10dda9338

goarch

amd64

goos

linux

pkg

golang.org/x/tools/gopls/internal/regtest/bench

post-submit

true

repository

tools

runstamp

2023-09-18T19:18:25.44175099Z

toolchain-commit

d5b851804329aa547dafa278a0c35dd62298d651

upload

20230918.22

upload-file

results

upload-part

20230918.22/0

upload-time

2023-09-18T20:41:29Z

label

values

toolchain

upload:20230918.22:

380	"baseline"
380	"experiment"

	time/op
CodeAction/kubernetes-8	490µs ± 9%
CodeAction/oracle-8	177µs ±16%
CodeAction/pkgsite-8	1.90ms ± 9%
CodeAction/starlark-8	11.0ms ± 2%
CodeAction/tools-8	4.29ms ±12%
CodeActionFollowingEdit/kubernetes-8	21.1ms ± 8%
CodeActionFollowingEdit/oracle-8	1.83ms ±117%
CodeActionFollowingEdit/pkgsite-8	62.1ms ±54%
CodeActionFollowingEdit/starlark-8	54.1ms ±27%
CodeActionFollowingEdit/tools-8	66.9ms ±30%
StructCompletion/tools-8	18.8ms ±22%
ImportCompletion/tools-8	1.29ms ± 9%
SliceCompletion/tools-8	19.9ms ±21%
FuncDeepCompletion/tools-8	30.6ms ± 7%
CompletionFollowingEdit/tools-8	43.3ms ± 3%
CompletionFollowingEdit/kubernetes-8	150ms ±25%
CompletionFollowingEdit/oracle-8	315ms ±16%
Definition/kubernetes-8	301µs ±45%
Definition/pkgsite-8	253µs ± 6%
Definition/starlark-8	284µs ± 8%
Definition/tools-8	283µs ±37%
DidChange/kubernetes-8	1.66ms ±13%
DidChange/oracle-8	3.38ms ±59%
DidChange/pkgsite-8	2.38ms ±39%
DidChange/starlark-8	3.74ms ±40%
DidChange/tools-8	5.62ms ±46%
DiagnoseChange/kubernetes/diagnose-8	1.05s ±51%
DiagnoseChange/pkgsite/diagnose-8	150ms ±24%
DiagnoseChange/starlark/diagnose-8	113ms ±17%
DiagnoseChange/tools/diagnose-8	206ms ±27%
DiagnoseSave/kubernetes/diagnose-8	1.36s ±47%
DiagnoseSave/pkgsite/diagnose-8	300ms ±17%
DiagnoseSave/starlark/diagnose-8	196ms ±16%
DiagnoseSave/tools/diagnose-8	319ms ±32%
Hover/kubernetes-8	463µs ±23%
Hover/pkgsite-8	396µs ±22%
Hover/starlark-8	342µs ± 2%
Hover/tools-8	1.29ms ± 1%
Implementations/kubernetes-8	130ms ±77%
Implementations/pkgsite-8	14.5ms ±40%
Implementations/starlark-8	2.32ms ± 6%
Implementations/tools-8	11.4ms ±39%
InitialWorkspaceLoad/kubernetes-8	11.5s ±47%
InitialWorkspaceLoad/oracle-8	5.62s ±67%
InitialWorkspaceLoad/pkgsite-8	1.48s ±59%
InitialWorkspaceLoad/starlark-8	500ms ±69%
InitialWorkspaceLoad/tools-8	1.51s ±68%
References/kubernetes-8	1.73ms ±26%
References/pkgsite-8	11.1ms ±18%
References/starlark-8	2.36ms ± 4%
References/tools-8	9.00ms ± 8%
Reload/kubernetes-8	304ms ± 4%
Rename/kubernetes-8	684ms ±95%
Rename/pkgsite-8	258ms ±27%
Rename/starlark-8	101ms ±12%
Rename/tools-8	98.0ms ±17%
Typing/kubernetes/10ms-8	10.0ms ± 0%
Typing/kubernetes/50ms-8	50.0ms ± 0%
Typing/kubernetes/150ms-8	150ms ± 0%
Typing/oracle/10ms-8	10.0ms ± 0%
Typing/oracle/50ms-8	50.0ms ± 0%
Typing/oracle/150ms-8	150ms ± 0%
Typing/pkgsite/10ms-8	10.0ms ± 0%
Typing/pkgsite/50ms-8	50.0ms ± 0%
Typing/pkgsite/150ms-8	150ms ± 0%
Typing/starlark/10ms-8	10.0ms ± 0%
Typing/starlark/50ms-8	50.0ms ± 0%
Typing/starlark/150ms-8	150ms ± 0%
Typing/tools/10ms-8	10.0ms ± 0%
Typing/tools/50ms-8	50.0ms ± 0%
Typing/tools/150ms-8	150ms ± 0%
WorkspaceSymbols/kubernetes-8	94.6ms ±11%
WorkspaceSymbols/oracle-8	83.0ms ±29%
WorkspaceSymbols/pkgsite-8	22.7ms ± 8%
WorkspaceSymbols/starlark-8	6.41ms ± 2%
WorkspaceSymbols/tools-8	10.2ms ± 6%
[Geo mean]	23.9ms

	cpu_seconds/op
CodeAction/kubernetes-8	0.00 ±71%
CodeAction/oracle-8	0.00 ±13%
CodeAction/pkgsite-8	0.00 ±17%
CodeAction/starlark-8	0.02 ±10%
CodeAction/tools-8	0.01 ±22%
CodeActionFollowingEdit/kubernetes-8	0.04 ±16%
CodeActionFollowingEdit/oracle-8	0.01 ±222%
CodeActionFollowingEdit/pkgsite-8	0.14 ±67%
CodeActionFollowingEdit/starlark-8	0.12 ±52%
CodeActionFollowingEdit/tools-8	0.16 ±63%
StructCompletion/tools-8	0.03 ±31%
ImportCompletion/tools-8	0.00 ±24%
SliceCompletion/tools-8	0.03 ±20%
FuncDeepCompletion/tools-8	0.04 ±28%
CompletionFollowingEdit/tools-8	0.08 ±28%
CompletionFollowingEdit/kubernetes-8	0.28 ±35%
CompletionFollowingEdit/oracle-8	0.80 ±58%
Definition/kubernetes-8	0.00 ±130%
Definition/pkgsite-8	0.00 ±20%
Definition/starlark-8	0.00 ±18%
Definition/tools-8	0.00 ±10%
DidChange/kubernetes-8	0.00 ±31%
DidChange/oracle-8	0.01 ±175%
DidChange/pkgsite-8	0.00 ±70%
DidChange/starlark-8	0.01 ±67%
DidChange/tools-8	0.01 ±86%
DiagnoseChange/kubernetes/diagnose-8	3.98 ±66%
DiagnoseChange/pkgsite/diagnose-8	0.45 ±58%
DiagnoseChange/starlark/diagnose-8	0.38 ±45%
DiagnoseChange/tools/diagnose-8	0.74 ±45%
DiagnoseSave/kubernetes/diagnose-8	4.76 ±67%
DiagnoseSave/pkgsite/diagnose-8	0.69 ±56%
DiagnoseSave/starlark/diagnose-8	0.66 ±43%
DiagnoseSave/tools/diagnose-8	1.08 ±42%
Hover/kubernetes-8	0.00 ±66%
Hover/pkgsite-8	0.00 ±16%
Hover/starlark-8	0.00 ± 9%
Hover/tools-8	0.00 ±13%
Implementations/kubernetes-8	0.27 ±34%
Implementations/pkgsite-8	0.03 ±45%
Implementations/starlark-8	0.01 ±60%
Implementations/tools-8	0.02 ±39%
InitialWorkspaceLoad/kubernetes-8
InitialWorkspaceLoad/oracle-8
InitialWorkspaceLoad/pkgsite-8
InitialWorkspaceLoad/starlark-8
InitialWorkspaceLoad/tools-8
References/kubernetes-8	0.00 ±98%
References/pkgsite-8	0.01 ± 6%
References/starlark-8	0.00 ±40%
References/tools-8	0.01 ±42%
Reload/kubernetes-8	0.18 ±43%
Rename/kubernetes-8	2.74 ±122%
Rename/pkgsite-8	0.85 ±27%
Rename/starlark-8	0.22 ±22%
Rename/tools-8	0.20 ±49%
Typing/kubernetes/10ms-8	0.04 ±59%
Typing/kubernetes/50ms-8	0.19 ±54%
Typing/kubernetes/150ms-8	0.58 ±59%
Typing/oracle/10ms-8	0.07 ±198%
Typing/oracle/50ms-8	0.35 ±37%
Typing/oracle/150ms-8	0.46 ±57%
Typing/pkgsite/10ms-8	0.02 ±65%
Typing/pkgsite/50ms-8	0.09 ±15%
Typing/pkgsite/150ms-8	0.17 ±22%
Typing/starlark/10ms-8	0.02 ±75%
Typing/starlark/50ms-8	0.07 ±25%
Typing/starlark/150ms-8	0.12 ±23%
Typing/tools/10ms-8	0.03 ±60%
Typing/tools/50ms-8	0.11 ±17%
Typing/tools/150ms-8	0.21 ±18%
WorkspaceSymbols/kubernetes-8	0.32 ± 3%
WorkspaceSymbols/oracle-8	0.30 ±12%
WorkspaceSymbols/pkgsite-8	0.08 ±14%
WorkspaceSymbols/starlark-8	0.02 ± 1%
WorkspaceSymbols/tools-8	0.04 ± 2%
[Geo mean]	0.04

	alloc_bytes
CodeAction/kubernetes-8
CodeAction/oracle-8
CodeAction/pkgsite-8
CodeAction/starlark-8
CodeAction/tools-8
CodeActionFollowingEdit/kubernetes-8
CodeActionFollowingEdit/oracle-8
CodeActionFollowingEdit/pkgsite-8
CodeActionFollowingEdit/starlark-8
CodeActionFollowingEdit/tools-8
StructCompletion/tools-8
ImportCompletion/tools-8
SliceCompletion/tools-8
FuncDeepCompletion/tools-8
CompletionFollowingEdit/tools-8
CompletionFollowingEdit/kubernetes-8
CompletionFollowingEdit/oracle-8
Definition/kubernetes-8
Definition/pkgsite-8
Definition/starlark-8
Definition/tools-8
DidChange/kubernetes-8
DidChange/oracle-8
DidChange/pkgsite-8
DidChange/starlark-8
DidChange/tools-8
DiagnoseChange/kubernetes/diagnose-8
DiagnoseChange/pkgsite/diagnose-8
DiagnoseChange/starlark/diagnose-8
DiagnoseChange/tools/diagnose-8
DiagnoseSave/kubernetes/diagnose-8
DiagnoseSave/pkgsite/diagnose-8
DiagnoseSave/starlark/diagnose-8
DiagnoseSave/tools/diagnose-8
Hover/kubernetes-8
Hover/pkgsite-8
Hover/starlark-8
Hover/tools-8
Implementations/kubernetes-8
Implementations/pkgsite-8
Implementations/starlark-8
Implementations/tools-8
InitialWorkspaceLoad/kubernetes-8	1.17G ±79%
InitialWorkspaceLoad/oracle-8	744M ±82%
InitialWorkspaceLoad/pkgsite-8	186M ±70%
InitialWorkspaceLoad/starlark-8	57.5M ±74%
InitialWorkspaceLoad/tools-8	198M ±83%
References/kubernetes-8
References/pkgsite-8
References/starlark-8
References/tools-8
Reload/kubernetes-8
Rename/kubernetes-8
Rename/pkgsite-8
Rename/starlark-8
Rename/tools-8
Typing/kubernetes/10ms-8
Typing/kubernetes/50ms-8
Typing/kubernetes/150ms-8
Typing/oracle/10ms-8
Typing/oracle/50ms-8
Typing/oracle/150ms-8
Typing/pkgsite/10ms-8
Typing/pkgsite/50ms-8
Typing/pkgsite/150ms-8
Typing/starlark/10ms-8
Typing/starlark/50ms-8
Typing/starlark/150ms-8
Typing/tools/10ms-8
Typing/tools/50ms-8
Typing/tools/150ms-8
WorkspaceSymbols/kubernetes-8
WorkspaceSymbols/oracle-8
WorkspaceSymbols/pkgsite-8
WorkspaceSymbols/starlark-8
WorkspaceSymbols/tools-8
[Geo mean]	284M

	in_use_bytes
CodeAction/kubernetes-8
CodeAction/oracle-8
CodeAction/pkgsite-8
CodeAction/starlark-8
CodeAction/tools-8
CodeActionFollowingEdit/kubernetes-8
CodeActionFollowingEdit/oracle-8
CodeActionFollowingEdit/pkgsite-8
CodeActionFollowingEdit/starlark-8
CodeActionFollowingEdit/tools-8
StructCompletion/tools-8
ImportCompletion/tools-8
SliceCompletion/tools-8
FuncDeepCompletion/tools-8
CompletionFollowingEdit/tools-8
CompletionFollowingEdit/kubernetes-8
CompletionFollowingEdit/oracle-8
Definition/kubernetes-8
Definition/pkgsite-8
Definition/starlark-8
Definition/tools-8
DidChange/kubernetes-8
DidChange/oracle-8
DidChange/pkgsite-8
DidChange/starlark-8
DidChange/tools-8
DiagnoseChange/kubernetes/diagnose-8
DiagnoseChange/pkgsite/diagnose-8
DiagnoseChange/starlark/diagnose-8
DiagnoseChange/tools/diagnose-8
DiagnoseSave/kubernetes/diagnose-8
DiagnoseSave/pkgsite/diagnose-8
DiagnoseSave/starlark/diagnose-8
DiagnoseSave/tools/diagnose-8
Hover/kubernetes-8
Hover/pkgsite-8
Hover/starlark-8
Hover/tools-8
Implementations/kubernetes-8
Implementations/pkgsite-8
Implementations/starlark-8
Implementations/tools-8
InitialWorkspaceLoad/kubernetes-8	1.36G ±78%
InitialWorkspaceLoad/oracle-8	860M ±81%
InitialWorkspaceLoad/pkgsite-8	250M ±70%
InitialWorkspaceLoad/starlark-8	77.1M ±78%
InitialWorkspaceLoad/tools-8	234M ±83%
References/kubernetes-8
References/pkgsite-8
References/starlark-8
References/tools-8
Reload/kubernetes-8
Rename/kubernetes-8
Rename/pkgsite-8
Rename/starlark-8
Rename/tools-8
Typing/kubernetes/10ms-8
Typing/kubernetes/50ms-8
Typing/kubernetes/150ms-8
Typing/oracle/10ms-8
Typing/oracle/50ms-8
Typing/oracle/150ms-8
Typing/pkgsite/10ms-8
Typing/pkgsite/50ms-8
Typing/pkgsite/150ms-8
Typing/starlark/10ms-8
Typing/starlark/50ms-8
Typing/starlark/150ms-8
Typing/tools/10ms-8
Typing/tools/50ms-8
Typing/tools/150ms-8
WorkspaceSymbols/kubernetes-8
WorkspaceSymbols/oracle-8
WorkspaceSymbols/pkgsite-8
WorkspaceSymbols/starlark-8
WorkspaceSymbols/tools-8
[Geo mean]	351M

	total_alloc_bytes
CodeAction/kubernetes-8
CodeAction/oracle-8
CodeAction/pkgsite-8
CodeAction/starlark-8
CodeAction/tools-8
CodeActionFollowingEdit/kubernetes-8
CodeActionFollowingEdit/oracle-8
CodeActionFollowingEdit/pkgsite-8
CodeActionFollowingEdit/starlark-8
CodeActionFollowingEdit/tools-8
StructCompletion/tools-8
ImportCompletion/tools-8
SliceCompletion/tools-8
FuncDeepCompletion/tools-8
CompletionFollowingEdit/tools-8
CompletionFollowingEdit/kubernetes-8
CompletionFollowingEdit/oracle-8
Definition/kubernetes-8
Definition/pkgsite-8
Definition/starlark-8
Definition/tools-8
DidChange/kubernetes-8
DidChange/oracle-8
DidChange/pkgsite-8
DidChange/starlark-8
DidChange/tools-8
DiagnoseChange/kubernetes/diagnose-8
DiagnoseChange/pkgsite/diagnose-8
DiagnoseChange/starlark/diagnose-8
DiagnoseChange/tools/diagnose-8
DiagnoseSave/kubernetes/diagnose-8
DiagnoseSave/pkgsite/diagnose-8
DiagnoseSave/starlark/diagnose-8
DiagnoseSave/tools/diagnose-8
Hover/kubernetes-8
Hover/pkgsite-8
Hover/starlark-8
Hover/tools-8
Implementations/kubernetes-8
Implementations/pkgsite-8
Implementations/starlark-8
Implementations/tools-8
InitialWorkspaceLoad/kubernetes-8	342M ±235%
InitialWorkspaceLoad/oracle-8	157M ±102%
InitialWorkspaceLoad/pkgsite-8	62.2M ±101%
InitialWorkspaceLoad/starlark-8	18.0M ±100%
InitialWorkspaceLoad/tools-8	41.5M ±101%
References/kubernetes-8
References/pkgsite-8
References/starlark-8
References/tools-8
Reload/kubernetes-8
Rename/kubernetes-8
Rename/pkgsite-8
Rename/starlark-8
Rename/tools-8
Typing/kubernetes/10ms-8
Typing/kubernetes/50ms-8
Typing/kubernetes/150ms-8
Typing/oracle/10ms-8
Typing/oracle/50ms-8
Typing/oracle/150ms-8
Typing/pkgsite/10ms-8
Typing/pkgsite/50ms-8
Typing/pkgsite/150ms-8
Typing/starlark/10ms-8
Typing/starlark/50ms-8
Typing/starlark/150ms-8
Typing/tools/10ms-8
Typing/tools/50ms-8
Typing/tools/150ms-8
WorkspaceSymbols/kubernetes-8
WorkspaceSymbols/oracle-8
WorkspaceSymbols/pkgsite-8
WorkspaceSymbols/starlark-8
WorkspaceSymbols/tools-8
[Geo mean]	75.7M

Go Performance Dashboard