Performance Result Comparison

label

common value

baseline-commit

6ce74ceaddcc4ff081d22ae134f4264a667d394f

benchmarks-commit

84f2805de5779fc1ba11d1763137518bc461e975

branch

release-branch.go1.21

coordinator@symbolic-datum-552.iam.gserviceaccount.com

cpu

Intel(R) Xeon(R) CPU @ 3.10GHz

experiment-commit

6d90c13c7adeddfe171a42742d380b6c9095f7ca

experiment-commit-time

2023-09-18T19:10:26Z

downloading golang.org/x/exp/typeparams v0.0.0-20221212164502-fae10dda9338

goarch

amd64

goos

linux

pkg

golang.org/x/tools/gopls/internal/regtest/bench

post-submit

true

repository

tools

runstamp

2023-09-18T19:18:30.560556004Z

toolchain-commit

2c1e5b05fe39fc5e6c730dd60e82946b8e67c6ba

upload

20230918.21

upload-file

results

upload-part

20230918.21/0

upload-time

2023-09-18T20:36:56Z

label

values

toolchain

upload:20230918.21:

380	"baseline"
380	"experiment"

	time/op
CodeAction/kubernetes-8	526µs ±24%
CodeAction/oracle-8	169µs ±17%
CodeAction/pkgsite-8	1.89ms ± 9%
CodeAction/starlark-8	10.7ms ± 3%
CodeAction/tools-8	4.26ms ±12%
CodeActionFollowingEdit/kubernetes-8	22.6ms ±16%
CodeActionFollowingEdit/oracle-8	3.91ms ±187%
CodeActionFollowingEdit/pkgsite-8	58.4ms ±41%
CodeActionFollowingEdit/starlark-8	51.5ms ±23%
CodeActionFollowingEdit/tools-8	65.2ms ±29%
StructCompletion/tools-8	19.8ms ±66%
ImportCompletion/tools-8	1.27ms ± 4%
SliceCompletion/tools-8	19.9ms ±24%
FuncDeepCompletion/tools-8	29.2ms ±19%
CompletionFollowingEdit/tools-8	42.9ms ± 6%
CompletionFollowingEdit/kubernetes-8	162ms ± 2%
CompletionFollowingEdit/oracle-8	294ms ±10%
Definition/kubernetes-8	272µs ±53%
Definition/pkgsite-8	244µs ± 7%
Definition/starlark-8	277µs ± 8%
Definition/tools-8	269µs ±16%
DidChange/kubernetes-8	1.66ms ±16%
DidChange/oracle-8	2.64ms ±22%
DidChange/pkgsite-8	2.35ms ±39%
DidChange/starlark-8	3.66ms ±39%
DidChange/tools-8	5.44ms ±45%
DiagnoseChange/kubernetes/diagnose-8	1.01s ±60%
DiagnoseChange/pkgsite/diagnose-8	147ms ±27%
DiagnoseChange/starlark/diagnose-8	112ms ±23%
DiagnoseChange/tools/diagnose-8	202ms ±25%
DiagnoseSave/kubernetes/diagnose-8	1.18s ±50%
DiagnoseSave/pkgsite/diagnose-8	301ms ±15%
DiagnoseSave/starlark/diagnose-8	194ms ±12%
DiagnoseSave/tools/diagnose-8	328ms ±20%
Hover/kubernetes-8	450µs ±21%
Hover/pkgsite-8	422µs ±30%
Hover/starlark-8	336µs ± 4%
Hover/tools-8	1.28ms ± 1%
Implementations/kubernetes-8	114ms ±50%
Implementations/pkgsite-8	11.9ms ±22%
Implementations/starlark-8	2.48ms ± 8%
Implementations/tools-8	8.99ms ±24%
InitialWorkspaceLoad/kubernetes-8	8.31s ±61%
InitialWorkspaceLoad/oracle-8	5.81s ±66%
InitialWorkspaceLoad/pkgsite-8	1.35s ±67%
InitialWorkspaceLoad/starlark-8	504ms ±70%
InitialWorkspaceLoad/tools-8	1.40s ±77%
References/kubernetes-8	1.59ms ± 9%
References/pkgsite-8	11.7ms ±25%
References/starlark-8	2.48ms ± 4%
References/tools-8	8.63ms ± 3%
Reload/kubernetes-8	298ms ± 2%
Rename/kubernetes-8	683ms ±98%
Rename/pkgsite-8	259ms ±25%
Rename/starlark-8	101ms ±14%
Rename/tools-8	97.8ms ±12%
Typing/kubernetes/10ms-8	10.0ms ± 0%
Typing/kubernetes/50ms-8	50.0ms ± 0%
Typing/kubernetes/150ms-8	150ms ± 0%
Typing/oracle/10ms-8	10.0ms ± 0%
Typing/oracle/50ms-8	50.0ms ± 0%
Typing/oracle/150ms-8	150ms ± 0%
Typing/pkgsite/10ms-8	10.0ms ± 0%
Typing/pkgsite/50ms-8	50.0ms ± 0%
Typing/pkgsite/150ms-8	150ms ± 0%
Typing/starlark/10ms-8	10.0ms ± 0%
Typing/starlark/50ms-8	50.0ms ± 0%
Typing/starlark/150ms-8	150ms ± 0%
Typing/tools/10ms-8	10.0ms ± 0%
Typing/tools/50ms-8	50.0ms ± 0%
Typing/tools/150ms-8	150ms ± 0%
WorkspaceSymbols/pkgsite-8	22.7ms ± 5%
WorkspaceSymbols/starlark-8	6.52ms ± 3%
WorkspaceSymbols/tools-8	10.3ms ± 8%
WorkspaceSymbols/kubernetes-8	96.1ms ±30%
WorkspaceSymbols/oracle-8	81.9ms ±12%
[Geo mean]	23.6ms

	cpu_seconds/op
CodeAction/kubernetes-8	0.00 ±148%
CodeAction/oracle-8	0.00 ± 7%
CodeAction/pkgsite-8	0.00 ±17%
CodeAction/starlark-8	0.02 ± 7%
CodeAction/tools-8	0.01 ±18%
CodeActionFollowingEdit/kubernetes-8	0.06 ±109%
CodeActionFollowingEdit/oracle-8	0.02 ±259%
CodeActionFollowingEdit/pkgsite-8	0.14 ±63%
CodeActionFollowingEdit/starlark-8	0.12 ±51%
CodeActionFollowingEdit/tools-8	0.16 ±60%
StructCompletion/tools-8	0.02 ±29%
ImportCompletion/tools-8	0.00 ±12%
SliceCompletion/tools-8	0.03 ±31%
FuncDeepCompletion/tools-8	0.04 ± 6%
CompletionFollowingEdit/tools-8	0.08 ±27%
CompletionFollowingEdit/kubernetes-8	0.29 ±46%
CompletionFollowingEdit/oracle-8	0.58 ±71%
Definition/kubernetes-8	0.00 ±22%
Definition/pkgsite-8	0.00 ±24%
Definition/starlark-8	0.00 ±24%
Definition/tools-8	0.00 ± 5%
DidChange/kubernetes-8	0.00 ±20%
DidChange/oracle-8	0.01 ±242%
DidChange/pkgsite-8	0.00 ±74%
DidChange/starlark-8	0.01 ±61%
DidChange/tools-8	0.01 ±78%
DiagnoseChange/kubernetes/diagnose-8	3.65 ±62%
DiagnoseChange/pkgsite/diagnose-8	0.45 ±64%
DiagnoseChange/starlark/diagnose-8	0.39 ±47%
DiagnoseChange/tools/diagnose-8	0.73 ±48%
DiagnoseSave/kubernetes/diagnose-8	4.69 ±67%
DiagnoseSave/pkgsite/diagnose-8	0.71 ±45%
DiagnoseSave/starlark/diagnose-8	0.67 ±40%
DiagnoseSave/tools/diagnose-8	1.07 ±46%
Hover/kubernetes-8	0.00 ±58%
Hover/pkgsite-8	0.00 ±42%
Hover/starlark-8	0.00 ± 9%
Hover/tools-8	0.00 ±37%
Implementations/kubernetes-8	0.26 ±46%
Implementations/pkgsite-8	0.03 ±68%
Implementations/starlark-8	0.01 ±60%
Implementations/tools-8	0.02 ±51%
InitialWorkspaceLoad/kubernetes-8
InitialWorkspaceLoad/oracle-8
InitialWorkspaceLoad/pkgsite-8
InitialWorkspaceLoad/starlark-8
InitialWorkspaceLoad/tools-8
References/kubernetes-8	0.00 ±35%
References/pkgsite-8	0.01 ± 5%
References/starlark-8	0.00 ±35%
References/tools-8	0.01 ±44%
Reload/kubernetes-8	0.17 ±40%
Rename/kubernetes-8	3.05 ±102%
Rename/pkgsite-8	0.86 ±31%
Rename/starlark-8	0.23 ±19%
Rename/tools-8	0.21 ±43%
Typing/kubernetes/10ms-8	0.05 ±32%
Typing/kubernetes/50ms-8	0.21 ±66%
Typing/kubernetes/150ms-8	0.53 ±53%
Typing/oracle/10ms-8	0.08 ±103%
Typing/oracle/50ms-8	0.36 ±31%
Typing/oracle/150ms-8	0.51 ±48%
Typing/pkgsite/10ms-8	0.02 ±68%
Typing/pkgsite/50ms-8	0.10 ± 8%
Typing/pkgsite/150ms-8	0.18 ±14%
Typing/starlark/10ms-8	0.02 ±73%
Typing/starlark/50ms-8	0.08 ±24%
Typing/starlark/150ms-8	0.12 ±23%
Typing/tools/10ms-8	0.02 ±59%
Typing/tools/50ms-8	0.11 ±18%
Typing/tools/150ms-8	0.21 ±17%
WorkspaceSymbols/pkgsite-8	0.08 ± 8%
WorkspaceSymbols/starlark-8	0.02 ± 5%
WorkspaceSymbols/tools-8	0.04 ± 2%
WorkspaceSymbols/kubernetes-8	0.32 ± 8%
WorkspaceSymbols/oracle-8	0.30 ± 3%
[Geo mean]	0.04

	alloc_bytes
CodeAction/kubernetes-8
CodeAction/oracle-8
CodeAction/pkgsite-8
CodeAction/starlark-8
CodeAction/tools-8
CodeActionFollowingEdit/kubernetes-8
CodeActionFollowingEdit/oracle-8
CodeActionFollowingEdit/pkgsite-8
CodeActionFollowingEdit/starlark-8
CodeActionFollowingEdit/tools-8
StructCompletion/tools-8
ImportCompletion/tools-8
SliceCompletion/tools-8
FuncDeepCompletion/tools-8
CompletionFollowingEdit/tools-8
CompletionFollowingEdit/kubernetes-8
CompletionFollowingEdit/oracle-8
Definition/kubernetes-8
Definition/pkgsite-8
Definition/starlark-8
Definition/tools-8
DidChange/kubernetes-8
DidChange/oracle-8
DidChange/pkgsite-8
DidChange/starlark-8
DidChange/tools-8
DiagnoseChange/kubernetes/diagnose-8
DiagnoseChange/pkgsite/diagnose-8
DiagnoseChange/starlark/diagnose-8
DiagnoseChange/tools/diagnose-8
DiagnoseSave/kubernetes/diagnose-8
DiagnoseSave/pkgsite/diagnose-8
DiagnoseSave/starlark/diagnose-8
DiagnoseSave/tools/diagnose-8
Hover/kubernetes-8
Hover/pkgsite-8
Hover/starlark-8
Hover/tools-8
Implementations/kubernetes-8
Implementations/pkgsite-8
Implementations/starlark-8
Implementations/tools-8
InitialWorkspaceLoad/kubernetes-8	1.19G ±80%
InitialWorkspaceLoad/oracle-8	783M ±83%
InitialWorkspaceLoad/pkgsite-8	194M ±71%
InitialWorkspaceLoad/starlark-8	59.9M ±75%
InitialWorkspaceLoad/tools-8	209M ±83%
References/kubernetes-8
References/pkgsite-8
References/starlark-8
References/tools-8
Reload/kubernetes-8
Rename/kubernetes-8
Rename/pkgsite-8
Rename/starlark-8
Rename/tools-8
Typing/kubernetes/10ms-8
Typing/kubernetes/50ms-8
Typing/kubernetes/150ms-8
Typing/oracle/10ms-8
Typing/oracle/50ms-8
Typing/oracle/150ms-8
Typing/pkgsite/10ms-8
Typing/pkgsite/50ms-8
Typing/pkgsite/150ms-8
Typing/starlark/10ms-8
Typing/starlark/50ms-8
Typing/starlark/150ms-8
Typing/tools/10ms-8
Typing/tools/50ms-8
Typing/tools/150ms-8
WorkspaceSymbols/pkgsite-8
WorkspaceSymbols/starlark-8
WorkspaceSymbols/tools-8
WorkspaceSymbols/kubernetes-8
WorkspaceSymbols/oracle-8
[Geo mean]	296M

	in_use_bytes
CodeAction/kubernetes-8
CodeAction/oracle-8
CodeAction/pkgsite-8
CodeAction/starlark-8
CodeAction/tools-8
CodeActionFollowingEdit/kubernetes-8
CodeActionFollowingEdit/oracle-8
CodeActionFollowingEdit/pkgsite-8
CodeActionFollowingEdit/starlark-8
CodeActionFollowingEdit/tools-8
StructCompletion/tools-8
ImportCompletion/tools-8
SliceCompletion/tools-8
FuncDeepCompletion/tools-8
CompletionFollowingEdit/tools-8
CompletionFollowingEdit/kubernetes-8
CompletionFollowingEdit/oracle-8
Definition/kubernetes-8
Definition/pkgsite-8
Definition/starlark-8
Definition/tools-8
DidChange/kubernetes-8
DidChange/oracle-8
DidChange/pkgsite-8
DidChange/starlark-8
DidChange/tools-8
DiagnoseChange/kubernetes/diagnose-8
DiagnoseChange/pkgsite/diagnose-8
DiagnoseChange/starlark/diagnose-8
DiagnoseChange/tools/diagnose-8
DiagnoseSave/kubernetes/diagnose-8
DiagnoseSave/pkgsite/diagnose-8
DiagnoseSave/starlark/diagnose-8
DiagnoseSave/tools/diagnose-8
Hover/kubernetes-8
Hover/pkgsite-8
Hover/starlark-8
Hover/tools-8
Implementations/kubernetes-8
Implementations/pkgsite-8
Implementations/starlark-8
Implementations/tools-8
InitialWorkspaceLoad/kubernetes-8	1.37G ±78%
InitialWorkspaceLoad/oracle-8	896M ±83%
InitialWorkspaceLoad/pkgsite-8	262M ±75%
InitialWorkspaceLoad/starlark-8	80.4M ±83%
InitialWorkspaceLoad/tools-8	244M ±82%
References/kubernetes-8
References/pkgsite-8
References/starlark-8
References/tools-8
Reload/kubernetes-8
Rename/kubernetes-8
Rename/pkgsite-8
Rename/starlark-8
Rename/tools-8
Typing/kubernetes/10ms-8
Typing/kubernetes/50ms-8
Typing/kubernetes/150ms-8
Typing/oracle/10ms-8
Typing/oracle/50ms-8
Typing/oracle/150ms-8
Typing/pkgsite/10ms-8
Typing/pkgsite/50ms-8
Typing/pkgsite/150ms-8
Typing/starlark/10ms-8
Typing/starlark/50ms-8
Typing/starlark/150ms-8
Typing/tools/10ms-8
Typing/tools/50ms-8
Typing/tools/150ms-8
WorkspaceSymbols/pkgsite-8
WorkspaceSymbols/starlark-8
WorkspaceSymbols/tools-8
WorkspaceSymbols/kubernetes-8
WorkspaceSymbols/oracle-8
[Geo mean]	363M

	total_alloc_bytes
CodeAction/kubernetes-8
CodeAction/oracle-8
CodeAction/pkgsite-8
CodeAction/starlark-8
CodeAction/tools-8
CodeActionFollowingEdit/kubernetes-8
CodeActionFollowingEdit/oracle-8
CodeActionFollowingEdit/pkgsite-8
CodeActionFollowingEdit/starlark-8
CodeActionFollowingEdit/tools-8
StructCompletion/tools-8
ImportCompletion/tools-8
SliceCompletion/tools-8
FuncDeepCompletion/tools-8
CompletionFollowingEdit/tools-8
CompletionFollowingEdit/kubernetes-8
CompletionFollowingEdit/oracle-8
Definition/kubernetes-8
Definition/pkgsite-8
Definition/starlark-8
Definition/tools-8
DidChange/kubernetes-8
DidChange/oracle-8
DidChange/pkgsite-8
DidChange/starlark-8
DidChange/tools-8
DiagnoseChange/kubernetes/diagnose-8
DiagnoseChange/pkgsite/diagnose-8
DiagnoseChange/starlark/diagnose-8
DiagnoseChange/tools/diagnose-8
DiagnoseSave/kubernetes/diagnose-8
DiagnoseSave/pkgsite/diagnose-8
DiagnoseSave/starlark/diagnose-8
DiagnoseSave/tools/diagnose-8
Hover/kubernetes-8
Hover/pkgsite-8
Hover/starlark-8
Hover/tools-8
Implementations/kubernetes-8
Implementations/pkgsite-8
Implementations/starlark-8
Implementations/tools-8
InitialWorkspaceLoad/kubernetes-8	332M ±243%
InitialWorkspaceLoad/oracle-8	156M ±101%
InitialWorkspaceLoad/pkgsite-8	62.3M ±100%
InitialWorkspaceLoad/starlark-8	18.2M ±101%
InitialWorkspaceLoad/tools-8	41.2M ±101%
References/kubernetes-8
References/pkgsite-8
References/starlark-8
References/tools-8
Reload/kubernetes-8
Rename/kubernetes-8
Rename/pkgsite-8
Rename/starlark-8
Rename/tools-8
Typing/kubernetes/10ms-8
Typing/kubernetes/50ms-8
Typing/kubernetes/150ms-8
Typing/oracle/10ms-8
Typing/oracle/50ms-8
Typing/oracle/150ms-8
Typing/pkgsite/10ms-8
Typing/pkgsite/50ms-8
Typing/pkgsite/150ms-8
Typing/starlark/10ms-8
Typing/starlark/50ms-8
Typing/starlark/150ms-8
Typing/tools/10ms-8
Typing/tools/50ms-8
Typing/tools/150ms-8
WorkspaceSymbols/pkgsite-8
WorkspaceSymbols/starlark-8
WorkspaceSymbols/tools-8
WorkspaceSymbols/kubernetes-8
WorkspaceSymbols/oracle-8
[Geo mean]	75.2M

Go Performance Dashboard