Performance Result Comparison

label

common value

baseline-commit

6ce74ceaddcc4ff081d22ae134f4264a667d394f

benchmarks-commit

84f2805de5779fc1ba11d1763137518bc461e975

branch

release-branch.go1.21

coordinator@symbolic-datum-552.iam.gserviceaccount.com

cpu

Intel(R) Xeon(R) CPU @ 3.10GHz

experiment-commit

d2b79cdec8ff8fdd6466aec7776d7a834f3d885e

experiment-commit-time

2023-09-18T22:08:22Z

downloading golang.org/x/exp/typeparams v0.0.0-20221212164502-fae10dda9338

goarch

amd64

goos

linux

pkg

golang.org/x/tools/gopls/internal/regtest/bench

post-submit

true

repository

tools

runstamp

2023-09-18T22:16:45.6740467Z

toolchain-commit

2c1e5b05fe39fc5e6c730dd60e82946b8e67c6ba

upload

20230918.34

upload-file

results

upload-part

20230918.34/0

upload-time

2023-09-18T23:35:20Z

label

values

toolchain

upload:20230918.34:

380	"baseline"
380	"experiment"

	time/op
CodeAction/kubernetes-8	485µs ± 2%
CodeAction/oracle-8	177µs ±16%
CodeAction/pkgsite-8	1.92ms ± 8%
CodeAction/starlark-8	10.9ms ± 3%
CodeAction/tools-8	4.36ms ±13%
CodeActionFollowingEdit/kubernetes-8	22.7ms ±10%
CodeActionFollowingEdit/oracle-8	4.09ms ±157%
CodeActionFollowingEdit/pkgsite-8	60.2ms ±44%
CodeActionFollowingEdit/starlark-8	52.7ms ±25%
CodeActionFollowingEdit/tools-8	65.5ms ±24%
StructCompletion/tools-8	20.4ms ±67%
ImportCompletion/tools-8	1.26ms ± 2%
SliceCompletion/tools-8	22.4ms ±59%
FuncDeepCompletion/tools-8	29.4ms ±13%
CompletionFollowingEdit/tools-8	44.0ms ± 5%
CompletionFollowingEdit/kubernetes-8	143ms ±22%
CompletionFollowingEdit/oracle-8	318ms ±14%
Definition/kubernetes-8	274µs ±58%
Definition/pkgsite-8	239µs ± 6%
Definition/starlark-8	277µs ± 9%
Definition/tools-8	271µs ±18%
DidChange/kubernetes-8	1.70ms ±26%
DidChange/oracle-8	2.95ms ±60%
DidChange/pkgsite-8	2.39ms ±39%
DidChange/starlark-8	3.67ms ±39%
DidChange/tools-8	5.49ms ±44%
DiagnoseChange/kubernetes/diagnose-8	1.04s ±62%
DiagnoseChange/pkgsite/diagnose-8	150ms ±28%
DiagnoseChange/starlark/diagnose-8	114ms ±16%
DiagnoseChange/tools/diagnose-8	209ms ±22%
DiagnoseSave/kubernetes/diagnose-8	1.27s ±42%
DiagnoseSave/pkgsite/diagnose-8	304ms ±15%
DiagnoseSave/starlark/diagnose-8	183ms ± 8%
DiagnoseSave/tools/diagnose-8	325ms ±31%
Hover/kubernetes-8	453µs ±20%
Hover/pkgsite-8	349µs ±16%
Hover/starlark-8	340µs ± 9%
Hover/tools-8	1.29ms ± 2%
Implementations/kubernetes-8	120ms ±79%
Implementations/pkgsite-8	12.6ms ±29%
Implementations/starlark-8	2.49ms ± 3%
Implementations/tools-8	9.82ms ±39%
InitialWorkspaceLoad/kubernetes-8	8.39s ±63%
InitialWorkspaceLoad/oracle-8	5.90s ±67%
InitialWorkspaceLoad/pkgsite-8	1.37s ±67%
InitialWorkspaceLoad/starlark-8	499ms ±68%
InitialWorkspaceLoad/tools-8	1.42s ±68%
References/kubernetes-8	1.59ms ± 8%
References/pkgsite-8	12.0ms ±25%
References/starlark-8	2.51ms ± 5%
References/tools-8	9.34ms ± 9%
Reload/kubernetes-8	301ms ± 3%
Rename/kubernetes-8	716ms ±91%
Rename/pkgsite-8	270ms ±25%
Rename/starlark-8	102ms ±16%
Rename/tools-8	100ms ±19%
Typing/kubernetes/10ms-8	10.0ms ± 0%
Typing/kubernetes/50ms-8	50.0ms ± 0%
Typing/kubernetes/150ms-8	150ms ± 0%
Typing/oracle/10ms-8	10.0ms ± 0%
Typing/oracle/50ms-8	50.0ms ± 0%
Typing/oracle/150ms-8	150ms ± 0%
Typing/pkgsite/10ms-8	10.0ms ± 0%
Typing/pkgsite/50ms-8	50.0ms ± 0%
Typing/pkgsite/150ms-8	150ms ± 0%
Typing/starlark/10ms-8	10.0ms ± 0%
Typing/starlark/50ms-8	50.0ms ± 0%
Typing/starlark/150ms-8	150ms ± 0%
Typing/tools/10ms-8	10.0ms ± 0%
Typing/tools/50ms-8	50.0ms ± 0%
Typing/tools/150ms-8	150ms ± 0%
WorkspaceSymbols/oracle-8	83.8ms ±18%
WorkspaceSymbols/pkgsite-8	23.7ms ± 6%
WorkspaceSymbols/tools-8	10.6ms ± 9%
WorkspaceSymbols/starlark-8	6.57ms ± 3%
WorkspaceSymbols/kubernetes-8	100ms ±24%
[Geo mean]	23.9ms

	cpu_seconds/op
CodeAction/kubernetes-8	0.00 ± 5%
CodeAction/oracle-8	0.00 ±88%
CodeAction/pkgsite-8	0.00 ±16%
CodeAction/starlark-8	0.02 ± 6%
CodeAction/tools-8	0.01 ±16%
CodeActionFollowingEdit/kubernetes-8	0.04 ±58%
CodeActionFollowingEdit/oracle-8	0.02 ±204%
CodeActionFollowingEdit/pkgsite-8	0.14 ±71%
CodeActionFollowingEdit/starlark-8	0.12 ±51%
CodeActionFollowingEdit/tools-8	0.16 ±63%
StructCompletion/tools-8	0.03 ±83%
ImportCompletion/tools-8	0.00 ±12%
SliceCompletion/tools-8	0.03 ±26%
FuncDeepCompletion/tools-8	0.04 ± 8%
CompletionFollowingEdit/tools-8	0.09 ±24%
CompletionFollowingEdit/kubernetes-8	0.23 ±13%
CompletionFollowingEdit/oracle-8	0.79 ±64%
Definition/kubernetes-8	0.00 ±30%
Definition/pkgsite-8	0.00 ± 9%
Definition/starlark-8	0.00 ±17%
Definition/tools-8	0.00 ± 4%
DidChange/kubernetes-8	0.00 ± 9%
DidChange/oracle-8	0.01 ±209%
DidChange/pkgsite-8	0.00 ±84%
DidChange/starlark-8	0.01 ±61%
DidChange/tools-8	0.01 ±81%
DiagnoseChange/kubernetes/diagnose-8	4.14 ±64%
DiagnoseChange/pkgsite/diagnose-8	0.46 ±65%
DiagnoseChange/starlark/diagnose-8	0.40 ±42%
DiagnoseChange/tools/diagnose-8	0.78 ±43%
DiagnoseSave/kubernetes/diagnose-8	4.72 ±65%
DiagnoseSave/pkgsite/diagnose-8	0.72 ±45%
DiagnoseSave/starlark/diagnose-8	0.67 ±44%
DiagnoseSave/tools/diagnose-8	1.14 ±36%
Hover/kubernetes-8	0.00 ±27%
Hover/pkgsite-8	0.00 ±27%
Hover/starlark-8	0.00 ± 6%
Hover/tools-8	0.00 ±11%
Implementations/kubernetes-8	0.28 ±39%
Implementations/pkgsite-8	0.03 ±57%
Implementations/starlark-8	0.01 ±60%
Implementations/tools-8	0.02 ±50%
InitialWorkspaceLoad/kubernetes-8
InitialWorkspaceLoad/oracle-8
InitialWorkspaceLoad/pkgsite-8
InitialWorkspaceLoad/starlark-8
InitialWorkspaceLoad/tools-8
References/kubernetes-8	0.00 ±36%
References/pkgsite-8	0.01 ± 5%
References/starlark-8	0.00 ±35%
References/tools-8	0.02 ±47%
Reload/kubernetes-8	0.18 ±50%
Rename/kubernetes-8	3.22 ±94%
Rename/pkgsite-8	0.89 ±35%
Rename/starlark-8	0.23 ±23%
Rename/tools-8	0.21 ±49%
Typing/kubernetes/10ms-8	0.06 ±29%
Typing/kubernetes/50ms-8	0.20 ±50%
Typing/kubernetes/150ms-8	0.59 ±56%
Typing/oracle/10ms-8	0.08 ±95%
Typing/oracle/50ms-8	0.36 ±39%
Typing/oracle/150ms-8	0.52 ±46%
Typing/pkgsite/10ms-8	0.02 ±67%
Typing/pkgsite/50ms-8	0.10 ± 7%
Typing/pkgsite/150ms-8	0.18 ±11%
Typing/starlark/10ms-8	0.02 ±70%
Typing/starlark/50ms-8	0.08 ±21%
Typing/starlark/150ms-8	0.12 ±26%
Typing/tools/10ms-8	0.03 ±53%
Typing/tools/50ms-8	0.11 ±21%
Typing/tools/150ms-8	0.21 ±17%
WorkspaceSymbols/oracle-8	0.30 ± 4%
WorkspaceSymbols/pkgsite-8	0.08 ±14%
WorkspaceSymbols/tools-8	0.04 ± 1%
WorkspaceSymbols/starlark-8	0.02 ± 2%
WorkspaceSymbols/kubernetes-8	0.32 ± 5%
[Geo mean]	0.04

	alloc_bytes
CodeAction/kubernetes-8
CodeAction/oracle-8
CodeAction/pkgsite-8
CodeAction/starlark-8
CodeAction/tools-8
CodeActionFollowingEdit/kubernetes-8
CodeActionFollowingEdit/oracle-8
CodeActionFollowingEdit/pkgsite-8
CodeActionFollowingEdit/starlark-8
CodeActionFollowingEdit/tools-8
StructCompletion/tools-8
ImportCompletion/tools-8
SliceCompletion/tools-8
FuncDeepCompletion/tools-8
CompletionFollowingEdit/tools-8
CompletionFollowingEdit/kubernetes-8
CompletionFollowingEdit/oracle-8
Definition/kubernetes-8
Definition/pkgsite-8
Definition/starlark-8
Definition/tools-8
DidChange/kubernetes-8
DidChange/oracle-8
DidChange/pkgsite-8
DidChange/starlark-8
DidChange/tools-8
DiagnoseChange/kubernetes/diagnose-8
DiagnoseChange/pkgsite/diagnose-8
DiagnoseChange/starlark/diagnose-8
DiagnoseChange/tools/diagnose-8
DiagnoseSave/kubernetes/diagnose-8
DiagnoseSave/pkgsite/diagnose-8
DiagnoseSave/starlark/diagnose-8
DiagnoseSave/tools/diagnose-8
Hover/kubernetes-8
Hover/pkgsite-8
Hover/starlark-8
Hover/tools-8
Implementations/kubernetes-8
Implementations/pkgsite-8
Implementations/starlark-8
Implementations/tools-8
InitialWorkspaceLoad/kubernetes-8	1.20G ±80%
InitialWorkspaceLoad/oracle-8	784M ±83%
InitialWorkspaceLoad/pkgsite-8	194M ±71%
InitialWorkspaceLoad/starlark-8	59.9M ±75%
InitialWorkspaceLoad/tools-8	209M ±83%
References/kubernetes-8
References/pkgsite-8
References/starlark-8
References/tools-8
Reload/kubernetes-8
Rename/kubernetes-8
Rename/pkgsite-8
Rename/starlark-8
Rename/tools-8
Typing/kubernetes/10ms-8
Typing/kubernetes/50ms-8
Typing/kubernetes/150ms-8
Typing/oracle/10ms-8
Typing/oracle/50ms-8
Typing/oracle/150ms-8
Typing/pkgsite/10ms-8
Typing/pkgsite/50ms-8
Typing/pkgsite/150ms-8
Typing/starlark/10ms-8
Typing/starlark/50ms-8
Typing/starlark/150ms-8
Typing/tools/10ms-8
Typing/tools/50ms-8
Typing/tools/150ms-8
WorkspaceSymbols/oracle-8
WorkspaceSymbols/pkgsite-8
WorkspaceSymbols/tools-8
WorkspaceSymbols/starlark-8
WorkspaceSymbols/kubernetes-8
[Geo mean]	296M

	in_use_bytes
CodeAction/kubernetes-8
CodeAction/oracle-8
CodeAction/pkgsite-8
CodeAction/starlark-8
CodeAction/tools-8
CodeActionFollowingEdit/kubernetes-8
CodeActionFollowingEdit/oracle-8
CodeActionFollowingEdit/pkgsite-8
CodeActionFollowingEdit/starlark-8
CodeActionFollowingEdit/tools-8
StructCompletion/tools-8
ImportCompletion/tools-8
SliceCompletion/tools-8
FuncDeepCompletion/tools-8
CompletionFollowingEdit/tools-8
CompletionFollowingEdit/kubernetes-8
CompletionFollowingEdit/oracle-8
Definition/kubernetes-8
Definition/pkgsite-8
Definition/starlark-8
Definition/tools-8
DidChange/kubernetes-8
DidChange/oracle-8
DidChange/pkgsite-8
DidChange/starlark-8
DidChange/tools-8
DiagnoseChange/kubernetes/diagnose-8
DiagnoseChange/pkgsite/diagnose-8
DiagnoseChange/starlark/diagnose-8
DiagnoseChange/tools/diagnose-8
DiagnoseSave/kubernetes/diagnose-8
DiagnoseSave/pkgsite/diagnose-8
DiagnoseSave/starlark/diagnose-8
DiagnoseSave/tools/diagnose-8
Hover/kubernetes-8
Hover/pkgsite-8
Hover/starlark-8
Hover/tools-8
Implementations/kubernetes-8
Implementations/pkgsite-8
Implementations/starlark-8
Implementations/tools-8
InitialWorkspaceLoad/kubernetes-8	1.38G ±82%
InitialWorkspaceLoad/oracle-8	885M ±79%
InitialWorkspaceLoad/pkgsite-8	259M ±80%
InitialWorkspaceLoad/starlark-8	80.9M ±76%
InitialWorkspaceLoad/tools-8	244M ±82%
References/kubernetes-8
References/pkgsite-8
References/starlark-8
References/tools-8
Reload/kubernetes-8
Rename/kubernetes-8
Rename/pkgsite-8
Rename/starlark-8
Rename/tools-8
Typing/kubernetes/10ms-8
Typing/kubernetes/50ms-8
Typing/kubernetes/150ms-8
Typing/oracle/10ms-8
Typing/oracle/50ms-8
Typing/oracle/150ms-8
Typing/pkgsite/10ms-8
Typing/pkgsite/50ms-8
Typing/pkgsite/150ms-8
Typing/starlark/10ms-8
Typing/starlark/50ms-8
Typing/starlark/150ms-8
Typing/tools/10ms-8
Typing/tools/50ms-8
Typing/tools/150ms-8
WorkspaceSymbols/oracle-8
WorkspaceSymbols/pkgsite-8
WorkspaceSymbols/tools-8
WorkspaceSymbols/starlark-8
WorkspaceSymbols/kubernetes-8
[Geo mean]	362M

	total_alloc_bytes
CodeAction/kubernetes-8
CodeAction/oracle-8
CodeAction/pkgsite-8
CodeAction/starlark-8
CodeAction/tools-8
CodeActionFollowingEdit/kubernetes-8
CodeActionFollowingEdit/oracle-8
CodeActionFollowingEdit/pkgsite-8
CodeActionFollowingEdit/starlark-8
CodeActionFollowingEdit/tools-8
StructCompletion/tools-8
ImportCompletion/tools-8
SliceCompletion/tools-8
FuncDeepCompletion/tools-8
CompletionFollowingEdit/tools-8
CompletionFollowingEdit/kubernetes-8
CompletionFollowingEdit/oracle-8
Definition/kubernetes-8
Definition/pkgsite-8
Definition/starlark-8
Definition/tools-8
DidChange/kubernetes-8
DidChange/oracle-8
DidChange/pkgsite-8
DidChange/starlark-8
DidChange/tools-8
DiagnoseChange/kubernetes/diagnose-8
DiagnoseChange/pkgsite/diagnose-8
DiagnoseChange/starlark/diagnose-8
DiagnoseChange/tools/diagnose-8
DiagnoseSave/kubernetes/diagnose-8
DiagnoseSave/pkgsite/diagnose-8
DiagnoseSave/starlark/diagnose-8
DiagnoseSave/tools/diagnose-8
Hover/kubernetes-8
Hover/pkgsite-8
Hover/starlark-8
Hover/tools-8
Implementations/kubernetes-8
Implementations/pkgsite-8
Implementations/starlark-8
Implementations/tools-8
InitialWorkspaceLoad/kubernetes-8	333M ±243%
InitialWorkspaceLoad/oracle-8	157M ±101%
InitialWorkspaceLoad/pkgsite-8	62.3M ±100%
InitialWorkspaceLoad/starlark-8	18.2M ±100%
InitialWorkspaceLoad/tools-8	41.3M ±102%
References/kubernetes-8
References/pkgsite-8
References/starlark-8
References/tools-8
Reload/kubernetes-8
Rename/kubernetes-8
Rename/pkgsite-8
Rename/starlark-8
Rename/tools-8
Typing/kubernetes/10ms-8
Typing/kubernetes/50ms-8
Typing/kubernetes/150ms-8
Typing/oracle/10ms-8
Typing/oracle/50ms-8
Typing/oracle/150ms-8
Typing/pkgsite/10ms-8
Typing/pkgsite/50ms-8
Typing/pkgsite/150ms-8
Typing/starlark/10ms-8
Typing/starlark/50ms-8
Typing/starlark/150ms-8
Typing/tools/10ms-8
Typing/tools/50ms-8
Typing/tools/150ms-8
WorkspaceSymbols/oracle-8
WorkspaceSymbols/pkgsite-8
WorkspaceSymbols/tools-8
WorkspaceSymbols/starlark-8
WorkspaceSymbols/kubernetes-8
[Geo mean]	75.4M

Go Performance Dashboard