Performance Result Comparison

label

common value

baseline-commit

6ce74ceaddcc4ff081d22ae134f4264a667d394f

benchmarks-commit

84f2805de5779fc1ba11d1763137518bc461e975

branch

release-branch.go1.20

coordinator@symbolic-datum-552.iam.gserviceaccount.com

cpu

Intel(R) Xeon(R) CPU @ 3.10GHz

experiment-commit

d2b79cdec8ff8fdd6466aec7776d7a834f3d885e

experiment-commit-time

2023-09-18T22:08:22Z

downloading golang.org/x/exp/typeparams v0.0.0-20221212164502-fae10dda9338

goarch

amd64

goos

linux

pkg

golang.org/x/tools/gopls/internal/regtest/bench

post-submit

true

repository

tools

runstamp

2023-09-18T22:16:04.183579632Z

toolchain-commit

d5b851804329aa547dafa278a0c35dd62298d651

upload

20230918.36

upload-file

results

upload-part

20230918.36/0

upload-time

2023-09-18T23:38:07Z

label

values

toolchain

upload:20230918.36:

380	"baseline"
380	"experiment"

	time/op
CodeAction/kubernetes-8	476µs ± 3%
CodeAction/oracle-8	174µs ±20%
CodeAction/pkgsite-8	1.90ms ± 9%
CodeAction/starlark-8	10.9ms ± 4%
CodeAction/tools-8	4.31ms ±11%
CodeActionFollowingEdit/kubernetes-8	22.2ms ±18%
CodeActionFollowingEdit/oracle-8	3.09ms ±255%
CodeActionFollowingEdit/pkgsite-8	59.1ms ±39%
CodeActionFollowingEdit/starlark-8	52.1ms ±24%
CodeActionFollowingEdit/tools-8	65.7ms ±29%
StructCompletion/tools-8	19.7ms ±69%
ImportCompletion/tools-8	1.28ms ± 3%
SliceCompletion/tools-8	19.7ms ±20%
FuncDeepCompletion/tools-8	29.9ms ± 8%
CompletionFollowingEdit/tools-8	43.5ms ± 5%
CompletionFollowingEdit/kubernetes-8	143ms ±23%
CompletionFollowingEdit/oracle-8	299ms ±10%
Definition/kubernetes-8	299µs ±46%
Definition/pkgsite-8	247µs ± 4%
Definition/starlark-8	280µs ± 9%
Definition/tools-8	275µs ±19%
DidChange/kubernetes-8	1.69ms ±17%
DidChange/oracle-8	3.13ms ±53%
DidChange/pkgsite-8	2.35ms ±37%
DidChange/starlark-8	3.70ms ±41%
DidChange/tools-8	5.47ms ±45%
DiagnoseChange/kubernetes/diagnose-8	961ms ±40%
DiagnoseChange/pkgsite/diagnose-8	146ms ±25%
DiagnoseChange/starlark/diagnose-8	112ms ±23%
DiagnoseChange/tools/diagnose-8	205ms ±25%
DiagnoseSave/kubernetes/diagnose-8	1.34s ±59%
DiagnoseSave/pkgsite/diagnose-8	293ms ±17%
DiagnoseSave/starlark/diagnose-8	196ms ±17%
DiagnoseSave/tools/diagnose-8	286ms ±18%
Hover/kubernetes-8	529µs ± 8%
Hover/pkgsite-8	341µs ±13%
Hover/starlark-8	340µs ± 4%
Hover/tools-8	1.29ms ± 4%
Implementations/kubernetes-8	125ms ±80%
Implementations/pkgsite-8	12.9ms ±38%
Implementations/starlark-8	2.31ms ± 4%
Implementations/tools-8	10.0ms ±32%
InitialWorkspaceLoad/kubernetes-8	11.3s ±46%
InitialWorkspaceLoad/oracle-8	5.83s ±67%
InitialWorkspaceLoad/pkgsite-8	1.48s ±59%
InitialWorkspaceLoad/starlark-8	506ms ±68%
InitialWorkspaceLoad/tools-8	1.51s ±65%
References/kubernetes-8	1.54ms ± 3%
References/pkgsite-8	12.3ms ±28%
References/starlark-8	2.42ms ± 1%
References/tools-8	9.42ms ±12%
Reload/kubernetes-8	298ms ± 4%
Rename/kubernetes-8	692ms ±122%
Rename/pkgsite-8	255ms ±27%
Rename/starlark-8	100ms ±15%
Rename/tools-8	97.8ms ±15%
Typing/kubernetes/10ms-8	10.0ms ± 0%
Typing/kubernetes/50ms-8	50.0ms ± 0%
Typing/kubernetes/150ms-8	150ms ± 0%
Typing/oracle/10ms-8	10.0ms ± 1%
Typing/oracle/50ms-8	50.0ms ± 0%
Typing/oracle/150ms-8	150ms ± 0%
Typing/pkgsite/10ms-8	10.0ms ± 0%
Typing/pkgsite/50ms-8	50.0ms ± 0%
Typing/pkgsite/150ms-8	150ms ± 0%
Typing/starlark/10ms-8	10.0ms ± 0%
Typing/starlark/50ms-8	50.0ms ± 0%
Typing/starlark/150ms-8	150ms ± 0%
Typing/tools/10ms-8	10.0ms ± 0%
Typing/tools/50ms-8	50.0ms ± 0%
Typing/tools/150ms-8	150ms ± 0%
WorkspaceSymbols/pkgsite-8	23.4ms ± 7%
WorkspaceSymbols/kubernetes-8	100ms ±19%
WorkspaceSymbols/oracle-8	84.2ms ±14%
WorkspaceSymbols/starlark-8	6.57ms ± 1%
WorkspaceSymbols/tools-8	10.2ms ± 9%
[Geo mean]	23.8ms

	cpu_seconds/op
CodeAction/kubernetes-8	0.00 ± 1%
CodeAction/oracle-8	0.00 ±10%
CodeAction/pkgsite-8	0.00 ±16%
CodeAction/starlark-8	0.02 ± 7%
CodeAction/tools-8	0.01 ±13%
CodeActionFollowingEdit/kubernetes-8	0.04 ±18%
CodeActionFollowingEdit/oracle-8	0.01 ±371%
CodeActionFollowingEdit/pkgsite-8	0.13 ±61%
CodeActionFollowingEdit/starlark-8	0.12 ±52%
CodeActionFollowingEdit/tools-8	0.16 ±55%
StructCompletion/tools-8	0.02 ±23%
ImportCompletion/tools-8	0.00 ±13%
SliceCompletion/tools-8	0.03 ±26%
FuncDeepCompletion/tools-8	0.04 ± 5%
CompletionFollowingEdit/tools-8	0.08 ±32%
CompletionFollowingEdit/kubernetes-8	0.23 ±22%
CompletionFollowingEdit/oracle-8	0.73 ±74%
Definition/kubernetes-8	0.00 ±123%
Definition/pkgsite-8	0.00 ±19%
Definition/starlark-8	0.00 ±16%
Definition/tools-8	0.00 ± 8%
DidChange/kubernetes-8	0.00 ±111%
DidChange/oracle-8	0.01 ±189%
DidChange/pkgsite-8	0.00 ±69%
DidChange/starlark-8	0.01 ±67%
DidChange/tools-8	0.01 ±82%
DiagnoseChange/kubernetes/diagnose-8	3.09 ±59%
DiagnoseChange/pkgsite/diagnose-8	0.43 ±59%
DiagnoseChange/starlark/diagnose-8	0.38 ±44%
DiagnoseChange/tools/diagnose-8	0.75 ±41%
DiagnoseSave/kubernetes/diagnose-8	4.47 ±65%
DiagnoseSave/pkgsite/diagnose-8	0.66 ±39%
DiagnoseSave/starlark/diagnose-8	0.66 ±47%
DiagnoseSave/tools/diagnose-8	1.04 ±48%
Hover/kubernetes-8	0.00 ±67%
Hover/pkgsite-8	0.00 ± 6%
Hover/starlark-8	0.00 ± 8%
Hover/tools-8	0.00 ±16%
Implementations/kubernetes-8	0.26 ±35%
Implementations/pkgsite-8	0.03 ±50%
Implementations/starlark-8	0.01 ±59%
Implementations/tools-8	0.02 ±45%
InitialWorkspaceLoad/kubernetes-8
InitialWorkspaceLoad/oracle-8
InitialWorkspaceLoad/pkgsite-8
InitialWorkspaceLoad/starlark-8
InitialWorkspaceLoad/tools-8
References/kubernetes-8	0.00 ±19%
References/pkgsite-8	0.01 ± 8%
References/starlark-8	0.00 ±39%
References/tools-8	0.01 ±46%
Reload/kubernetes-8	0.15 ±23%
Rename/kubernetes-8	2.59 ±151%
Rename/pkgsite-8	0.85 ±34%
Rename/starlark-8	0.22 ±21%
Rename/tools-8	0.19 ±43%
Typing/kubernetes/10ms-8	0.06 ±30%
Typing/kubernetes/50ms-8	0.19 ±46%
Typing/kubernetes/150ms-8	0.45 ±55%
Typing/oracle/10ms-8	0.06 ±114%
Typing/oracle/50ms-8	0.36 ±33%
Typing/oracle/150ms-8	0.51 ±46%
Typing/pkgsite/10ms-8	0.02 ±75%
Typing/pkgsite/50ms-8	0.10 ±14%
Typing/pkgsite/150ms-8	0.17 ±21%
Typing/starlark/10ms-8	0.02 ±71%
Typing/starlark/50ms-8	0.07 ±21%
Typing/starlark/150ms-8	0.12 ±26%
Typing/tools/10ms-8	0.02 ±66%
Typing/tools/50ms-8	0.11 ±19%
Typing/tools/150ms-8	0.22 ±17%
WorkspaceSymbols/pkgsite-8	0.08 ±13%
WorkspaceSymbols/kubernetes-8	0.32 ± 3%
WorkspaceSymbols/oracle-8	0.30 ± 2%
WorkspaceSymbols/starlark-8	0.02 ± 3%
WorkspaceSymbols/tools-8	0.04 ± 9%
[Geo mean]	0.04

	alloc_bytes
CodeAction/kubernetes-8
CodeAction/oracle-8
CodeAction/pkgsite-8
CodeAction/starlark-8
CodeAction/tools-8
CodeActionFollowingEdit/kubernetes-8
CodeActionFollowingEdit/oracle-8
CodeActionFollowingEdit/pkgsite-8
CodeActionFollowingEdit/starlark-8
CodeActionFollowingEdit/tools-8
StructCompletion/tools-8
ImportCompletion/tools-8
SliceCompletion/tools-8
FuncDeepCompletion/tools-8
CompletionFollowingEdit/tools-8
CompletionFollowingEdit/kubernetes-8
CompletionFollowingEdit/oracle-8
Definition/kubernetes-8
Definition/pkgsite-8
Definition/starlark-8
Definition/tools-8
DidChange/kubernetes-8
DidChange/oracle-8
DidChange/pkgsite-8
DidChange/starlark-8
DidChange/tools-8
DiagnoseChange/kubernetes/diagnose-8
DiagnoseChange/pkgsite/diagnose-8
DiagnoseChange/starlark/diagnose-8
DiagnoseChange/tools/diagnose-8
DiagnoseSave/kubernetes/diagnose-8
DiagnoseSave/pkgsite/diagnose-8
DiagnoseSave/starlark/diagnose-8
DiagnoseSave/tools/diagnose-8
Hover/kubernetes-8
Hover/pkgsite-8
Hover/starlark-8
Hover/tools-8
Implementations/kubernetes-8
Implementations/pkgsite-8
Implementations/starlark-8
Implementations/tools-8
InitialWorkspaceLoad/kubernetes-8	1.17G ±79%
InitialWorkspaceLoad/oracle-8	745M ±82%
InitialWorkspaceLoad/pkgsite-8	186M ±70%
InitialWorkspaceLoad/starlark-8	57.5M ±74%
InitialWorkspaceLoad/tools-8	198M ±83%
References/kubernetes-8
References/pkgsite-8
References/starlark-8
References/tools-8
Reload/kubernetes-8
Rename/kubernetes-8
Rename/pkgsite-8
Rename/starlark-8
Rename/tools-8
Typing/kubernetes/10ms-8
Typing/kubernetes/50ms-8
Typing/kubernetes/150ms-8
Typing/oracle/10ms-8
Typing/oracle/50ms-8
Typing/oracle/150ms-8
Typing/pkgsite/10ms-8
Typing/pkgsite/50ms-8
Typing/pkgsite/150ms-8
Typing/starlark/10ms-8
Typing/starlark/50ms-8
Typing/starlark/150ms-8
Typing/tools/10ms-8
Typing/tools/50ms-8
Typing/tools/150ms-8
WorkspaceSymbols/pkgsite-8
WorkspaceSymbols/kubernetes-8
WorkspaceSymbols/oracle-8
WorkspaceSymbols/starlark-8
WorkspaceSymbols/tools-8
[Geo mean]	284M

	in_use_bytes
CodeAction/kubernetes-8
CodeAction/oracle-8
CodeAction/pkgsite-8
CodeAction/starlark-8
CodeAction/tools-8
CodeActionFollowingEdit/kubernetes-8
CodeActionFollowingEdit/oracle-8
CodeActionFollowingEdit/pkgsite-8
CodeActionFollowingEdit/starlark-8
CodeActionFollowingEdit/tools-8
StructCompletion/tools-8
ImportCompletion/tools-8
SliceCompletion/tools-8
FuncDeepCompletion/tools-8
CompletionFollowingEdit/tools-8
CompletionFollowingEdit/kubernetes-8
CompletionFollowingEdit/oracle-8
Definition/kubernetes-8
Definition/pkgsite-8
Definition/starlark-8
Definition/tools-8
DidChange/kubernetes-8
DidChange/oracle-8
DidChange/pkgsite-8
DidChange/starlark-8
DidChange/tools-8
DiagnoseChange/kubernetes/diagnose-8
DiagnoseChange/pkgsite/diagnose-8
DiagnoseChange/starlark/diagnose-8
DiagnoseChange/tools/diagnose-8
DiagnoseSave/kubernetes/diagnose-8
DiagnoseSave/pkgsite/diagnose-8
DiagnoseSave/starlark/diagnose-8
DiagnoseSave/tools/diagnose-8
Hover/kubernetes-8
Hover/pkgsite-8
Hover/starlark-8
Hover/tools-8
Implementations/kubernetes-8
Implementations/pkgsite-8
Implementations/starlark-8
Implementations/tools-8
InitialWorkspaceLoad/kubernetes-8	1.37G ±79%
InitialWorkspaceLoad/oracle-8	858M ±81%
InitialWorkspaceLoad/pkgsite-8	256M ±76%
InitialWorkspaceLoad/starlark-8	76.5M ±78%
InitialWorkspaceLoad/tools-8	235M ±81%
References/kubernetes-8
References/pkgsite-8
References/starlark-8
References/tools-8
Reload/kubernetes-8
Rename/kubernetes-8
Rename/pkgsite-8
Rename/starlark-8
Rename/tools-8
Typing/kubernetes/10ms-8
Typing/kubernetes/50ms-8
Typing/kubernetes/150ms-8
Typing/oracle/10ms-8
Typing/oracle/50ms-8
Typing/oracle/150ms-8
Typing/pkgsite/10ms-8
Typing/pkgsite/50ms-8
Typing/pkgsite/150ms-8
Typing/starlark/10ms-8
Typing/starlark/50ms-8
Typing/starlark/150ms-8
Typing/tools/10ms-8
Typing/tools/50ms-8
Typing/tools/150ms-8
WorkspaceSymbols/pkgsite-8
WorkspaceSymbols/kubernetes-8
WorkspaceSymbols/oracle-8
WorkspaceSymbols/starlark-8
WorkspaceSymbols/tools-8
[Geo mean]	352M

	total_alloc_bytes
CodeAction/kubernetes-8
CodeAction/oracle-8
CodeAction/pkgsite-8
CodeAction/starlark-8
CodeAction/tools-8
CodeActionFollowingEdit/kubernetes-8
CodeActionFollowingEdit/oracle-8
CodeActionFollowingEdit/pkgsite-8
CodeActionFollowingEdit/starlark-8
CodeActionFollowingEdit/tools-8
StructCompletion/tools-8
ImportCompletion/tools-8
SliceCompletion/tools-8
FuncDeepCompletion/tools-8
CompletionFollowingEdit/tools-8
CompletionFollowingEdit/kubernetes-8
CompletionFollowingEdit/oracle-8
Definition/kubernetes-8
Definition/pkgsite-8
Definition/starlark-8
Definition/tools-8
DidChange/kubernetes-8
DidChange/oracle-8
DidChange/pkgsite-8
DidChange/starlark-8
DidChange/tools-8
DiagnoseChange/kubernetes/diagnose-8
DiagnoseChange/pkgsite/diagnose-8
DiagnoseChange/starlark/diagnose-8
DiagnoseChange/tools/diagnose-8
DiagnoseSave/kubernetes/diagnose-8
DiagnoseSave/pkgsite/diagnose-8
DiagnoseSave/starlark/diagnose-8
DiagnoseSave/tools/diagnose-8
Hover/kubernetes-8
Hover/pkgsite-8
Hover/starlark-8
Hover/tools-8
Implementations/kubernetes-8
Implementations/pkgsite-8
Implementations/starlark-8
Implementations/tools-8
InitialWorkspaceLoad/kubernetes-8	342M ±235%
InitialWorkspaceLoad/oracle-8	157M ±101%
InitialWorkspaceLoad/pkgsite-8	62.2M ±100%
InitialWorkspaceLoad/starlark-8	18.0M ±101%
InitialWorkspaceLoad/tools-8	41.4M ±100%
References/kubernetes-8
References/pkgsite-8
References/starlark-8
References/tools-8
Reload/kubernetes-8
Rename/kubernetes-8
Rename/pkgsite-8
Rename/starlark-8
Rename/tools-8
Typing/kubernetes/10ms-8
Typing/kubernetes/50ms-8
Typing/kubernetes/150ms-8
Typing/oracle/10ms-8
Typing/oracle/50ms-8
Typing/oracle/150ms-8
Typing/pkgsite/10ms-8
Typing/pkgsite/50ms-8
Typing/pkgsite/150ms-8
Typing/starlark/10ms-8
Typing/starlark/50ms-8
Typing/starlark/150ms-8
Typing/tools/10ms-8
Typing/tools/50ms-8
Typing/tools/150ms-8
WorkspaceSymbols/pkgsite-8
WorkspaceSymbols/kubernetes-8
WorkspaceSymbols/oracle-8
WorkspaceSymbols/starlark-8
WorkspaceSymbols/tools-8
[Geo mean]	75.6M

Go Performance Dashboard