Skip to content

Commit 94abf69

Browse files
authored
feat(kubernetes): let kubevirt-csi detach without the HotplugVolumes gate (cozystack#4451)
## What this PR does This lets kubevirt-csi detach volumes without the deprecated KubeVirt `HotplugVolumes` gate. The default stays as it is, so nothing changes at runtime yet. Part of cozystack#4032. The driver got a switch upstream for exactly this, and I bumped to it. kubevirt/csi-driver#382 added `--enable-vmi-hotplug-fallback`, merged as cb4770e4e475. With it set to false, the driver no longer calls the VMI-level `removevolume` on a VMI owned by a VM. virt-api rejects that call once `HotplugVolumes` is off. Our wrapper now passes the flag to upstream and no longer has its own hot-unplug path. `unpublishHotplugVolume` was a backport of kubevirt/csi-driver#184, and the previous pin already contained that change. Upstream detaches from the VMI when the VM is gone, then waits for the VMI status to drop the volume before it returns. So the wrapper's re-check never found the volume attached. Adding the ownership check there would have been dead code. Closes cozystack#4450 The chart leaves the flag at its default of true and does not render it. The driver image in the chart is stamped only at release preparation, so between releases main runs the previous release's binary, which does not know the flag. Go's `flag` package exits on an unknown flag. Rendering `=true` would crash-loop the CSI controller for no effect. The right value depends on the KubeVirt CR, not on the tenant, so the comment next to `HotplugVolumes` in `kubevirt-cr.yaml` points at the controller Deployment. The follow-up PR drops the gate and renders the flag as false. Nothing changes on the node side. Main already pins f5de10d39556, and cb4770e4e475 is that commit plus kubevirt/csi-driver#382. A Go unit test runs an unpublish through the wrapper during a teardown, with the flag on, off with a VM-owned VMI, and off with an orphaned VMI. It checks that the flag reaches upstream and that only upstream makes the VMI-level call. Upstream's own tests cover the ownership rule. A second test holds that an NFS volume only releases the node from its CiliumNetworkPolicy and never reaches the upstream hot-unplug. A helm-unittest pins that the chart renders no such argument. I haven't built the image or run e2e. Volume attach and detach on a tenant cluster in e2e is the real check. ### Screenshots No UI change. ### Downstream repositories - [x] No downstream repository is affected by this change - [ ] [cozystack/website](https://github.com/cozystack/website) - follow-up: - [ ] [cozystack/terraform-provider-cozystack](https://github.com/cozystack/terraform-provider-cozystack) - follow-up: - [ ] [cozystack/ansible-cozystack](https://github.com/cozystack/ansible-cozystack) - follow-up: - [ ] [cozystack/ccp](https://github.com/cozystack/ccp) - follow-up: - [ ] [cozystack/talm](https://github.com/cozystack/talm) - follow-up: - [ ] [cozystack/cozyhr](https://github.com/cozystack/cozyhr) - follow-up: - [ ] [cozystack/cozy-proxy](https://github.com/cozystack/cozy-proxy) - follow-up: - [ ] [cozystack/cozystack-telemetry-server](https://github.com/cozystack/cozystack-telemetry-server) - follow-up: - [ ] [cozystack/external-apps-example](https://github.com/cozystack/external-apps-example) - follow-up: - [ ] [cozystack/examples](https://github.com/cozystack/examples) - follow-up: - [ ] [cozystack/community](https://github.com/cozystack/community) - follow-up: ### Release note ```release-note feat(kubernetes): kubevirt-csi supports --enable-vmi-hotplug-fallback, so it can detach volumes without the KubeVirt HotplugVolumes feature gate. The flag stays true for now and behaviour is unchanged. ```
2 parents 091b854 + bb1b2a6 commit 94abf69

7 files changed

Lines changed: 264 additions & 83 deletions

File tree

‎packages/apps/kubernetes/images/kubevirt-csi-driver/controller.go‎

Lines changed: 5 additions & 60 deletions
Original file line numberDiff line numberDiff line change
@@ -411,65 +411,10 @@ func (w *WrappedControllerService) ControllerPublishVolume(ctx context.Context,
411411
}, nil
412412
}
413413

414-
// unpublishHotplugVolume delegates to upstream for the hot-unplug, then re-verifies
415-
// that the volume is gone from VMI.Status.VolumeStatus before returning success.
416-
// Upstream treats a missing parent VM as "detach succeeded", but during a CAPI/CAPK
417-
// teardown the VMI (and its hot-plug pod) can outlive the VM: the hot-plug pod then
418-
// keeps the infra storage device exclusively attached to the source host, and every
419-
// subsequent attach of the same volume fails (on DRBD with "failed to set source
420-
// device readwrite"). When the VMI still reports the hot-plug after upstream
421-
// returned success, detach it from the VMI directly. Backport of
422-
// kubevirt/csi-driver#184; drop once it is merged and the module is bumped past it.
423-
func (w *WrappedControllerService) unpublishHotplugVolume(ctx context.Context, req *csi.ControllerUnpublishVolumeRequest) (*csi.ControllerUnpublishVolumeResponse, error) {
424-
if _, err := w.ControllerService.ControllerUnpublishVolume(ctx, req); err != nil {
425-
return nil, err
426-
}
427-
428-
dvName := req.GetVolumeId()
429-
_, vmName, err := cache.SplitMetaNamespaceKey(req.GetNodeId())
430-
if err != nil {
431-
return nil, status.Errorf(codes.Internal, "failed to parse node ID %q: %v", req.GetNodeId(), err)
432-
}
433-
434-
// GetVirtualMachine on this client returns a VirtualMachineInstance, not a VM.
435-
vmi, err := w.virtClient.GetVirtualMachine(ctx, w.infraNamespace, vmName)
436-
if err != nil {
437-
if errors.IsNotFound(err) {
438-
return &csi.ControllerUnpublishVolumeResponse{}, nil
439-
}
440-
return nil, status.Errorf(codes.Unavailable,
441-
"cannot verify VMI %s/%s after unpublish of %s: %v", w.infraNamespace, vmName, dvName, err)
442-
}
443-
444-
stillAttached := false
445-
for _, vs := range vmi.Status.VolumeStatus {
446-
if vs.HotplugVolume != nil && vs.Name == dvName {
447-
stillAttached = true
448-
break
449-
}
450-
}
451-
if !stillAttached {
452-
return &csi.ControllerUnpublishVolumeResponse{}, nil
453-
}
454-
455-
klog.Infof("Volume %s still reported by VMI %s/%s after unpublish – detaching from the VMI", dvName, w.infraNamespace, vmName)
456-
if err := w.virtClient.RemoveVolumeFromVMI(ctx, w.infraNamespace, vmName, &kubevirtv1.RemoveVolumeOptions{Name: dvName}); err != nil {
457-
return nil, status.Errorf(codes.Unavailable,
458-
"failed to remove volume %s from VMI %s/%s: %v", dvName, w.infraNamespace, vmName, err)
459-
}
460-
if err := w.virtClient.EnsureVolumeRemoved(ctx, w.infraNamespace, vmName, dvName, 2*time.Minute); err != nil {
461-
return nil, status.Errorf(codes.Unavailable,
462-
"volume %s failed to be removed from VMI %s/%s in time: %v", dvName, w.infraNamespace, vmName, err)
463-
}
464-
465-
klog.V(3).Infof("Successfully unpublished volume %s from VMI %s/%s", dvName, w.infraNamespace, vmName)
466-
return &csi.ControllerUnpublishVolumeResponse{}, nil
467-
}
468-
469-
// ControllerUnpublishVolume for NFS volumes (RWX Filesystem): deletes CiliumNetworkPolicy.
470-
// For everything else (RWO and RWX Block), delegates to upstream so the hotplug
471-
// DataVolume is removed from VM.spec.template.spec.volumes, then verifies the volume
472-
// actually left VMI.Status.VolumeStatus. RWX Block volumes used
414+
// ControllerUnpublishVolume for NFS volumes (RWX Filesystem): drops this node from the
415+
// CiliumNetworkPolicy owners, which deletes the policy once no node is left.
416+
// For everything else (RWO and RWX Block), delegates to upstream, which removes the
417+
// hotplug DataVolume and waits for it to leave VMI.Status.VolumeStatus. RWX Block volumes used
473418
// for live migration must NOT be treated as NFS — their cleanup goes through upstream
474419
// hotplug removal, otherwise stale VM-spec entries permanently block re-attachment to
475420
// a different VM via the anti-split-brain check (issue #2634).
@@ -485,7 +430,7 @@ func (w *WrappedControllerService) ControllerUnpublishVolume(ctx context.Context
485430
}
486431

487432
if !isNFSVolume(pvc) {
488-
return w.unpublishHotplugVolume(ctx, req)
433+
return w.ControllerService.ControllerUnpublishVolume(ctx, req)
489434
}
490435

491436
// NFS volume: remove VMI ownerReference from CiliumNetworkPolicy

‎packages/apps/kubernetes/images/kubevirt-csi-driver/controller_test.go‎

Lines changed: 196 additions & 3 deletions
Original file line numberDiff line numberDiff line change
@@ -3,9 +3,12 @@ package main
33
import (
44
"context"
55
"encoding/json"
6+
"errors"
7+
"flag"
68
"net"
79
"reflect"
810
"testing"
11+
"time"
912

1013
csi "github.com/container-storage-interface/spec/lib/go/csi"
1114
"google.golang.org/grpc"
@@ -15,8 +18,15 @@ import (
1518
"google.golang.org/grpc/test/bufconn"
1619
"google.golang.org/protobuf/types/known/emptypb"
1720
corev1 "k8s.io/api/core/v1"
18-
"k8s.io/apimachinery/pkg/api/errors"
21+
k8serrors "k8s.io/apimachinery/pkg/api/errors"
1922
"k8s.io/apimachinery/pkg/api/resource"
23+
metav1 "k8s.io/apimachinery/pkg/apis/meta/v1"
24+
"k8s.io/apimachinery/pkg/apis/meta/v1/unstructured"
25+
"k8s.io/apimachinery/pkg/runtime"
26+
"k8s.io/apimachinery/pkg/runtime/schema"
27+
dynamicfake "k8s.io/client-go/dynamic/fake"
28+
"k8s.io/client-go/kubernetes/fake"
29+
kubevirtv1 "kubevirt.io/api/core/v1"
2030
cdiv1 "kubevirt.io/containerized-data-importer-api/pkg/apis/core/v1beta1"
2131

2232
kubevirtclient "kubevirt.io/csi-driver/pkg/kubevirt"
@@ -32,7 +42,7 @@ type fakeVirtClient struct {
3242
}
3343

3444
func (f *fakeVirtClient) GetDataVolume(_ context.Context, _, name string) (*cdiv1.DataVolume, error) {
35-
return nil, errors.NewNotFound(cdiv1.SchemeGroupVersion.WithResource("datavolumes").GroupResource(), name)
45+
return nil, k8serrors.NewNotFound(cdiv1.SchemeGroupVersion.WithResource("datavolumes").GroupResource(), name)
3646
}
3747

3848
func (f *fakeVirtClient) CreateDataVolume(_ context.Context, _ string, dv *cdiv1.DataVolume) (*cdiv1.DataVolume, error) {
@@ -43,7 +53,7 @@ func (f *fakeVirtClient) CreateDataVolume(_ context.Context, _ string, dv *cdiv1
4353
func newTestControllerService(virtClient kubevirtclient.Client) *WrappedControllerService {
4454
enforcement := util.StorageClassEnforcement{AllowAll: true}
4555
return &WrappedControllerService{
46-
ControllerService: service.NewControllerService(virtClient, "infra-ns", nil, enforcement),
56+
ControllerService: service.NewControllerService(virtClient, "infra-ns", nil, enforcement, true),
4757
virtClient: virtClient,
4858
infraNamespace: "infra-ns",
4959
storageClassEnforcement: enforcement,
@@ -293,3 +303,186 @@ func TestBuildEndpointSelectorListsEveryVM(t *testing.T) {
293303
t.Errorf("buildEndpointSelector = %#v, want %#v", got, want)
294304
}
295305
}
306+
307+
const (
308+
testInfraNamespace = "tenant-test"
309+
testVMName = "worker-0"
310+
testVolumeName = "pvc-0"
311+
)
312+
313+
// teardownClient models the CAPI/CAPK teardown race: the VM is gone while its
314+
// VMI still reports the hot-plugged volume. The VMI drops the volume once
315+
// RemoveVolumeFromVMI is called, or when the garbage collector deletes a
316+
// VMI whose controlling VM is gone.
317+
type teardownClient struct {
318+
kubevirtclient.Client
319+
vmiOwners []metav1.OwnerReference
320+
vmiRemovals int
321+
lookups int
322+
}
323+
324+
func (c *teardownClient) vmiGarbageCollected() bool {
325+
owner := metav1.GetControllerOf(&metav1.ObjectMeta{OwnerReferences: c.vmiOwners})
326+
return owner != nil && owner.Kind == "VirtualMachine" && owner.APIVersion == kubevirtv1.SchemeGroupVersion.String()
327+
}
328+
329+
func (c *teardownClient) GetWorkloadManagingVirtualMachine(context.Context, string, string) (*kubevirtv1.VirtualMachine, error) {
330+
c.lookups++
331+
return nil, k8serrors.NewNotFound(schema.GroupResource{Group: "kubevirt.io", Resource: "virtualmachines"}, testVMName)
332+
}
333+
334+
func (c *teardownClient) GetVirtualMachine(context.Context, string, string) (*kubevirtv1.VirtualMachineInstance, error) {
335+
c.lookups++
336+
vmi := &kubevirtv1.VirtualMachineInstance{
337+
ObjectMeta: metav1.ObjectMeta{Name: testVMName, Namespace: testInfraNamespace, OwnerReferences: c.vmiOwners},
338+
}
339+
if c.vmiRemovals == 0 {
340+
vmi.Status.VolumeStatus = []kubevirtv1.VolumeStatus{{Name: testVolumeName, HotplugVolume: &kubevirtv1.HotplugVolumeStatus{}}}
341+
}
342+
return vmi, nil
343+
}
344+
345+
func (c *teardownClient) EnsureVolumeRemovedVMI(context.Context, string, string, string) (bool, error) {
346+
return c.vmiRemovals > 0, nil
347+
}
348+
349+
func (c *teardownClient) RemoveVolumeFromVMI(context.Context, string, string, *kubevirtv1.RemoveVolumeOptions) error {
350+
c.vmiRemovals++
351+
return nil
352+
}
353+
354+
func (c *teardownClient) EnsureVolumeRemoved(context.Context, string, string, string, time.Duration) error {
355+
if c.vmiRemovals > 0 || c.vmiGarbageCollected() {
356+
return nil
357+
}
358+
return errors.New("timed out waiting for the VMI to drop the volume")
359+
}
360+
361+
func vmOwner() []metav1.OwnerReference {
362+
return []metav1.OwnerReference{
363+
*metav1.NewControllerRef(&kubevirtv1.VirtualMachine{ObjectMeta: metav1.ObjectMeta{Name: testVMName}}, kubevirtv1.VirtualMachineGroupVersionKind),
364+
}
365+
}
366+
367+
// The flag has to reach the upstream controller service, which alone decides
368+
// whether to call the VMI-level removevolume. A VMI no VM controls gets the
369+
// call either way, since virt-api accepts it there.
370+
func TestControllerUnpublishVolumeHonoursVMIHotplugFallback(t *testing.T) {
371+
const name = "enable-vmi-hotplug-fallback"
372+
tests := []struct {
373+
name string
374+
args []string
375+
owners []metav1.OwnerReference
376+
wantRemovals int
377+
}{
378+
{name: "default, VM-owned VMI", args: nil, owners: vmOwner(), wantRemovals: 1},
379+
{name: "disabled, VM-owned VMI", args: []string{"--" + name + "=false"}, owners: vmOwner(), wantRemovals: 0},
380+
{name: "disabled, orphaned VMI", args: []string{"--" + name + "=false"}, owners: nil, wantRemovals: 1},
381+
}
382+
383+
for _, tt := range tests {
384+
t.Run(tt.name, func(t *testing.T) {
385+
t.Cleanup(func() {
386+
_ = flag.Set(name, flag.Lookup(name).DefValue)
387+
_ = flag.Set("infra-cluster-namespace", flag.Lookup("infra-cluster-namespace").DefValue)
388+
})
389+
args := append([]string{"--infra-cluster-namespace=" + testInfraNamespace}, tt.args...)
390+
if err := flag.CommandLine.Parse(args); err != nil {
391+
t.Fatalf("parse flags: %v", err)
392+
}
393+
394+
client := &teardownClient{vmiOwners: tt.owners}
395+
infra := fake.NewClientset(&corev1.PersistentVolumeClaim{
396+
ObjectMeta: metav1.ObjectMeta{Name: testVolumeName, Namespace: testInfraNamespace},
397+
Spec: corev1.PersistentVolumeClaimSpec{AccessModes: []corev1.PersistentVolumeAccessMode{corev1.ReadWriteOnce}},
398+
})
399+
enforcement := util.StorageClassEnforcement{AllowAll: true, AllowDefault: true}
400+
w := newWrappedControllerService(service.NewKubevirtCSIDriver(), client, infra, nil, nil, enforcement)
401+
402+
req := &csi.ControllerUnpublishVolumeRequest{VolumeId: testVolumeName, NodeId: testInfraNamespace + "/" + testVMName}
403+
if _, err := w.ControllerUnpublishVolume(context.Background(), req); err != nil {
404+
t.Fatalf("ControllerUnpublishVolume() error = %v", err)
405+
}
406+
if client.vmiRemovals != tt.wantRemovals {
407+
t.Errorf("RemoveVolumeFromVMI calls = %d, want %d", client.vmiRemovals, tt.wantRemovals)
408+
}
409+
})
410+
}
411+
}
412+
413+
func nfsCNP(owners ...string) *unstructured.Unstructured {
414+
refs := make([]interface{}, 0, len(owners))
415+
for _, owner := range owners {
416+
refs = append(refs, map[string]interface{}{
417+
"apiVersion": kubevirtv1.SchemeGroupVersion.String(), "kind": "VirtualMachineInstance", "name": owner, "uid": owner,
418+
})
419+
}
420+
return &unstructured.Unstructured{Object: map[string]interface{}{
421+
"apiVersion": "cilium.io/v2",
422+
"kind": "CiliumNetworkPolicy",
423+
"metadata": map[string]interface{}{"name": "csi-nfs-" + testVolumeName, "namespace": testInfraNamespace, "ownerReferences": refs},
424+
}}
425+
}
426+
427+
// An RWX filesystem volume is served over NFS, not hot-plugged, so unpublish
428+
// only releases this node from the volume's CiliumNetworkPolicy and never
429+
// reaches the upstream hot-unplug.
430+
func TestControllerUnpublishVolumeNFSReleasesNetworkPolicyOnly(t *testing.T) {
431+
tests := []struct {
432+
name string
433+
owners []string
434+
wantOwners []string
435+
}{
436+
{name: "other nodes still mount it", owners: []string{testVMName, "worker-1"}, wantOwners: []string{"worker-1"}},
437+
{name: "last node", owners: []string{testVMName}, wantOwners: nil},
438+
}
439+
440+
for _, tt := range tests {
441+
t.Run(tt.name, func(t *testing.T) {
442+
client := &teardownClient{vmiOwners: vmOwner()}
443+
filesystem := corev1.PersistentVolumeFilesystem
444+
infra := fake.NewClientset(&corev1.PersistentVolumeClaim{
445+
ObjectMeta: metav1.ObjectMeta{Name: testVolumeName, Namespace: testInfraNamespace},
446+
Spec: corev1.PersistentVolumeClaimSpec{
447+
AccessModes: []corev1.PersistentVolumeAccessMode{corev1.ReadWriteMany},
448+
VolumeMode: &filesystem,
449+
},
450+
})
451+
dynamic := dynamicfake.NewSimpleDynamicClientWithCustomListKinds(runtime.NewScheme(),
452+
map[schema.GroupVersionResource]string{ciliumNetworkPolicyGVR: "CiliumNetworkPolicyList"}, nfsCNP(tt.owners...))
453+
w := &WrappedControllerService{
454+
ControllerService: service.NewControllerService(client, testInfraNamespace, nil, util.StorageClassEnforcement{AllowAll: true}, true),
455+
infraClient: infra,
456+
dynamicClient: dynamic,
457+
virtClient: client,
458+
infraNamespace: testInfraNamespace,
459+
}
460+
461+
req := &csi.ControllerUnpublishVolumeRequest{VolumeId: testVolumeName, NodeId: testInfraNamespace + "/" + testVMName}
462+
if _, err := w.ControllerUnpublishVolume(context.Background(), req); err != nil {
463+
t.Fatalf("ControllerUnpublishVolume() error = %v", err)
464+
}
465+
if client.lookups != 0 || client.vmiRemovals != 0 {
466+
t.Errorf("VM/VMI lookups = %d, RemoveVolumeFromVMI calls = %d, want none", client.lookups, client.vmiRemovals)
467+
}
468+
469+
cnp, err := dynamic.Resource(ciliumNetworkPolicyGVR).Namespace(testInfraNamespace).Get(context.Background(), "csi-nfs-"+testVolumeName, metav1.GetOptions{})
470+
if tt.wantOwners == nil {
471+
if !k8serrors.IsNotFound(err) {
472+
t.Fatalf("CiliumNetworkPolicy still present after its last owner left: err = %v", err)
473+
}
474+
return
475+
}
476+
if err != nil {
477+
t.Fatalf("get CiliumNetworkPolicy: %v", err)
478+
}
479+
var got []string
480+
for _, ref := range cnp.GetOwnerReferences() {
481+
got = append(got, ref.Name)
482+
}
483+
if len(got) != len(tt.wantOwners) || got[0] != tt.wantOwners[0] {
484+
t.Errorf("CiliumNetworkPolicy owners = %v, want %v", got, tt.wantOwners)
485+
}
486+
})
487+
}
488+
}

‎packages/apps/kubernetes/images/kubevirt-csi-driver/go.mod‎

Lines changed: 1 addition & 1 deletion
Original file line numberDiff line numberDiff line change
@@ -104,5 +104,5 @@ replace (
104104
k8s.io/mount-utils => k8s.io/mount-utils v0.36.0
105105
k8s.io/pod-security-admission => k8s.io/pod-security-admission v0.36.0
106106
k8s.io/sample-apiserver => k8s.io/sample-apiserver v0.36.0
107-
kubevirt.io/csi-driver => github.com/kubevirt/csi-driver v0.0.0-20260803174826-f5de10d39556
107+
kubevirt.io/csi-driver => github.com/kubevirt/csi-driver v0.0.0-20260924151015-cb4770e4e475
108108
)

‎packages/apps/kubernetes/images/kubevirt-csi-driver/go.sum‎

Lines changed: 2 additions & 2 deletions
Original file line numberDiff line numberDiff line change
@@ -148,8 +148,8 @@ github.com/kubernetes-csi/csi-lib-utils v0.24.0 h1:hpL5ecxtr07/DNIF9Qn/gbNG/ZlgM
148148
github.com/kubernetes-csi/csi-lib-utils v0.24.0/go.mod h1:JbvkvtWghDcVZnwQoSi6Np9ITwqN7+sqLiSsM9y4kRE=
149149
github.com/kubernetes-csi/external-snapshotter/client/v6 v6.3.0 h1:qS4r4ljINLWKJ9m9Ge3Q3sGZ/eIoDVDT2RhAdQFHb1k=
150150
github.com/kubernetes-csi/external-snapshotter/client/v6 v6.3.0/go.mod h1:oGXx2XTEzs9ikW2V6IC1dD8trgjRsS/Mvc2JRiC618Y=
151-
github.com/kubevirt/csi-driver v0.0.0-20260803174826-f5de10d39556 h1:8hJJprxgOOvg17Gc5LFLSKpjr77/eh82KW6URo/uiFs=
152-
github.com/kubevirt/csi-driver v0.0.0-20260803174826-f5de10d39556/go.mod h1:ErITd7C1TCf5N8MRWOjoabX5s5sfW2BUGOOiUOtx+9E=
151+
github.com/kubevirt/csi-driver v0.0.0-20260924151015-cb4770e4e475 h1:82B2pAet/OdspUVsJ8VWl4KI58dfcyJJPyrr/dW6o08=
152+
github.com/kubevirt/csi-driver v0.0.0-20260924151015-cb4770e4e475/go.mod h1:ErITd7C1TCf5N8MRWOjoabX5s5sfW2BUGOOiUOtx+9E=
153153
github.com/mailru/easyjson v0.0.0-20190614124828-94de47d64c63/go.mod h1:C1wdFJiN94OJF2b5HbByQZoLdCWB1Yqtg26g4irojpc=
154154
github.com/mailru/easyjson v0.0.0-20190626092158-b2ccc519800e/go.mod h1:C1wdFJiN94OJF2b5HbByQZoLdCWB1Yqtg26g4irojpc=
155155
github.com/mailru/easyjson v0.7.6/go.mod h1:xzfreul335JAWq5oZzymOObrkdz5UnU4kGfJJLY9Nlc=

0 commit comments

Comments
 (0)