MLContext should have extensions for loading and saving binary files, like it currently has for text files. Specifically, add:
MLContext.Data.SaveAsBinary, corresponding to MLContext.Data.SaveAsText
MLContext.Data.ReadFromBinaryFile, corresponding to MLContext.Data.ReadFromTextFile