我可以在Golang中加载经过Python训练的分类器吗？

Question

I am trying to load a python trained classifier in a Golang server.

In python, I generally do that:

classifier = pickle.load( open("classifier1.p", "rb"))

Is there any equivalent in Golang?

It took me 3 days to train the data and I can't wait again. So I tried to convert the classifier1.p to JSON format using this code.

fpkl = pickle.load( open("whatever/classifier1.p", "rb"))
fjson = open("whatever/classifier.json", "w")
json.dump(fpkl, fjson, ensure_ascii=False, sort_keys=True, indent=4)

An error occured: Object of type 'Pipeline' is not JSON serializable

I need some advice. Is there any Golang equivalent for my first problem? If there isn't, what can I do to avoid the data training again?

Thanks in advance.

Answer 1

The documentation for the Python pickle library notes:

The data format used by pickle is Python-specific. This [...] means that non-Python programs may not be able to reconstruct pickled Python objects.

In principle you could read back the format (it's "just" a byte stream representing an object graph) and assign some meaning to the Python class name references in the pickle file. This would be highly specific to the specific object format you're reading back.

My gut feel is that if it would take you 3 days to re-train your model using either Go-native tools or export it into a more neutral format, that will probably be faster and less frustrating than trying to decode the pickle file.