ValueError: After pruning, no terms remain. Try a lower min_df or a higher max_df.

Question

之前报的是lower的问题，加上fillna("")以后解决了问题，但是出现了新的问题：

vectorizer = TfidfVectorizer(min_df=0.005, max_df=0.98, stop_words=None)
X_train = vectorizer.fit_transform(X_train)
X_test = vectorizer.transform(X_test)
X_train.shape

ValueError: After pruning, no terms remain. Try a lower min_df or a higher max_df.

请教大家如何解决。

Answer 1

看看是不是这个问题

删除在语料库Python中出现超过x％的单词-python黑洞网 https://www.pythonheidong.com/blog/article/512086/c9c5fe56dd22e2ec2f6a/