Python LDA gensim“弃用警告：无效的转义序列”

Question

我是 stackoverflow 和 python 的新手，所以请多多包涵。 我正在尝试使用 PyCharm 编辑器在 python 中使用 gensim 包对文本语料库运行潜在狄利克雷分析。我在 R 中准备了语​​料库并使用此 R 命令将其导出到 csv 文件：

write.csv(testdf, "C://...//test.csv", fileEncoding = "utf-8") 

这会创建以下 csv 结构（尽管具有更长且已经预处理的文本）：

,"datetimestamp","id","origin","text"
1,"1960-01-01","id_1","Newspaper1","Test text one"
2,"1960-01-02","id_2","Newspaper1","Another text"
3,"1960-01-03","id_3","Newspaper1","Yet another text"
4,"1960-01-04","id_4","Newspaper2","Four Five Six"
5,"1960-01-05","id_5","Newspaper2","Alpha Bravo Charly"
6,"1960-01-06","id_6","Newspaper2","Singing Dancing Laughing"

然后我尝试使用以下基本 Python 代码（基于 gensim tutorials）来执行简单的 LDA 分析：

import gensim
from gensim import corpora, models, similarities, parsing
import pandas as pd
from six import iteritems
import os
import pyLDAvis.gensim

class MyCorpus(object):
     def __iter__(self):
             for row in pd.read_csv('//mpifg.local/dfs/home/lu/Meine Daten/Imagined Futures and Greek State Bonds/Topic Modelling/Python/test.csv', index_col=False, header = 0 ,encoding='utf-8')['text']:
                 # assume there's one document per line, tokens separated by whitespace
                 yield dictionary.doc2bow(row.split())

if __name__ == '__main__':
    dictionary = corpora.Dictionary(row.split() for row in pd.read_csv(
        '//.../test.csv', index_col=False, encoding='utf-8')['text'])
    print(dictionary)
    dictionary.save(
        '//.../greekdict.dict')  # store the dictionary, for future reference

    ## create an mmCorpus
    corpora.MmCorpus.serialize('//.../greekcorpus.mm', MyCorpus())
    corpus = corpora.MmCorpus('//.../greekcorpus.mm')

    dictionary = corpora.Dictionary.load('//.../greekdict.dict')
    corpus = corpora.MmCorpus('//.../greekcorpus.mm')

    # train model
    lda = gensim.models.ldamodel.LdaModel(corpus=corpus, id2word=dictionary, num_topics=50, iterations=1000)

我收到以下错误代码并且代码退出：

...\Python\venv\lib\site-packages\setuptools-28.8.0-py3.6.egg\pkg_resources_vendor\pyparsing.py:832: DeprecationWarning: invalid escape sequence \d

\...\Python\venv\lib\site-packages\setuptools-28.8.0-py3.6.egg\pkg_resources_vendor\pyparsing.py:2736: DeprecationWarning: invalid escape sequence \d

\...\Python\venv\lib\site-packages\setuptools-28.8.0-py3.6.egg\pkg_resources_vendor\pyparsing.py:2914: DeprecationWarning: invalid escape sequence \g

\...\Python\venv\lib\site-packages\pyLDAvis_prepare.py:387： 弃用警告： .ix 已弃用。请用 .loc 用于基于标签的索引或 .iloc 用于位置索引

我找不到任何解决方案，老实说，我也不知道问题到底出在哪里。我花了几个小时确保 csv 的编码是 utf-8 并正确导出（从 R）和导入（在 python 中）。

我做错了什么或者我还能在哪里看？干杯！

Answer 1

DeprecationWarining 正是这样 - 警告一个功能被弃用，它应该提示用户使用其他一些功能，而不是在未来保持兼容性。所以在你的情况下，我只会关注你使用的库的更新。

从最后一个警告开始，它看起来像是来自 pandas 并已针对 pyLDAvis here 记录。

其余的来自pyparsing 模块，但您似乎没有明确导入它。也许您使用的其中一个库具有依赖关系，并且使用了一些相对较旧且已弃用的功能。为了消除一开始的警告，我会检查升级是否没有帮助。祝你好运！