【问题标题】:Speaker label/ diarization does not return in Watson Speech to Text APIWatson Speech to Text API 中不返回说话者标签/分类
【发布时间】:2020-04-08 01:36:23
【问题描述】:

我正在尝试通过 IBM watson Speech to text api 获取演讲者标签。 在我的最终输出中,我希望它显示整个音频的成绩单、置信度和扬声器标签。我的代码如下:

import json
from os.path import join, dirname
from ibm_watson import SpeechToTextV1
from ibm_watson.websocket import RecognizeCallback, AudioSource
import threading
from ibm_cloud_sdk_core.authenticators import IAMAuthenticator
import pandas as pd
authenticator = IAMAuthenticator('rXXXYYZZ')
service = SpeechToTextV1(authenticator=authenticator)
service.set_service_url('https://api.us-east.speech-to-text.watson.cloud.ibm.com')

models = service.list_models().get_result()
#print(json.dumps(models, indent=2))

model = service.get_model('en-US_BroadbandModel').get_result()
#print(json.dumps(model, indent=2))

with open(join(dirname('__file__'), 'testvoicejen.wav'),
          'rb') as audio_file:
#    print(json.dumps(
    output = service.recognize(
    audio=audio_file,
    speaker_labels=True,
    content_type='audio/wav',
    #timestamps=True,
    #word_confidence=True,
    model='en-US_NarrowbandModel',
    continuous=True).get_result(),
    indent=2
df = pd.DataFrame([i for elts in output for alts in elts['results'] for i in alts['alternatives']])

然而,df的输出是:

df
Out[22]: 
                                          timestamps  ...                                         transcript
0  [[thank, 3.88, 4.04], [you, 4.04, 4.13], [for,...  ...  thank you for calling my name is Britney and h...
1  [[thank, 30.21, 30.56], [you, 30.56, 30.74], [...  ...  thank you %HESITATION and then %HESITATION you..

如您所见,我确实成功获得了成绩单,但是,我获得的不是说话者分类或标签,而是时间戳。扬声器标签如下所示:

from": 0.68,
      "to": 1.19,
      "speaker": 2

我如何得到这个?

【问题讨论】:

    标签: python api speech-recognition ibm-watson


    【解决方案1】:

    当您打开speaker_labels 时,您会自动获得timestamps。如果您查看服务文档中的示例输出 - https://cloud.ibm.com/docs/speech-to-text?topic=speech-to-text-output#speaker_labels

    您会看到演讲者标签部分与替代品/结果部分是分开的。您的代码仅解析结果/替代部分。要获得扬声器标签,您需要类似 -

    df = pd.DataFrame([i for elts in output for i in elts['speaker_labels']])
    

    【讨论】:

      猜你喜欢
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      • 2017-07-28
      • 1970-01-01
      • 1970-01-01
      • 1970-01-01
      • 2020-04-07
      • 1970-01-01
      相关资源
      最近更新 更多