【发布时间】：2018-12-07 07:50:32
【问题描述】：
我目前正在努力使用 Python 和 Flask 实现一个简单的实时流媒体 Web 应用程序。 我似乎无法将我的现场录制音频从服务器麦克风输入流式传输到网页。
server.py
from flask import Flask, render_template, Response
import cv2
import framework
import pyaudio
import audio_processing as audioRec
FORMAT = pyaudio.paInt16
CHANNELS = 1
RATE = 44100
CHUNK = 1024
audio = pyaudio.PyAudio()
app = Flask(__name__)
@app.route('/')
def index():
"""Video streaming home page."""
return render_template('index.html')
# Stream routing
@app.route('/video_feed')
def video_feed():
"""Video streaming route. Put this in the src attribute of an img tag."""
return Response(generateVideo(),
mimetype='multipart/x-mixed-replace; boundary=frame')
@app.route("/audio_feed")
def audio_feed():
"""Audio streaming route. Put this in the src attribute of an audio tag."""
return Response(generateAudio(),
mimetype="audio/x-wav")
# Stream generating
def generateVideo():
"""Video streaming generator function."""
cap = cv2.VideoCapture(0)
while (cap.isOpened()):
ret, frame = cap.read()
output = framework.streamer(frame, 'final')
cv2.imwrite('signals/currFrame.jpg', output)
yield (b'--frame\r\n'
b'Content-Type: image/jpeg\r\n\r\n' + open('signals/currFrame.jpg', 'rb').read() + b'\r\n')
def generateAudio():
"""Audio streaming generator function."""
currChunk = audioRec.record()
data_to_stream = genHeader(44100, 32, 1, 200000) + currChunk
yield data_to_stream
# with open("signals/audio.wav", "rb") as fwav:
# data = fwav.read(1024)
# while data:
# yield data
# data = fwav.read(1024)
def genHeader(sampleRate, bitsPerSample, channels, samples):
datasize = samples * channels * bitsPerSample // 8
o = bytes("RIFF",'ascii') # (4byte) Marks file as RIFF
o += (datasize + 36).to_bytes(4,'little') # (4byte) File size in bytes excluding this and RIFF marker
o += bytes("WAVE",'ascii') # (4byte) File type
o += bytes("fmt ",'ascii') # (4byte) Format Chunk Marker
o += (16).to_bytes(4,'little') # (4byte) Length of above format data
o += (1).to_bytes(2,'little') # (2byte) Format type (1 - PCM)
o += (channels).to_bytes(2,'little') # (2byte)
o += (sampleRate).to_bytes(4,'little') # (4byte)
o += (sampleRate * channels * bitsPerSample // 8).to_bytes(4,'little') # (4byte)
o += (channels * bitsPerSample // 8).to_bytes(2,'little') # (2byte)
o += (bitsPerSample).to_bytes(2,'little') # (2byte)
o += bytes("data",'ascii') # (4byte) Data Chunk Marker
o += (datasize).to_bytes(4,'little') # (4byte) Data size in bytes
return o
if __name__ == '__main__':
app.run(host='0.0.0.0', debug=True, threaded=True)
audio_processing.py
import pyaudio
FORMAT = pyaudio.paInt16
CHANNELS = 1
RATE = 44100
CHUNK = 1024
audio = pyaudio.PyAudio()
def record():
# start Recording
stream = audio.open(format=FORMAT, channels=CHANNELS,
rate=RATE, input=True,
frames_per_buffer=CHUNK)
# print "recording..."
data = stream.read(CHUNK)
return data
我正在尝试使用 audio_processing.py 获取麦克风的当前块，并使用 yield 将当前样本响应给用户。视频流效果很好。 任何人都知道，我在这里做错了什么？
亲切的问候， 费利克斯
【问题讨论】：
-
请注意，您不应该持续打开 PyAudio 流；即在流式传输开始之前将其设置为 init 函数调用或类似的东西。然后在需要时使用
record()方法访问流对象以从中读取。或者如果您想继续打开它，至少关闭它。 -
是的，你是对的，我稍微修改了代码。我最近将 pyAudio 录制过程添加到 server.py 到 generateAudio() 中。该功能现在应该可以正常工作。唯一的问题是，我当前使用的 Python2.7 不支持 byte() 函数。您有什么想法吗，如何在 2.7 中编写类似的功能？找不到预制的解决方案：/
-
你好 @F.Geißler ，我想看看你是如何在你的 html 中调用 @app.route("/audio_feed") 端点的。此设置的新手。会有很大的帮助。
标签： python flask live-streaming