使用 apache HttpClient 4.1.2 上传 3 GB 文档

Question

我们使用的是 HttpClient 4.1.2。 当我们尝试将文档上传到服务器时，如果我们尝试上传大小小于 2 GB 的文档，这会很好，如果我上传超过 2 GB 的文档，那么我会看到以下错误..

java.net.SocketException: Connection reset by peer: socket write error
    at java.net.SocketOutputStream.socketWrite0(Native Method)
    at java.net.SocketOutputStream.socketWrite(SocketOutputStream.java:92)
    at java.net.SocketOutputStream.write(SocketOutputStream.java:136)
    at com.sun.net.ssl.internal.ssl.OutputRecord.writeBuffer(OutputRecord.java:297)
    at com.sun.net.ssl.internal.ssl.OutputRecord.write(OutputRecord.java:286)
    at com.sun.net.ssl.internal.ssl.SSLSocketImpl.writeRecordInternal(SSLSocketImpl.java:743)
    at com.sun.net.ssl.internal.ssl.SSLSocketImpl.writeRecord(SSLSocketImpl.java:731)
    at com.sun.net.ssl.internal.ssl.AppOutputStream.write(AppOutputStream.java:59)
    at org.apache.http.impl.io.AbstractSessionOutputBuffer.write(AbstractSessionOutputBuffer.java:153)
    at org.apache.http.impl.io.ContentLengthOutputStream.write(ContentLengthOutputStream.java:114)
    at org.apache.commons.io.output.ProxyOutputStream.write(ProxyOutputStream.java:90)
    at org.apache.commons.io.IOUtils.copyLarge(IOUtils.java:1859)

请在下面找到代码：

try {
    // Requires a multi-part post
    MultipartEntity requestEntity = new MultipartEntity();
    post.setEntity(requestEntity);

    requestEntity.addPart(MIME_TYPE_NAME, new StringBody(mimeType));

    requestEntity.addPart(USER_ID_PARAMETER, new StringBody(loginUser
            .getUserid().toLowerCase()));
    requestEntity.addPart(USER_PASSWORD_PARAMETER, new StringBody(
            loginUser.getPassword()));

    requestEntity.addPart(DOCUMENT_PART_NAME,
            new ProgressReportingFileBody(filePath, uploadListener));

    post.getParams().setBooleanParameter(
            CoreProtocolPNames.USE_EXPECT_CONTINUE, true);

    // Find out what happened with the request
    HttpContext context = new BasicHttpContext();
    // Add AuthCache to the execution context
    context.setAttribute(ClientContext.AUTH_CACHE, authCache);
    // Perform the POST
    setCurrentRequest(post);
    HttpResponse response = httpClient.execute(targetHost, post,
            context);
    // Get the response back
    message = response.getEntity();

    // Ensure the middleware returned an acceptable response
    checkError(response, context);
    checkInterrupted(post);

    Header documentId = response.getFirstHeader("DOCUMENT_ID");

    oDoc.sMimeType = mimeType;

} catch (ClientProtocolException ex) {
    throw new IwException(-3, "HTTP Error: " + ex.getMessage(),
            ex.toString());
} catch (IOException ex) {
    checkInterrupted(post);
    log.error("Failed to Upload Document", ex);
    throw new IwException(-3, "Upload Document Error: "
            + ex.getMessage(), ex.toString());
} finally {
    try {
        if (message != null) {
            // Clean up to allow another HTTP client call
            EntityUtils.consume(message);
        }
    } catch (IOException ex) {
        log.error("Failed to Close HTTP Connection", ex);
    }
}

任何想法可能/会很棒！感谢您的宝贵时间。

Answer 1

分块上传，每个大小为 256 Mb 或大约。在服务器端加入。在编程层面上，这很容易做到。此外，上传 3 Gb 可能需要很长时间。在失败的情况下，有可能用更小的块重试是有意义的。