【发布时间】：2017-11-29 22:45:28
【问题描述】：
我无法使用 gitlab-ci 构建我的 golang 项目。 在项目目录中运行 dep init 时，它仅获取我的部分依赖项，并且当尝试构建二进制文件失败并出现未找到依赖项的错误时。当我在 osx 上构建我的项目，或者在 osx 上运行 docker golang image 来编译项目时，它会成功构建。
我的 .gitlab-ci.yml 文件：
image: golang:1.9.2
variables:
REPO_NAME: storage
before_script:
- mkdir -p $GOPATH/src/$REPO_NAME
- ln -svf $CI_PROJECT_DIR/* $GOPATH/src/$REPO_NAME
- cd $GOPATH/src/$REPO_NAME
- go get -u github.com/golang/dep/cmd/dep
- dep init
stages:
- compile
compile:
stage: compile
script:
- go build -o $CI_PROJECT_DIR/main
artifacts:
paths:
- main
gitlab-runner 任务的输出：
[0KRunning with gitlab-runner 10.2.0 (0a75cdd1)
on docker-auto-scale (4e4528ca)
[0;m[0KUsing Docker executor with image golang:1.9.2 ...
[0;m[0KUsing docker image sha256:5f8b4886692c4897e1f0855043da1896fe4f1e6762fccddfa2114a2fdfa1674f for predefined container...
[0;m[0KPulling docker image golang:1.9.2 ...
[0;m[0KUsing docker image golang:1.9.2 ID=sha256:1a34fad76b34f485ebc72d32044cafe963ae00c8e80dbf4115bafabd31e93ff6 for build container...
[0;msection_start:1511994825:prepare_script
[0KRunning on runner-4e4528ca-project-4778312-concurrent-0 via runner-4e4528ca-srm-1511994698-320032ac...
section_end:1511994828:prepare_script
[0Ksection_start:1511994828:get_sources
[0K[32;1mCloning repository...[0;m
Cloning into '/builds/group-name/service-storage'...
[32;1mChecking out f59f57e4 as master...[0;m
[32;1mSkipping Git submodules setup[0;m
section_end:1511994831:get_sources
[0Ksection_start:1511994831:restore_cache
[0Ksection_end:1511994832:restore_cache
[0Ksection_start:1511994832:download_artifacts
[0Ksection_end:1511994834:download_artifacts
[0Ksection_start:1511994834:build_script
[0K[32;1m$ mkdir -p $GOPATH/src/$REPO_NAME[0;m
[32;1m$ ln -svf $CI_PROJECT_DIR/* $GOPATH/src/$REPO_NAME[0;m
'/go/src/storage/Dockerfile' -> '/builds/group-name/service-storage/Dockerfile'
'/go/src/storage/aws' -> '/builds/group-name/service-storage/aws'
'/go/src/storage/db' -> '/builds/group-name/service-storage/db'
'/go/src/storage/logHelper' -> '/builds/group-name/service-storage/logHelper'
'/go/src/storage/main' -> '/builds/group-name/service-storage/main'
'/go/src/storage/main.go' -> '/builds/group-name/service-storage/main.go'
'/go/src/storage/responses' -> '/builds/group-name/service-storage/responses'
'/go/src/storage/routers' -> '/builds/group-name/service-storage/routers'
[32;1m$ cd $GOPATH/src/$REPO_NAME[0;m
[32;1m$ go get -u github.com/golang/dep/cmd/dep[0;m
[32;1m$ dep init[0;m
Using ^1.2.0 as constraint for direct dep github.com/joho/godotenv
Locking in v1.2.0 (a79fa1e) for direct dep github.com/joho/godotenv
Using ^1.6.0 as constraint for direct dep github.com/gorilla/mux
Locking in v1.6.0 (7f08801) for direct dep github.com/gorilla/mux
Locking in v1.1 (1ea2538) for transitive dep github.com/gorilla/context
[32;1m$ go build -o $CI_PROJECT_DIR/main[0;m
aws/aws.go:16:2: cannot find package "github.com/aws/aws-sdk-go/aws" in any of:
/go/src/storage/vendor/github.com/aws/aws-sdk-go/aws (vendor tree)
/usr/local/go/src/github.com/aws/aws-sdk-go/aws (from $GOROOT)
/go/src/github.com/aws/aws-sdk-go/aws (from $GOPATH)
aws/aws.go:17:2: cannot find package "github.com/aws/aws-sdk-go/aws/credentials" in any of:
/go/src/storage/vendor/github.com/aws/aws-sdk-go/aws/credentials (vendor tree)
/usr/local/go/src/github.com/aws/aws-sdk-go/aws/credentials (from $GOROOT)
/go/src/github.com/aws/aws-sdk-go/aws/credentials (from $GOPATH)
aws/aws.go:18:2: cannot find package "github.com/aws/aws-sdk-go/aws/session" in any of:
/go/src/storage/vendor/github.com/aws/aws-sdk-go/aws/session (vendor tree)
/usr/local/go/src/github.com/aws/aws-sdk-go/aws/session (from $GOROOT)
/go/src/github.com/aws/aws-sdk-go/aws/session (from $GOPATH)
aws/aws.go:19:2: cannot find package "github.com/aws/aws-sdk-go/service/s3" in any of:
/go/src/storage/vendor/github.com/aws/aws-sdk-go/service/s3 (vendor tree)
/usr/local/go/src/github.com/aws/aws-sdk-go/service/s3 (from $GOROOT)
/go/src/github.com/aws/aws-sdk-go/service/s3 (from $GOPATH)
routers/v1/images/imageFunctions/save_images.go:23:2: cannot find package "github.com/disintegration/imaging" in any of:
/go/src/storage/vendor/github.com/disintegration/imaging (vendor tree)
/usr/local/go/src/github.com/disintegration/imaging (from $GOROOT)
/go/src/github.com/disintegration/imaging (from $GOPATH)
db/dbFunctions/db_functions.go:7:2: cannot find package "github.com/satori/go.uuid" in any of:
/go/src/storage/vendor/github.com/satori/go.uuid (vendor tree)
/usr/local/go/src/github.com/satori/go.uuid (from $GOROOT)
/go/src/github.com/satori/go.uuid (from $GOPATH)
db/db.go:13:2: cannot find package "gopkg.in/mgo.v2" in any of:
/go/src/storage/vendor/gopkg.in/mgo.v2 (vendor tree)
/usr/local/go/src/gopkg.in/mgo.v2 (from $GOROOT)
/go/src/gopkg.in/mgo.v2 (from $GOPATH)
db/db.go:14:2: cannot find package "gopkg.in/mgo.v2/bson" in any of:
/go/src/storage/vendor/gopkg.in/mgo.v2/bson (vendor tree)
/usr/local/go/src/gopkg.in/mgo.v2/bson (from $GOROOT)
/go/src/gopkg.in/mgo.v2/bson (from $GOPATH)
section_end:1511994846:build_script
[0Ksection_start:1511994846:after_script
[0Ksection_end:1511994847:after_script
[0K[31;1mERROR: Job failed: exit code 1
[0;m
在 osx 上本地运行时，我看到 dep init 拉取了所有依赖项，之后我可以成功运行 go build 并构建二进制文件。
username@hostname storage (master) $ dep init
Locking in v1.1 (1ea2538) for transitive dep github.com/gorilla/context
Locking in v1.32.0 (32e4c1e) for transitive dep github.com/go-ini/ini
Locking in master (f7e31b4) for transitive dep golang.org/x/image
Using ^1.6.0 as constraint for direct dep github.com/gorilla/mux
Locking in v1.6.0 (7f08801) for direct dep github.com/gorilla/mux
Using ^1.1.0 as constraint for direct dep github.com/satori/go.uuid
Locking in v1.1.0 (879c588) for direct dep github.com/satori/go.uuid
Using ^1.2.0 as constraint for direct dep github.com/joho/godotenv
Locking in v1.2.0 (a79fa1e) for direct dep github.com/joho/godotenv
Using ^1.12.36 as constraint for direct dep github.com/aws/aws-sdk-go
Locking in v1.12.36 (5bcc0a2) for direct dep github.com/aws/aws-sdk-go
Locking in (0b12d6b5) for transitive dep github.com/jmespath/go-jmespath
Using v2 as constraint for direct dep gopkg.in/mgo.v2
Locking in v2 (3f83fa5) for direct dep gopkg.in/mgo.v2
Using ^1.2.4 as constraint for direct dep github.com/disintegration/imaging
Locking in v1.2.4 (dd50a3e) for direct dep github.com/disintegration/imaging
我还尝试使用 docker golang 映像在本地 OSX 上运行，并且编译良好：
docker run --rm -v "$PWD":/go/src/storage -w /go/src/storage golang:1.9.2 go get -u github.com/golang/dep/cmd/dep && dep init
docker run --rm -v "$PWD":/go/src/storage -w /go/src/storage golang:1.9.2 go build -v -o main
问题只存在，在 gitlab-ci 上运行。
尝试了各种 golang 图像，alpine 等。相同的结果，它总是失败并缺少相同的依赖项。
更新和解决方案示例：
正如用户 @vardius 指出和 cmets 并随后做出的回答，问题出在符号链接上。
将我在 .gitlab-ci.yml 中的行替换为：
- ln -svf $CI_PROJECT_DIR/* $GOPATH/src/$REPO_NAME
到
- cp -rf $CI_PROJECT_DIR/* $GOPATH/src/$REPO_NAME/
一切都编译好了。
【问题讨论】：
-
我不确定 gitlab-ci 是如何工作的，但是如果您提供依赖项，将它们与您的项目一起部署，并且根本不运行 dep，它会解决您的问题吗？
-
依赖项（供应商）被编译为 *.so 文件，它们应该在编译二进制文件的同一环境中编译。 deps 也是 150 兆字节。每次存储和更新它们都会很繁重。 Gitlab-CI runner 应该完成所有编译、构建、测试和部署过程。我只发布了失败的编译部分。开发者只需要编写代码并将其推送到 gitlab。一切都应该由 Gitlab-CI runner 完成。
-
@mkopriva 请看我上面的评论。也许我错过了什么？我是 Golang 的新手
-
通常情况下，您的情况可能会有所不同，Go 依赖项保存在项目文件夹内的供应商文件夹中，并且它们以原始形式保存，*.go。这意味着如果您在项目的 vendor 文件夹中拥有所有 Go dep，将其推送到远程服务器，然后运行 go install，您的项目应该与 deps 一起编译，并且没有问题。
-
@mkopriva 如果我推送供应商目录，我是否还需要将 Gopkg.lock 和 Gopkg.toml 文件推送到我的存储库？如果没有人提供如何使用 Gitlab-CI 解决问题，我会将您的建议用作备份变体
标签： docker go gitlab gitlab-ci gitlab-ci-runner