Search code examples
tensorflowbazeltensorflow2.0

Does compilation start from beginning or resume after fixing error while building Tensorflow from source?


I need to compile Tensorflow from source for compute capability 3.0

I was compiling Tensorflow and I got this error after 6 hours of compiling:

cache/bazel/_bazel_maydin/435ff134a8a529ccec16636685173684/execroot/org_tensorflow/bazel-out/host/bin/tensorflow/create_tensorflow.python_api_2_tf_python_api_gen_v2.runfiles/org_tensorflow/tensorflow/python/keras/preprocessing/__init__.py", line 21, in <module>
   import keras_preprocessing
ModuleNotFoundError: No module named 'keras_preprocessing'
Target //tensorflow/tools/pip_package:build_pip_package failed to build
Use --verbose_failures to see the command lines of failed build steps.
INFO: Elapsed time: 20674.165s, Critical Path: 247.43s
INFO: 12297 processes: 12297 local.
FAILED: Build did NOT complete successfully

In below link, I found this answer and I think it will work. Error Compiling Tensorflow From Source - No module named 'keras_applications'

pip install keras_applications==1.0.4 --no-deps
pip install keras_preprocessing==1.0.2 --no-deps
pip install h5py==2.8.0

I also got similar error before beginning of build where it says numpy is missing, i just installed it via pip and build started without problem.

But I am scared to run build command again. Because I don't want to compile everything 6 hours again.

If I start building again does it start all over from beginning or it continue from where it failed?

Build command I used is this: bazel build --config=opt --config=cuda //tensorflow/tools/pip_package:build_pip_package

I cloned tensorflow repository, checkout to branch 2.0 and started build.

Additional info about system:

  • Cuda 10.0.130
  • cuDNN 7.6.2
  • Bazel 0.26.1
  • Ubuntu 18.04

Solution

  • It resumes compiling where it left off after fixing errors.