Search code examples
google-cloud-dataflowgoogle-cloud-bigtable

Stuck in the error: "Not Started" when try to access BigTable through Dataflow Pipeline

My pipeline is very simple.

Pipeline p = Pipeline.create();
         p.apply("Read", (BigtableIO.read().withBigtableOptions(BIGTABLE_OPTIONS)).withKeyRange(keyRange).withTableId("myTable"));
        p.run().waitUntilFinish();

But when I run I constantly receiving:

Exception in thread "main" java.lang.IllegalStateException: **Not started**
    at com.google.common.base.Preconditions.checkState(Preconditions.java:459)
    at io.grpc.internal.ClientCallImpl.request(ClientCallImpl.java:344)
    at io.grpc.ForwardingClientCall.request(ForwardingClientCall.java:52)
    at io.grpc.ForwardingClientCall.request(ForwardingClientCall.java:52)
    at io.grpc.ForwardingClientCall.request(ForwardingClientCall.java:52)
    at io.grpc.stub.ClientCalls.startCall(ClientCalls.java:276)
    at io.grpc.stub.ClientCalls.asyncUnaryRequestCall(ClientCalls.java:249)
    at io.grpc.stub.ClientCalls.futureUnaryCall(ClientCalls.java:186)
    at io.grpc.stub.ClientCalls.blockingUnaryCall(ClientCalls.java:132)
    at com.google.bigtable.admin.v2.BigtableTableAdminGrpc$BigtableTableAdminBlockingStub.getTable(BigtableTableAdminGrpc.java:381)
    at com.google.cloud.bigtable.grpc.BigtableTableAdminGrpcClient.getTable(BigtableTableAdminGrpcClient.java:58)
    at org.apache.beam.sdk.io.gcp.bigtable.BigtableServiceImpl.tableExists(BigtableServiceImpl.java:82)
    at org.apache.beam.sdk.io.gcp.bigtable.BigtableIO$Read.validate(BigtableIO.java:294)
    at org.apache.beam.sdk.Pipeline$ValidateVisitor.enterCompositeTransform(Pipeline.java:578)
    at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:482)
    at org.apache.beam.sdk.runners.TransformHierarchy$Node.visit(TransformHierarchy.java:486)
    at org.apache.beam.sdk.runners.TransformHierarchy$Node.access$400(TransformHierarchy.java:235)
    at org.apache.beam.sdk.runners.TransformHierarchy.visit(TransformHierarchy.java:210)
    at org.apache.beam.sdk.Pipeline.traverseTopologically(Pipeline.java:409)
    at org.apache.beam.sdk.Pipeline.validate(Pipeline.java:520)
    at org.apache.beam.sdk.Pipeline.run(Pipeline.java:294)
    at org.apache.beam.sdk.Pipeline.run(Pipeline.java:281)

I already tried the inside my IDE, outside through command line.

And every attempt I keep getting this error.

I'm running on Windows environment.

Any help would be appreciated.

Thanks.

Solution

  • I believe this is an issue in Cloud Bigtable client that has been fixed in a later version. Beam 2.1.0 uses the new version, please try using Beam 2.1.0 and let us know if the problem persists.