0

I am trying create dataflow with subnetwork pararameter, but getting these errors user@cloudshell:~ (project-id)$ unrecognized arguments: --subnetwork

from Console Invalid value for field 'resource.properties.networkInterfaces[0].subnetwork

gcloud dataflow jobs run mysqldb_to_bigquery_with_subnet --gcs-location \
gs://dataflow-templates/latest/Jdbc_to_BigQuery \
--region='europe-west1' \
--subnetwork='regions/europe-west1/subnetworks/europe-west1' \
--parameters=driverJars=gs://bucket/mysql-connector-java-8.0.17.jar,driverClassName=com.mysql.jdbc.Driver,connectionURL='jdbc:mysql://server:3306/database?user=user_name&password=password',query='select * from table_name',outputTable=project-name:dataset_name.table_name,bigQueryLoadingTemporaryDirectory=gs://bucket_name/dataflow-files/temp-dir
BVSKanth
  • 111
  • 2
  • 16
  • You didn't specify full command in which you gave. – Inder R Singh Aug 02 '19 at 16:16
  • Updated it @InderRSingh – BVSKanth Aug 02 '19 at 18:29
  • gcloud dataflow jobs run, can have following arguments ...only (gcloud.dataflow.jobs.run) argument JOB_NAME --gcs-location: Must be specified. Usage: gcloud dataflow jobs run JOB_NAME --gcs-location=GCS_LOCATION [optional flags] optional flags may be --help | --max-workers | --parameters | --region | --service-account-email | --staging-location | --zone – Inder R Singh Aug 06 '19 at 23:24

2 Answers2

1
Correct command is still in beta version which you want you use as per documentation.
Command link https://cloud.google.com/dataflow/docs/guides/using-command-line-intf


gcloud beta dataflow jobs  run 
(gcloud.beta.dataflow.jobs.run) argument JOB_NAME --gcs-location
Must be specified.
Usage: gcloud beta dataflow jobs run JOB_NAME --gcs-location=GCS_LOCATION [optional flags]
  optional flags may be  --help | --max-workers | --network | --num-workers |
                         --parameters | --region | --service-account-email |
                         --staging-location | --subnetwork |
                         --worker-machine-type | --zone
Inder R Singh
  • 652
  • 1
  • 6
  • 21
0
  gcloud dataflow jobs run  --> This command can have following arguments only

  (gcloud.dataflow.jobs.run) argument JOB_NAME --gcs-location:        
  Must be specified.
  Usage: gcloud dataflow jobs run JOB_NAME --gcs-location=GCS_LOCATION 
  [optional flags]
  optional flags may be  --help | --max-workers | --parameters | --region |
                         --service-account-email | --staging-location | --zone
Inder R Singh
  • 652
  • 1
  • 6
  • 21
  • I am following Dataflow SDK documentation from this page. https://cloud.google.com/dataflow/docs/guides/specifying-networks. It shows subnetwork parameter. – BVSKanth Aug 07 '19 at 07:29
  • @BVSKanth Please see answer above and accept it. This is what you need & enjoy. – Inder R Singh Aug 07 '19 at 10:41