Questions tagged [dataconnect]

IBM Bluemix Data Connect, formerly DataWorks, is a self-service data preparation and integration service for users to access and prepare their data for analytics.

IBM Bluemix Data Connect is a fully managed self-service data preparation and movement service that enables you to streamline your analytics and application development projects to deliver insights faster and with increased accuracy. It provides a wide range of data access connectors to your most essential data sources so you can explore, combine, and shape your data to prepare it for analytics. Use it to positively impact the way your organization leverages valuable data resources - all from the convenience of the cloud.

Capabilities

  • Simple Data Access - Easy and secure access your most essential on-premises and cloud data sources with a powerful visual interface, ensuring you have the right data for your analytics project.
  • Fast Data Preparation - A broad range of operations let you join data from multiple sources and design data flows to generate your own data sets to propel your analytics project forward with speed and accuracy.
  • Smart Delivery - A fully managed infrastructure in addition to seamless integration across the IBM cloud data services ecosystem enable you to take the load off of IT and to focus on delivering insights.

Key Features

  • Accessing data - Access data wherever it resides by relying on connectivity to the most common industry data sources. With 25+ connectors available today, it’s easy to securely connect to the data you need.
  • Designing Data Flows - Complexity demands a way to move beyond working directly with the data. Design data flows combining multiple data sources with real-time validation to quickly create complex transformation routines.
  • Shaping Raw Data - Filter values and columns from the source data, sort, remove duplicates, and understand the quality of the data through standardized scores.

When asking questions about Data Connect, you should:

  • Ensure you are asking a technical question about the Data Connect service. (For questions about your account, ask at IBM developerWorks Answers or open a support ticket.)

  • Search Stack Overflow to see if somebody else has already asked the same question.

  • Explain what you were trying to do when you encountered the problem. What software versions were you using? Is there anything else about your environment that could lead to the problem?

  • Provide detailed steps where possible. Isolate the problem and reproduce it with as few steps as possible. Additionally, include information about data sources/targets where relevant.

  • Include the dataconnect tag, plus the additional ibm-bluemix tag.

Getting support for Data Connect

  • Stack Overflow is the best option for technical questions about the Data Connect service. The Data Connect Development and Support teams monitor Stack Overflow closely.

  • Ask questions about the Data Connect service at IBM developerWorks Answers. It's also the best place to ask questions about getting started with Data Connect and Bluemix.

  • Anyone with a Bluemix account can open a support ticket. See Getting Customer Support for details on contacting Support and opening tickets.

Helpful links

19 questions
2
votes
1 answer

How to connect to a Secure Gateway's destination with TLS in DataWorks

I would like to load on-premise Oracle data to Bluemix dashDB. I plan to use DataWorks and Secure Gateway. It is required that only DataWorks can access to Secure Gateway. According to the tutorial Securing Destinations with TLS in Bluemix Secure…
shimac-jp
  • 233
  • 3
  • 11
1
vote
2 answers

Connect services DataConnect and DB2 Warehouse on Cloud (former DashDB)

I am working on the migration of a db2 process, which connects to several remotes servers, exports data into our local db, and then manipulates it (insert computed data, calculated times, etc) I have created some activities in DataConnect to…
1
vote
0 answers

dashDB to BigInsights using Data Connect

I use Data Connect to copy data from a dashDB table to BigInsights HDFS but even if the activity completes successfully, I can't find the data in hadoop. Am I missing something? I gave 777 privileges on the target HDFS dir. Thanks 1
1
vote
2 answers

Push data from dashDB to Watson Analytics using DataWorks?

I have an account in IBM Public Bluemix. I provisioned a dashDB instance and have inserted data into a dashDB table. I login to Bluemix using my IBM ID (not IBM Intranet ID) I also have a Watson Analytics account. Please note that my Watson…
0
votes
1 answer

ibm data connect connection for ibm cloud object storage

I have created bucket in ibm cloud object storage and successfully able to upload file posting there. Now, I want to refine those files using ibm data connect. I am trying to create a connection in data connect and selected bluemix object…
nish
  • 1
  • 1
0
votes
1 answer

Custom filter in DataConnect

As you may have realized, I am using a lot this IBM Bluemix DataConnect service. When creating an activity, you can refine the data you are going to export, using a custom filter (it enables a WHERE clause to add logic to the query) I am trying to…
0
votes
0 answers

DataConnect error while trying to export from remote server

I have created several activities this month. Run many also with successfull results. Lately I've been experiencing some issues. Specifically the following one. CDICO2024E: Batch of 1756 records could not be written to the data source: [SQLSTATE…
0
votes
1 answer

mysQL to IBM Data Connect

I setup my first local mysql and tables and want to push these tables via IBM Data Connect to an other location. Gateway/Connection works fine, but Data Connect doesn't show the tables at refine step. Is it because of timeout or schemas? Where can…
0
votes
2 answers

IBM DataConnect refine operations

The supported list of transformations in IBM's ETL service DataConnect in Bluemix Cloud are these ones here: https://console.ng.bluemix.net/docs/services/dataworks1/using_operations.html#concept_h4k_5tf_xw I have looked and looked but with no luck,…
and_apo
  • 1,217
  • 3
  • 17
  • 41
0
votes
2 answers

How to chain IBM Data Connect Activities in a flow

I have defined several Activities in IBM Data Connect (on Bluemix) and would like to chain them together, e.g. one for copying a Cloudant DB to dashDB, another for refining the copied data - so forth and so on. Can this be done? If yes - how.
0
votes
1 answer

Can I use ElephantSql service as a target in bluemix data connect?

I created a service to ElephantSql in bluemix (plan: Tiny Turtle). I created a connection to the ElephantSql service in Data Connect. It appears in my list of Connections in Data Connect. However - It does not appear as an option when I try to use…
johnmatt
  • 3
  • 2
0
votes
1 answer

Bluemix Data Connect does not apply the filter rows for the entire dataset, just for the first 1000 rows

The operation "filter rows" does not apply for the entire dataset, just for the first 1000 rows, that is the preview. This is weird, once other operations are applied onto the entire dataset with no problem. Is it a bug or something that just work…
0
votes
0 answers

License issue connecting to on premise DB2 ZoS

Even after connection is established (with secure gateway and client on my computer through which I can access the DB) and schema and tables selected in dataworks and either refine or copy selected the error below appears: The IBM Data Server for…
zygas
  • 1
0
votes
2 answers

secure gateway ACL_FILE definition?

My /etc/ibm/sgenvironment.conf file has a ACL_FILE: # Access Control List File # If manually modifying the following, accepted values are the absolute path to your ACL files ('none' if no file, separated by '--'…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
1 answer

Connecting on-premises Microsoft SQL Server to Dataworks using a secure gateway

I am trying to connect to an on-premises SQL Server to DataWorks using a secure gateway. I have already created the Secure Gateway (installed the client on my PC and can connect to it). When I go to dataworks -> tasks -> Create connection ->…
1
2