2

I am exploring new tools for data pipelines. Trying Google's Data Fusion I was very surprised to not see any REST connector.

It seems like REST API's are a very standard way to access data and I am confused not to see it available.

Am I missing something ? Are there REST source/sink connectors ? And if not, why ? Is that a design decision by CDAP ?

nate-k
  • 191
  • 2
  • 10
  • Hi nate. Would you mind to be a bit more specific regarding these REST connectors? What is that you are trying to achieve/which methods do you actually want? Just in case, [here](https://cloud.google.com/data-fusion/docs/reference/rest/) you have the REST API reference for creating and managing your Cloud Data Fusion instances on Google Cloud. – Sergi Muñoz Jan 22 '20 at 14:47

1 Answers1

1

For the any tasks related to the managing Cloud Data Fusion instances you might consider looking at particular REST API reference as @Sergi Muñoz has already mentioned in the comment above, leveraging projects.locations method which is perfectly explained by @Guillem Xercavinsin from the practice perspective in the thread here.

However, when it turns for Data Fusion source connectors, it is worthy to mentioned about HTTP plugin which is available to install from Data Fusion Hub inventory. This plugin gives you a collection of variety features for Batch and Streaming purposes matching particular use case.

You can read more here where @Edwin Elia explains processing HTTP data within HTTP plugin.

Nick_Kh
  • 5,089
  • 2
  • 10
  • 16