Stack Overflow
Stack Overflow

Questions tagged [cloudant-sdp]

Cloudant schema discovery process (SDP) scans a Cloudant database and intuits the implicit structures in your data. It then creates that proper schema in dashDB and copies the data over.

DashDB is built on a relational database, where the data is stored in structured relational tables. Cloudant stores JSON documents, where all the data is encapsulated in a single record. To move data between these two systems we need to be able to translate our JSON docs into a schema (or set of tables) that dashDB understands. This is exactly what the SDP does. It scans your Cloudant database and intuits the implicit structures in your data. It then creates that proper schema in dashDB and copies the data over.

Source: https://cloudant.com/blog/introducing-data-warehousing-and-analytics-with-cloudant-and-dashdb/#.VXrvwudnlK4

18 questions
1
vote
1 answer

Cloudant warehouse, deleted documents are not synced

I went through documentation on Cloudant warehouse but not able to find how are deleted documents synced. My requirement is that, just as in Cloudant replication, I would want documents deleted in Cloudant to also be deleted in dash DB. But I do not…
jeet
  • 629
  • 1
  • 4
  • 15
0
votes
1 answer

How to write selector query in cloudant for below cloudant json Data

How to write selector query for below data specially for (payload) in cloudant? { "_id": "1575370d5a7a4cdcd11c64f9066ed454", "_rev": "1-2c8aa9288c2e86aa83cea78299c63dcf", "topic": "smart_parking", How to write selector Query…
Rajesh Kumar Kanumetta
  • 314
  • 4
  • 15
0
votes
1 answer

How to automate creating and managing the Cloudant SDP?

I need to automate setting up the Cloudant SDP process so that devops can ensure that environment setup is repeatable. One option is to directly manipulate documents in _warehouser, but this is akin to messing around with an internal API which is…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
1 answer

Password is url encoded resulting in "The Bluemix credentials you entered don't appear to be valid. Please try again."

I'm trying to create a new warehouse from the Cloudant dashboard, but receive the following error message: The Bluemix credentials you entered don't appear to be valid. Please try again. I had a look at the network traffic and noticed the…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
1 answer

Issue in Cloudant to Dash DB sync on bluemix: Documents lost in transit

Few documents have just vanished in sync between Cloudant to Dash DB. On Cloudant side, the count of messages in main & overflow table is different than the actual count in dash db tables. Any clue how to find those documents?
jeet
  • 629
  • 1
  • 4
  • 15
0
votes
1 answer

Access search index by cloudant-client api

I have a document in cloudant server as: { "_id": "web", "_rev": "11-b1d0e315272a87c2549df4004d836049", "min_weight": 40, "max_weight": 65, "min_length": 1, "max_length": 2.2, "attributeCollection": { "attributeArray": [ { …
Nguyen Chi Hieu
  • 98
  • 1
  • 11
0
votes
1 answer

XXXX does not exist in the discovered schema. Document has not been imported

When using the SDP to extract data from Cloudant and populate dashDB, I occasionally see error messages in the dashdb "XXXX_OVERFLOW" table that look like this: [XXXX does not exist in the discovered schema. Document has not been…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
1 answer

SDP status shows that one document was skipped, but the *_OVERFLOW table is empty

I am running the SDP to export some data from Cloudant to dashDB. The SDP status shows that one document is skipped, but the *_OVERFLOW table is empty. Questions: What does 'skipped' actually mean? What is the difference between skipped and…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
2 answers

Error: 'You are not authorized to perform the requested action' when trying to create a warehouse

I'm trying to create a dashDB warehouse from Cloudant. I have provided my IBM ID for Bluemix and Cloudant appears to have logged me on ok, however when I try to create the warehouse I get the following error: Error: provision_dynamite_warehouse: …
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
1 answer

What steps are performed by a 'Rescan'?

To automatically warehouse documents from Cloudant to dashDB, there is a schema discovery process (SDP) that automates the data migration for you. When using the SDP to warehouse documents from Cloudant to dashDB, there is an option 'Rescan'. I…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
1 answer

how to increase the sample size used during schema discovery to 'unlimited'?

I have encountered some errors with the SDP where one of the potential fixes is to increase the sample size used during schema discovery to 'unlimited'. For more information on these errors, see: No matched schema for {"_id":"...","doc":{...} The…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
1 answer

The value type for json field XXXX was presented as YYYY but the discovered data type of the table's column was ZZZZ

When using the SDP to extract data from Cloudant and populate dashDB, I occasionally see error messages in the dashdb "XXXX_OVERFLOW" table that look like this: EXCEPTION The value type for json field XXXX was presented as java.lang.String but the…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
1 answer

No matched schema for {"_id":"...","doc":{...}

When using the SDP to extract data from Cloudant and populate dashDB, I occasionally see error messages in the dashdb "XXXX_OVERFLOW" table that look like this: No matched schema for {"_id":"...","doc":{...} Questions What does this error…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
1 answer

SQL0670N The statement failed because the row size of the resulting table would have exceeded the row size limit

When working with the Cloudant SDP, I have encountered the following error: SQL0670N The statement failed because the row size of the resulting table would have exceeded the row size limit. What does the error mean, and how can I fix it?
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
0
votes
1 answer

how to 'flatten' the table in dashDB created by the schema discovery process (SDP)?

I've used the Cloudant schema discovery process (SDP) to create and populate a table in dashDB. The data in Cloudant is time series in nature: ... { "date": "20150101T00:00:00", "type": "temperature", "reading": "21" } { "date":…
Chris Snow
  • 23,813
  • 35
  • 144
  • 309
1
2