Questions tagged [fiware-cygnus]

fiware-cygnus tag refers to the Cygnus connector implementation (FIWARE platform), allowing for Orion context data persistence in an historical way in several different storages such as HDFS, MySQL or CKAN

Cygnus is a data connector within FIWARE platform allowing for Orion context data persistence in an historical way in several different storages such as HDFS, MySQL or CKAN. Cygnus characteristics are:

  • It is based in Apache Flume, expanding the core elements with custom sinks, http handlers, channel selectors and interceptors among others.
  • Smart destination (HDFS file, MySQL table or CKAN resource) extraction based on data properties.
  • Automatic Hive tables creation when using HDFS sinks.
  • Support for multiple persistence models (json-row, json-column, ...)

Home Page: http://catalogue.fiware.org/enablers/publishsubscribe-context-broker-orion-context-broker/documentation (within the Orion Context Broker catalogue entry)

GitHub Page: https://github.com/telefonicaid/fiware-connectors/tree/master/flume

284 questions
2
votes
1 answer

Cannot start Cygnus with 2 instances as a service

I have configured 2 cygnus intances with their agents but when I start cygnus as a service I get the following error: sudo service cygnus start Starting cygnus (via systemctl): Job for cygnus.service failed because the control process exited with…
Stelios Botonakis
  • 183
  • 1
  • 3
  • 11
2
votes
1 answer

Cygnus doesn't persist data because: "namespace name generated is too long >127"

After some days breaking my head because cygnus persist randomly the updates, I have found in the logs that the size of a generated name space is too long. I'm working on Centos 7 my entities use the standard type: BikeHireDockingStation The error…
2
votes
0 answers

How to match column between HDFS File(save through cygnus) to Hive table?

I want save some data in hive through fiware-cygnus, I set the conf file, cygnus-ngsi.sources = http-source cygnus-ngsi.sinks = hdfs-sink cygnus-ngsi.channels = hdfs-channel cygnus-ngsi.sources.http-source.channels =…
Jongho Lee
  • 21
  • 2
2
votes
2 answers

About the version of each component in release 7.5 of FIWARE

Currently I am going to verify FIWARE. Release 7.5 was announced, but there are components whose version is lower in the core component. cygnus Release7.4 : version2.0.0 Release7.5 : version1.9.0 sth-comet Release7.4 :…
hiro
  • 59
  • 3
2
votes
1 answer

How can I calculate the appropriate amount of channel capacity?

I am looking for a solution because the sth-channel is full. I am troubled with calculating the appropriate capacity of channel capacity. This document has the following description. In order to calculate the appropriate capacity, just have in…
hiro
  • 59
  • 3
2
votes
0 answers

Store structured context values for attributes using FIWARE Orion Context Broker and CYGNUS MongoDB Sink?

Background I'm using the following Generic Enablers in a specific application that I am building over FIWARE: Orion Context Broker CYGNUS NGSI STH-Comet Also, I'm using MongoDB database, in order to persist all raw historical data received by…
Emiliano Viotti
  • 1,619
  • 2
  • 16
  • 30
2
votes
1 answer

Fiware cygnus docker installation

I have questions regarding docker installation of fiware-cygnus: What docker image should I use, I found at least 3 of them(not sure if this affect installation) I have agent.conf on my host, and I was not able to map it to the container. So it…
Igor
  • 225
  • 1
  • 9
2
votes
1 answer

FIWARE [NGSI] Orion-Cygnus-Hadoop HTTPBadRequestException: 'fiware-servicepath' through an Orion subscription

I want to persist some historical data from my server. So the documentation says that you must first send a subscription to Orion and then Orion will send the notification to Cygnus. I made the subscription like this: Entity payload =…
Cristina V
  • 117
  • 7
2
votes
0 answers

How to fetch data from Fiware Cygnus?

I have setup Cygnus with MySQL agent and now data is storing into MySQL server. As a next step, we need to show reports of historical data (Saved in Cygnus_MySQL) in GUI. It may be based upon some filters like data for today, last week/month, area…
Krishan Babbar
  • 766
  • 1
  • 7
  • 17
2
votes
1 answer

How to store hierarchical data through FIWARE Cygnus with MongoDB

I've deployed a FIWARE configuration to receive MQTT messages from TheThingsNetwork. The configuration uses IoTAgent-JSON, Orion and Cygnus, with a MongoDB backend for Cygnus. The messages are correctly persisted to MongoDB. Unfortunately, the…
Juergen
  • 95
  • 2
  • 8
2
votes
1 answer

Not able to connect to MongoDB with Auth - FIWARE Cygnus

We have been trying today to put a Cygnus container in production and we haven't been able to connect it to MongoDB. In our case, we have installed MongoDB with the Auth flag, and we created different users in order to test everything work.…
2
votes
0 answers

How to remove the following character "/" from service path

Good Morning! Currently I have set up my structure in Fiware saving my historical records in MongoDB, for this I have been using Mlab as a hosting. I attache the configuration file of my agent, the problem comes in that due to the mandatory…
2
votes
1 answer

My Cygnus agent doesn't create a MySQL database

Good afternoon! Following the documentation of http://fiware-cygnus.readthedocs.io I created my two conf as follows: cygnus_instance_1.conf (EDIT: UPDATED AT…
2
votes
3 answers

ContextBroker subscriptions Error

I've updated cygnus from version 0.13 to 1.7.0 by installing NGSI following this tutorial: https://github.com/telefonicaid/fiware-cygnus/tree/master/cygnus-ngsi Error the subscription [ { "id": "59d38a92dbaa1e477aef9c00", …
Manolait
  • 353
  • 2
  • 11
2
votes
1 answer

Modeling BD MYSQL Cygnus FIWARE

I am trying to model my DB in MYSQL, I would like my structure to be formed by a data collection table, which would be the one that generates cygnus automatically, then its subsequent related tables for those data with greenhouses and users. All the…
Manolait
  • 353
  • 2
  • 11