Stack Overflow
Stack Overflow

Questions tagged [fiware-cygnus]

fiware-cygnus tag refers to the Cygnus connector implementation (FIWARE platform), allowing for Orion context data persistence in an historical way in several different storages such as HDFS, MySQL or CKAN

Cygnus is a data connector within FIWARE platform allowing for Orion context data persistence in an historical way in several different storages such as HDFS, MySQL or CKAN. Cygnus characteristics are:

  • It is based in Apache Flume, expanding the core elements with custom sinks, http handlers, channel selectors and interceptors among others.
  • Smart destination (HDFS file, MySQL table or CKAN resource) extraction based on data properties.
  • Automatic Hive tables creation when using HDFS sinks.
  • Support for multiple persistence models (json-row, json-column, ...)

Home Page: http://catalogue.fiware.org/enablers/publishsubscribe-context-broker-orion-context-broker/documentation (within the Orion Context Broker catalogue entry)

GitHub Page: https://github.com/telefonicaid/fiware-connectors/tree/master/flume

284 questions
3
votes
1 answer

Fiware: Data loss prevention

I’m working with the 0.27.0 version of context broker. I'm using the Cygnus generic enabler and I have established a MQTT agent that connects external devices to the context broker. My major concern right now is how to prevent from data loss. I…
Julen
  • 263
  • 1
  • 9
3
votes
0 answers

Cygnus to Ckan - Runtime error (Don't know how to treat response code 409)

I am trying to use Cygnus with CKAN, but I get an error when I send the notification to the data is saved in CKAN. The Cygnus log: time=2016-02-17T10:01:11.601CET | lvl=INFO | trans=1455699663-312-0000000000 | srv=testjsb | subsrv=testjsb |…
Jonatan Santos
  • 65
  • 4
3
votes
1 answer

Orion notification to cygnus

I have followed the official guide about entity creation/update and subscribtion in Orion, they are working and I get success responses. But Orion doesnt send notifications to Cygnus. Am i missing some step here? These are the basic scripts I am…
dmtzz
  • 223
  • 2
  • 8
3
votes
1 answer

Orion JSON Bad Request

I'm currently trying to subscribe Orion and Cosmos. All data sent to Orion is being updated without any issue. But, when posting to http://xxx.xxx.xx.xx:1026/v1/subscribeContext I'm getting the following error: { "subscribeError": { …
medaqueno
  • 73
  • 6
3
votes
1 answer

Subscription to CB working but not visible

I have an entity represented on the Context Broker with severall attributes (such as temperature, humidity etc...). I have a MySql database that persists the values from that entity by row. So in order to persist that info i have to make a…
Diogo Nunes
  • 319
  • 1
  • 3
  • 16
3
votes
1 answer

Connectivity problems between FILAB VMs and Cosmos global instance

I have the same kind of connectivity problem discussed in the question "Cygnus can not persist data on Cosmos global instance". However, I have found no solution after read it. Nowadays, I have recently deployed two virtual machines in FILAB (both…
Ramón Martínez Carreras
  • 83
  • 4
3
votes
1 answer

Using Parquet format with Cygnus

I would like to store the events data in Parquet format (e.g., on HDFS). Do I need to modify the code of the corresponding sinks, or there is a way around it? E.g., using a Flume interceptor.. Thanks.
Alex Glikson
  • 401
  • 4
  • 13
3
votes
1 answer

Cygnus can not persist data on Cosmos global instance

When trying to persist an entity from Cygnus to Cosmos global instance it fails. Looking at the log file I see something like that: 2015 15:31:50,006 DEBUG [SinkRunner-PollingRunner-DefaultSinkProcessor]…
M. S.
  • 131
  • 5
3
votes
1 answer

Fiware: can not start cygnus as service

I installed cygnus using RPMs on fiware image CentOS-7-x64 and I can't start it as a service, Here is my logs: [centos@cygnus-mongo conf]$ sudo service cygnus start Starting cygnus (via systemctl): Job for cygnus.service failed. See 'systemctl…
sabrina2020
  • 2,102
  • 3
  • 25
  • 54
3
votes
1 answer

cygnus instance not reached from orion context broker

I have installed cygnus 0.8.2 on fiware image CentOS-7-x64, I subscribed to orion context broker using: (curl 193.48.247.246:1026/v1/subscribeContext -s -S --header 'Content-Type: application/json' --header 'Accept: application/json' --header…
sabrina2020
  • 2,102
  • 3
  • 25
  • 54
3
votes
1 answer

Cygnus: Bad HTTP notification (curl/7.29.0 user agent not supported)

I installed cygnus version 0.8.2 on Fiware instance basing on the image CentOS-7-x64 using: sudo yum install cygnus I configured my agent as the following: cygnusagent.sources = http-source cygnusagent.sinks = mongo-sink cygnusagent.channels =…
sabrina2020
  • 2,102
  • 3
  • 25
  • 54
3
votes
1 answer

Fiware Cygnus: Can we store Orion data in MongoDB under other types than String?

I am subscribing to Orion Context Broker data using Cygnus. Cygnus stores the data on MongoDB like the following. Is there a possibility to store the attrValue as float not as String to be able to use Mongo's aggregation features? >…
sabrina2020
  • 2,102
  • 3
  • 25
  • 54
3
votes
2 answers

Make Cygnus use WebHDFS to write to local HDFS

I'm trying to make a local Orion+Cygnus persist Orion's data on a local HDFS through WebHDFS. On Cygnus' instructions on gitub, very little is mentioned about WebHDFS, as the configuration is more about HttpFS. On the .md OrionHDFSsink it's said…
A. Vieira
  • 1,213
  • 2
  • 11
  • 27
3
votes
1 answer

Cygnus MySQL sink error (attr_persistence = column)

I'm using cygnus to store data in both MySQL Database and Cosmos. Storing the data in cosmos works ok, but when storing in MySQL, especifically with the attribute "cygnusagent.sinks.mysql-sink.attr_persistence = column" instead of…
Hellin.H
  • 33
  • 2
3
votes
1 answer

JDBC and Hive query error 10 or 9

In may i've created a Java servlet which allow me to query my hive tables on Cosmos . Before the migration to cygnus 0.8.2 , my data were pushed to a table named "hostabee" which I can still query from my Java application . But now a table is…
Guillaume Jourdain
  • 169
  • 9
1
2
3
…
18 19