Questions tagged [kylo]

Kylo is an open-source data lake management platform. Ask programming related questions here. For other topics refer to Google groups.

Kylo is an open-source data lake management platform.

Kylo offers a turn-key, enterprise-ready data lake solution that integrates best practices around metadata management, governance, and security gleaned from Think Big's 150+ big data implementation projects.

For non programming related topics refer to Kylo Community on Google groups.

68 questions
1
vote
1 answer

Nifi putHiveStreaming Failed to connect to metastore uri

I'm facing issues with putHiveStreaming Processor as it is not connecting to hive metastore. I am using kylo-cloudera-sandbox-0.9.1, please help me on this as I'm not able to figure out the issue.
Karthik Mannava
  • 207
  • 1
  • 5
  • 12
1
vote
1 answer

I need to get latest data in data ingest template nifi

Hi sir, In data ingest template i need to get this property for ex i have data with date field date data 12-07-2018 a 13-07-2018 b 14-07-2018 c 15-07-2018 d In that , i would like to take latest one i.e,…
IMRAN S K
  • 23
  • 3
1
vote
1 answer

Not able to login into Kylo

When I'm trying to login into Kylo, it is throwing the following error, 2018-05-03 10:00:10 INFO http-nio-8400-exec-6:JerseyRestClient:219 - Created new Jersey Client without SSL connecting to http://sdo-dbstore2:8400/proxy 2018-05-03 10:00:11 INFO…
1
vote
1 answer

nifi pyspark - "no module named boto3"

I'm trying to run a pyspark job I created that downloads and uploads data from s3 using the boto3 library. While the job runs fine in pycharm, when I try to run it in nifi using this template…
mitroberts
  • 193
  • 1
  • 16
1
vote
1 answer

Data Cleansing in Kylo

I wanted to know if there are any methods to do data cleansing in Kylo (https://kylo.io/). I was able to get the tool to point out errors using data validation rules, but I was curious to know if it can also perform other functions.…
1
vote
2 answers

not able to see all services in kylo ui

I am not able to get HDFS, Hive and Spark on Kylo UI under service section. Does anybody has any idea regarding this.
Vish
  • 186
  • 3
  • 17
1
vote
1 answer

Maven Build stuck at Creating Spec file

I've been trying to build the kylo (ver 0.8.4) project using maven on my windows machine, using the new bash feature, and following the instructions on the dev docs site. I'm running into this situation where there's a spec file being created, and…
PapaJer
  • 11
  • 1
1
vote
2 answers

How to fix cross-origin error when request to Kylo API

I have a running instance of a Kylo Sandbox in a server called: kyloserver. I am trying to access Kylo API from my website, running in localhost:8080. I try to use Search API calling…
Israel Varea
  • 2,600
  • 2
  • 17
  • 24
1
vote
1 answer

Ambari Service Monitor is now a Kylo plugin jar

Kylo gives feature of ambari services.I try but find nothing how to use it. That what a got from internet. Modify/Ensure the connection properties are setup. The ambari connection parameters need to be moved out of the main kylo-services…
RAJ
  • 11
  • 6
1
vote
1 answer

Cannot load jdbc driver class org.apache.hive.jdbc.hivedriver in Kylo

I am trying to create a Data Ingest Feed but all the jobs are failing. I checked Nifi and there are error marks saying that "org.apache.hive.jdbc.hivedriver" was not found. I checked the nifi logs and found the following error : So where exactly…
Deven
  • 55
  • 8
1
vote
3 answers

Kylo service startup fails

I try to install Kylo on my existing HDP 2.6.2 Hadoop cluster. I follow Kylo Document but when I try to start Kylo, it says starting, but start fails a few seconds later and status turns stopped. [root@ ~]# service kylo-services…
Erkan Şirin
  • 1,935
  • 18
  • 28
1
vote
1 answer

Kylo plugin for UI is not working

I would like to extend Kylo user interface. From documentation, i understood that I can use Plugin mechanism to add new features and I am referring to the examples available here. I have built this example code and deployed the generated jar files…
Gana
  • 482
  • 3
  • 11
  • 32
1
vote
0 answers

Integrating kafka in kylo

I am trying to integrate kafka in kylo using data ingest template available in nifi. I am generating JSON files and have created a topic in kafka. And same has been configured in nifi's kafka-consume processor and added to the existing data ingest…
1
vote
1 answer

Configuring Reporting Task in Kylo

I am trying to configure reporting task in Nifi to be used by Kylo.I could not find Kylo reporting task in list. I see following list of jars in Nifi lib. Any pointers ?
Shashi
  • 2,686
  • 7
  • 35
  • 67
0
votes
1 answer

Need help migrating from Spark 2.0 to Spark 3.1 - Accumulable to AccumulatorV2

I'm working on adding Spark 3.1 and Scala 2.12 support for Kylo Data-Lake Management Platform. I need help with migrating the following functions: /** * Creates an {@link Accumulable} shared variable with a name for display in the Spark…
SaleemKhair
  • 499
  • 3
  • 12