Questions tagged [apache-atlas]

Apache Atlas is a data governance and metadata framework for Hadoop. Use for questions about setting up Atlas, the REST APIs, bridges, or problems encountered using Atlas.

Data Governance and Metadata framework for Hadoop

Features

  • Data Classification

Import or define taxonomy business-oriented annotations for data Define, annotate, and automate capture of relationships between data sets and underlying elements including source, target, and derivation processes Export metadata to third-party systems

  • Centralized Auditing

Capture security access information for every application, process, and interaction with data Capture the operational information for execution, steps, and activities

  • Search & Lineage (Browse)

Pre-defined navigation paths to explore the data classification and audit information Text-based search features locates relevant data and audit event across Data Lake quickly and accurately Browse visualization of data set lineage allowing users to drill-down into operational, security, and provenance related information

  • Security & Policy Engine

Rationalize compliance policy at runtime based on data classification schemes, attributes and roles. Advanced definition of policies for preventing data derivation based on classification (i.e. re-identification) – Prohibitions Column and Row level masking based on cell values and attibutes.

References:

107 questions
0
votes
0 answers

Cant Delete Entity in Apache Atlas if Entity has an Entity Attribute

I have an Atlas Type Definition that has an attribute of another Type Definition. I can create Entities but once the Entity is created, if I added the Entity Attribute to the Entity, I cannot edit or delete the Entity. Example TypeDefs: { …
jason
  • 3,821
  • 10
  • 63
  • 120
0
votes
0 answers

Running Apache Atlas via Docker now fails

I am trying to run the https://hub.docker.com/r/sburn/apache-atlas docker image. I have been using this image for months now with no issue. Starting today, when I run the image using this command: docker run -d -p 21000:21000 --name atlas…
jason
  • 3,821
  • 10
  • 63
  • 120
0
votes
0 answers

Duplication of process for different inputs and outputs

Hi I am new to apache atlas and I am facing the following issue. I know it's possible to link entities through a process, but I'm having difficulty in cases where different sets are created by the same process. That is, conditionally, I have a set…
0
votes
0 answers

Apache Atlas create Relationship with SDK

I am trying to figure out the Apache Atlas Common Library for my Spring Boot project. To be honest, I am having a really hard time finding any documentation on this library. But, I import it in my Pom file like this:
jason
  • 3,821
  • 10
  • 63
  • 120
0
votes
0 answers

Setting up Apache Atlas

I am trying to setup Apache Atlas on my Windows 10 machine. I have the following prereqs: Maven Version 3.8.6 JDK Version 1.8.0 Python 2.7.7 I then pull Apache Atlas and I am using tags/release-2.3.0. Once downloaded, I run the following…
jason
  • 3,821
  • 10
  • 63
  • 120
0
votes
0 answers

How to do upgrade/instructions Apache Atlas from version 2.0 to version 2.2?

I need help with upgrade instructions/process for Apache Atlas from version 2.0 to 2.2. Can't find instructions on how to upgrade Apache Atlas version 2.o to 2.2.
0
votes
0 answers

Can't overwrite HIVE database metadata in Apache Atlas service

Good afternoon everyone! I use HDP-2.6.5.1175 and the Atlas version is 0.8.0. The problem: In hive I have a database with 2 tables, but in Atlas for some reason this database remains with 3 tables (one of them belongs to another database), even when…
0
votes
0 answers

What happens in Apache Atlas when two attributes collide?

I am designing a governance model, and I would like to know what happens in apache atlas when I have 2 classifications (tags) collide with different attribute values? Example Revenue table (tag: certified; attribute: expires_on: 2023) Customer…
Rupert
  • 4,209
  • 7
  • 31
  • 36
0
votes
0 answers

Could not transfer artifact com.sleepycat:je:pom:7.3.7 from/to central (http://repo1.maven.org/maven2)

I want to use apache atlas so I was flolloing the instruction in the official page : enter link description here but I got this error when doing mvn clean -DskipTests package -Pdist Error resolving project artifact: Could not transfer artifact…
0
votes
0 answers

Setting up workspace to build on Apache Atlas

I'm exploring options on open source data catalog tools which can provide metadata features like Open source Search and discovery Lineage tracking Tagging I found Apache Atlas as a good candidate to start working on since it does not currently…
Tameem
  • 408
  • 7
  • 19
0
votes
0 answers

Error "Failed to get the lock" while creating or deleting TYPE Metadata object in APACHE ATLAS

I am trying to create custom TYPE Metadata objects in Apache Atlas for a Reporting tool. I can create or delete, but most of the time I get the below error. I am not sure what is triggering this error. {"errorCode":…
0
votes
1 answer

'atlas.graph.index.search.map-name' doesn't map to a List object: false

I tried to setup the sqoop-hook with Atlas Following these steps : 1- Set-up Atlas hook in sqoop-site.xml: sqoop.job.data.publish.class org.apache.atlas.sqoop.hook.SqoopHook 2- copy…
Omar Tougui
  • 183
  • 2
  • 8
0
votes
1 answer

cannot purge deleted entity in apache atlas

I tried to purge deleted entities in apache atlas and I keep getting the following error "error":"Cannot deserialize instance of java.util.HashSet out of START_OBJECT token\n at [Source:…
0
votes
1 answer

Why do I get guid -1 for hive assets when calling Atlas v2 API?

I get GUID=-1 for all hive assets when calling the Apache Atlas V2 API for some reason. Why could that be? Notes: The reason for the problem is probably simple, but I thought I should add it as question for others to find it as well. I get guid:s…
nize
  • 1,012
  • 1
  • 11
  • 27
0
votes
1 answer

Apache Atlas with Cassandra on Openshift , Exception while starting Atlas server

I am setting up Apache Atlas with Cassandra as backend and solr as indexer. Below are my configuration setting for Atlas-cassandra atlas.graph.storage.backend=cql atlas.graph.storage.hostname=cassandra-dc-service …