Stack Overflow
Stack Overflow

Questions tagged [databricks-community-edition]

85 questions
1
vote
2 answers

Apache Spark Data Generator Function on Databricks Not working

I am trying to execute the Data Generator function provided my Microsoft to test streaming data to Event Hubs. Unfortunately, I keep on getting the error Processing failure: No such file or directory When I try and execute the…
Patterson
  • 1,927
  • 1
  • 19
  • 56
1
vote
1 answer

Is Machine Learning persona available for Databricks community edition?

I just started using Databricks community edition, and by default I am in the "Data Science and Eingineering" persona. I wanted to explore the Machine Learning environment, but could not find such options from the sidebar (see below). Is the feature…
Ying Xiong
  • 4,578
  • 8
  • 33
  • 69
1
vote
1 answer

Unable to access file from DBFS using DataBricks fuse mount path

I have files in data bricks as shown below I am trying to access them like this from data bricks notebooks But I am getting error, even trying to use pandas gives an error I don't understand where am I going wrong. Althought…
Probhakar Sarkar
  • 169
  • 10
1
vote
1 answer

How to import text file in Data bricks

I am trying to write text file with some text and loading same text file in data-bricks but i am getting error Code #write a file to DBFS using Python I/O APIs with open("/dbfs/FileStore/tables/test_dbfs.txt", 'w') as f: f.write("Apache Spark is…
Suneel Kumar
  • 127
  • 1
  • 2
  • 8
1
vote
0 answers

Unable to create cluster on Databricks Community Edition

I have been using Databricks Community Edition for over 4 years and suddenly I'm unable to create a single node cluster as I have always been doing. I keep on getting the message 'Only professional or enterprise tier customers can create autoscaling…
Patterson
  • 1,927
  • 1
  • 19
  • 56
1
vote
2 answers

Opening a File in DBFS on Databricks throws an error

I'm using databricks community edition and when I try to open a file that exists in the DBFS, it throw me an error. as the image below Image attached First cell, is to show that the file exists. and Second cell, is trying to open the file
Moe
  • 11
  • 4
1
vote
1 answer

SparkSessionExtensions injectFunction in Databricks environment

SparkSessionExtensions injectFunction works locally, but I can't get it working in the Databricks environment. The itachi project defines Catalyst expressions, like age that I can successfully use locally via spark-sql: bin/spark-sql --packages…
Powers
  • 18,150
  • 10
  • 103
  • 108
1
vote
2 answers

Where is flowers parquet dataset in Databricks

I am working on this notebook. https://databricks.com/notebooks/simple-aws/petastorm-spark-converter-pytorch.html I tried running the first line df = spark.read.parquet("/databricks-datasets/flowers/parquet") \ .select(col("content"),…
Sajeed
  • 119
  • 10
1
vote
0 answers

Package Cell Issue on Databricks Community Edition

Followed this https://docs.databricks.com/notebooks/package-cells.html On Community Edition - latest release Spark 3.x: A.1. Created the Package with Object as per the example. A.2. Ran in same Notebook in a different cell without cluster re-start.…
thebluephantom
  • 16,458
  • 8
  • 40
  • 83
1
vote
2 answers

Accessing file from python code in databricks

I am trying to access a model file I had previously copied over via CLI by using the following code in a notebook at https://community.cloud.databricks.com/ with open("/dbfs/cat_encoder.joblib", "rb") as f: lb_category = joblib.load(f) For this…
demongolem
  • 9,474
  • 36
  • 90
  • 105
1
vote
1 answer

Can data access tokens be generated using Databricks Community Edition?

I'm trying to create an access token using Databricks community edition but the option doesn't seem to be available. Can an access token be created in the community edition or is this not available? This is what the guide shows: This is what I'm…
John
  • 3,458
  • 4
  • 33
  • 54
1
vote
1 answer

Databricks Community Edition conflicting Scala libraries or JARs attached to the cluster

Everytime I attempted to execute any Scala code on Databricks Community Edition, I get the following error message: java.lang.Exception: An error occurred while initializing the REPL. Please check whether there are conflicting Scala libraries or…
Carltonp
  • 1,166
  • 5
  • 19
  • 39
0
votes
1 answer

How to declare variables in Databricks SQL editor

In Databricks Notebook (Sql) I was able to declare a variable and use it also with below syntax: set name.table=(select distinct name from t1); select * from t2 where name IN ${name.table} but the same is not working in the SQL Editor. Getting…
Rita Kumari
  • 13
  • 2
0
votes
0 answers

Connecting RStudio Desktop to Databricks Community Edition on Mac OS Ventura(13.4) with M1 chip via ODBC

Has anyone been successful in using/configuring ODBC for Rstudio desktop with databricks community edition on MAC OS Ventura (13.4) and M1 chip? Tha link to databricks community edition is here --> link I downloaded the MAC OS driver here --> link I…
wdefreit
  • 51
  • 3
0
votes
0 answers

Can I run scala script directly from git repo in databricks

I want to run a scala script as a job from my git repo in databricks. I am not able to see any option to do it. Do we need a special access to be able to do it? I can see the option to run notebook from the git repo but cannot see the option to…
Monika Samant
  • 1
  • 1
1 2
3
4 5 6