I have a graph with 18 million vertices but when I want to count the edges and I use g.edges.count
, I get stuck in a stage
Also when I use LPA (community detection) algorithm, again I get stuck in a stage, especially when my edges are large.
Any idea on how can I prevent getting stuck in stages in spark when I'm using graphframes?
Spark stuck on stage when using community detection lpa AND g.edges.count() from graphframes library
Asked
Active
Viewed 14 times
0

Arash Mohamadpour
- 13
- 4