SocialArgAnalysis/distributed_social_network_...

Distributed Social Network Analyzer

Requirements

Required sbt version: 1.4.6

• Java 11
• Spark 3.0.1 (with GraphX) : https://spark.apache.org/releases/spark-release-3-0-1.html
• sbt project uses scala 2.12.2

You can get help here

Compiling

Go to the project folder distributed_social_network_analyzer and execute:

$sbt package

Executing

The main way to execute the project in Apache Spark after compiling:

$ spark-submit --master local[*] --class "MainAppFromXML" target/scala-2.12/social-network-analyzer_2.12-1.0.jar  xmlfilewithconversationgraph

Or use the script found in scripts/solveXMLconversation.sh

GraphX Pregel API

Doc:

https://spark.apache.org/docs/latest/graphx-programming-guide.html#pregel-api

Examples:

spark-2.2.1-bin-hadoop2.7/examples/src/main/scala/org/apache/spark/examples/graphx/