Scala/Spark Wikipedia assignment doesn't receive resources | Coursera Community
Coursera Header
Question

Scala/Spark Wikipedia assignment doesn't receive resources

  • 30 June 2020
  • 0 replies
  • 31 views

Badge +1

Hi all,

 

I am trying to complete this week assignment https://www.coursera.org/learn/scala-spark-big-data/programming/QcWcs/wikipedia but when I submit the assignment I receive a low-score with the following description for all the tests, even though I have copied the dataset in the requested folder: src/main/resources/wikipedia

 

 

Test Description] 'rankLangs' run on a subset of the dataset provided in object 'WikipediaData' returns the correct ranking (in descending order)(wikipedia.WikipediaSuite) [Observed Error] class org.apache.hadoop.mapred.InvalidInputException: Input path does not exist: file:/grader/src/main/resources/wikipedia/wikipedia.dat org.apache.hadoop.mapred.InvalidInputException: Input path does not exist: file:/grader/src/main/resources/wikipedia/wikipedia.dat at org.apache.hadoop.mapred.FileInputFormat.singleThreadedListStatus(FileInputFormat.java:285)

 

I have also tried by reading the file with this.getClass.getClassLoader.getResource("wikipedia/wikipedia.dat")  and in that case I receive:

 

[Test Description] 'rankLangs' run on a subset of the dataset provided in object 'WikipediaData' returns the correct ranking (in descending order)(wikipedia.WikipediaSuite) [Observed Error] class java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: jar:file:/grader/grader.jar!/wikipedia/wikipedia.dat java.lang.IllegalArgumentException: java.net.URISyntaxException: Relative path in absolute URI: jar:file:/grader/grader.jar!/wikipedia/wikipedia.dat at org.apache.hadoop.fs.Path.initialize(Path.java:206) at org.apache.hadoop.fs.Path.<init>(Path.java:172)

 

 

Could anybody help me please?

 

Thanks,

Fabry

 


0 replies

Be the first to reply!

Reply