NewsgroupsDataLoader

Value Members

1. final def !=(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef

2. final def !=(arg0: Any): Boolean

   Definition Classes

   Any

3. final def ##(): Int

   Definition Classes

   AnyRef → Any

4. final def ==(arg0: AnyRef): Boolean

   Definition Classes

   AnyRef

5. final def ==(arg0: Any): Boolean

   Definition Classes

   Any

6. def apply(sc: SparkContext, dataDir: String): LabeledData[Int, String]

   Loads the 20 newsgroups dataset.

   Loads the 20 newsgroups dataset. Designed to load data from 20news-bydate.tar.gz from http://qwone.com/~jason/20Newsgroups/

   The expected directory structure for the train and test dirs is: train_or_test_dir/class_label/docs_as_separate_plaintext_files

   sc

   SparkContext to use

   dataDir

   Directory of the training data

   returns

   A NewsgroupsData object containing the loaded train & test data as RDDs

7. final def asInstanceOf[T0]: T0

   Definition Classes

   Any

8. val classes: Array[String]

   The 20 Newsgroups class labels (and directory names) *

9. def clone(): AnyRef

   Attributes

   protected[java.lang]

   Definition Classes

   AnyRef

   Annotations

   @throws( ... )

10. final def eq(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

11. def equals(arg0: Any): Boolean

    Definition Classes

    AnyRef → Any

12. def finalize(): Unit

    Attributes

    protected[java.lang]

    Definition Classes

    AnyRef

    Annotations

    @throws( classOf[java.lang.Throwable] )

13. final def getClass(): Class[_]

    Definition Classes

    AnyRef → Any

14. def hashCode(): Int

    Definition Classes

    AnyRef → Any

15. final def isInstanceOf[T0]: Boolean

    Definition Classes

    Any

16. final def ne(arg0: AnyRef): Boolean

    Definition Classes

    AnyRef

17. final def notify(): Unit

    Definition Classes

    AnyRef

18. final def notifyAll(): Unit

    Definition Classes

    AnyRef

19. final def synchronized[T0](arg0: ⇒ T0): T0

    Definition Classes

    AnyRef

20. def toString(): String

    Definition Classes

    AnyRef → Any

21. final def wait(): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

22. final def wait(arg0: Long, arg1: Int): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )

23. final def wait(arg0: Long): Unit

    Definition Classes

    AnyRef

    Annotations

    @throws( ... )