wikiparser

Type Members

final class AnnotationKey[T] extends AnyRef

A marker class whose purpose is to add compile-time type safety to node annotations.
A marker class whose purpose is to add compile-time type safety to node annotations. Replaces annotation key names. Usage is similar to annotation key names, but annotation key names are distinguished by equality, while AnnotationKey objects are distinguished by identity. Thus, this class does not override hashCode and equals.
Note: we could add a name to objects of this class, which would probably be nice for debugging, but could lead to confusion: one might think that the name is the actual key, but is isn't, and cannot be, because we cannot associate the name with the type of the annotation - at run-time, the type is gone because of erasure. Two annotation key objects with the same name would still be completely unrelated keys.
TODO: as a dedugging aid, call Thread.currentThread.getStackTrace in the constructor and save class name, method name and line number of the place where the annotation key was created. Probably the second element in the stack trace array, but that's not guaranteed.
case class ExternalLinkNode(destination: IRI, children: List[Node], line: Int, destinationNodes: List[Node] = List[Node]()) extends LinkNode with Product with Serializable

Represents an external Link.
Represents an external Link. The children of this node represent the label of the link. If the source does not define a label explicitly, a TextNode containing the link destination will be the only child.
destination
The destination URI of this link
children
The nodes of the label of this link
line
The source line number of this link
case class InterWikiLinkNode(destination: WikiTitle, children: List[Node], line: Int, destinationNodes: List[Node] = List[Node]()) extends WikiLinkNode with Product with Serializable

Represents an InterWiki Link.
Represents an InterWiki Link. The children of this node represent the label of the link. If the source does not define a label explicitly, a TextNode containing the link destination will be the only child.
destination
The destination WikiTitle of this link
children
The nodes of the label of this link
line
The source line number of this link
case class InternalLinkNode(destination: WikiTitle, children: List[Node], line: Int, destinationNodes: List[Node] = List[Node]()) extends WikiLinkNode with Product with Serializable

Represents an internal Link.
Represents an internal Link. The children of this node represent the label of the link. If the source does not define a label explicitly, a TextNode containing the link destination will be the only child.
destination
The destination WikiTitle of this link
children
The nodes of the label of this link
line
The source line number of this link
class JsonNode extends Node
sealed abstract class LinkNode extends Node

Represents a Link.
Represents a Link. This class is abstract and derived by ExternalLinkNode and InternalLinkNode. The children of this node represent the label of the link. If the source does not define a label explicitly, a TextNode containing the link destination will be the only child.
class Namespace extends Serializable

Namespaces codes.
Namespaces codes.
FIXME: This object should not exist. We must load the namespaces for a MediaWiki instance from its api.php or from a file. These values must then be injected into all objects that need them.
FIXME: separate Wikipedia and DBpedia namespaces. We cannot even be sure that there are no name clashes. "Mapping ko" may mean "Template talk" in some language...
abstract class Node extends AnyRef

Base class of all nodes in the abstract syntax tree.
Base class of all nodes in the abstract syntax tree.
This class is NOT thread-safe.
class PageNode extends Node

Represents a page.
case class ParserFunctionNode(title: String, children: List[Node], line: Int) extends Node with Product with Serializable

Represents a parser function.
Represents a parser function.
title
The title of the page, where this parser function is defined
children
The properties of this parser function
line
The source line number of this parser function
case class PropertyNode(key: String, children: List[Node], line: Int) extends Node with Product with Serializable

Represents a template property.
Represents a template property.
key
The key by which this property is identified in the template.
children
The contents of the value of this property
line
The source line number of this property
case class SectionNode(name: String, level: Int, children: List[Node], line: Int) extends Node with Product with Serializable

Represents a section.
Represents a section.
name
The name of this section
level
The level of this section. This corresponds to the number of '=' in the WikiText source
children
The nodes of the section name
line
The source line number of this section
case class TableCellNode(children: List[Node], line: Int, rowSpan: Int, colSpan: Int) extends Node with Product with Serializable

Represents a table cell
Represents a table cell
children
The contents of this cell
line
The (first) line where this table cell is located in the source
case class TableNode(caption: Option[String], children: List[TableRowNode], line: Int) extends Node with Product with Serializable

Represents a table.
Represents a table.
The rows are represents as child nodes. Each row itself contains a child node for each of its cells.
caption
The caption of this table
children
The rows of this table
line
The (first) line where this table is located in the source
case class TableRowNode(children: List[TableCellNode], line: Int) extends Node with Product with Serializable

Represents a table row
Represents a table row
children
The cells of this table row.
line
The (first) line where this table row is located in the source
case class TemplateNode(title: WikiTitle, children: List[PropertyNode], line: Int, titleParsed: List[Node] = List()) extends Node with Product with Serializable

Represents a template.
Represents a template.
title
The title of the page, where this template is defined
children
The properties of this template
line
The source line number of this property
case class TemplateParameterNode(parameter: String, children: List[Node], line: Int) extends Node with Product with Serializable

Represents a template property.
Represents a template property.
parameter
The key by which this property is identified in the template.
children
The contents of the value of this property
line
The source line number of this property
case class TextNode(text: String, line: Int, lang: Language = null) extends Node with Product with Serializable

Represents plain text.
Represents plain text.
text
The text
line
The source line number where this text begins
sealed abstract class WikiLinkNode extends LinkNode
class WikiPage extends Serializable

Represents a wiki page
Represents a wiki page
TODO: use redirect id to check redirect extractor. Or get rid of redirect extractor.
trait WikiParser extends (WikiPage) ⇒ Option[PageNode]

Parses WikiText source and builds an Abstract Syntax Tree.
Parses WikiText source and builds an Abstract Syntax Tree. Create new instances of this trait by using the companion object.
class WikiParserException extends Exception

Thrown whenever a parsing error is encountered.
class WikiTitle extends Serializable

Represents a page title.
Represents a page title. Or a link to a page.
FIXME: a link is different from a title and should be represented by a different class.

Value Members

object Namespace extends Serializable
object Node
object NodeUtil

Utility functions for working with nodes.
object TemplateNode extends Serializable
object WikiPage extends Serializable
object WikiParser

Creates new WikiParser instances.
object WikiTitle extends Serializable
package impl

package wikiparser

Type Members

final class AnnotationKey[T] extends AnyRef

case class ExternalLinkNode(destination: IRI, children: List[Node], line: Int, destinationNodes: List[Node] = List[Node]()) extends LinkNode with Product with Serializable

case class InterWikiLinkNode(destination: WikiTitle, children: List[Node], line: Int, destinationNodes: List[Node] = List[Node]()) extends WikiLinkNode with Product with Serializable

case class InternalLinkNode(destination: WikiTitle, children: List[Node], line: Int, destinationNodes: List[Node] = List[Node]()) extends WikiLinkNode with Product with Serializable

class JsonNode extends Node

sealed abstract class LinkNode extends Node

class Namespace extends Serializable

abstract class Node extends AnyRef

class PageNode extends Node

case class ParserFunctionNode(title: String, children: List[Node], line: Int) extends Node with Product with Serializable

case class PropertyNode(key: String, children: List[Node], line: Int) extends Node with Product with Serializable

case class SectionNode(name: String, level: Int, children: List[Node], line: Int) extends Node with Product with Serializable

case class TableCellNode(children: List[Node], line: Int, rowSpan: Int, colSpan: Int) extends Node with Product with Serializable

case class TableNode(caption: Option[String], children: List[TableRowNode], line: Int) extends Node with Product with Serializable

case class TableRowNode(children: List[TableCellNode], line: Int) extends Node with Product with Serializable

case class TemplateNode(title: WikiTitle, children: List[PropertyNode], line: Int, titleParsed: List[Node] = List()) extends Node with Product with Serializable

case class TemplateParameterNode(parameter: String, children: List[Node], line: Int) extends Node with Product with Serializable

case class TextNode(text: String, line: Int, lang: Language = null) extends Node with Product with Serializable

sealed abstract class WikiLinkNode extends LinkNode

class WikiPage extends Serializable

trait WikiParser extends (WikiPage) ⇒ Option[PageNode]

class WikiParserException extends Exception

class WikiTitle extends Serializable

Value Members

object Namespace extends Serializable

object Node

object NodeUtil

object TemplateNode extends Serializable

object WikiPage extends Serializable

object WikiParser

object WikiTitle extends Serializable

package impl

Ungrouped