org.apache.spark.sql.jdbc

Class JDBCRelation

Object

org.apache.spark.sql.sources.BaseRelation

org.apache.spark.sql.jdbc.JDBCRelation

All Implemented Interfaces:

java.io.Serializable, PrunedFilteredScan, scala.Equals, scala.Product

public class JDBCRelation
extends BaseRelation
implements PrunedFilteredScan, scala.Product, scala.Serializable

See Also:

Serialized Form

Constructor Summary

Constructors

Constructor and Description
JDBCRelation(String url, String table, Partition[] parts, java.util.Properties properties, SQLContext sqlContext)

Method Summary

Methods

Modifier and Type	Method and Description
RDD<Row>	buildScan(String[] requiredColumns, Filter[] filters)
static Partition[]	columnPartition(JDBCPartitioningInfo partitioning) Given a partitioning schematic (a column of integral type, a number of partitions, and upper and lower bounds on the column's value), generate WHERE clauses for each partition so that each row in the table appears exactly once.
Partition[]	parts()
java.util.Properties	properties()
StructType	schema()
SQLContext	sqlContext()
String	table()
String	url()

Methods inherited from class org.apache.spark.sql.sources.BaseRelation

sizeInBytes

Methods inherited from class Object

equals, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Methods inherited from interface scala.Product

productArity, productElement, productIterator, productPrefix

Methods inherited from interface scala.Equals

canEqual, equals

Constructor Detail

JDBCRelation

public JDBCRelation(String url,
            String table,
            Partition[] parts,
            java.util.Properties properties,
            SQLContext sqlContext)

Method Detail

columnPartition

public static Partition[] columnPartition(JDBCPartitioningInfo partitioning)

Given a partitioning schematic (a column of integral type, a number of partitions, and upper and lower bounds on the column's value), generate WHERE clauses for each partition so that each row in the table appears exactly once. The parameters minValue and maxValue are advisory in that incorrect values may cause the partitioning to be poor, but no data will fail to be represented.

url

public String url()

table

public String table()

parts

public Partition[] parts()

properties

public java.util.Properties properties()

sqlContext

public SQLContext sqlContext()

Specified by:

sqlContext in class BaseRelation

schema

public StructType schema()

Specified by:

schema in class BaseRelation

buildScan

public RDD<Row> buildScan(String[] requiredColumns,
                 Filter[] filters)

Specified by:

buildScan in interface PrunedFilteredScan