com.logicalclocks.hsfs

Class StorageConnector.BigqueryConnector

java.lang.Object

com.logicalclocks.hsfs.StorageConnector

com.logicalclocks.hsfs.StorageConnector.BigqueryConnector

Enclosing class:

StorageConnector

public static class StorageConnector.BigqueryConnector
extends StorageConnector

Nested Class Summary

Nested classes/interfaces inherited from class com.logicalclocks.hsfs.StorageConnector

StorageConnector.AdlsConnector, StorageConnector.BigqueryConnector, StorageConnector.GcsConnector, StorageConnector.HopsFsConnector, StorageConnector.JdbcConnector, StorageConnector.KafkaConnector, StorageConnector.RedshiftConnector, StorageConnector.S3Connector, StorageConnector.SnowflakeConnector

Field Summary

Fields

Modifier and Type	Field and Description
protected List<Option>	arguments
protected String	dataset
protected String	keyPath
protected String	materializationDataset
protected String	parentProject
protected String	queryProject
protected String	queryTable

Fields inherited from class com.logicalclocks.hsfs.StorageConnector

description, featurestoreId, id, LOGGER, name, storageConnectorApi, storageConnectorType

Constructor Summary

Constructors

Constructor and Description
BigqueryConnector()

Method Summary

Modifier and Type	Method and Description
String	getPath(String subPath)
Map<String,String>	sparkOptions() Set spark options specific to BigQuery.

Methods inherited from class com.logicalclocks.hsfs.StorageConnector

refetch

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Field Detail

keyPath

protected String keyPath

parentProject

protected String parentProject

queryProject

protected String queryProject

dataset

protected String dataset

queryTable

protected String queryTable

materializationDataset

protected String materializationDataset

arguments

protected List<Option> arguments

Constructor Detail

BigqueryConnector

public BigqueryConnector()

Method Detail

sparkOptions

public Map<String,String> sparkOptions()

Set spark options specific to BigQuery.

Specified by:

sparkOptions in class StorageConnector

Returns:

Map

getPath

public String getPath(String subPath)

Specified by:

getPath in class StorageConnector